title: Fiber-pigtailing quantum-dot cavity-enhanced light emitting diodes

abstract: We report on a process for the fiber-coupling of electrically driven cavity-enhanced quantum dot light emitting devices. The developed technique allows for the direct and permanent coupling of p-i-n-doped quantum dot micropillar cavities to single-mode optical fibers. The coupling process, fully carried out at room temperature, involves a spatial scanning technique, where the fiber facet is positioned relative to a device with a diameter of 2 $\mu$m using the fiber-coupled electroluminescence of the cavity emission as a feedback parameter. Subsequent gluing and UV curing enables a rigid and permanent coupling between micropillar and fiber core. Comparing our experimental results with finite element method simulations indicates a cavity-to-fiber mode-coupling efficiency of ~46%. Furthermore, we demonstrate pulsed current injection at a repetition rate exceeding 200 MHz as well as low-temperature operation down to 77 K of the fiber-coupled micropillar device. The technique presented in this work is an important step in the quest for efficient and practical quantum light sources for applications in quantum information.


title: Are Anti-Feminist Communities Gateways to the Far Right? Evidence from Reddit and YouTube

abstract: Researchers have suggested that "the Manosphere," a conglomerate of men-centered online communities, may serve as a gateway to far right movements. In that context, this paper quantitatively studies the migratory patterns between a variety of groups within the Manosphere and the Alt-right, a loosely connected far right movement that has been particularly active in mainstream social networks. Our analysis leverages over 300 million comments spread through Reddit (in 115 subreddits) and YouTube (in 526 channels) to investigate whether the audiences of channels and subreddits associated with these communities have converged between 2006 and 2018. In addition to subreddits related to the communities of interest, we also collect data on counterparts: other groups of users which we use for comparison (e.g., for YouTube we use a set of media channels). Besides measuring the similarity in the commenting user bases of these communities, we perform a migration study, calculating to which extent users in the Manosphere gradually engage with Alt-right content. Our results suggest that there is a large overlap between the user bases of the Alt-right and of the Manosphere and that members of the Manosphere have a bigger chance to engage with far right content than carefully chosen counterparts. However, our analysis also shows that migration and user base overlap varies substantially across different platforms and within the Manosphere. Members of some communities (e.g., Men's Rights Activists) gradually engage with the Alt-right significantly more than counterparts on both Reddit and YouTube, whereas for other communities, this engagement happens mostly on Reddit (e.g., Pick Up Artists). Overall, our work paints a nuanced picture of the pipeline between the Manosphere and the Alt-right, which may inform platforms' policies and moderation decisions regarding these communities.


title: Unidirectional magnetoresistance and spin-orbit torque in NiMnSb

abstract: Spin-dependent transport phenomena due to relativistic spin-orbit coupling and broken space-inversion symmetry are often difficult to interpret microscopically, in particular when occurring at surfaces or interfaces. Here we present a theoretical and experimental study of spin-orbit torque and unidirectional magnetoresistance in a model room-temperature ferromagnet NiMnSb with inversion asymmetry in the bulk of this half-heusler crystal. Besides the angular dependence on magnetization, the competition of Rashba and Dresselhaus-like spin-orbit couplings results in the dependence of these effects on the crystal direction of the applied electric field. The phenomenology that we observe highlights potential inapplicability of commonly considered approaches for interpreting experiments. We point out that, in general, there is no direct link between the current-induced non-equilibrium spin polarization inferred from the measured spin-orbit torque and the unidirectional magnetiresistance. We also emphasize that the unidirectional magnetoresistance has not only longitudinal but also transverse components in the electric field -- current indices which complicates its separation from the thermoelectric contributions to the detected signals in common experimental techniques. We use the theoretical results to analyze our measurements of the on-resonance and off-resonance mixing signals in microbar devices fabricated from an epitaxial NiMnSb film along different crystal directions. Based on the analysis we extract an experimental estimate of the unidirectional magnetoresistance in NiMnSb.


title: A deep perceptual metric for 3D point clouds

abstract: Point clouds are essential for storage and transmission of 3D content. As they can entail significant volumes of data, point cloud compression is crucial for practical usage. Recently, point cloud geometry compression approaches based on deep neural networks have been explored. In this paper, we evaluate the ability to predict perceptual quality of typical voxel-based loss functions employed to train these networks. We find that the commonly used focal loss and weighted binary cross entropy are poorly correlated with human perception. We thus propose a perceptual loss function for 3D point clouds which outperforms existing loss functions on the ICIP2020 subjective dataset. In addition, we propose a novel truncated distance field voxel grid representation and find that it leads to sparser latent spaces and loss functions that are more correlated with perceived visual quality compared to a binary representation. The source code is available at https://github.com/mauriceqch/2021_pc_perceptual_loss.


title: Small curvature concentration and Ricci flow smoothing

abstract: We show that a complete Ricci flow of bounded curvature which begins from a manifold with a Ricci lower bound, local entropy bound, and small local scale-invariant integral curvature control will have global point-wise curvature control at positive times. As applications, we obtain under similar assumptions a compactness result and a gap theorem for complete noncompact manifolds with nonnegative Ricci Curvature.


title: MaskCycleGAN-VC: Learning Non-parallel Voice Conversion with Filling in Frames

abstract: Non-parallel voice conversion (VC) is a technique for training voice converters without a parallel corpus. Cycle-consistent adversarial network-based VCs (CycleGAN-VC and CycleGAN-VC2) are widely accepted as benchmark methods. However, owing to their insufficient ability to grasp time-frequency structures, their application is limited to mel-cepstrum conversion and not mel-spectrogram conversion despite recent advances in mel-spectrogram vocoders. To overcome this, CycleGAN-VC3, an improved variant of CycleGAN-VC2 that incorporates an additional module called time-frequency adaptive normalization (TFAN), has been proposed. However, an increase in the number of learned parameters is imposed. As an alternative, we propose MaskCycleGAN-VC, which is another extension of CycleGAN-VC2 and is trained using a novel auxiliary task called filling in frames (FIF). With FIF, we apply a temporal mask to the input mel-spectrogram and encourage the converter to fill in missing frames based on surrounding frames. This task allows the converter to learn time-frequency structures in a self-supervised manner and eliminates the need for an additional module such as TFAN. A subjective evaluation of the naturalness and speaker similarity showed that MaskCycleGAN-VC outperformed both CycleGAN-VC2 and CycleGAN-VC3 with a model size similar to that of CycleGAN-VC2. Audio samples are available at http://www.kecl.ntt.co.jp/people/kaneko.takuhiro/projects/maskcyclegan-vc/index.html.


title: Coalgebra Encoding for Efficient Minimization

abstract: Recently, we have developed an efficient generic partition refinement algorithm, which computes behavioural equivalence on a state-based system given as an encoded coalgebra, and implemented it in the tool CoPaR. Here we extend this to a fully fledged minimization algorithm and tool by integrating two new aspects: (1) the computation of the transition structure on the minimized state set, and (2) the computation of the reachable part of the given system. In our generic coalgebraic setting these two aspects turn out to be surprisingly non-trivial requiring us to extend the previous theory. In particular, we identify a sufficient condition on encodings of coalgebras, and we show how to augment the existing interface, which encapsulates computations that are specific for the coalgebraic type functor, to make the above extensions possible. Both extensions have linear run time.


title: Spanish Biomedical and Clinical Language Embeddings

abstract: We computed both Word and Sub-word Embeddings using FastText. For Sub-word embeddings we selected Byte Pair Encoding (BPE) algorithm to represent the sub-words. We evaluated the Biomedical Word Embeddings obtaining better results than previous versions showing the implication that with more data, we obtain better representations.


title: Generalized Adversarial Distances to Efficiently Discover Classifier Errors

abstract: Given a black-box classification model and an unlabeled evaluation dataset from some application domain, efficient strategies need to be developed to evaluate the model. Random sampling allows a user to estimate metrics like accuracy, precision, and recall, but may not provide insight to high-confidence errors. High-confidence errors are rare events for which the model is highly confident in its prediction, but is wrong. Such errors can represent costly mistakes and should be explicitly searched for. In this paper we propose a generalization to the Adversarial Distance search that leverages concepts from adversarial machine learning to identify predictions for which a classifier may be overly confident. These predictions are useful instances to sample when looking for high-confidence errors because they are prone to a higher rate of error than expected. Our generalization allows Adversarial Distance to be applied to any classifier or data domain. Experimental results show that the generalized method finds errors at rates greater than expected given the confidence of the sampled predictions, and outperforms competing methods.


title: Magnetic hyperthermia experiments with magnetic nanoparticles in clarified butter oil and paraffin: a thermodynamic analysis

abstract: In Specific Power Absorption (SPA) models for Magnetic Fluid Hyperthermia (MFH) experiments, the magnetic relaxation time of the nanoparticles (NPs) is known to be a fundamental descriptor of the heating mechanisms. The relaxation time is mainly determined by the interplay between the magnetic properties of the NPs and the rheological properties of NPs environment. Although the role of magnetism in MFH has been extensively studied, the thermal properties of the NPs medium and their changes during of MFH experiments have been so far underrated. Here, we show that ZnxFe3-xO4 NPs dispersed through different with phase transition in the temperature range of the experiment: clarified butter oil (CBO) and paraffin. These systems show non-linear behavior of the heating rate within the temperature range of the MFH experiments. For CBO, a fast increase at $306 K$ associated to changes in the viscosity (\texteta(T)) and specific heat (c_p(T)) of the medium below and above its melting temperature. This increment in the heating rate takes place around $318 K$ for paraffin. Magnetic and morphological characterizations of NPs together with the observed agglomeration of the nanoparticles above $306 K$ indicate that the fast increase in MFH curves could not be associated to a change in the magnetic relaxation mechanism, with N\'eel relaxation being dominant. In fact, successive experiment runs performed up to temperatures below and above the CBO melting point resulted in different MFH curves due to agglomeration of NPs driven by magnetic field inhomogeneity during the experiments. Similar effects were observed for paraffin. Our results highlight the relevance of the NPs medium's thermodynamic properties for an accurate measurement of the heating efficiency for in vitro and in vivo environments, where the thermal properties are largely variable within the temperature window of MFH experiments.


title: QNLP in Practice: Running Compositional Models of Meaning on a Quantum Computer

abstract: Quantum Natural Language Processing (QNLP) deals with the design and implementation of NLP models intended to be run on quantum hardware. In this paper, we present results on the first NLP experiments conducted on Noisy Intermediate-Scale Quantum (NISQ) computers for datasets of size greater than 100 sentences. Exploiting the formal similarity of the compositional model of meaning by Coecke, Sadrzadeh and Clark (2010) with quantum theory, we create representations for sentences that have a natural mapping to quantum circuits. We use these representations to implement and successfully train NLP models that solve simple sentence classification tasks on quantum hardware. We conduct quantum simulations that compare the syntax-sensitive model of Coecke et al. with two baselines that use less or no syntax; specifically, we implement the quantum analogues of a "bag-of-words" model, where syntax is not taken into account at all, and of a word-sequence model, where only word order is respected. We demonstrate that all models converge smoothly both in simulations and when run on quantum hardware, and that the results are the expected ones based on the nature of the tasks and the datasets used. Another important goal of this paper is to describe in a way accessible to AI and NLP researchers the main principles, process and challenges of experiments on quantum hardware. Our aim in doing this is to take the first small steps in this unexplored research territory and pave the way for practical Quantum Natural Language Processing.


title: Molecular composition of comet 46P/Wirtanen from millimetre-wave spectroscopy

abstract: We present the results of a molecular survey of comet 46P/Wirtanen undertaken with the IRAM 30-m and NOEMA radio telescopes in December 2018. Observations at IRAM 30-m during the 12-18 Dec. period comprise a 2 mm spectral survey covering 25 GHz and a 1 mm survey covering 62 GHz. The gas outflow velocity and kinetic temperature have been accurately constrained by the observations. We derive abundances of 11 molecules, some being identified remotely for the first time in a Jupiter-family comet, including complex organic molecules such as formamide, ethylene glycol, acetaldehyde, or ethanol. Sensitive upper limits on the abundances of 24 other molecules are obtained. The comet is found to be relatively rich in methanol (3.4 percent relative to water), but relatively depleted in CO, CS, HNC, HNCO, and HCOOH.


title: HPC AI500: Representative, Repeatable and Simple HPC AI Benchmarking

abstract: Recent years witness a trend of applying large-scale distributed deep learning algorithms (HPC AI) in both business and scientific computing areas, whose goal is to speed up the training time to achieve a state-of-the-art quality. The HPC AI benchmarks accelerate the process. Unfortunately, benchmarking HPC AI systems at scale raises serious challenges. This paper presents a representative, repeatable and simple HPC AI benchmarking methodology. Among the seventeen AI workloads of AIBench Training -- by far the most comprehensive AI Training benchmarks suite -- we choose two representative and repeatable AI workloads. The selected HPC AI benchmarks include both business and scientific computing: Image Classification and Extreme Weather Analytics. To rank HPC AI systems, we present a new metric named Valid FLOPS, emphasizing both throughput performance and a target quality. The specification, source code, datasets, and HPC AI500 ranking numbers are publicly available from \url{https://www.benchcouncil.org/HPCAI500/}.


title: Active beating of a reconstituted synthetic minimal axoneme

abstract: Propelling microorganisms through fluids and moving fluids along cellular surfaces are essential biological functions accomplished by long, thin structures called motile cilia and flagella, whose regular, oscillatory beating breaks the time-reversal symmetry required for transport. Although top-down experimental approaches and theoretical models have allowed us to broadly characterize such organelles and propose mechanisms underlying their complex dynamics, constructing minimal systems capable of mimicking ciliary beating and identifying the role of each component remains a challenge. Here we report the bottom-up assembly of a minimal synthetic axoneme, which we call a synthoneme, using biological building blocks from natural organisms, namely pairs of microtubules and cooperatively associated axonemal dynein motors. We show that upon provision of energy by ATP, microtubules undergo rhythmic bending by cyclic association-dissociation of dyneins. Our simple and unique beating minimal synthoneme represents a self-organized nanoscale biomolecular machine that can also help understand the mechanisms underlying ciliary beating.


abstract: This is a short review of the Kadomtsev-Petviashvili hierarchies of types B and C. The main objects are the $L$-operator, the wave operator, the auxiliary linear problems for the wave function, the bilinear identity for the wave function and the tau-function. All of them are discussed in the paper. The connections with the usual Kadomtsev-Petviashvili hierarchy (of the type A) are clarified. Examples of soliton solutions and the dispersionless limit of the hierarchies are also considered.


title: Homogeneous Spectrum of Quasi-periodic Gevrey Schr\"odinger Operators with Diophantine Frequency

abstract: We consider the quasi-periodic Schr\"odinger operator with the non-degenerate Gevrey potential for the Diophantine frequency. We prove that if the coupling number of the potential is large, then the spectrum is homogeneous.


title: Trigonal Quasicrystalline States in $30^\circ$ Rotated Double Moir\'{e} Superlattices

abstract: We study the lattice configuration and electronic structure of a double moir\'{e} superlattice, which is composed of a graphene layer encapsulated by two other layers in a way such that the two hexagonal moir\'{e} patterns are arranged in a dodecagonal quasicrystalline configuration. We show that there are between 0 and 4 such configurations depending on the lattice mismatch between graphene and the encapsulating layer. We then reveal the resonant interaction, which is distinct from the conventional 2-, 3-, 4-wave mixing of moir\'{e} superlattices, that brings together and hybridizes twelve degenerate Bloch states of monolayer graphene. These states do not fully satisfy the dodecagonal quasicrystalline rotational symmetry due to the symmetry of the wave vectors involved. Instead, their wave functions exhibit trigonal quasicrystalline order, which lacks inversion symmetry, at the energies much closer to the charge neutrality point of graphene.


title: CausalX: Causal Explanations and Block Multilinear Factor Analysis

abstract: By adhering to the dictum, "No causation without manipulation (treatment, intervention)", cause and effect data analysis represents changes in observed data in terms of changes in the causal factors. When causal factors are not amenable for active manipulation in the real world due to current technological limitations or ethical considerations, a counterfactual approach performs an intervention on the model of data formation. In the case of object representation or activity (temporal object) representation, varying object parts is generally unfeasible whether they be spatial and/or temporal. Multilinear algebra, the algebra of higher-order tensors, is a suitable and transparent framework for disentangling the causal factors of data formation. Learning a part-based intrinsic causal factor representations in a multilinear framework requires applying a set of interventions on a part-based multilinear model. We propose a unified multilinear model of wholes and parts. We derive a hierarchical block multilinear factorization, the M-mode Block SVD, that computes a disentangled representation of the causal factors by optimizing simultaneously across the entire object hierarchy. Given computational efficiency considerations, we introduce an incremental bottom-up computational alternative, the Incremental M-mode Block SVD, that employs the lower-level abstractions, the part representations, to represent the higher level of abstractions, the parent wholes. This incremental computational approach may also be employed to update the causal model parameters when data becomes available incrementally. The resulting object representation is an interpretable combinatorial choice of intrinsic causal factor representations related to an object's recursive hierarchy of wholes and parts that renders object recognition robust to occlusion and reduces training data requirements.


title: Linking Zonal Winds and Gravity II: explaining the equatorially antisymmetric gravity moments of Jupiter

abstract: The recent gravity field measurements of Jupiter (Juno) and Saturn (Cassini) confirm the existence of deep zonal flows reaching to a depth of 5\% and 15\% of the respective radius. Relating the zonal wind induced density perturbations to the gravity moments has become a major tool to characterise the interior dynamics of gas giants. Previous studies differ with respect to the assumptions made on how the wind velocity relates to density anomalies, on the functional form of its decay with depth, and on the continuity of antisymmetric winds across the equatorial plane. Most of the suggested vertical structures exhibit a rather smooth radial decay of the zonal wind, which seems at odds with the observed secular variation of the magnetic field and the prevailing geostrophy of the zonal winds. Moreover, the results relied on an artificial equatorial regularisation or ignored the equatorial discontinuity altogether. We favour an alternative structure, where the equatorially antisymmetric zonal wind in an equatorial latitude belt between $\pm 21^\circ$ remains so shallow that it does not contribute to the gravity signal. The winds at higher latitudes suffice to convincingly explain the measured gravity moments. Our results indicate that the winds are geostrophic, i.e. constant along cylinders, in the outer $3000\,$ km and decay rapidly below. The preferred wind structure is 50\% deeper than previously thought, agrees with the measured gravity moment, is compliant with the magnetic constraints and the requirement of an adiabatic atmosphere and unbiased by the treatment of the equatorial discontinuity.


title: Modular Deep Reinforcement Learning for Continuous Motion Planning with Temporal Logic

abstract: This paper investigates the motion planning of autonomous dynamical systems modeled by Markov decision processes (MDP) with unknown transition probabilities over continuous state and action spaces. Linear temporal logic (LTL) is used to specify high-level tasks over infinite horizon, which can be converted into a limit deterministic generalized B\"uchi automaton (LDGBA) with several accepting sets. The novelty is to design an embedded product MDP (EP-MDP) between the LDGBA and the MDP by incorporating a synchronous tracking-frontier function to record unvisited accepting sets of the automaton, and to facilitate the satisfaction of the accepting conditions. The proposed LDGBA-based reward shaping and discounting schemes for the model-free reinforcement learning (RL) only depend on the EP-MDP states and can overcome the issues of sparse rewards. Rigorous analysis shows that any RL method that optimizes the expected discounted return is guaranteed to find an optimal policy whose traces maximize the satisfaction probability. A modular deep deterministic policy gradient (DDPG) is then developed to generate such policies over continuous state and action spaces. The performance of our framework is evaluated via an array of OpenAI gym environments.


title: Supercontinuum Generation by Saturated Second-Order Nonlinear Interactions

abstract: We propose a new approach to supercontinuum generation and carrier-envelope-offset detection based on saturated second-order nonlinear interactions in dispersion-engineered nanowaveguides. The technique developed here broadens the interacting harmonics by forming stable bifurcations of the pulse envelopes due to an interplay between phase-mismatch and pump depletion. We first present an intuitive heuristic model for spectral broadening by second-harmonic generation of femtosecond pulses, and show that this model agrees well with experiments. Then, having established strong agreement between theory and experiment, we develop scaling laws that determine the energy required to generate an octave of bandwidth as a function of input pulse duration, device length, and input pulse chirp. These scaling laws suggest that future realization based on this approach could enable supercontinuum generation with orders of magnitude less energy than current state-of-the-art devices.


title: Non-reciprocal energy transfer through the Casimir effect

abstract: A fundamental prediction of quantum mechanics is that there are random fluctuations everywhere in a vacuum because of the zero-point energy. Remarkably, quantum electromagnetic fluctuations can induce a measurable force between neutral objects, known as the Casimir effect, which has attracted broad interests. The Casimir effect can dominate the interaction between microstructures at small separations and has been utilized to realize nonlinear oscillation, quantum trapping, phonon transfer, and dissipation dilution. However, a non-reciprocal device based on quantum vacuum fluctuations remains an unexplored frontier. Here we report quantum vacuum mediated non-reciprocal energy transfer between two micromechanical oscillators. We modulate the Casimir interaction parametrically to realize strong coupling between two oscillators with different resonant frequencies. We engineer the system's spectrum to have an exceptional point in the parameter space and observe the asymmetric topological structure near it. By dynamically changing the parameters near the exceptional point and utilizing the non-adiabaticity of the process, we achieve non-reciprocal energy transfer with high contrast. Our work represents an important development in utilizing quantum vacuum fluctuations to regulate energy transfer at the nanoscale and build functional Casimir devices.


title: Emotion-Aware, Emotion-Agnostic, or Automatic: Corpus Creation Strategies to Obtain Cognitive Event Appraisal Annotations

abstract: Appraisal theories explain how the cognitive evaluation of an event leads to a particular emotion. In contrast to theories of basic emotions or affect (valence/arousal), this theory has not received a lot of attention in natural language processing. Yet, in psychology it has been proven powerful: Smith and Ellsworth (1985) showed that the appraisal dimensions attention, certainty, anticipated effort, pleasantness, responsibility/control and situational control discriminate between (at least) 15 emotion classes. We study different annotation strategies for these dimensions, based on the event-focused enISEAR corpus (Troiano et al., 2019). We analyze two manual annotation settings: (1) showing the text to annotate while masking the experienced emotion label; (2) revealing the emotion associated with the text. Setting 2 enables the annotators to develop a more realistic intuition of the described event, while Setting 1 is a more standard annotation procedure, purely relying on text. We evaluate these strategies in two ways: by measuring inter-annotator agreement and by fine-tuning RoBERTa to predict appraisal variables. Our results show that knowledge of the emotion increases annotators' reliability. Further, we evaluate a purely automatic rule-based labeling strategy (inferring appraisal from annotated emotion classes). Training on automatically assigned labels leads to a competitive performance of our classifier, even when tested on manual annotations. This is an indicator that it might be possible to automatically create appraisal corpora for every domain for which emotion corpora already exist.


title: Deep Learning based Channel Extrapolation for Large-Scale Antenna Systems: Opportunities, Challenges and Solutions

abstract: With the depletion of spectrum, wireless communication systems turn to exploit large antenna arrays to achieve the degree of freedom in space domain, such as millimeter wave massive multi-input multioutput (MIMO), reconfigurable intelligent surface assisted communications and cell-free massive MIMO. In these systems, how to acquire accurate channel state information (CSI) is difficult and becomes a bottleneck of the communication links. In this article, we introduce the concept of channel extrapolation that relies on a small portion of channel parameters to infer the remaining channel parameters. Since the substance of channel extrapolation is a mapping from one parameter subspace to another, we can resort to deep learning (DL), a powerful learning architecture, to approximate such mapping function. Specifically, we first analyze the requirements, conditions and challenges for channel extrapolation. Then, we present three typical extrapolations over the antenna dimension, the frequency dimension, and the physical terminal, respectively. We also illustrate their respective principles, design challenges and DL strategies. It will be seen that channel extrapolation could greatly reduce the transmission overhead and subsequently enhance the performance gains compared with the traditional strategies. In the end, we provide several potential research directions on channel extrapolation for future intelligent communications systems.


title: A mathematical modelling framework for the regulation of intra-cellular OCT4 in human pluripotent stem cells

abstract: Human pluripotent stem cells (hPSCs) have promising clinical applications in regenerative medicine, drug-discovery and personalised medicine due to their potential to differentiate into all cell types, a property know as pluripotency. A deeper understanding of how pluripotency is regulated is required to assist in controlling pluripotency and differentiation trajectories experimentally. Mathematical modelling provides a non-invasive tool through which to explore, characterise and replicate the regulation of pluripotency and the consequences on cell fate. Here we use experimental data of the expression of the pluripotency transcription factor OCT4 in a growing hPSC colony to develop and evaluate mathematical models for temporal pluripotency regulation. We consider fractional Brownian motion and the stochastic logistic equation and explore the effects of both additive and multiplicative noise. We illustrate the use of time-dependent carrying capacities and the introduction of Allee effects to the stochastic logistic equation to describe cell differentiation. This mathematical framework for describing intra-cellular OCT4 regulation can be extended to other transcription factors and developed into sophisticated predictive models.


title: New Gaussian Riesz transforms on variable Lebesgue spaces

abstract: We give sufficient conditions on the exponent $p: \mathbb R^d\rightarrow [1,\infty)$ for the boundedness of the non-centered Gaussian maximal function on variable Lebesgue spaces $L^{p(\cdot)}(\mathbb R^d, \gamma_d)$, as well as of the new higher order Riesz transforms associated with the Ornstein-Uhlenbeck semigroup, which are the natural extensions of the supplementary first order Gaussian Riesz transforms defined by A. Nowak and K. Stempak in \cite{nowakstempak}.


title: BASEMENT v3: a modular freeware for river process modelling over multiple computational backends

abstract: Modelling river physical processes is of critical importance for flood protection, river management and restoration of riverine environments. Developments in algorithms and computational power have led to a wider spread of river simulation tools. However, the use of two-dimensional models can still be hindered by complexity in the setup and the high computational costs. Here we present the freeware BASEMENT version 3, a flexible tool for two-dimensional river simulations that bundles solvers for hydrodynamic, morphodynamic and scalar advection-diffusion processes. BASEMENT leverages different computational platforms (multi-core CPUs and graphics processing units GPUs) to enable the simulation of large domains and long-term river processes. The adoption of a fully costless worflow and a light GUI facilitate its broad utilization. We test its robustness and efficiency in a selection of benchmarks. Results confirm that BASEMENT could be an efficient and versatile tool for research, engineering practice and education in river modelling.


title: New Singly and Doubly Even Binary [72,36,12] Self-Dual Codes from $M_2(R)G$ -- Group Matrix Rings

abstract: In this work, we present a number of generator matrices of the form $[I_{2n} \ | \ \tau_k(v)],$ where $I_{kn}$ is the $kn \times kn$ identity matrix, $v$ is an element in the group matrix ring $M_2(R)G$ and where $R$ is a finite commutative Frobenius ring and $G$ is a finite group of order 18. We employ these generator matrices and search for binary $[72,36,12]$ self-dual codes directly over the finite field $\mathbb{F}_2.$ As a result, we find 134 Type I and 1 Type II codes of this length, with parameters in their weight enumerators that were not known in the literature before. We tabulate all of our findings.


title: Localized structures in dispersive and doubly resonant optical parametric oscillators

abstract: We study temporally localized structures in doubly resonant degenerate optical parametric oscillators in the absence of temporal walk-off. We focus on states formed through the locking of domain walls between the zero and a non-zero continuous wave solution. We show that these states undergo collapsed snaking and we characterize their dynamics in the parameter space.


title: Maximum Absorption of the Global 21 cm Spectrum in the Standard Cosmological Model

abstract: The absorption feature in the global spectrum is likely the first 21 cm observable from the cosmic dawn, which provides valuable insights into the earliest history of structure formation. We run a set of high-resolution hydrodynamic simulations of early structure formation to assess the effect of non-linear structure formation on the maximum absorption level (i.e. assuming the spin temperature coupling is saturated) of the global 21 cm spectrum in the standard cosmological framework. We ignore the star formation and feedbacks, which also tends to reduce the absorption signal, but take into account the inevitable non-linear density fluctuations in the intergalactic medium (IGM), shock heating, and Compton heating, which can reduce the absorption level. We found that the combination of these reduced the maximum absorption signal by $\sim 15\%$ at redshift 17, as compared with the homogeneous or linearly fluctuating IGM. These effects have to be carefully accounted for when interpreting the observational results, especially when considering the necessity of introducing new physics.


title: Energy bounds for a fourth-order equation in low dimensions related to wave maps

abstract: For compact, isometrically embedded Riemannian manifolds $ N \hookrightarrow \mathbb{R}^L$, we introduce a fourth-order version of the wave map equation. By energy estimates, we prove an $\textit{a priori}$ estimate for smooth local solutions in the energy subcritical dimension $ n = 1,2$. The estimate excludes blow-up of a Sobolev norm in finite existence times. In particular, combining this with recent work of local well-posedness of the Cauchy problem, it follows that for smooth initial data with compact support, there exists a (smooth) unique global solution in dimension $n = 1,2$. We also give a proof of the uniqueness of solutions that are bounded in these Sobolev norms.


title: FASA: Feature Augmentation and Sampling Adaptation for Long-Tailed Instance Segmentation

abstract: Recent methods for long-tailed instance segmentation still struggle on rare object classes with few training data. We propose a simple yet effective method, Feature Augmentation and Sampling Adaptation (FASA), that addresses the data scarcity issue by augmenting the feature space especially for rare classes. Both the Feature Augmentation (FA) and feature sampling components are adaptive to the actual training status -- FA is informed by the feature mean and variance of observed real samples from past iterations, and we sample the generated virtual features in a loss-adapted manner to avoid over-fitting. FASA does not require any elaborate loss design, and removes the need for inter-class transfer learning that often involves large cost and manually-defined head/tail class groups. We show FASA is a fast, generic method that can be easily plugged into standard or long-tailed segmentation frameworks, with consistent performance gains and little added cost. FASA is also applicable to other tasks like long-tailed classification with state-of-the-art performance.


title: Moufang loops and toric surfaces

abstract: The toric surfaces for octonions and related objects are discussed.


title: Understanding Worldwide Private Information Collection on Android

abstract: Mobile phones enable the collection of a wealth of private information, from unique identifiers (e.g., email addresses), to a user's location, to their text messages. This information can be harvested by apps and sent to third parties, which can use it for a variety of purposes. In this paper we perform the largest study of private information collection (PIC) on Android to date. Leveraging an anonymized dataset collected from the customers of a popular mobile security product, we analyze the flows of sensitive information generated by 2.1M unique apps installed by 17.3M users over a period of 21 months between 2018 and 2019. We find that 87.2% of all devices send private information to at least five different domains, and that actors active in different regions (e.g., Asia compared to Europe) are interested in collecting different types of information. The United States (62% of the total) and China (7% of total flows) are the countries that collect most private information. Our findings raise issues regarding data regulation, and would encourage policymakers to further regulate how private information is used by and shared among the companies and how accountability can be truly guaranteed.


title: Dynamical density functional theory for "dry" and "wet" active matter

abstract: In the last 50 years, equilibrium density functional theory (DFT) has been proven to be a powerful, versatile and predictive approach for the statics and structure of classical particles. This theory can be extended to the nonequilibrium dynamics of completely overdamped Brownian colloidal particles towards so-called dynamical density functional theory (DDFT). The success of DDFT makes it a promising candidate for a first-principle description of active matter. In this lecture, we shall first recapitulate classical DDFT for passive colloidal particles typically described by Smoluchowski equation. After a basic derivation of DDFT from the Smoluchowski equation, we discuss orientational degrees of freedom and the effect of hydrodynamic interactions for passive particles. This brings us into an ideal position to generalize DDFT towards active matter. In particular we distinguish between "dry active matter" which is composed of self-propelled particles that contain no hydrodynamic flow effects of a surrounding solvent and "wet active matter" where the hydrodynamic flow fields generated by the microswimmers are taken into account. For the latter, DDFT is a tool which unifies thermal fluctuations, direct particle interactions, external driving fields and hydrodynamic effects arising from internal self-propulsion discriminating between "pushers" and "pullers". A number of recent applications is discussed including transient clustering of self-propelled rods and the spontaneous formation of a hydrodynamic pump in confined microswimmers.


title: SparseBERT: Rethinking the Importance Analysis in Self-attention

abstract: Transformer-based models are popularly used in natural language processing (NLP). Its core component, self-attention, has aroused widespread interest. To understand the self-attention mechanism, a direct method is to visualize the attention map of a pre-trained model. Based on the patterns observed, a series of efficient Transformers with different sparse attention masks have been proposed. From a theoretical perspective, universal approximability of Transformer-based models is also recently proved. However, the above understanding and analysis of self-attention is based on a pre-trained model. To rethink the importance analysis in self-attention, we study the significance of different positions in attention matrix during pre-training. A surprising result is that diagonal elements in the attention map are the least important compared with other attention positions. We provide a proof showing that these diagonal elements can indeed be removed without deteriorating model performance. Furthermore, we propose a Differentiable Attention Mask (DAM) algorithm, which further guides the design of the SparseBERT. Extensive experiments verify our interesting findings and illustrate the effect of the proposed algorithm.


title: Digital almost nets

abstract: Digital nets (in base $2$) are the subsets of $[0,1]^d$ that contain the expected number of points in every not-too-small dyadic box. We construct sets that contain almost the expected number of points in every such box, but which are exponentially smaller than the digital nets. We also establish a lower bound on the size of such almost nets.


title: Free boundary dimers: random walk representation and scaling limit

abstract: We study the dimer model on subgraphs of the square lattice in which vertices on a prescribed part of the boundary (the free boundary) are possibly unmatched. Each such unmatched vertex is called a monomer and contributes a fixed multiplicative weight $z>0$ to the total weight of the configuration. A bijection described by Giuliani, Jauslin and Lieb relates this model to a standard dimer model but on a non-bipartite graph. The Kasteleyn matrix of this dimer model describes a walk with transition weights that are negative along the free boundary. Yet under certain assumptions, which are in particular satisfied in the infinite volume limit in the upper half-plane, we prove an effective, true random walk representation for the inverse Kasteleyn matrix. In this case we further show that, independently of the value of $z>0$, the scaling limit of the height function is the Gaussian free field with Neumann (or free) boundary conditions, thereby answering a question of Giuliani et al.


title: Electric-field-dependent $g$ factor for the ground state of lead monofluoride, PbF

abstract: The electric-field-dependent $g$ factor and the electron electric dipole moment (eEDM)-induced Stark splittings for the lowest rotational levels of $^{207,208}$PbF are calculated. Observed and calculated Zeeman shifts for $^{207}$PbF are found to be in very good agreement. It is shown that the $^{207}$PbF hyperfine sublevels provide a promising system for the eEDM search and related experiments.


title: Quenched decay of correlations for one dimensional random Lorenz maps

abstract: We study rates of mixing for small random perturbations of one dimensional Lorenz maps. Using a random tower construction, we prove that, for Holder observables, the random system admits exponential rates of quenched correlation decay.


title: Particle dynamics governed by radiation losses in extreme-field current sheets

abstract: Particles moving in current sheets under extreme conditions, such as those in the vicinity of pulsars or those predicted on upcoming multipetawatt laser facilities, may be subject to significant radiation losses. We present an analysis of particle motion in fields of a relativistic neutral electron-positron current sheet in the case when radiative effects must be accounted for. In the Landau-Lifshitz radiation reaction force model, when quantum effects are negligible, an analytical solution for particle trajectories is derived. Based on this solution, for the case when quantum effects are significant an averaged quantum solution in the semiclassical approach is obtained. The applicability region of the solutions is determined and analytical trajectories are found to be in good agreement with those of numerical simulations with account for radiative effects. Based on these results we gain new insights into current sheet phenomena expected on upcoming laser facilities.


title: TELESTO: A Graph Neural Network Model for Anomaly Classification in Cloud Services

abstract: Deployment, operation and maintenance of large IT systems becomes increasingly complex and puts human experts under extreme stress when problems occur. Therefore, utilization of machine learning (ML) and artificial intelligence (AI) is applied on IT system operation and maintenance - summarized in the term AIOps. One specific direction aims at the recognition of re-occurring anomaly types to enable remediation automation. However, due to IT system specific properties, especially their frequent changes (e.g. software updates, reconfiguration or hardware modernization), recognition of reoccurring anomaly types is challenging. Current methods mainly assume a static dimensionality of provided data. We propose a method that is invariant to dimensionality changes of given data. Resource metric data such as CPU utilization, allocated memory and others are modelled as multivariate time series. The extraction of temporal and spatial features together with the subsequent anomaly classification is realized by utilizing TELESTO, our novel graph convolutional neural network (GCNN) architecture. The experimental evaluation is conducted in a real-world cloud testbed deployment that is hosting two applications. Classification results of injected anomalies on a cassandra database node show that TELESTO outperforms the alternative GCNNs and achieves an overall classification accuracy of 85.1%. Classification results for the other nodes show accuracy values between 85% and 60%.


title: Single-shot electron imaging of dopant-induced nanoplasmas

abstract: We present single-shot electron velocity-map images of nanoplasmas generated from doped helium nanodroplets and neon clusters by intense near-infrared and mid-infrared laser pulses. We report a large variety of signal types, most crucially depending on the cluster size. The common feature is a two-component distribution for each single-cluster event: A bright inner part with nearly circular shape corresponding to electron energies up to a few eV, surrounded by an extended background of more energetic electrons. The total counts and energy of the electrons in the inner part are strongly correlated and follow a simple power-law dependence. Deviations from the circular shape of the inner electrons observed for neon clusters and large helium nanodroplets indicate non-spherical shapes of the neutral clusters. The dependence of the measured electron energies on the extraction voltage of the spectrometer indicates that the evolution of the nanoplasma is significantly affected by the presence of an external electric field. This conjecture is confirmed by molecular dynamics simulations, which reproduce the salient features of the experimental electron spectra.


title: A Refined Analysis of Submodular Greedy

abstract: Many algorithms for maximizing a monotone submodular function subject to a knapsack constraint rely on the natural greedy heuristic. We present a novel refined analysis of this greedy heuristic which enables us to: $(1)$ reduce the enumeration in the tight $(1-e^{-1})$-approximation of [Sviridenko 04] from subsets of size three to two; $(2)$ present an improved upper bound of $0.42945$ for the classic algorithm which returns the better between a single element and the output of the greedy heuristic.


title: The three-loop singlet contribution to the massless axial-vector quark form factor

abstract: We compute the three-loop corrections to the quark axial vector form factor in massless QCD, focusing on the pure-singlet contributions where the axial vector current couples to a closed quark loop. Employing the Larin prescription for $\gamma_5$, we discuss the UV renormalization of the form factor. The infrared singularity structure of the resulting singlet axial-vector form factor is explained from infrared factorization, defining a finite remainder function.


title: Global results for a Cauchy problem related to biharmonic wave maps

abstract: We prove global existence of a derivative bi-harmonic wave equation with a non-generic quadratic nonlinearity and small initial data in the scaling critical space $\dot{B}^{2,1}_{\frac{d}{2}}(\mathbb{R}^d) \times \dot{B}^{2,1}_{\frac{d}{2}-2}(\mathbb{R}^d)$ for $ d \geq 3 $. Since the solution persists higher regularity of the initial data, we obtain a small data global regularity result for the biharmonic wave maps equation for a certain class of target manifolds including the sphere.


title: A solver based on pseudo-spectral analytical time-domain method for the two-fluid plasma model

abstract: A number of physical processes in laser-plasma interaction can be described with the two-fluid plasma model. We report on a solver for the three-dimensional two-fluid plasma model equations. This solver is particularly suited for simulating the interaction between short laser pulses with plasmas. The fluid solver relies on two-step Lax-Wendroff split with a fourth-order Runge-Kutta scheme, and we use the PseudoSpectral Analytical Time-Domain (PSATD) method to solve Maxwell's curl equations. Overall, this method is only based on finite difference schemes and fast Fourier transforms and does not require any grid staggering. The PseudoSpectral Analytical Time-Domain method removes the numerical dispersion for transverse electromagnetic wave propagation in the absence of current that is conventionally observed for other Maxwell solvers. The full algorithm is validated by conservation of energy and momentum when an electromagnetic pulse is launched onto a plasma ramp and by quantitative agreement with wave conversion of p-polarized electromagnetic wave onto a plasma ramp.


title: Totally real Thue inequalities over imaginary quadratic fields: an improvement

abstract: We significantly improve our results of Glas. Mat., III. Ser. 53(2018), No. 2, 229-238, reducing relative Thue inequalities to absolute ones.


title: Carbon dust in the evolved born-again planetary nebulae A30 and A78

abstract: We present an infrared (IR) characterization of the born-again planetary nebulae (PNe) A30 and A78 using IR images and spectra. We demonstrate that the carbon-rich dust in A30 and A78 is spatially coincident with the H-poor ejecta and coexists with hot X-ray-emitting gas up to distances of 50$''$ from the central stars (CSPNs). Dust forms immediately after the born-again event and survives for 1000 yr in the harsh environment around the CSPN as it is destroyed and pushed away by radiation pressure and dragged by hydrodynamical effects. Spitzer IRS spectral maps showed that the broad spectral features at 6.4 and 8.0 $\mu$m, attributed to amorphous carbon formed in H-deficient environments, are associated with the disrupted disk around their CSPN, providing an optimal environment for charge exchange reactions with the stellar wind that produces the soft X-ray emission of these sources. Nebular and dust properties are modeled for A30 with Cloudy taking into account different carbonaceous dust species. Our models predict dust temperatures in the 40-230 K range, five times lower than predicted by previous works. Gas and dust masses for the born-again ejecta in A30 are estimated to be $M_\mathrm{gas}=(4.41^{+0.55}_{-0.14})\times10^{-3}$ M$_\odot$ and $M_\mathrm{dust}=(3.20^{+3.21}_{-2.06})\times10^{-3}$ M$_\odot$, which can be used to estimate a total ejected mass and mass-loss rate for the born-again event of $(7.61^{+3.76}_{-2.20})\times10^{-3}$ M$_{\odot}$ and $\dot{M}=[5-60]\times10^{-5}$ M$_{\odot}$ yr$^{-1}$, respectively. Taking into account the carbon trapped into dust grains, we estimate that the C/O mass ratio of the H-poor ejecta of A30 is larger than 1, which favors the very late thermal pulse model over the alternate hypothesis of a nova-like event.


title: Local topological moves determine global diffusion properties of hyperbolic higher-order networks

abstract: From social interactions to the human brain, higher-order networks are key to describe the underlying network geometry and topology of many complex systems. While it is well known that network structure strongly affects its function, the role that network topology and geometry has on the emerging dynamical properties of higher-order networks is yet to be clarified. In this perspective, the spectral dimension plays a key role since it determines the effective dimension for diffusion processes on a network. Despite its relevance, a theoretical understanding of which mechanisms lead to a finite spectral dimension, and how this can be controlled, represents nowadays still a challenge and is the object of intense research. Here we introduce two non-equilibrium models of hyperbolic higher-order networks and we characterize their network topology and geometry by investigating the interwined appearance of small-world behavior, $\delta$-hyperbolicity and community structure. We show that different topological moves determining the non-equilibrium growth of the higher-order hyperbolic network models induce tunable values of the spectral dimension, showing a rich phenomenology which is not displayed in random graph ensembles. In particular, we observe that, if the topological moves used to construct the higher-order network increase the area$/$volume ratio, the spectral dimension continuously decreases, while the opposite effect is observed if the topological moves decrease the area$/$volume ratio. Our work reveals a new link between the geometry of a network and its diffusion properties, contributing to a better understanding of the complex interplay between network structure and dynamics.


title: Generalized Parametric Path Problems

abstract: Parametric path problems arise independently in diverse domains, ranging from transportation to finance, where they are studied under various assumptions. We formulate a general path problem with relaxed assumptions, and describe how this formulation is applicable in these domains. We study the complexity of the general problem, and a variant of it where preprocessing is allowed. We show that when the parametric weights are linear functions, algorithms remain tractable even under our relaxed assumptions. Furthermore, we show that if the weights are allowed to be non-linear, the problem becomes NP-hard. We also study the mutli-dimensional version of the problem where the weight functions are parameterized by multiple parameters. We show that even with two parameters, the problem is NP-hard.


title: Significant Improvements over the State of the Art? A Case Study of the MS MARCO Document Ranking Leaderboard

abstract: Leaderboards are a ubiquitous part of modern research in applied machine learning. By design, they sort entries into some linear order, where the top-scoring entry is recognized as the "state of the art" (SOTA). Due to the rapid progress being made in information retrieval today, particularly with neural models, the top entry in a leaderboard is replaced with some regularity. These are touted as improvements in the state of the art. Such pronouncements, however, are almost never qualified with significance testing. In the context of the MS MARCO document ranking leaderboard, we pose a specific question: How do we know if a run is significantly better than the current SOTA? We ask this question against the backdrop of recent IR debates on scale types: in particular, whether commonly used significance tests are even mathematically permissible. Recognizing these potential pitfalls in evaluation methodology, our study proposes an evaluation framework that explicitly treats certain outcomes as distinct and avoids aggregating them into a single-point metric. Empirical analysis of SOTA runs from the MS MARCO document ranking leaderboard reveals insights about how one run can be "significantly better" than another that are obscured by the current official evaluation metric (MRR@100).


title: Extending the extensional level of the Minimalist Foundation to axiomatic set theories

abstract: We introduce extensions by rules of the extensional level of the Minimalist Foundation which turn out to be equivalent to constructive and classical axiomatic set theories.


title: Role of galactic bars in the formation of spiral arms: A study through orbital and escape dynamics -- I

abstract: In the present work we have developed a three-dimensional gravitational model of barred galaxies, in order to study orbital and escape dynamics of the stars inside their central barred region. Our gravitational model is composed of four components, central nucleus, bar, disc and dark matter halo. Furthermore we have analysed the model for two different types of bar potentials. The study has been carried out for a Hamiltonian system and thorough numerical studies have been done in order to categorize regular and chaotic motions of stars. We have seen that escape mechanism has only seen near saddle points ($L_2$, $L_4$ and $L_2^{'}$, $L_4^{'}$) of the Hamiltonian system. Orbital structures in $x$ - $y$ plane indicate that this escaping motion corresponds to the two ends of the bar. Classifications of orbits are found by calculating maximal Lyapunov exponent of the stellar trajectories corresponding to a specific initial condition vector. Poincar\'e surface section maps are studied in both $x$ - $y$ and $x$ - $p_x$ ($p_x$ is the momentum along $x$ - direction) plane to get a complete view of the escape properties of the system in the phase space. Also we studied in detail how the chaotic dynamics varies with mass, length and nature of the bar. We found that under suitable physical conditions the chaos plays a pivotal role behind the formation of grand design or poor spiral pattern for stronger bars and ring structures for weaker bars.


title: Diffeomorphisms of the 4-sphere, Cerf theory and Montesinos twins

abstract: One way to better understand the smooth mapping class group of the 4-sphere would be to give a list of generators in the form of explicit diffeomorphisms supported in neighborhoods of submanifolds, in analogy with Dehn twists on surfaces. As a step in this direction, we describe a surjective homomorphism from a group associated to loops of 2-spheres in $S^2 \times S^2$'s onto this smooth mapping class group, discuss two natural and in some sense complementary subgroups of the domain of this homomomorphism, show that one is in the kernel, and give generators as above for the image of the other. These generators are described as twists along Montesinos twins, i.e. pairs of embedded 2-spheres in the 4-sphere intersecting transversely at two points.


title: CPG-ACTOR: Reinforcement Learning for Central Pattern Generators

abstract: Central Pattern Generators (CPGs) have several properties desirable for locomotion: they generate smooth trajectories, are robust to perturbations and are simple to implement. Although conceptually promising, we argue that the full potential of CPGs has so far been limited by insufficient sensory-feedback information. This paper proposes a new methodology that allows tuning CPG controllers through gradient-based optimization in a Reinforcement Learning (RL) setting. To the best of our knowledge, this is the first time CPGs have been trained in conjunction with a MultilayerPerceptron (MLP) network in a Deep-RL context. In particular, we show how CPGs can directly be integrated as the Actor in an Actor-Critic formulation. Additionally, we demonstrate how this change permits us to integrate highly non-linear feedback directly from sensory perception to reshape the oscillators' dynamics. Our results on a locomotion task using a single-leg hopper demonstrate that explicitly using the CPG as the Actor rather than as part of the environment results in a significant increase in the reward gained over time (6x more) compared with previous approaches. Furthermore, we show that our method without feedback reproduces results similar to prior work with feedback. Finally, we demonstrate how our closed-loop CPG progressively improves the hopping behaviour for longer training epochs relying only on basic reward functions.


title: Restoring Uniqueness in MicroVM Snapshots

abstract: Code initialization -- the step of loading code, executing static code, filling caches, and forming re-used connections -- tends to dominate cold-start time in serverless compute systems such as AWS Lambda. Post-initialization memory snapshots, cloned and restored on start, have emerged as a viable solution to this problem, with incremental snapshot and fast restore support in VMMs like Firecracker. Saving memory introduces the challenge of managing high-value memory contents, such as cryptographic secrets. Cloning introduces the challenge of restoring the uniqueness of the VMs, to allow them to do unique things like generate UUIDs, secrets, and nonces. This paper examines solutions to these problems in the every microsecond counts context of serverless cold-start, and discusses the state-of-the-art of available solutions. We present two new interfaces aimed at solving this problem -- MADV\_WIPEONSUSPEND and SysGenId -- and compare them to alternative solutions.


title: Novelty and Primacy: A Long-Term Estimator for Online Experiments

abstract: Online experiments are the gold standard for evaluating impact on user experience and accelerating innovation in software. However, since experiments are typically limited in duration, observed treatment effects are not always permanently stable, sometimes revealing increasing or decreasing patterns over time. There are multiple causes for a treatment effect to change over time. In this paper, we focus on a particular cause, user-learning, which is primarily associated with novelty or primacy. Novelty describes the desire to use new technology that tends to diminish over time. Primacy describes the growing engagement with technology as a result of adoption of the innovation. User-learning estimation is critical because it holds experimentation responsible for trustworthiness, empowers organizations to make better decisions by providing a long-term view of expected impact, and prevents user dissatisfaction. In this paper, we propose an observational approach, based on difference-in-differences technique to estimate user-learning at scale. We use this approach to test and estimate user-learning in many experiments at Microsoft. We compare our approach with the existing experimental method to show its benefits in terms of ease of use and higher statistical power, and to discuss its limitation in presence of other forms of treatment interaction with time.


title: Constrained Optimization to Train Neural Networks on Critical and Under-Represented Classes

abstract: Deep neural networks (DNNs) are notorious for making more mistakes for the classes that have substantially fewer samples than the others during training. Such class imbalance is ubiquitous in clinical applications and very crucial to handle because the classes with fewer samples most often correspond to critical cases (e.g., cancer) where misclassifications can have severe consequences. Not to miss such cases, binary classifiers need to be operated at high True Positive Rates (TPRs) by setting a higher threshold, but this comes at the cost of very high False Positive Rates (FPRs) for problems with class imbalance. Existing methods for learning under class imbalance most often do not take this into account. We argue that prediction accuracy should be improved by emphasizing reducing FPRs at high TPRs for problems where misclassification of the positive, i.e. critical, class samples are associated with higher cost. To this end, we pose the training of a DNN for binary classification as a constrained optimization problem and introduce a novel constraint that can be used with existing loss functions to enforce maximal area under the ROC curve (AUC) through prioritizing FPR reduction at high TPR. We solve the resulting constrained optimization problem using an Augmented Lagrangian method (ALM). Going beyond binary, we also propose two possible extensions of the proposed constraint for multi-class classification problems. We present experimental results for image-based binary and multi-class classification applications using an in-house medical imaging dataset, CIFAR10, and CIFAR100. Our results demonstrate that the proposed method improves the baselines in majority of the cases by attaining higher accuracy on critical classes while reducing the misclassification rate for the non-critical class samples.


title: Evolving Attention with Residual Convolutions

abstract: Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However, they are learned independently in each layer and sometimes fail to capture precise patterns. In this paper, we propose a novel and generic mechanism based on evolving attention to improve the performance of transformers. On one hand, the attention maps in different layers share common knowledge, thus the ones in preceding layers can instruct the attention in succeeding layers through residual connections. On the other hand, low-level and high-level attentions vary in the level of abstraction, so we adopt convolutional layers to model the evolutionary process of attention maps. The proposed evolving attention mechanism achieves significant performance improvement over various state-of-the-art models for multiple tasks, including image classification, natural language understanding and machine translation.


title: Predicting times of waiting on red signals using BERT

abstract: We present a method for approximating outcomes of road traffic simulations using BERT-based models, which may find applications in, e.g., optimizing traffic signal settings, especially with the presence of autonomous and connected vehicles. The experiments were conducted on a dataset generated using the Traffic Simulation Framework software runs on a realistic road network. The BERT-based models were compared with 4 other types of machine learning models (LightGBM, fully connected neural networks and 2 types of graph neural networks) and gave the best results in terms of all the considered metrics.


title: $SE_2(3)$ based Extended Kalman Filtering and Smoothing Framework for Inertial-Integrated Navigation

abstract: This paper proposes an $SE_2(3)$ based extended Kalman filtering (EKF) framework for the inertial-integrated state estimation problem. The error representation using the straight difference of two vectors in the inertial navigation system may not be reasonable as it does not take the direction difference into consideration. Therefore, we choose to use the $SE_2(3)$ matrix Lie group to represent the state of the inertial-integrated navigation system which consequently leads to the common frame error representation. With the new velocity and position error definition, we leverage the group affine dynamics with the autonomous error properties and derive the error state differential equation for the inertial-integrated navigation on the north-east-down (NED) navigation frame and the earth-centered earth-fixed (ECEF) frame, respectively, the corresponding EKF, terms as $SE_2(3)$ based EKF has also been derived. It provides a new perspective on the geometric EKF with a more sophisticated formula for the inertial-integrated navigation system. Furthermore, we design two new modified error dynamics on the NED frame and the ECEF frame respectively by introducing new auxiliary vectors. Finally the equivalence of the left-invariant EKF and left $SE_2(3)$ based EKF have been shown in navigation frame and ECEF frame.


title: ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep learning

abstract: Diffusion-weighted magnetic resonance imaging (DW-MRI) can be used to characterise the microstructure of the nervous tissue, e.g. to delineate brain white matter connections in a non-invasive manner via fibre tracking. Magnetic Resonance Imaging (MRI) in high spatial resolution would play an important role in visualising such fibre tracts in a superior manner. However, obtaining an image of such resolution comes at the expense of longer scan time. Longer scan time can be associated with the increase of motion artefacts, due to the patient's psychological and physical conditions. Single Image Super-Resolution (SISR), a technique aimed to obtain high-resolution (HR) details from one single low-resolution (LR) input image, achieved with Deep Learning, is the focus of this study. Compared to interpolation techniques or sparse-coding algorithms, deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts. In this research, a deep learning based super-resolution technique is proposed and has been applied for DW-MRI. Images from the IXI dataset have been used as the ground-truth and were artificially downsampled to simulate the low-resolution images. The proposed method has shown statistically significant improvement over the baselines and achieved an SSIM of $0.913\pm0.045$.


title: Mobility for Cellular-Connected UAVs: challenges for the network provider

abstract: Unmanned Aerial Vehicle (UAV) technology is becoming more prevalent and more diverse in its application. 5G and beyond networks must enable UAV connectivity. This will require the network operator to consider this new type of user in the planning and operation of the network. This work presents the challenges an operator will encounter and should consider in the future as UAVs become users of the network. We analyse the 3GPP specifications, the existing research literature, and a publicly available UAV connectivity dataset, to describe the challenges. We classify these challenges into network planning and network optimisation categories. We discuss the challenge of planning network coverage when considering coverage for flying users and the PCI collision and confusion issues that can be aggravated by these users. In discussing network optimisation challenges, we introduce Automatic Neighbouring Relation (ANR) and handover challenges, specifically the number of neighbours in the Neighbour Relation Table (NRT), and their potential deletion and block-listing, the frequent number of handovers and the possibility that the UAV disconnects because of handover issues. We discuss possible approaches to address the presented challenges and use a real-world dataset to support our findings about these challenges and their importance.


title: Measurements of asymmetries in top-quark production and tests of lepton universality in ATLAS

abstract: The top quark is the heaviest known fundamental particle. As it is the only quark that decays without hadronisation, it provides the unique opportunity to probe the properties of bare quarks at the Large Hadron Collider (LHC). This article will present two recent measurements of the top quark using 13TeV collision data with the ATLAS experiment: the top and anti-top quark pair charge asymmetry measurement alongside the first test of lepton flavour universality (LFU) of leptons to W bosons from tt events.


title: Pointless proofs of the Menger and Rothberger games

abstract: This work presents proofs for Hurewicz's and Pawlikowski's Theorems about topological games in the context of lattices, in which one cannot argue with points.


title: Remedy of some cosmological tensions via effective phantom-like behavior of interacting vacuum energy

abstract: Since physics of the dark sector components of the Universe is not yet well-understood, the phenomenological studies of non-minimal interaction in the dark sector could possibly pave the way to theoretical and experimental progress in this direction. Therefore, in this work, we intend to explore some features and consequences of a phenomenological interaction in the dark sector. We use the Planck 2018, BAO, JLA, KiDS and HST data to investigate two extensions of the base $\Lambda$CDM model, viz., (i) we allow the interaction among vacuum energy and dark matter, namely the I$\Lambda$CDM model, wherein the interaction strength is proportional to the vacuum energy density and expansion rate of the Universe, and (ii) the I$\Lambda$CDM scenario with free effective neutrino mass and number, namely the $\nu$I$\Lambda$CDM model. We also present comparative analyses of the interaction models with the companion models, namely, $\Lambda$CDM, $\nu\Lambda$CDM, $w$CDM and $\nu w$CDM. In both the interaction models, we find non-zero coupling in the dark sector up to 99\% CL with energy transfer from dark matter to vacuum energy, and observe a phantom-like behavior of the effective dark energy without actual ``phantom crossing". The well-known tensions on the cosmological parameters $H_0$ and $\sigma_8$, prevailing within the $\Lambda$CDM cosmology, are relaxed significantly in these models wherein the $\nu$I$\Lambda$CDM model shows consistency with the standard effective neutrino mass and number. Both the interaction models find a better fit to the combined data compared to the companion models under consideration.


title: Self-Tuning for Data-Efficient Deep Learning

abstract: Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic scenarios. To mitigate the requirement for labeled data, semi-supervised learning (SSL) focuses on simultaneously exploring both labeled and unlabeled data, while transfer learning (TL) popularizes a favorable practice of fine-tuning a pre-trained model to the target data. A dilemma is thus encountered: Without a decent pre-trained model to provide an implicit regularization, SSL through self-training from scratch will be easily misled by inaccurate pseudo-labels, especially in large-sized label space; Without exploring the intrinsic structure of unlabeled data, TL through fine-tuning from limited labeled data is at risk of under-transfer caused by model shift. To escape from this dilemma, we present Self-Tuning to enable data-efficient deep learning by unifying the exploration of labeled and unlabeled data and the transfer of a pre-trained model, as well as a Pseudo Group Contrast (PGC) mechanism to mitigate the reliance on pseudo-labels and boost the tolerance to false labels. Self-Tuning outperforms its SSL and TL counterparts on five tasks by sharp margins, e.g. it doubles the accuracy of fine-tuning on Cars with 15% labels.


title: Mott insulating states with competing orders in the triangular lattice Hubbard model

abstract: The physics of the triangular lattice Hubbard model exhibits a rich phenomenology, ranging from a metal-insulator transition, intriguing thermodynamic behavior, and a putative spin liquid phase at intermediate coupling, ultimately becoming a magnetic insulator at strong coupling. In this multimethod study, we combine a finite-temperature tensor network method, minimally entangled thermal typical states (METTS), with two Green-function-based methods, connected-determinant diagrammatic Monte Carlo and cellular dynamical mean-field theory, to establish several aspects of this model. We elucidate the evolution from the metallic to the insulating regime from the complementary perspectives brought by these different methods. We compute the full thermodynamics of the model on a width-four cylinder using METTS in the intermediate to strong coupling regime. We find that the insulating state hosts a large entropy at intermediate temperatures, which increases with the strength of the coupling. Correspondingly, and consistently with a thermodynamic Maxwell relation, the double occupancy has a minimum as a function of temperature which is the manifestation of the Pomeranchuk effect of increased localization upon heating. The intermediate coupling regime is found to exhibit both pronounced chiral as well as stripy antiferromagnetic spin correlations. We propose a scenario in which time-reversal symmetry-broken states compete with stripy-spin states at lowest temperatures.


title: Tuning as a Means of Assessing the Benefits of New Ideas in Interplay with Existing Algorithmic Modules

abstract: Introducing new algorithmic ideas is a key part of the continuous improvement of existing optimization algorithms. However, when introducing a new component into an existing algorithm, assessing its potential benefits is a challenging task. Often, the component is added to a default implementation of the underlying algorithm and compared against a limited set of other variants. This assessment ignores any potential interplay with other algorithmic ideas that share the same base algorithm, which is critical in understanding the exact contributions being made. We introduce a more extensive procedure, which uses hyperparameter tuning as a means of assessing the benefits of new algorithmic components. This allows for a more robust analysis by not only focusing on the impact on performance, but also by investigating how this performance is achieved. We implement our suggestion in the context of the Modular CMA-ES framework, which was redesigned and extended to include some new modules and several new options for existing modules, mostly focused on the step-size adaptation method. Our analysis highlights the differences between these new modules, and identifies the situations in which they have the largest contribution.


title: Regularity for Obstacle Problems without Structure Conditions

abstract: This paper deals with the Lipschitz regularity of minimizers for a class of variational obstacle problems with possible occurance of the Lavrentiev phenomenon. In order to overcome this problem, the availment of the notions of relaxed functional and Lavrentiev gap are needed. The main tool used here is a ingenious Lemma which reveals to be crucial because it allows us to move from the variational obstacle problem to the relaxed-functional-related one. This is fundamental in order to find the solutions' regularity that we intended to study. We assume the same Sobolev regularity both for the gradient of the obstacle and for the coefficients.


title: Witnessing the survival of time-energy entanglement through biological tissue and scattering media

abstract: We demonstrate the preservation of time-energy entanglement of near-IR photons through thick biological media ($\leq$1.55 mm) and tissue ($\leq$ 235 $\mu$m) at room temperature. Using a Franson-type interferometer, we demonstrate interferometric contrast of over 0.9 in skim milk, 2% milk, and chicken tissue. This work supports the many proposed opportunities for nonclassical light in biological imaging and analyses from sub-shot noise measurements to entanglement-enhanced fluorescence imaging, clearly indicating that the entanglement characteristics of photons can be maintained even after propagation through thick, turbid biological samples.


title: Adaptive Load Shedding for Grid Emergency Control via Deep Reinforcement Learning

abstract: Emergency control, typically such as under-voltage load shedding (UVLS), is broadly used to grapple with low voltage and voltage instability issues in practical power systems under contingencies. However, existing emergency control schemes are rule-based and cannot be adaptively applied to uncertain and floating operating conditions. This paper proposes an adaptive UVLS algorithm for emergency control via deep reinforcement learning (DRL) and expert systems. We first construct dynamic components for picturing the power system operation as the environment. The transient voltage recovery criteria, which poses time-varying requirements to UVLS, is integrated into the states and reward function to advise the learning of deep neural networks. The proposed approach has no tuning issue of coefficients in reward functions, and this issue was regarded as a deficiency in the existing DRL-based algorithms. Extensive case studies illustrate that the proposed method outperforms the traditional UVLS relay in both the timeliness and efficacy for emergency control.


title: Docking and Undocking a Modular Underactuated Oscillating Swimming Robot

abstract: We describe a docking mechanism and strategy to allow modular self-assembly for the Modboat: an inexpensive underactuated oscillating swimming robot powered by a single motor. Because propulsion is achieved through oscillation, orientation can be controlled only in the average; this complicates docking, which requires precise position and orientation control. Given these challenges, we present a docking strategy and a motion primitive for controlling orientation, and show that this strategy allows successful docking in multiple configurations. Moreover, we demonstrate that the Modboat is also capable of undocking and changing its dock configuration, all without any additional actuation. This is unique among similar modular robotic systems.


title: A remark on two notions of flatness for sets in the Euclidean space

abstract: In this note we compare two ways of measuring the $n$-dimensional "flatness" of a set $S\subset \mathbb{R}^d$, where $n\in \mathbb{N}$ and $d>n$. The first one is to consider the classical Reifenberg-flat numbers $\alpha(x,r)$ ($x \in S$, $r>0$), which measure the minimal scaling-invariant Hausdorff distances in $B_r(x)$ between $S$ and $n$-dimensional affine subspaces of $\mathbb{R}^d$. The second is an `intrinsic' approach in which we view the same set $S$ as a metric space (endowed with the induced Euclidean distance). Then we consider numbers ${\sf a}(x,r)$'s, that are the scaling-invariant Gromov-Hausdorff distances between balls centered at $x$ of radius $r$ in $S$ and the $n$-dimensional Euclidean ball of the same radius. As main result of our analysis we make rigorous a phenomenon, first noted by David and Toro, for which the numbers ${\sf a}(x,r)$'s behaves as the square of the numbers $\alpha(x,r)$'s. Moreover we show how this result finds application in extending the Cheeger-Colding intrinsic-Reifenberg theorem to the biLipschitz case. As a by-product of our arguments, we deduce analogous results also for the Jones' numbers $\beta$'s (i.e. the one-sided version of the numbers $\alpha$'s).


title: Blocks World Revisited: The Effect of Self-Occlusion on Classification by Convolutional Neural Networks

abstract: Despite the recent successes in computer vision, there remain new avenues to explore. In this work, we propose a new dataset to investigate the effect of self-occlusion on deep neural networks. With TEOS (The Effect of Self-Occlusion), we propose a 3D blocks world dataset that focuses on the geometric shape of 3D objects and their omnipresent challenge of self-occlusion. We designed TEOS to investigate the role of self-occlusion in the context of object classification. Even though remarkable progress has been seen in object classification, self-occlusion is a challenge. In the real-world, self-occlusion of 3D objects still presents significant challenges for deep learning approaches. However, humans deal with this by deploying complex strategies, for instance, by changing the viewpoint or manipulating the scene to gather necessary information. With TEOS, we present a dataset of two difficulty levels (L1 and L2 ), containing 36 and 12 objects, respectively. We provide 738 uniformly sampled views of each object, their mask, object and camera position, orientation, amount of self-occlusion, as well as the CAD model of each object. We present baseline evaluations with five well-known classification deep neural networks and show that TEOS poses a significant challenge for all of them. The dataset, as well as the pre-trained models, are made publicly available for the scientific community under https://nvision2.data.eecs.yorku.ca/TEOS.


title: Global Research Trends in the Modern Language Journal from 1999 to 2018: A Data-Driven Analysis

abstract: The present study conducts a scientometric study of the Modern Language Journal literature from 1999 to 2018 based on the database of Web of Science, 2018. A total of 2564 items resulted from the publication name using "Modern Language Journal" as the search term. Based on the number of publications during the study period no consistent growth is observed in the research activities pertaining to the journal. The annual distribution of publications, number of authors, institution productivity, country wise publications and Citations are analyzed. Highly productive authors, institutions, and countries are identified. The results reveal that the maximum number of papers 179 is published in the year 1999. It was also observed that Byrnes H is the most productive, contributed 51 publications and Kramsch C is most cited author in the field having 543 global citations. The highest number (38.26%) of publications, contributed from USA and the foremost productive establishment was University of Iowa.


title: Symmetry reduction in AM/GM-based optimization

abstract: The arithmetic mean/geometric mean-inequality (AM/GM-inequality) facilitates classes of non-negativity certificates and of relaxation techniques for polynomials and, more generally, for exponential sums. Here, we present a first systematic study of the AM/GM-based techniques in the presence of symmetries under the linear action of a finite group. We prove a symmetry-adapted representation theorem and develop techniques to reduce the size of the resulting relative entropy programs. We study in more detail the complexity gain in the case of the symmetric group. In this setup, we can show in particular certain stabilization results. We exhibit several sequences of examples in growing dimensions where the size of the problem stabilizes. Finally, we provide some numerical results, emphasizing the computational speed-up.


title: Publication Trend in an Indian Journal and a Pakistan Journal: A Comparative Analysis using Scientometric Approach

abstract: Scientometric analysis of 146 and 59 research articles published in Indian journal of Information Sources and Services (IJISS) and Pakistan Journal of Library and Information Science has been carried out. Seven Volumes of the IJISS containing 14 issues and Seven volumes of PJLIS containing 8 issues from 2011 - 2017 have been taken into consideration for the present study. The number of contributions, authorship pattern & author productivity, average citations, average length of articles, average keywords and collaborative papers has been analyzed. Out of 146 of IJISS contributions, only 39 are single authored and rest by multi authored with degree of collaboration 0.73 and week collaboration among the authors and from 59 contributions of PJLIS only 18 are single authored and rest by multi authored with degree of collaboration 0.69 and week collaboration among the authors. The study revealed that the author productivity is 0.53 (IJISS) and 0.50 (PJLIS) and dominated by the Indian and Pakistani authors.


title: Fresh, Fair and Energy-Efficient Content Provision in a Private and Cache-Enabled UAV Network

abstract: In this paper, we investigate a private and cache-enabled unmanned aerial vehicle (UAV) network for content provision. Aiming at delivering fresh, fair, and energy-efficient content files to terrestrial users, we formulate a joint UAV caching, UAV trajectory, and UAV transmit power optimization problem. This problem is confirmed to be a sequential decision problem with mixed-integer non-convex constraints, which is intractable directly. To this end, we propose a novel algorithm based on the techniques of subproblem decomposition and convex approximation. Particularly, we first propose to decompose the sequential decision problem into multiple repeated optimization subproblems via a Lyapunov technique. Next, an iterative optimization scheme incorporating a successive convex approximation (SCA) technique is explored to tackle the challenging mixed-integer non-convex subproblems. Besides, we analyze the convergence and computational complexity of the proposed algorithm and derive the theoretical value of the expected peak age of information (PAoI) to estimate the content freshness. Simulation results demonstrate that the proposed algorithm can achieve the expected PAoI close to the theoretical value and is more 22.11% and 70.51% energy-efficient and fairer than benchmark algorithms.


title: Factorization and transverse phase-space parton distributions

abstract: We first revisit impact-parameter dependent collisions of ultra-relativistic particles in quantum field theory. Two conditions sufficient for defining an impact-parameter dependent cross section are given, which could be violated in proton-proton collisions. By imposing these conditions, a general formula for the impact-parameter dependent cross section is derived. Then, using soft-collinear effective theory, we derive a factorization formula for the impact-parameter dependent cross section for inclusive hard processes with only colorless final-state products in hadron and nuclear collisions. It entails defining thickness beam functions, which are Fourier transforms of transverse phase-space parton distribution functions. By modelling non-perturbative modes in thickness beam functions of large nuclei in heavy-ion collisions, the factorization formula confirms the cross section in the Glauber model for hard processes. Besides, the factorization formula is verified up to one loop in perturbative QCD for the inclusive Drell-Yan process in quark-antiquark collisions at a finite impact parameter.


title: Category measures, the dual of $C(K)^\delta$ and hyper-Stonean spaces

abstract: For a compact Hausdorff space $K$, we give descriptions of the dual of $C(K)^\delta$, the Dedekind completion of the Banach lattice $C(K)$ of continuous, real-valued functions on $K$. We characterize those functionals which are $\sigma$-order continuous and order continuous, respectively, in terms of Oxtoby's category measures. This leads to a purely topological characterization of hyper-Stonean spaces.


title: Dual MINE-based Neural Secure Communications under Gaussian Wiretap Channel

abstract: Recently, some researches are devoted to the topic of end-to-end learning a physical layer secure communication system based on autoencoder under Gaussian wiretap channel. However, in those works, the reliability and security of the encoder model were learned through necessary decoding outputs of not only legitimate receiver but also the eavesdropper. In fact, the assumption of known eavesdropper's decoder or its output is not practical. To address this issue, in this paper we propose a dual mutual information neural estimation (MINE) based neural secure communications model. The security constraints of this method is constructed only with the input and output signal samples of the legal and eavesdropper channels and benefit that training the encoder is completely independent of the decoder. Moreover, since the design of secure coding does not rely on the eavesdropper's decoding results, the security performance would not be affected by the eavesdropper's decoding means. Numerical results show that the performance of our model is guaranteed whether the eavesdropper learns the decoder himself or uses the legal decoder.


title: Distribution-Free Robust Linear Regression

abstract: We study random design linear regression with no assumptions on the distribution of the covariates and with a heavy-tailed response variable. In this distribution-free regression setting, we show that boundedness of the conditional second moment of the response given the covariates is a necessary and sufficient condition for achieving nontrivial guarantees. As a starting point, we prove an optimal version of the classical in-expectation bound for the truncated least squares estimator due to Gy\"{o}rfi, Kohler, Krzy\.{z}ak, and Walk. However, we show that this procedure fails with constant probability for some distributions despite its optimal in-expectation performance. Then, combining the ideas of truncated least squares, median-of-means procedures, and aggregation theory, we construct a non-linear estimator achieving excess risk of order $d/n$ with an optimal sub-exponential tail. While existing approaches to linear regression for heavy-tailed distributions focus on proper estimators that return linear functions, we highlight that the improperness of our procedure is necessary for attaining nontrivial guarantees in the distribution-free setting.


title: Emerging Trends in Federated Learning: From Model Fusion to Federated X Learning

abstract: Federated learning is a new learning paradigm that decouples data collection and model training via multi-party computation and model aggregation. As a flexible learning setting, federated learning has the potential to integrate with other learning frameworks. We conduct a focused survey of federated learning in conjunction with other learning algorithms. Specifically, we explore various learning algorithms to improve the vanilla federated averaging algorithm and review model fusion methods such as adaptive aggregation, regularization, clustered methods, and Bayesian methods. Following the emerging trends, we also discuss federated learning in the intersection with other learning paradigms, termed federated X learning, where X includes multitask learning, meta-learning, transfer learning, unsupervised learning, and reinforcement learning. In addition to reviewing state-of-the-art studies, this paper also identifies key challenges and applications in this field, while also highlighting promising future directions.


title: BBN Constraints on $f(Q,T)$ Gravity

abstract: $f(Q,T)$ gravity is a novel extension of the symmetric teleparallel gravity where the Lagrangian $L$ is represented through an arbitrary function of the nonmetricity $Q$ and the trace of the energy-momentum tensor $T$ \cite{fqt}. In this work, we have constrained a widely used $f(Q,T)$ gravity model of the form $f(Q,T) = Q^{n+1} + m T$ from the primordial abundances of the light elements to understand its viability in Cosmology. We report that the $f(Q,T)$ gravity model can elegantly explain the observed abundances of Helium and Deuterium while the Lithium problem persists. From the constraint on the expansion factor in the range $0.9425 \lesssim Z \lesssim1.1525$, we report strict constraints on the parameters $m$ and $n$ in the range $-1.13 \lesssim n \lesssim -1.08$ and $-5.86 \lesssim m \lesssim12.52$ respectively.


title: BPF for storage: an exokernel-inspired approach

abstract: The overhead of the kernel storage path accounts for half of the access latency for new NVMe storage devices. We explore using BPF to reduce this overhead, by injecting user-defined functions deep in the kernel's I/O processing stack. When issuing a series of dependent I/O requests, this approach can increase IOPS by over 2.5$\times$ and cut latency by half, by bypassing kernel layers and avoiding user-kernel boundary crossings. However, we must avoid losing important properties when bypassing the file system and block layer such as the safety guarantees of the file system and translation between physical blocks addresses and file offsets. We sketch potential solutions to these problems, inspired by exokernel file systems from the late 90s, whose time, we believe, has finally come!


title: Machine Learning-Based Optimal Mesh Generation in Computational Fluid Dynamics

abstract: Computational Fluid Dynamics (CFD) is a major sub-field of engineering. Corresponding flow simulations are typically characterized by heavy computational resource requirements. Often, very fine and complex meshes are required to resolve physical effects in an appropriate manner. Since all CFD algorithms scale at least linearly with the size of the underlying mesh discretization, finding an optimal mesh is key for computational efficiency. One methodology used to find optimal meshes is goal-oriented adaptive mesh refinement. However, this is typically computationally demanding and only available in a limited number of tools. Within this contribution, we adopt a machine learning approach to identify optimal mesh densities. We generate optimized meshes using classical methodologies and propose to train a convolutional network predicting optimal mesh densities given arbitrary geometries. The proposed concept is validated along 2d wind tunnel simulations with more than 60,000 simulations. Using a training set of 20,000 simulations we achieve accuracies of more than 98.7%. Corresponding predictions of optimal meshes can be used as input for any mesh generation and CFD tool. Thus without complex computations, any CFD engineer can start his predictions from a high quality mesh.