title: Algorithmic Symplectic Packing

abstract: In this article we explore a symplectic packing problem where the targets and domains are $2n$-dimensional symplectic manifolds. We work in the context where the manifolds have first homology group equal to $\mathbb{Z}^n$, and we require the embeddings to induce isomorphisms between first homology groups. In this case, Maley, Mastrangeli and Traynor showed that the problem can be reduced to a combinatorial optimization problem, namely packing certain allowable simplices into a given standard simplex. They designed a computer program and presented computational results. In particular, they determined the simplex packing widths in dimension four for up to $k=12$ simplices, along with lower bounds for higher values of $k$. We present a modified algorithmic approach that allows us to determine the $k$-simplex packing widths for up to $k = 13$ simplices in dimension four and up to $k = 8$ simplices in dimension six. Moreover, our approach determines all simplex-multisets that allow for optimal packings.


title: Unsupervised Domain Adaptation for Dysarthric Speech Detection via Domain Adversarial Training and Mutual Information Minimization

abstract: Dysarthric speech detection (DSD) systems aim to detect characteristics of the neuromotor disorder from speech. Such systems are particularly susceptible to domain mismatch where the training and testing data come from the source and target domains respectively, but the two domains may differ in terms of speech stimuli, disease etiology, etc. It is hard to acquire labelled data in the target domain, due to high costs of annotating sizeable datasets. This paper makes a first attempt to formulate cross-domain DSD as an unsupervised domain adaptation (UDA) problem. We use labelled source-domain data and unlabelled target-domain data, and propose a multi-task learning strategy, including dysarthria presence classification (DPC), domain adversarial training (DAT) and mutual information minimization (MIM), which aim to learn dysarthria-discriminative and domain-invariant biomarker embeddings. Specifically, DPC helps biomarker embeddings capture critical indicators of dysarthria; DAT forces biomarker embeddings to be indistinguishable in source and target domains; and MIM further reduces the correlation between biomarker embeddings and domain-related cues. By treating the UASPEECH and TORGO corpora respectively as the source and target domains, experiments show that the incorporation of UDA attains absolute increases of 22.2% and 20.0% respectively in utterance-level weighted average recall and speaker-level accuracy.


title: Exponentiable Lie-Backlund vector fields in $J^\infty(\mathbb{R}^n, \mathbb{R}^m)$

abstract: We characterize Lie -Backlund vector fields in infinite dimensional jet bundles $J^\infty(\mathbb{R}^n, \mathbb{R}^m)$ that can be exponentiated to flows with each component depending on a finite set of variables. We show that for $m=1$ each such field is an extension of one in a finite dimensional jet space. For $m>1$ this is no longer the case and we give necessary and sufficient conditions for exponentiation. Non-trivial examples are provided for $(n,m)=(1,2)$.


title: Towards Robotic Laboratory Automation Plug & Play: The "LAPP" Framework

abstract: Increasing the level of automation in pharmaceutical laboratories and production facilities plays a crucial role in delivering medicine to patients. However, the particular requirements of this field make it challenging to adapt cutting-edge technologies present in other industries. This article provides an overview of relevant approaches and how they can be utilized in the pharmaceutical industry, especially in development laboratories. Recent advancements include the application of flexible mobile manipulators capable of handling complex tasks. However, integrating devices from many different vendors into an end-to-end automation system is complicated due to the diversity of interfaces. Therefore, various approaches for standardization are considered in this article, and a concept is proposed for taking them a step further. This concept enables a mobile manipulator with a vision system to "learn" the pose of each device and - utilizing a barcode - fetch interface information from a universal cloud database. This information includes control and communication protocol definitions and a representation of robot actions needed to operate the device. In order to define the movements in relation to the device, devices have to feature - besides the barcode - a fiducial marker as standard. The concept will be elaborated following appropriate research activities in follow-up papers.


title: Phase diagrams of confined square lattice links

abstract: We study by Monte Carlo simulations and scaling analysis two models of pairs of confined and dense ring polymers in two dimensions. The pair of ring polymers are modelled by squared lattice polygons confined within a square cavity and they are placed in relation to each other to be either unlinked or linked in the plane. The observed rich phase diagrams of the two models reveal several equilibrium phases separated by first order and continuous phase boundaries whose critical nature depend on this reciprocal placements. We estimate numerically the critical exponents associated with the phase boundaries and with the multicritical points where first order and continuous phase boundaries meet.


title: Enhancing user creativity: Semantic measures for idea generation

abstract: Human creativity generates novel ideas to solve real-world problems. This thereby grants us the power to transform the surrounding world and extend our human attributes beyond what is currently possible. Creative ideas are not just new and unexpected, but are also successful in providing solutions that are useful, efficient and valuable. Thus, creativity optimizes the use of available resources and increases wealth. The origin of human creativity, however, is poorly understood, and semantic measures that could predict the success of generated ideas are currently unknown. Here, we analyze a dataset of design problem-solving conversations in real-world settings by using 49 semantic measures based on WordNet 3.1 and demonstrate that a divergence of semantic similarity, an increased information content, and a decreased polysemy predict the success of generated ideas. The first feedback from clients also enhances information content and leads to a divergence of successful ideas in creative problem solving. These results advance cognitive science by identifying real-world processes in human problem solving that are relevant to the success of produced solutions and provide tools for real-time monitoring of problem solving, student training and skill acquisition. A selected subset of information content (IC S\'anchez-Batet) and semantic similarity (Lin/S\'anchez-Batet) measures, which are both statistically powerful and computationally fast, could support the development of technologies for computer-assisted enhancements of human creativity or for the implementation of creativity in machines endowed with general artificial intelligence.


title: VQMIVC: Vector Quantization and Mutual Information-Based Unsupervised Speech Representation Disentanglement for One-shot Voice Conversion

abstract: One-shot voice conversion (VC), which performs conversion across arbitrary speakers with only a single target-speaker utterance for reference, can be effectively achieved by speech representation disentanglement. Existing work generally ignores the correlation between different speech representations during training, which causes leakage of content information into the speaker representation and thus degrades VC performance. To alleviate this issue, we employ vector quantization (VQ) for content encoding and introduce mutual information (MI) as the correlation metric during training, to achieve proper disentanglement of content, speaker and pitch representations, by reducing their inter-dependencies in an unsupervised manner. Experimental results reflect the superiority of the proposed method in learning effective disentangled speech representations for retaining source linguistic content and intonation variations, while capturing target speaker characteristics. In doing so, the proposed approach achieves higher speech naturalness and speaker similarity than current state-of-the-art one-shot VC systems. Our code, pre-trained models and demo are available at https://github.com/Wendison/VQMIVC.


title: Spatial structure and information transfer in visual networks

abstract: In human and animal groups, social interactions often rely on the transmission of information via visual observation of the behavior of others. These visual interactions are governed by the laws of physics and sensory limits. Individuals appear smaller when far away and thus become harder to detect visually, while close by neighbors tend to occlude large areas of the visual field and block out interactions with individuals behind them. Here, we systematically study the effect of a group's spatial structure, its density as well as polarization and aspect ratio of the physical bodies, on the properties of the visual interaction network. In such a network individuals are connected if they can see each other as opposed to other interaction models such as metric or topological networks that omit these limitations due to the individual's physical bodies. We study the effect that spatial configuration has on the static properties of these networks as well as its influence on the transmission of information or behaviors which we investigate via two generic models of social contagion. We expect our work to have implications for the study of animal groups, where it could inform the study of functional benefits of different macroscopic states. It may also be applicable to the construction of robotic swarms communicating via vision or for understanding the spread of panics in human crowds.


title: An Audio-Driven System For Real-Time Music Visualisation

abstract: Computer-generated visualisations can accompany recorded or live music to create novel audiovisual experiences for audiences. We present a system to streamline the creation of audio-driven visualisations based on audio feature extraction and mapping interfaces. Its architecture is based on three modular software components: backend (audio plugin), frontend (3D game-like environment), and middleware (visual mapping interface). We conducted a user evaluation comprising two stages. Results from the first stage (34 participants) indicate that music visualisations generated with the system were significantly better at complementing the music than a baseline visualisation. Nine participants took part in the second stage involving interactive tasks. Overall, the system yielded a Creativity Support Index above average (68.1) and a System Usability Scale index (58.6) suggesting that ease of use can be improved. Thematic analysis revealed that participants enjoyed the system's synchronicity and expressive capabilities, but found technical problems and difficulties understanding the audio feature terminology.


title: CLT for LSS of sample covariance matrices with unbounded dispersions

abstract: Under the high-dimensional setting that data dimension and sample size tend to infinity proportionally, we derive the central limit theorem (CLT) for linear spectral statistics (LSS) of large-dimensional sample covariance matrix. Different from existing literature, our results do not require the assumption that the population covariance matrices are bounded. Moreover, many common kernel functions in the real data such as logarithmic functions and polynomial functions are allowed in this paper. In our model, the number of spiked eigenvalues can be fixed or tend to infinity. One salient feature of the asymptotic mean and covariance in our proposed central limit theorem is that it is related to the divergence order of the population spectral norm.


title: The inconsistency of linear dynamics and Born's rule

abstract: Modern experiments using nanoscale devices come ever closer to bridging the divide between the quantum and classical realms, bringing experimental tests of objective collapse theories that propose alterations to Schr\"{o}dinger's equation within reach. Such objective collapse theories aim to explain the emergence of classical dynamics in the thermodynamic limit and hence resolve the inconsistency that exists within the axioms of quantum mechanics. Here, we show that requiring the emergence of Born's rule for relative frequencies of measurement outcomes without imposing them as part of any axiom, implies that such objective collapse theories cannot be linear. Previous suggestions for a proof of the emergence of Born's rule in classes of problems that include linear objective collapse theories are analysed and shown to include hidden assumptions.


title: Self-supervised Video Representation Learning with Cross-Stream Prototypical Contrasting

abstract: Instance-level contrastive learning techniques, which rely on data augmentation and a contrastive loss function, have found great success in the domain of visual representation learning. They are not suitable for exploiting the rich dynamical structure of video however, as operations are done on many augmented instances. In this paper we propose "Video Cross-Stream Prototypical Contrasting", a novel method which predicts consistent prototype assignments from both RGB and optical flow views, operating on sets of samples. Specifically, we alternate the optimization process; while optimizing one of the streams, all views are mapped to one set of stream prototype vectors. Each of the assignments is predicted with all views except the one matching the prediction, pushing representations closer to their assigned prototypes. As a result, more efficient video embeddings with ingrained motion information are learned, without the explicit need for optical flow computation during inference. We obtain state-of-the-art results on nearest-neighbour video retrieval and action recognition, outperforming previous best by +3.2% on UCF101 using the S3D backbone (90.5% Top-1 acc), and by +7.2% on UCF101 and +15.1% on HMDB51 using the R(2+1)D backbone.


title: Classical Planning as QBF without Grounding (extended version)

abstract: Most classical planners use grounding as a preprocessing step, essentially reducing planning to propositional logic. However, grounding involves instantiating all action rules with concrete object combinations, and results in large encodings for SAT/QBF-based planners. This severe cost in memory becomes a main bottleneck when actions have many parameters, such as in the Organic Synthesis problems from the IPC 2018 competition. We provide a compact QBF encoding that is logarithmic in the number of objects and avoids grounding completely, by using universal quantification for object combinations. We show that we can solve some of the Organic Synthesis problems, which could not be handled before by any SAT/QBF based planners due to grounding.


title: Stochastic parareal: an application of probabilistic methods to time-parallelisation

abstract: Parareal is a well-studied algorithm for numerically integrating systems of time-dependent differential equations by parallelising the temporal domain. Given approximate initial values at each temporal sub-interval, the algorithm locates a solution in a fixed number of iterations using a predictor-corrector, stopping once a tolerance is met. This iterative process combines solutions located by inexpensive (coarse resolution) and expensive (fine resolution) numerical integrators. In this paper, we introduce a stochastic parareal algorithm aimed at accelerating the convergence of the deterministic parareal algorithm. Instead of providing the predictor-corrector with a deterministically located set of initial values, the stochastic algorithm samples initial values from dynamically varying probability distributions in each temporal sub-interval. All samples are then propagated in parallel using the expensive integrator. The set of sampled initial values yielding the most continuous (smoothest) trajectory across consecutive sub-intervals are fed into the predictor-corrector, converging in fewer iterations than the deterministic algorithm with a given probability. The performance of the stochastic algorithm, implemented using various probability distributions, is illustrated on low-dimensional systems of ordinary differential equations (ODEs). We provide numerical evidence that when the number of sampled initial values is large enough, stochastic parareal converges almost certainly in fewer iterations than the deterministic algorithm, maintaining solution accuracy. Given its stochastic nature, we also highlight that multiple simulations of stochastic parareal return a distribution of solutions that can represent a measure of uncertainty over the ODE solution.


title: Spatial Distribution of Distortion due to Nonlinear Power Amplification in Distributed Massive MIMO

abstract: Due to the nonlinearity of power amplifiers (PAs), the transmit signal is distorted. Previous works have studied the spatial distribution of this distortion for a central massive MIMO array. In this work, we extend the analysis for distributed massive MIMO in a line-of-sight scenario. We show that the distortion is not always uniformly distributed in space. In the single-user case, it coherently combines at the user location. In the few users case, the signals will add up at the user locations plus several others locations. As the number of users increases, it becomes close to uniformly distributed. As a comparison with a central massive MIMO system, having the same total number of antennas, the distortion in distributed massive MIMO is considerably more uniformly distributed in space. Moreover, the potential coherent combining is contained in a zone rather than in generic directions, i.e., in a beamspot. Furthermore, a small-scale fading effect is observed at unintended locations due to the non-coherent combining of the signals. As a result, one can expect that going towards distributed systems allows working closer to saturation, increasing the PA operating efficiency and/or using low-cost PAs.


title: Active labour market policies for the long-term unemployed: New evidence from causal machine learning

abstract: Active labor market programs are important instruments used by European employment agencies to help the unemployed find work. Investigating large administrative data on German long-term unemployed persons, we analyze the effectiveness of three job search assistance and training programs using Causal Machine Learning. Participants benefit from quickly realizing and long-lasting positive effects across all programs, with placement services being the most effective. For women, we find differential effects in various characteristics. Especially, women benefit from better local labor market conditions. We propose more effective data-driven rules for allocating the unemployed to the respective labor market programs that could be employed by decision-makers.


title: Multipolar Force Fields for Amide-I Spectroscopy from Conformational Dynamics of the Alanine-Trimer

abstract: The dynamics and spectroscopy of N-methyl-acetamide (NMA) and trialanine in solution is characterized from molecular dynamics (MD) simulations using different energy functions, including a conventional point charge (PC)-based force field, one based on a multipolar (MTP) representation of the electrostatics, and a semiempirical DFT method. For the 1-d infrared spectra, the frequency splitting between the two amide-I groups is 10 cm$^{-1}$ from the PC, 13 cm$^{-1}$ from the MTP, and 47 cm$^{-1}$ from SCC-DFTB simulations, compared with 25 cm$^{-1}$ from experiment. The frequency trajectory required for determining the frequency fluctuation correlation function (FFCF) is determined from individual (INM) and full normal mode (FNM) analyses of the amide-I vibrations. The spectroscopy, time-zero magnitude of the FFCF $C(t=0)$, and the static component $\Delta_0^2$ from simulations using MTP and analysis based on FNM are all consistent with experiments for (Ala)$_3$. Contrary to that, for the analysis excluding mode-mode coupling (INM) the FFCF decays to zero too rapidly and for simulations with a PC-based force field the $\Delta_0^2$ is too small by a factor of two compared with experiments. Simulations with SCC-DFTB agree better with experiment for these observables than those from PC-based simulations. The conformational ensemble sampled from simulations using PCs is consistent with the literature , whereas that covered by the MTP-based simulations is dominated by P$_{\rm II}$ which agrees with and confirms recently reported, Bayesian-refined populations based on 1-dimensional infrared experiments. Full normal mode analysis together with a MTP representation provides a meaningful model to correctly describe the dynamics of hydrated trialanine.


title: On finite GK-dimensional Nichols algebras of diagonal type: rank 3 and Cartan type

abstract: This paper contributes to the proof of the conjecture posed in arXiv:1606.02521, stating that a Nichols algebra of diagonal type with finite Gelfand-Kirillov dimension has finite (generalized) root system. We prove the conjecture assuming that the rank is 3 or that the braiding is of Cartan type.


title: LNIRT: An R Package for Joint Modeling of Response Accuracy and Times

abstract: In \textit{computer-based testing} it has become standard to collect response accuracy (RA) and response times (RTs) for each test item. IRT models are used to measure a latent variable (e.g., ability, intelligence) using the RA observations. The information in the RTs can help to improve routine operations in (educational) testing, and provide information about speed of working. In modern applications, the joint models are needed to integrate RT information in a test analysis. The R-package LNIRT supports fitting joint models through a user-friendly setup which only requires specifying RA, RT data, and the total number of Gibbs sampling iterations. More detailed specifications of the analysis are optional. The main results can be reported through the summary functions, but output can also be analysed with Markov chain Monte Carlo (MCMC) output tools (i.e., coda, mcmcse). The main functionality of the LNIRT package is illustrated with two real data applications.


title: Refined Selmer equations for the thrice-punctured line in depth two

abstract: In [Kim05], Kim gave a new proof of Siegel's Theorem that there are only finitely many $S$-integral points on $\mathbb P^1_{\mathbb Z}\setminus\{0,1,\infty\}$. One advantage of Kim's method is that it in principle allows one to actually find these points, but the calculations grow vastly more complicated as the size of $S$ increases. In this paper, we implement a refinement of Kim's method to explicitly compute various examples where $S$ has size $2$ which has been introduced in [BD19]. In so doing, we exhibit new examples of a natural generalisation of a conjecture of Kim.


title: Numerical estimation of reachable and controllability sets for a two-level open quantum system driven by coherent and incoherent controls

abstract: The article considers a two-level open quantum system, whose evolution is governed by the Gorini--Kossakowski--Lindblad--Sudarshan master equation with Hamiltonian and dissipation superoperator depending, correspondingly, on piecewise constant coherent and incoherent controls with constrained magnitudes. Additional constraints on controls' variations are also considered. The system is analyzed using Bloch parametrization of the system's density matrix. We adapt the section method for obtaining outer parallelepipedal and pointwise estimations of reachable and controllability sets in the Bloch ball via solving a number of problems for optimizing coherent and incoherent controls with respect to some objective criteria. The differential evolution and dual annealing optimization methods are used. The numerical results show how the reachable sets' estimations depend on distances between the system's initial states and the Bloch ball's center point, final times, constraints on controls' magnitudes and variations.


title: Evaluating the Robustness of Trigger Set-Based Watermarks Embedded in Deep Neural Networks

abstract: Trigger set-based watermarking schemes have gained emerging attention as they provide a means to prove ownership for deep neural network model owners. In this paper, we argue that state-of-the-art trigger set-based watermarking algorithms do not achieve their designed goal of proving ownership. We posit that this impaired capability stems from two common experimental flaws that the existing research practice has committed when evaluating the robustness of watermarking algorithms: (1) incomplete adversarial evaluation and (2) overlooked adaptive attacks. We conduct a comprehensive adversarial evaluation of 11 representative watermarking schemes against six of the existing attacks and demonstrate that each of these watermarking schemes lacks robustness against at least two non-adaptive attacks. We also propose novel adaptive attacks that harness the adversary's knowledge of the underlying watermarking algorithm of a target model. We demonstrate that the proposed attacks effectively break all of the 11 watermarking schemes, consequently allowing adversaries to obscure the ownership of any watermarked model. We encourage follow-up studies to consider our guidelines when evaluating the robustness of their watermarking schemes via conducting comprehensive adversarial evaluation that includes our adaptive attacks to demonstrate a meaningful upper bound of watermark robustness.


title: Do people's user types change over time? An exploratory study

abstract: In recent years, different studies have proposed and validated user models (e.g., Bartle, BrainHex, and Hexad) to represent the different user profiles in games and gamified settings. However, the results of applying these user models in practice (e.g., to personalize gamified systems) are still contradictory. One of the hypotheses for these results is that the user types can change over time (i.e., user types are dynamic). To start to understand whether user types can change over time, we conducted an exploratory study analyzing data from 74 participants to identify if their user type (Achiever, Philanthropist, Socialiser, Free Spirit, Player, and Disruptor) had changed over time (six months). The results indicate that there is a change in the dominant user type of the participants, as well as the average scores in the Hexad sub-scales. These results imply that all the scores should be considered when defining the Hexad's user type and that the user types are dynamic. Our results contribute with practical implications, indicating that the personalization currently made (generally static) may be insufficient to improve the users' experience, requiring user types to be analyzed continuously and personalization to be done dynamically.


title: Searching for Point Locations using Lines

abstract: Versions of the following problem appear in several topics such as Gamma Knife radiosurgery, studying objects with the X-ray transform, the 3SUM problem, and the $k$-linear degeneracy testing. Suppose there are $n$ points on a plane whose specific locations are unknown. We are given all the lines that go through the points with a given slope. We show that the minimum number of slopes needed, in general, to find all the point locations is $n+1$ and we provide an algorithm to do so.


title: Geometry of the charge density wave in kagom${\'e}$ metal AV$_{3}$Sb$_{5}$

abstract: Kagom${\'e}$ lattice is a fertile platform for topological and intertwined electronic excitations. Recently, experimental evidence of an unconventional charge density wave (CDW) is observed in a Z2 kagom${\'e}$ metal AV$_{3}$Sb$_{5}$ (A= K, Cs, Rb). This observation triggers wide interests on the interplay between frustrated crystal structure and Fermi surface instabilities. Here we analyze the lattice effect and its impact on CDW in AV$_{3}$Sb$_{5}$. Based on published experimental data, we show that the CDW induced structural distortions is consistent with the theoretically predicted inverse star-of-David pattern, which preserves the $D_{6h}$ symmetry in the kagom${\'e}$ plane but breaks the sixfold rotational symmetry of the crystal due to the phase shift between kagom${\'e}$ layers. The coupling between the lattice and electronic degrees of freedom yields a weak first order structural transition without continuous change of lattice dynamics. Our result emphasizes the fundamental role of lattice geometry in proper understanding of unconventional electronic orders in AV$_{3}$Sb$_{5}$.


title: The Dimpled Manifold Model of Adversarial Examples in Machine Learning

abstract: The extreme fragility of deep neural networks, when presented with tiny perturbations in their inputs, was independently discovered by several research groups in 2013. However, despite enormous effort, these adversarial examples remained a counterintuitive phenomenon with no simple testable explanation. In this paper, we introduce a new conceptual framework for how the decision boundary between classes evolves during training, which we call the {\em Dimpled Manifold Model}. In particular, we demonstrate that training is divided into two distinct phases. The first phase is a (typically fast) clinging process in which the initially randomly oriented decision boundary gets very close to the low dimensional image manifold, which contains all the training examples. Next, there is a (typically slow) dimpling phase which creates shallow bulges in the decision boundary that move it to the correct side of the training examples. This framework provides a simple explanation for why adversarial examples exist, why their perturbations have such tiny norms, and why they look like random noise rather than like the target class. This explanation is also used to show that a network that was adversarially trained with incorrectly labeled images might still correctly classify most test images, and to show that the main effect of adversarial training is just to deepen the generated dimples in the decision boundary. Finally, we discuss and demonstrate the very different properties of on-manifold and off-manifold adversarial perturbations. We describe the results of numerous experiments which strongly support this new model, using both low dimensional synthetic datasets and high dimensional natural datasets.


title: On-sky results for the novel integrated micro-lens ring tip-tilt sensor

abstract: We present the first on-sky results of the micro-lens ring tip-tilt (MLR-TT) sensor. This sensor utilizes a 3D printed micro-lens ring feeding six multi-mode fibers to sense misaligned light, allowing centroid reconstruction. A tip-tilt mirror allows the beam to be corrected, increasing the amount of light coupled into a centrally positioned single-mode (science) fiber. The sensor was tested with the iLocater acquisition camera at the Large Binocular Telescope in November 2019. The limit on the maximum achieved root mean square reconstruction accuracy was found to be 0.19 $\lambda$/D in both tip and tilt, of which approximately 50% of the power originates at frequencies below 10 Hz. We show the reconstruction accuracy is highly dependent on the estimated Strehl ratio and simulations support the assumption that residual adaptive optics aberrations are the main limit to the reconstruction accuracy. We conclude that this sensor is ideally suited to remove post-adaptive optics non-common path tip tilt residuals. We discuss the next steps for the concept development, including optimizations of the lens and fiber, tuning of the correction algorithm and selection of optimal science cases.


title: All You Can Embed: Natural Language based Vehicle Retrieval with Spatio-Temporal Transformers

abstract: Combining Natural Language with Vision represents a unique and interesting challenge in the domain of Artificial Intelligence. The AI City Challenge Track 5 for Natural Language-Based Vehicle Retrieval focuses on the problem of combining visual and textual information, applied to a smart-city use case. In this paper, we present All You Can Embed (AYCE), a modular solution to correlate single-vehicle tracking sequences with natural language. The main building blocks of the proposed architecture are (i) BERT to provide an embedding of the textual descriptions, (ii) a convolutional backbone along with a Transformer model to embed the visual information. For the training of the retrieval model, a variation of the Triplet Margin Loss is proposed to learn a distance measure between the visual and language embeddings. The code is publicly available at https://github.com/cscribano/AYCE_2021.


title: A Survey of Privacy Vulnerabilities of Mobile Device Sensors

abstract: The number of mobile devices, such as smartphones and smartwatches, is relentlessly increasing to almost 6.8 billion by 2022, and along with it, the amount of personal and sensitive data captured by them. This survey overviews the state of the art of what personal and sensitive user attributes can be extracted from mobile device sensors, emphasising critical aspects such as demographics, health and body features, activity and behaviour recognition, etc. In addition, we review popular metrics in the literature to quantify the degree of privacy, and discuss powerful privacy methods to protect the sensitive data while preserving data utility for analysis. Finally, open research questions a represented for further advancements in the field.


title: World-GAN: a Generative Model for Minecraft Worlds

abstract: This work introduces World-GAN, the first method to perform data-driven Procedural Content Generation via Machine Learning in Minecraft from a single example. Based on a 3D Generative Adversarial Network (GAN) architecture, we are able to create arbitrarily sized world snippets from a given sample. We evaluate our approach on creations from the community as well as structures generated with the Minecraft World Generator. Our method is motivated by the dense representations used in Natural Language Processing (NLP) introduced with word2vec [1]. The proposed block2vec representations make World-GAN independent from the number of different blocks, which can vary a lot in Minecraft, and enable the generation of larger levels. Finally, we demonstrate that changing this new representation space allows us to change the generated style of an already trained generator. World-GAN enables its users to generate Minecraft worlds based on parts of their creations.


title: Predicting Gender by First Name Using Character-level Machine Learning

abstract: Predicting gender by the first name is not a simple task. In many applications, especially in the natural language processing (NLP) field, this task may be necessary, mainly when considering foreign names. In this paper, we examined and implemented several machine learning algorithms, such as extra trees, KNN, Naive Bayes, SVM, random forest, gradient boosting, light GBM, logistic regression, ridge classifier, and deep neural network models, such as MLP, RNN, GRU, CNN, and BiLSTM, to classify gender through the first name. A dataset of Brazilian names is used to train and evaluate the models. We analyzed the accuracy, recall, precision, f1 score, and confusion matrix to measure the models' performances. The results indicate that the gender prediction can be performed from the feature extraction strategy looking at the names as a set of strings. Some models accurately predict gender in more than 95% of the cases. The recurrent models overcome the feedforward models in this binary classification problem.


title: pyWATTS: Python Workflow Automation Tool for Time Series

abstract: Time series data are fundamental for a variety of applications, ranging from financial markets to energy systems. Due to their importance, the number and complexity of tools and methods used for time series analysis is constantly increasing. However, due to unclear APIs and a lack of documentation, researchers struggle to integrate them into their research projects and replicate results. Additionally, in time series analysis there exist many repetitive tasks, which are often re-implemented for each project, unnecessarily costing time. To solve these problems we present \texttt{pyWATTS}, an open-source Python-based package that is a non-sequential workflow automation tool for the analysis of time series data. pyWATTS includes modules with clearly defined interfaces to enable seamless integration of new or existing methods, subpipelining to easily reproduce repetitive tasks, load and save functionality to simply replicate results, and native support for key Python machine learning libraries such as scikit-learn, PyTorch, and Keras.


title: Learning to Complete Code with Sketches

abstract: Code completion is usually cast as a language modelling problem, i.e., continuing an input in a left-to-right fashion. However, in practice, some parts of the completion (e.g., string literals) may be very hard to predict, whereas subsequent parts directly follow from the context. To handle this, we instead consider the scenario of generating code completions with "holes" inserted in places where a model is uncertain. We develop Grammformer, a Transformer-based model that guides code generation by the programming language grammar, and compare it to a variety of more standard sequence models. We train the models on code completion for C# and Python given partial code context. To evaluate models, we consider both ROUGE as well as a new metric RegexAcc that measures success of generating completions matching long outputs with as few holes as possible. In our experiments, Grammformer generates 10-50% more accurate completions compared to traditional generative models and 37-50% longer sketches compared to sketch-generating baselines trained with similar techniques.


title: FinGAT: Financial Graph Attention Networks for Recommending Top-K Profitable Stocks

abstract: Financial technology (FinTech) has drawn much attention among investors and companies. While conventional stock analysis in FinTech targets at predicting stock prices, less effort is made for profitable stock recommendation. Besides, in existing approaches on modeling time series of stock prices, the relationships among stocks and sectors (i.e., categories of stocks) are either neglected or pre-defined. Ignoring stock relationships will miss the information shared between stocks while using pre-defined relationships cannot depict the latent interactions or influence of stock prices between stocks. In this work, we aim at recommending the top-K profitable stocks in terms of return ratio using time series of stock prices and sector information. We propose a novel deep learning-based model, Financial Graph Attention Networks (FinGAT), to tackle the task under the setting that no pre-defined relationships between stocks are given. The idea of FinGAT is three-fold. First, we devise a hierarchical learning component to learn short-term and long-term sequential patterns from stock time series. Second, a fully-connected graph between stocks and a fully-connected graph between sectors are constructed, along with graph attention networks, to learn the latent interactions among stocks and sectors. Third, a multi-task objective is devised to jointly recommend the profitable stocks and predict the stock movement. Experiments conducted on Taiwan Stock, S&P 500, and NASDAQ datasets exhibit remarkable recommendation performance of our FinGAT, comparing to state-of-the-art methods.


title: Toward Fault Detection in Industrial Welding Processes with Deep Learning and Data Augmentation

abstract: With the rise of deep learning models in the field of computer vision, new possibilities for their application in industrial processes proves to return great benefits. Nevertheless, the actual fit of machine learning for highly standardised industrial processes is still under debate. This paper addresses the challenges on the industrial realization of the AI tools, considering the use case of Laser Beam Welding quality control as an example. We use object detection algorithms from the TensorFlow object detection API and adapt them to our use case using transfer learning. The baseline models we develop are used as benchmarks and evaluated and compared to models that undergo dataset scaling and hyperparameter tuning. We find that moderate scaling of the dataset via image augmentation leads to improvements in intersection over union (IoU) and recall, whereas high levels of augmentation and scaling may lead to deterioration of results. Finally, we put our results into perspective of the underlying use case and evaluate their fit.


title: Golos: Russian Dataset for Speech Research

abstract: This paper introduces a novel Russian speech dataset called Golos, a large corpus suitable for speech research. The dataset mainly consists of recorded audio files manually annotated on the crowd-sourcing platform. The total duration of the audio is about 1240 hours. We have made the corpus freely available to download, along with the acoustic model with CTC loss prepared on this corpus. Additionally, transfer learning was applied to improve the performance of the acoustic model. In order to evaluate the quality of the dataset with the beam-search algorithm, we have built a 3-gram language model on the open Common Crawl dataset. The total word error rate (WER) metrics turned out to be about 3.3% and 11.5%.


title: ChemiQ: A Chemistry Simulator for Quantum Computer

abstract: Quantum computing, an innovative computing system carrying prominent processing rate, is meant to be the solutions to problems in many fields. Among these realms, the most intuitive application is to help chemical researchers correctly de-scribe strong correlation and complex systems, which are the great challenge in current chemistry simulation. In this paper, we will present a standalone quantum simulation tool for chemistry, ChemiQ, which is designed to assist people carry out chemical research or molecular calculation on real or virtual quantum computers. Under the idea of modular programming in C++ language, the software is designed as a full-stack tool without third-party physics or chemistry application packages. It provides services as follow: visually construct molecular structure, quickly simulate ground-state energy, scan molecular potential energy curve by distance or angle, study chemical reaction, and return calculation results graphically after analysis.


title: Steerable Partial Differential Operators for Equivariant Neural Networks

abstract: Recent work in equivariant deep learning bears strong similarities to physics. Fields over a base space are fundamental entities in both subjects, as are equivariant maps between these fields. In deep learning, however, these maps are usually defined by convolutions with a kernel, whereas they are partial differential operators (PDOs) in physics. Developing the theory of equivariant PDOs in the context of deep learning could bring these subjects even closer together and lead to a stronger flow of ideas. In this work, we derive a $G$-steerability constraint that completely characterizes when a PDO between feature vector fields is equivariant, for arbitrary symmetry groups $G$. We then fully solve this constraint for several important groups. We use our solutions as equivariant drop-in replacements for convolutional layers and benchmark them in that role. Finally, we develop a framework for equivariant maps based on Schwartz distributions that unifies classical convolutions and differential operators and gives insight about the relation between the two.


title: Rare and Different: Anomaly Scores from a combination of likelihood and out-of-distribution models to detect new physics at the LHC

abstract: We propose a new method to define anomaly scores and apply this to particle physics collider events. Anomalies can be either rare, meaning that these events are a minority in the normal dataset, or different, meaning they have values that are not inside the dataset. We quantify these two properties using an ensemble of One-Class Deep Support Vector Data Description models, which quantifies differentness, and an autoregressive flow model, which quantifies rareness. These two parameters are then combined into a single anomaly score using different combination algorithms. We train the models using a dataset containing only simulated collisions from the Standard Model of particle physics and test it using various hypothetical signals in four different channels and a secret dataset where the signals are unknown to us. The anomaly detection method described here has been evaluated in a summary paper [1] where it performed very well compared to a large number of other methods. The method is simple to implement and is applicable to other datasets in other fields as well.


title: The Principles of Deep Learning Theory

abstract: This book develops an effective theory approach to understanding deep neural networks of practical relevance. Beginning from a first-principles component-level picture of networks, we explain how to determine an accurate description of the output of trained networks by solving layer-to-layer iteration equations and nonlinear learning dynamics. A main result is that the predictions of networks are described by nearly-Gaussian distributions, with the depth-to-width aspect ratio of the network controlling the deviations from the infinite-width Gaussian description. We explain how these effectively-deep networks learn nontrivial representations from training and more broadly analyze the mechanism of representation learning for nonlinear models. From a nearly-kernel-methods perspective, we find that the dependence of such models' predictions on the underlying learning algorithm can be expressed in a simple and universal way. To obtain these results, we develop the notion of representation group flow (RG flow) to characterize the propagation of signals through the network. By tuning networks to criticality, we give a practical solution to the exploding and vanishing gradient problem. We further explain how RG flow leads to near-universal behavior and lets us categorize networks built from different activation functions into universality classes. Altogether, we show that the depth-to-width ratio governs the effective model complexity of the ensemble of trained networks. By using information-theoretic techniques, we estimate the optimal aspect ratio at which we expect the network to be practically most useful and show how residual connections can be used to push this scale to arbitrary depths. With these tools, we can learn in detail about the inductive bias of architectures, hyperparameters, and optimizers.


title: Problem Dependent View on Structured Thresholding Bandit Problems

abstract: We investigate the problem dependent regime in the stochastic Thresholding Bandit problem (TBP) under several shape constraints. In the TBP, the objective of the learner is to output, at the end of a sequential game, the set of arms whose means are above a given threshold. The vanilla, unstructured, case is already well studied in the literature. Taking $K$ as the number of arms, we consider the case where (i) the sequence of arm's means $(\mu_k)_{k=1}^K$ is monotonically increasing (MTBP) and (ii) the case where $(\mu_k)_{k=1}^K$ is concave (CTBP). We consider both cases in the problem dependent regime and study the probability of error - i.e. the probability to mis-classify at least one arm. In the fixed budget setting, we provide upper and lower bounds for the probability of error in both the concave and monotone settings, as well as associated algorithms. In both settings the bounds match in the problem dependent regime up to universal constants in the exponential.


title: Global Three-Dimensional Simulations of Outer Protoplanetary Disks with Ambipolar Diffusion

abstract: The structure and evolution of protoplanetary disks (PPDs) are largely governed by disk angular momentum transport, mediated by magnetic fields. In the most observable outer disk, PPD gas dynamics is primarily controlled by ambipolar diffusion as the dominant non-ideal magnetohydrodynamic (MHD) effect. In this work, we study the gas dynamics in outer PPDs by conducting a set of global 3D non-ideal MHD simulations with ambipolar diffusion and net poloidal magnetic flux, using the Athena++ MHD code, with resolution comparable to local simulations. Our simulations demonstrate the co-existence of magnetized disk wind and turbulence driven by the magneto-rotational instability (MRI). While MHD wind dominates disk angular momentum transport, the MRI turbulence also contributes significantly. We observe that magnetic flux spontaneously concentrate into axisymmetric flux sheets, leading to radial variations in turbulence levels, stresses, and accretion rates. Annular substructures arise as a natural consequence of magnetic flux concentration. The flux concentration phenomena show diverse properties with different levels of disk magnetization and ambipolar diffusion. The disk generally loses magnetic flux over time, though flux sheets could prevent the leak of magnetic flux in some cases. Our results demonstrate the ubiquity of disk annular substructures in weakly MRI turbulent outer PPDs, and imply a stochastic nature of disk evolution.


title: Radio interference reduction in interstellar communications: methods and observations

abstract: The discovery of interstellar communication signals is complicated by the presence of radio interference. Consequently, interstellar communication signals are hypothesized to have properties that favor discovery in high levels of local planetary radio interference. A hypothesized type of interstellar signal, delta-t delta-f polarized pulse pairs, has properties that are similar to infrequent elements of random noise, while dissimilar from many types of known radio interference. Discovery of delta-t delta-f polarized pulse pairs is aided by the use of interference-filtered receiver systems that are designed to indicate anomalous presence of delta-t delta-f polarized pulse pairs, when pointing a radio telescope to celestial coordinates of a hypothetical transmitter. Observations reported in previous work (ref. arXiv:2105.03727) indicate an anomalous celestial pointing direction having coordinates 5.25 +- 0.15 hours Right Ascension and -7.6 +- 1 degrees Declination. Augmented interference reduction mechanisms used in the current work are described, together with reports of follow-up radio telescope beam transit measurements during 40 days. Conclusions and further work are proposed.


title: Fusion of Embeddings Networks for Robust Combination of Text Dependent and Independent Speaker Recognition

abstract: By implicitly recognizing a user based on his/her speech input, speaker identification enables many downstream applications, such as personalized system behavior and expedited shopping checkouts. Based on whether the speech content is constrained or not, both text-dependent (TD) and text-independent (TI) speaker recognition models may be used. We wish to combine the advantages of both types of models through an ensemble system to make more reliable predictions. However, any such combined approach has to be robust to incomplete inputs, i.e., when either TD or TI input is missing. As a solution we propose a fusion of embeddings network foenet architecture, combining joint learning with neural attention. We compare foenet with four competitive baseline methods on a dataset of voice assistant inputs, and show that it achieves higher accuracy than the baseline and score fusion methods, especially in the presence of incomplete inputs.


title: Unidirectional lasing in nonlinear Taiji micro-ring resonators

abstract: We develop a general formalism to study laser operation in active micro-ring resonators supporting two counterpropagating modes. Our formalism is based on the coupled-mode equations of motion for the field amplitudes in the two counterpropagating modes and a linearized analysis of the small perturbations around the steady state. We show that the devices including an additional S-shaped waveguide establishing an unidirectional coupling between both modes -- the so-called Taiji resonators (TJR) -- feature a preferred chirality on the laser emission and can ultimately lead to unidirectional lasing even in the presence of sizable backscattering. The efficiency of this mode selection process is further reinforced by the Kerr nonlinearity of the material. This stable unidirectional laser operation can be seen as an effective breaking of $\mathcal{T}$-reversal symmetry dynamically induced by the breaking of the $\mathcal{P}$-symmetry of the underlying device geometry. This mechanism appears as a promising building block to ensure non-reciprocal behaviors in integrated photonic networks and topological lasers without the need for magnetic elements.


title: Generalized Linear Randomized Response Modeling using GLMMRR

abstract: Randomized response (RR) designs are used to collect response data about sensitive behaviors (e.g., criminal behavior, sexual desires). The modeling of RR data is more complex, since it requires a description of the RR process. For the class of generalized linear mixed models (GLMMs), the RR process can be represented by an adjusted link function, which relates the expected RR to the linear predictor, for most common RR designs. The package GLMMRR includes modified link functions for four different cumulative distributions (i.e., logistic, cumulative normal, gumbel, cauchy) for GLMs and GLMMs, where the package lme4 facilitates ML and REML estimation. The mixed modeling framework in GLMMRR can be used to jointly analyse data collected under different designs (e.g., dual questioning, multilevel, mixed mode, repeated measurements designs, multiple-group designs). The well-known features of the GLM and GLMM (package lme4) software are remained, while adding new model-fit tests, residual analyses, and plot functions to give support to a profound RR data analysis. Data of H\"{o}glinger and Jann (2018) and H\"{o}glinger, Jann, and Diekmann (2014) is used to illustrate the methodology and software.


title: Full realization of ergodic IRS entropy in SL2(Z) and free groups

abstract: We show that any a-priori possible entropy value is realized by an ergodic IRS, in free groups and in SL2(Z). This is in stark contrast to what may happen in SLn(Z) for n>2, where only the trivial entropy values can be realized by ergodic IRSs.


title: Robust nonparametric hypothesis tests for differences in the covariance structure of functional data

abstract: We develop a group of robust, nonparametric hypothesis tests which detect differences between the covariance operators of several populations of functional data. These tests, called FKWC tests, are based on functional data depth ranks. These tests work well even when the data is heavy tailed, which is shown both in simulation and theoretically. These tests offer several other benefits, they have a simple distribution under the null hypothesis, they are computationally cheap and they possess transformation invariance properties. We show that under general alternative hypotheses these tests are consistent under mild, nonparametric assumptions. As a result of this work, we introduce a new functional depth function called L2-root depth which works well for the purposes of detecting differences in magnitude between covariance kernels. We present an analysis of the FKWC test using L2-root depth under local alternatives. In simulation, when the true covariance kernels have strictly positive eigenvalues, we show that these tests have higher power than their competitors, while still maintaining their nominal size. We also provide a methods for computing sample size and performing multiple comparisons.


title: Sufficient and Necessary Condition of the Lp-Brunn-Minkowski Inequality Conjecture for p\in[0,1)

abstract: The Lp-Brunn-Minkowski inequality palys a central role in the Brunn-Minkowski theory proposed by Firey [13] in 60's and developed by Lutwak [26,27] in 90's, which generalizes the classical Brunn-Minkowski inequality by Lp-sum of convex bodies. The inequality has been established by Firey for p>1 and later been conjectured by Borozky-Lutwak-Yang-Zhang [5] for p\in[0,1). (see also [23,7]) The validity of this conjecture was verified for the planar case in [5], and for the higher dimensional case when p closing to 1 by Chen-Huang-Li-Liu [7]. (see alsoo a local version by Kolesnikov-Milman [23]) In this short note, we give a simple argument clarifying the equivalence between the full conjecture and a lower bound of the third eigenvalue of the Aleksandrov's problem.


title: L\'evy measures of infinitely divisible positive processes -- examples and distributional identities

abstract: The law of a positive infinitely divisible process with no drift is characterized by its L\'evy measure on the paths space. Based on recent results of the two authors, it is shown that even for simple examples of such processes, the knowledge of their L\'evy measures allows to obtain remarkable distributional identities.


title: Self-supervised Incremental Deep Graph Learning for Ethereum Phishing Scam Detection

abstract: In recent years, phishing scams have become the crime type with the largest money involved on Ethereum, the second-largest blockchain platform. Meanwhile, graph neural network (GNN) has shown promising performance in various node classification tasks. However, for Ethereum transaction data, which could be naturally abstracted to a real-world complex graph, the scarcity of labels and the huge volume of transaction data make it difficult to take advantage of GNN methods. Here in this paper, to address the two challenges, we propose a Self-supervised Incremental deep Graph learning model (SIEGE), for the phishing scam detection problem on Ethereum. In our model, two pretext tasks designed from spatial and temporal perspectives help us effectively learn useful node embedding from the huge amount of unlabelled transaction data. And the incremental paradigm allows us to efficiently handle large-scale transaction data and help the model maintain good performance when the data distribution is drastically changing. We collect transaction records about half a year from Ethereum and our extensive experiments show that our model consistently outperforms strong baselines in both transductive and inductive settings.


title: Efficient partitioning and reordering of conforming virtual element discretizations for large scale Discrete Fracture Network flow parallel solvers

abstract: Discrete Fracture Network models are largely used for very large scale geological flow simulations. For this reason numerical methods require an investigation of tools for efficient parallel solutions on High Performance Computing systems. In this paper we discuss and compare several partitioning and reordering strategies, that result to be highly efficient and scalable, overperforming the classical mesh partitioning approach used to partition a conforming mesh among several processes.


title: Stellar dynamics in the periodic cube

abstract: We use the problem of dynamical friction within the periodic cube to illustrate the application of perturbation theory in stellar dynamics, testing its predictions against measurements from $N$-body simulation. Our development is based on the explicitly time-dependent Volterra integral equation for the cube's linear response, which avoids the subtleties encountered in analyses based on complex frequency. We obtain an expression for the self-consistent response of the cube to steady stirring by an external perturber. From this we show how to obtain the familiar Chandrasekhar dynamical friction formula and construct an elementary derivation of the Lenard--Balescu equation for the secular quasilinear evolution of an isolated cube composed of $N$ equal-mass stars. We present an alternative expression for the (real-frequency) van Kampen modes of the cube and show explicitly how to decompose any linear perturbation of the cube into a superposition of such modes.


title: M-ary Aggregate Spread Pulse Modulation in LPWANs for IoT applications

abstract: In low-power wide-area networks (LPWANs), various trade-offs among the bandwidth, data rates, and energy per bit have different effects on the quality of service under different propagation conditions (e.g. fading and multipath), interference scenarios, multi-user requirements, and design constraints. Such compromises, and the manner in which they are implemented, further affect other technical aspects, such as system's computational complexity and power efficiency. At the same time, this difference in trade-offs also adds to the technical flexibility in addressing a broader range of IoT applications. This paper addresses a physical layer LPWAN approach based on the Aggregate Spread Pulse Modulation (ASPM) and provides a brief assessment of its properties in additive white Gaussian noise (AWGN) channel. In the binary ASPM the control of the quality of service is performed through the change in the spectral efficiency, i.e., the data rate at a given bandwidth. Implementing M-ary encoding in ASPM further enables controlling service quality through changing the energy per bit (in about an order of magnitude range) as an additional trade-off parameter. Such encoding is especially useful for improving the ASPM's energy per bit performance, thus increasing its range and overall energy efficiency, and making it more attractive for use in LPWANs for IoT applications.


title: Determining when a truncated generalised Reed-Solomon code is Hermitian self-orthogonal

abstract: We prove that there is a Hermitian self-orthogonal $k$-dimensional truncated generalised Reed-Solomon code of length $n \leqslant q^2$ over ${\mathbb F}_{q^2}$ if and only if there is a polynomial $g \in {\mathbb F}_{q^2}$ of degree at most $(q-k)q-1$ such that $g+g^q$ has $q^2-n$ distinct zeros. This allows us to determine the smallest $n$ for which there is a Hermitian self-orthogonal $k$-dimensional truncated generalised Reed-Solomon code of length $n$ over ${\mathbb F}_{q^2}$, verifying a conjecture of Grassl and R\"otteler. We also provide examples of Hermitian self-orthogonal $k$-dimensional generalised Reed-Solomon codes of length $q^2+1$ over ${\mathbb F}_{q^2}$, for $k=q-1$ and $q$ an odd power of two.


title: Applications of Cosmological Perturbation Theory in the Late Universe

abstract: In this thesis, we discuss some of the applications of cosmological perturbation theory in the late universe. We begin by reviewing the tools used to understand the standard model of cosmology theoretically and to compute its observational consequences, including a detailed exposition of cosmological perturbation theory. We then describe the results in this thesis; we present novel analytical solutions for linear-order gravitational waves or tensor perturbations in a flat Friedmann-Robertson-Walker universe containing two perfect fluids -- radiation and pressureless dust -- and allowing for neutrino anisotropic stress. One of the results applies to any sub-horizon gravitational wave in such a universe. Another result applies to gravitational waves of primordial origin (for example, produced during inflation) and works both before and after they cross the horizon. These results improve on analytical approximations previously set out in the literature. Comparison with numerical solutions shows that both these approximations are accurate to within 1% or better, for a wide range of wave-numbers relevant for cosmology. We present a new and independent approach to computing the relativistic galaxy number counts to second order in cosmological perturbation theory. We also derive analytical expressions for the full second-order relativistic observed redshift, for the angular diameter distance and the volume spanned by a survey. We then compare our result with previous works which compute the general distance-redshift relation, finding that our result is in agreement at linear and leading nonlinear order. Lastly, we briefly study a class of almost scale-invariant Gauss-Bonnet modified gravity theory and derive the Einstein-like field equations to first order in cosmological perturbation theory in longitudinal gauge.


title: Cyclic Shuffle Compatibility

abstract: Consider a permutation p to be any finite list of distinct positive integers. A statistic is a function St whose domain is all permutations. Let S(p,q) be the set of shuffles of two disjoint permutations p and q. We say that St is shuffle compatible if the distribution of St over S(p,q) depends only on St(p), St(q), and the lengths of p and q. This notion is implicit in Stanley's work on P-partitions and was first explicitly studied by Gessel and Zhuang. One of the places where shuffles are useful is in describing the product in the algebra of quasisymmetric functions. Recently Adin, Gessel, Reiner, and Roichman defined an algebra of cyclic quasisymmetric functions where a cyclic version of shuffling comes into play. The purpose of this paper is to define and study cyclic shuffle compatibility. In particular, we show how one can lift shuffle compatibility results for (linear) permutations to cyclic ones. We then apply this result to cyclic descents and cyclic peaks. We also discuss the problem of finding a cyclic analogue of the major index.


title: Near-critical avalanches in 2D frozen percolation and forest fires

abstract: We study two closely related processes on the triangular lattice: frozen percolation, where connected components of occupied vertices freeze (they stop growing) as soon as they contain at least $N$ vertices, and forest fire processes, where connected components burn (they become entirely vacant) at rate $\zeta > 0$. In this paper, we prove that when the density of occupied sites approaches the critical threshold for Bernoulli percolation, both processes display a striking phenomenon: the appearance of near-critical "avalanches". More specifically, we analyze the avalanches, all the way up to the natural characteristic scale of each model, which constitutes an important step toward understanding the self-organized critical behavior of such processes. For frozen percolation, we show in particular that the number of frozen clusters surrounding a given vertex is asymptotically equivalent to $(\log(96/5))^{-1} \log \log N$ as $N \to \infty$. A similar mechanism underlies forest fires, enabling us to obtain an analogous result for these processes, but with substantially more work: the number of burnt clusters is equivalent to $(\log(96/41))^{-1} \log \log (\zeta^{-1})$ as $\zeta \searrow 0$. Moreover, almost all of these clusters have a volume $\zeta^{- 91/55 + o(1)}$. For forest fires, the percolation process with impurities introduced in arXiv:1810.08181 plays a crucial role in our proofs, and we extend the results in that paper, up to a positive density of impurities. In addition, we develop a novel exploration procedure to couple full-plane forest fires with processes in finite but large enough (compared to the characteristic scale) domains.


title: Backreaction from inhomogeneous matter fields during large-scale structure formation

abstract: We study how inhomogeneities of the cosmological fluid fields backreact on the homogeneous part of energy density and how they modify the Friedmann equations. In general, backreaction requires to go beyond the pressureless ideal fluid approximation, and this can lead to a reduced growth of cosmological large scale structure. Since observational evidence favours evolution close to the standard growing mode in the linear regime, we focus on two-component fluids in which the non-ideal fluid is gravitationally coupled to cold dark matter and in which a standard growing mode persists. This is realized, e.g. for a baryonic fluid coupled to cold dark matter. We calculate the backreaction for this case and for a wide range of other two-fluid models. Here the effect is either suppressed because the non-ideal matter properties are numerically too small, or because they lead to a too stringent UV cut-off of the integral over the power spectrum that determines backreaction. We discuss then matter field backreaction from a broader perspective and generalize the formalism such that also far-from-equilibrium scenarios relevant to late cosmological times and non-linear scales can be addressed in the future.


title: NoiseGrad: Enhancing Explanations by Introducing Stochasticity to Model Weights

abstract: Many efforts have been made for revealing the decision-making process of black-box learning machines such as deep neural networks, resulting in useful local and global explanation methods. For local explanation, stochasticity is known to help: a simple method, called SmoothGrad, has improved the visual quality of gradient-based attribution by adding noise to the input space and averaging the explanations of the noisy inputs. In this paper, we extend this idea and propose NoiseGrad that enhances both local and global explanation methods. Specifically, NoiseGrad introduces stochasticity in the weight parameter space, such that the decision boundary is perturbed. NoiseGrad is expected to enhance the local explanation, similarly to SmoothGrad, due to the dual relationship between the input perturbation and the decision boundary perturbation. We evaluate NoiseGrad and its fusion with SmoothGrad -- FusionGrad -- qualitatively and quantitatively with several evaluation criteria, and show that our novel approach significantly outperforms the baseline methods. Both NoiseGrad and FusionGrad are method-agnostic and as handy as SmoothGrad using a simple heuristic for the choice of the hyperparameter setting without the need of finetuning.


title: An analytical model for tidal evolution in co-orbital systems $\,$I. Application to exoplanets

abstract: Close-in co-orbital planets (in a 1:1 mean motion resonance) can experience strong tidal interactions with the central star. Here, we develop an analytical model adapted to the study of the tidal evolution of those systems. We use a Hamiltonian version of the constant time-lag tidal model, which extends the Hamiltonian formalism developed for the point-mass case. We show that co-orbital systems undergoing tidal dissipation either favour the Lagrange or the anti-Lagrange configurations, depending on the system parameters. However, for all range of parameters and initial conditions, both configurations become unstable, although the timescale for the destruction of the system can be larger than the lifetime of the star. We provide an easy-to-use criterion to determine if an already known close-in exoplanet may have an undetected co-orbital companion.


title: Interaction-driven dynamical quantum phase transitions in a strongly correlated bosonic system

abstract: We study dynamical quantum phase transitions (DQPTs) in the extended Bose-Hubbard model after a sudden quench of the nearest-neighbor interaction strength. Using the time-dependent density matrix renormalization group, we demonstrate that interaction-driven DQPTs can appear after quenches between two topologically trivial insulating phases -- a phenomenon that has so far only been studied between gapped and gapless phases. These DQPTs occur when the interaction strength crosses a certain threshold value that does not coincide with the equilibrium phase boundaries, which is in contrast to quenches that involve a change of topology. In order to elucidate the nonequilibrium excitations during the time evolution, we define a new set of string and parity order parameters. We find a close connection between DQPTs and these newly defined order parameters for both types of quenches. In the interaction-driven case, the order parameter exhibits a singularity at the time of the DQPT only when the quench parameter is close to the threshold value. Finally, the timescales of DQPTs are scrutinized and different kinds of power laws are revealed for the topological and interaction-driven cases.


title: Deterministic Gibbs Sampling via Ordinary Differential Equations

abstract: Deterministic dynamics is an essential part of many MCMC algorithms, e.g. Hybrid Monte Carlo or samplers utilizing normalizing flows. This paper presents a general construction of deterministic measure-preserving dynamics using autonomous ODEs and tools from differential geometry. We show how Hybrid Monte Carlo and other deterministic samplers follow as special cases of our theory. We then demonstrate the utility of our approach by constructing a continuous non-sequential version of Gibbs sampling in terms of an ODE flow and extending it to discrete state spaces. We find that our deterministic samplers are more sample efficient than stochastic counterparts, even if the latter generate independent samples.


title: Adversarial Training Helps Transfer Learning via Better Representations

abstract: Transfer learning aims to leverage models pre-trained on source data to efficiently adapt to target setting, where only limited data are available for model fine-tuning. Recent works empirically demonstrate that adversarial training in the source data can improve the ability of models to transfer to new domains. However, why this happens is not known. In this paper, we provide a theoretical model to rigorously analyze how adversarial training helps transfer learning. We show that adversarial training in the source data generates provably better representations, so fine-tuning on top of this representation leads to a more accurate predictor of the target data. We further demonstrate both theoretically and empirically that semi-supervised learning in the source data can also improve transfer learning by similarly improving the representation. Moreover, performing adversarial training on top of semi-supervised learning can further improve transferability, suggesting that the two approaches have complementary benefits on representations. We support our theories with experiments on popular data sets and deep learning architectures.


title: Experimental quantum state measurement with classical shadows

abstract: A crucial subroutine for various quantum computing and communication algorithms is to efficiently extract different classical properties of quantum states. In a notable recent theoretical work by Huang, Kueng, and Preskill [Nat. Phys. 16, 1050 (2020)], a thrifty scheme showed how to project the quantum state into classical shadows and simultaneously predict $M$ different functions of a state with only $\mathcal{O}(\log_2 M)$ measurements, independent of the system size and saturating the information-theoretical limit. Here, we experimentally explore the feasibility of the scheme in the realistic scenario with a finite number of measurements and noisy operations. We prepare a four-qubit GHZ state and show how to estimate expectation values of multiple observables and Hamiltonians. We compare the measurement strategies with uniform, biased, and derandomized classical shadows to conventional ones that sequentially measure each state function exploiting either importance sampling or observable grouping. We next demonstrate the estimation of nonlinear functions using classical shadows and analyze the entanglement of the prepared quantum state. Our experiment verifies the efficacy of exploiting (derandomized) classical shadows and sheds light on efficient quantum computing with noisy intermediate-scale quantum hardware.


title: Rational Shapley Values

abstract: Explaining the predictions of opaque machine learning algorithms is an important and challenging task, especially as complex models are increasingly used to assist in high-stakes decisions such as those arising in healthcare and finance. Most popular tools for post-hoc explainable artificial intelligence (XAI) are either insensitive to context (e.g., feature attributions) or difficult to summarize (e.g., counterfactuals). In this paper, I introduce $\textit{rational Shapley values}$, a novel XAI method that synthesizes and extends these seemingly incompatible approaches in a rigorous, flexible manner. I leverage tools from decision theory and causal modeling to formalize and implement a pragmatic approach that resolves a number of known challenges in XAI. By pairing the distribution of random variables with the appropriate reference class for a given explanation task, I illustrate through theory and experiments how user goals and knowledge can inform and constrain the solution set in an iterative fashion. The method compares favorably to state of the art XAI tools in a range of quantitative and qualitative comparisons.


title: Equilibrium Design for Concurrent Games

abstract: In game theory, mechanism design is concerned with the design of incentives so that a desired outcome of the game can be achieved. In this paper, we study the design of incentives so that a desirable equilibrium is obtained, for instance, an equilibrium satisfying a given temporal logic property -- a problem that we call equilibrium design. We base our study on a framework where system specifications are represented as temporal logic formulae, games as quantitative concurrent game structures, and players' goals as mean-payoff objectives. In particular, we consider system specifications given by LTL and GR(1) formulae, and show that implementing a mechanism to ensure that a given temporal logic property is satisfied on some/every Nash equilibrium of the game, whenever such a mechanism exists, can be done in PSPACE for LTL properties and in NP/$\Sigma^{P}_{2}$ for GR(1) specifications. We also study the complexity of various related decision and optimisation problems, such as optimality and uniqueness of solutions, and show that the complexities of all such problems lie within the polynomial hierarchy. As an application, equilibrium design can be used as an alternative solution to the rational synthesis and verification problems for concurrent games with mean-payoff objectives whenever no solution exists, or as a technique to repair, whenever possible, concurrent games with undesirable rational outcomes (Nash equilibria) in an optimal way.


title: Informing antenna design for sky-averaged 21-cm experiments using a simulated Bayesian data analysis pipeline

abstract: Global 21cm experiments aim to measure the sky averaged HI absorption signal from cosmic dawn and the epoch of reionisation. However, antenna chromaticity coupling to bright foregrounds can introduce distortions into the observational data of such experiments. We demonstrate a method for guiding the antenna design of a global experiment through data analysis simulations. This is done by performing simulated observations for a range of inserted 21cm signals, then attempting to identify the signals with a data analysis pipeline. We demonstrate this method on five antennae that were considered as potential designs for the Radio Experiment for the Analysis of Cosmic Hydrogen (REACH); a conical log spiral antenna, an inverted conical sinuous antenna and polygonal-, square- and elliptical-bladed dipoles. We find that the log spiral performs significantly better than the other antennae tested, able to correctly and confidently identify every inserted 21cm signal. In second place is the polygonal dipole antenna, which was only unable to detect signals with both very low amplitudes of 0.05K and low centre frequency of 80MHz. The conical sinuous antenna was found to perform least accurately, only able to detect the highest amplitude 21cm signals, and even then with biases. We also demonstrate that, due to the non-trivial nature of chromatic distortion and the processes of correcting for it, these are not the results that could have been expected superficially from the extent of chromatic variation in each antenna.


title: Near-maximal two-photon entanglement for quantum communications at 2.1 $\mu$m

abstract: Owing to a reduced solar background and low propagation losses in the atmosphere, the 2- to 2.5-$\mu$m waveband is a promising candidate for daylight quantum communication. This spectral region also offers low losses and low dispersion in hollow-core fibers and in silicon waveguides. We demonstrate for the first time near-maximally entangled photon pairs at 2.1 $\mu$m that could support device independent quantum key distribution (DIQKD) assuming sufficiently high channel efficiencies. The state corresponds to a positive secure-key rate (0.254 bits/pair, with a quantum bit error rate of 3.8%) based on measurements in a laboratory setting with minimal channel loss and transmission distance. This is promising for the future implementation of DIQKD at 2.1 $\mu$m.


title: Non-Iterative Phase Retrieval With Cascaded Neural Networks

abstract: Fourier phase retrieval is the problem of reconstructing a signal given only the magnitude of its Fourier transformation. Optimization-based approaches, like the well-established Gerchberg-Saxton or the hybrid input output algorithm, struggle at reconstructing images from magnitudes that are not oversampled. This motivates the application of learned methods, which allow reconstruction from non-oversampled magnitude measurements after a learning phase. In this paper, we want to push the limits of these learned methods by means of a deep neural network cascade that reconstructs the image successively on different resolutions from its non-oversampled Fourier magnitude. We evaluate our method on four different datasets (MNIST, EMNIST, Fashion-MNIST, and KMNIST) and demonstrate that it yields improved performance over other non-iterative methods and optimization-based methods.


title: Federated Robustness Propagation: Sharing Robustness in Heterogeneous Federated Learning

abstract: Federated learning (FL) emerges as a popular distributed learning schema that learns a model from a set of participating users without sharing raw data. One major challenge of FL comes with heterogeneous users, who may have distributionally different (or non-iid) data and varying computation resources. As federated users would use the model for prediction, they often demand the trained model to be robust against malicious attackers at test time. Whereas adversarial training (AT) provides a sound solution for centralized learning, extending its usage for federated users has imposed significant challenges, as many users may have very limited training data and tight computational budgets, to afford the data-hungry and costly AT. In this paper, we study a novel FL strategy: propagating adversarial robustness from rich-resource users that can afford AT, to those with poor resources that cannot afford it, during federated learning. We show that existing FL techniques cannot be effectively integrated with the strategy to propagate robustness among non-iid users and propose an efficient propagation approach by the proper use of batch-normalization. We demonstrate the rationality and effectiveness of our method through extensive experiments. Especially, the proposed method is shown to grant federated models remarkable robustness even when only a small portion of users afford AT during learning. Source code will be released.


title: A Dynamic Spatial-temporal Attention Network for Early Anticipation of Traffic Accidents

abstract: The rapid advancement of sensor technologies and artificial intelligence are creating new opportunities for traffic safety enhancement. Dashboard cameras (dashcams) have been widely deployed on both human driving vehicles and automated driving vehicles. A computational intelligence model that can accurately and promptly predict accidents from the dashcam video will enhance the preparedness for accident prevention. The spatial-temporal interaction of traffic agents is complex. Visual cues for predicting a future accident are embedded deeply in dashcam video data. Therefore, the early anticipation of traffic accidents remains a challenge. Inspired by the attention behavior of humans in visually perceiving accident risks, this paper proposes a Dynamic Spatial-Temporal Attention (DSTA) network for the early accident anticipation from dashcam videos. The DSTA-network learns to select discriminative temporal segments of a video sequence with a Dynamic Temporal Attention (DTA) module. It also learns to focus on the informative spatial regions of frames with a Dynamic Spatial Attention (DSA) module. A Gated Recurrent Unit (GRU) is trained jointly with the attention modules to predict the probability of a future accident. The evaluation of the DSTA-network on two benchmark datasets confirms that it has exceeded the state-of-the-art performance. A thorough ablation study that assesses the DSTA-network at the component level reveals how the network achieves such performance. Furthermore, this paper proposes a method to fuse the prediction scores from two complementary models and verifies its effectiveness in further boosting the performance of early accident anticipation.


title: Systematic comparison of graph embedding methods in practical tasks

abstract: Network embedding techniques aim at representing structural properties of graphs in geometric space. Those representations are considered useful in downstream tasks such as link prediction and clustering. However, the number of graph embedding methods available on the market is large, and practitioners face the non-trivial choice of selecting the proper approach for a given application. The present work attempts to close this gap of knowledge through a systematic comparison of eleven different methods for graph embedding. We consider methods for embedding networks in the hyperbolic and Euclidean metric spaces, as well as non-metric community-based embedding methods. We apply these methods to embed more than one hundred real-world and synthetic networks. Three common downstream tasks -- mapping accuracy, greedy routing, and link prediction -- are considered to evaluate the quality of the various embedding methods. Our results show that some Euclidean embedding methods excel in greedy routing. As for link prediction, community-based and hyperbolic embedding methods yield overall performance superior than that of Euclidean-space-based approaches. We compare the running time for different methods and further analyze the impact of different network characteristics such as degree distribution, modularity, and clustering coefficients on the quality of the different embedding methods. We release our evaluation framework to provide a standardized benchmark for arbitrary embedding methods.


title: BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-models

abstract: We introduce BitFit, a sparse-finetuning method where only the bias-terms of the model (or a subset of them) are being modified. We show that with small-to-medium training data, applying BitFit on pre-trained BERT models is competitive with (and sometimes better than) fine-tuning the entire model. For larger data, the method is competitive with other sparse fine-tuning methods. Besides their practical utility, these findings are relevant for the question of understanding the commonly-used process of finetuning: they support the hypothesis that finetuning is mainly about exposing knowledge induced by language-modeling training, rather than learning new task-specific linguistic knowledge.


title: Quenched universality for deformed Wigner matrices

abstract: Following E. Wigner's original vision, we prove that sampling the eigenvalue gaps within the bulk spectrum of a fixed (deformed) Wigner matrix $H$ yields the celebrated Wigner-Dyson-Mehta universal statistics with high probability. Similarly, we prove universality for a monoparametric family of deformed Wigner matrices $H+xA$ with a deterministic Hermitian matrix $A$ and a fixed Wigner matrix $H$, just using the randomness of a single scalar real random variable $x$. Both results constitute quenched versions of bulk universality that has so far only been proven in annealed sense with respect to the probability space of the matrix ensemble.


title: A time and space optimal stable population protocol solving exact majority

abstract: We study population protocols, a model of distributed computing appropriate for modeling well-mixed chemical reaction networks and other physical systems where agents exchange information in pairwise interactions, but have no control over their schedule of interaction partners. The well-studied *majority* problem is that of determining in an initial population of $n$ agents, each with one of two opinions $A$ or $B$, whether there are more $A$, more $B$, or a tie. A *stable* protocol solves this problem with probability 1 by eventually entering a configuration in which all agents agree on a correct consensus decision of $\mathsf{A}$, $\mathsf{B}$, or $\mathsf{T}$, from which the consensus cannot change. We describe a protocol that solves this problem using $O(\log n)$ states ($\log \log n + O(1)$ bits of memory) and optimal expected time $O(\log n)$. The number of states $O(\log n)$ is known to be optimal for the class of polylogarithmic time stable protocols that are "output dominant" and "monotone". These are two natural constraints satisfied by our protocol, making it simultaneously time- and state-optimal for that class. We introduce a key technique called a "fixed resolution clock" to achieve partial synchronization. Our protocol is *nonuniform*: the transition function has the value $\left \lceil {\log n} \right \rceil$ encoded in it. We show that the protocol can be modified to be uniform, while increasing the state complexity to $\Theta(\log n \log \log n)$.


title: An Investigation into Mini-Batch Rule Learning

abstract: We investigate whether it is possible to learn rule sets efficiently in a network structure with a single hidden layer using iterative refinements over mini-batches of examples. A first rudimentary version shows an acceptable performance on all but one dataset, even though it does not yet reach the performance levels of Ripper.


title: Trend estimation and short-term forecasting of COVID-19 cases and deaths worldwide

abstract: Since the beginning of the COVID-19 pandemic, many dashboards have emerged as useful tools to monitor the evolution of the pandemic, inform the public, and assist governments in decision making. Our goal is to develop a globally applicable method, integrated in a twice daily updated dashboard that provides an estimate of the trend in the evolution of the number of cases and deaths from reported data of more than 200 countries and territories, as well as a seven-day forecast. One of the significant difficulties to manage a quickly propagating epidemic is that the details of the dynamic needed to forecast its evolution are obscured by the delays in the identification of cases and deaths and by irregular reporting. Our forecasting methodology substantially relies on estimating the underlying trend in the observed time series using robust seasonal trend decomposition techniques. This allows us to obtain forecasts with simple, yet effective extrapolation methods in linear or log scale. We present the results of an assessment of our forecasting methodology and discuss its application to the production of global and regional risk maps.


title: Abrupt orthorhombic relaxation in compressively strained ultra-thin SrRuO3 films

abstract: Lattice structure can dictate electronic and magnetic properties of a material. Especially, reconstruction at a surface or heterointerface can create properties that are fundamentally different from those of the corresponding bulk material. We have investigated the lattice structure on the surface and in the thin films of epitaxial SrRuO3 with the film thickness up to 22 pseudo-cubic unit cells (u.c.), using the combination of surface sensitive low energy electron diffraction and bulk sensitive scanning transmission electron microscopy. Our analysis indicates that, in contrast to many perovskite oxides, the RuO6 tilt and rotational distortions appear even in single unit cell SrRuO3 thin films on cubic SrTiO3, while the full relaxation to the bulk-like orthorhombic structure takes 3-4 u.c. from the interface for thicker films. Yet the TiO6 octahedra of the substrate near the interface with SrRuO3 films show no sign of distortion, unlike those near the interface with CaRuO3 films. Two orthogonal in-plane rotated structural domains are identified. These structural distortions are essential for the nature of the thickness dependent transport and magnetism in ultrathin films.


title: The most accurate quantum thermoelectric

abstract: Thermodynamic Uncertainty Relations (TURs) represent a benchmark result in non-equilibrium physics that allows to place fundamental lower bounds on the noise-to-signal ratio (precision) of currents in nanoscale devices. Originally formulated for classical time-homogeneous Markov processes, these relations, were shown to be violated in thermoelectric engines and photovoltaic devices supporting quantum-coherent transport. However, the extent to which these violations may occur still represent a missing piece of the puzzle. In this work we provide such answer in a definitive way within the general Landauer-B\"uttiker formalism beyond any perturbative regime, e.g. linear response. In particular, using analytical constrained-optimization techniques, we rigorously demonstrate that the transmission function which maximizes the reliability of thermoelectric devices (i.e. which minimizes the fluctuations of its steady-state currents) for fixed average power and efficiency is a collection of boxcar functions. This allows us to show that TURs can be violated by arbitrarily large amounts, depending on the temperature and chemical potential gradients, thus providing guidelines to the design of optimal devices.


title: Position-based Dynamics Simulator of Brain Deformations for Path Planning and Intra-Operative Control in Keyhole Neurosurgery

abstract: Many tasks in robot-assisted surgery require planning and controlling manipulators' motions that interact with highly deformable objects. This study proposes a realistic, time-bounded simulator based on Position-based Dynamics (PBD) simulation that mocks brain deformations due to catheter insertion for pre-operative path planning and intra-operative guidance in keyhole surgical procedures. It maximizes the probability of success by accounting for uncertainty in deformation models, noisy sensing, and unpredictable actuation. The PBD deformation parameters were initialized on a parallelepiped-shaped simulated phantom to obtain a reasonable starting guess for the brain white matter. They were calibrated by comparing the obtained displacements with deformation data for catheter insertion in a composite hydrogel phantom. Knowing the gray matter brain structures' different behaviors, the parameters were fine-tuned to obtain a generalized human brain model. The brain structures' average displacement was compared with values in the literature. The simulator's numerical model uses a novel approach with respect to the literature, and it has proved to be a close match with real brain deformations through validation using recorded deformation data of in-vivo animal trials with a mean mismatch of 4.73$\pm$2.15%. The stability, accuracy, and real-time performance make this model suitable for creating a dynamic environment for KN path planning, pre-operative path planning, and intra-operative guidance.


title: Distributed Deep Learning in Open Collaborations

abstract: Modern deep learning applications require increasingly more compute to train state-of-the-art models. To address this demand, large corporations and institutions use dedicated High-Performance Computing clusters, whose construction and maintenance are both environmentally costly and well beyond the budget of most organizations. As a result, some research directions become the exclusive domain of a few large industrial and even fewer academic actors. To alleviate this disparity, smaller groups may pool their computational resources and run collaborative experiments that benefit all participants. This paradigm, known as grid- or volunteer computing, has seen successful applications in numerous scientific areas. However, using this approach for machine learning is difficult due to high latency, asymmetric bandwidth, and several challenges unique to volunteer computing. In this work, we carefully analyze these constraints and propose a novel algorithmic framework designed specifically for collaborative training. We demonstrate the effectiveness of our approach for SwAV and ALBERT pretraining in realistic conditions and achieve performance comparable to traditional setups at a fraction of the cost. Finally, we provide a detailed report of successful collaborative language model pretraining with 40 participants.


title: Fiber-based biphoton source with ultrabroad frequency tunability

abstract: Tunable biphotons are highly important for a wide range of quantum applications. For some applications, especially interesting are cases where two photons of a pair are far apart in frequency. Here, we report a tunable biphoton source based on a xenon-filled hollow-core photonic crystal fiber. Tunability is achieved by adjusting the pressure of the gas inside the fiber. This allows us to tailor the dispersion landscape of the fiber, overcoming the principal limitations of solid-core fiber-based biphoton sources. We report a maximum tunability of 120 THz for a pressure range of 4 bar with a continuous shift of 30 THz/bar. At 21 bar, the photons of a pair are separated by more than one octave. Despite the large separation, both photons have large bandwidths. At 17 bar, they form a very broad (110 THz) band around the frequency of the pump.