title: Primordial Black Hole Formation in Non-Standard Post-Inflationary Epochs

abstract: When large overdensities gravitationally collapse in the early universe, they lead to primordial black holes (PBH). Depending on the exact model of inflation leading to necessary large perturbations at scales much smaller than scales probed at the Cosmic Microwave Background (CMB) surveys, PBHs of masses $\lesssim$$10^3 M_{\odot}$ can be formed sometime between the end of inflation and nucleosynthesis. However, the lack of a direct probe for the exact expansion history of the universe in this duration introduces uncertainties in the PBH formation process. The presence of alternate cosmological evolution for some duration after inflation affects the relation between (i) PBH mass and the scale of the collapsing overdensity; and (ii) PBH abundance and amplitude of the overdensities. In this review, the non-standard cosmological epochs relevant for a difference in PBH production are motivated and discussed. The importance of developing the framework of PBH formation in non-standard epochs is discussed from a phenomenological point of view, with particular emphasis on the advances in gravitational wave (GW) phenomenology, since abundant PBHs are always accompanied by large induced GWs. PBH formation in general non-standard epochs is also reviewed including the mathematical formalism. Specific examples, such as PBH formation in a kinetic energy dominated epoch and an early matter dominated epoch, are discussed with figures showing higher PBH abundances as compared to the production in standard radiation domination.


title: Reproducibility of Machine Learning: Terminology, Recommendations and Open Issues

abstract: Reproducibility is one of the core dimensions that concur to deliver Trustworthy Artificial Intelligence. Broadly speaking, reproducibility can be defined as the possibility to reproduce the same or a similar experiment or method, thereby obtaining the same or similar results as the original scientists. It is an essential ingredient of the scientific method and crucial for gaining trust in relevant claims. A reproducibility crisis has been recently acknowledged by scientists and this seems to affect even more Artificial Intelligence and Machine Learning, due to the complexity of the models at the core of their recent successes. Notwithstanding the recent debate on Artificial Intelligence reproducibility, its practical implementation is still insufficient, also because many technical issues are overlooked. In this survey, we critically review the current literature on the topic and highlight the open issues. Our contribution is three-fold. We propose a concise terminological review of the terms coming into play. We collect and systematize existing recommendations for achieving reproducibility, putting forth the means to comply with them. We identify key elements often overlooked in modern Machine Learning and provide novel recommendations for them. We further specialize these for two critical application domains, namely the biomedical and physical artificial intelligence fields.


title: Language Models are Few-shot Learners for Prognostic Prediction

abstract: Clinical prediction is an essential task in the healthcare industry. However, the recent success of transformers, on which large language models are built, has not been extended to this domain. In this research, we explore the use of transformers and language models in prognostic prediction for immunotherapy using real-world patients' clinical data and molecular profiles. This paper investigates the potential of transformers to improve clinical prediction compared to conventional machine learning approaches and addresses the challenge of few-shot learning in predicting rare disease areas. The study benchmarks the efficacy of baselines and language models on prognostic prediction across multiple cancer types and investigates the impact of different pretrained language models under few-shot regimes. The results demonstrate significant improvements in accuracy and highlight the potential of NLP in clinical research to improve early detection and intervention for different diseases.


title: Wasserstein Projection Pursuit of Non-Gaussian Signals

abstract: We consider the general dimensionality reduction problem of locating in a high-dimensional data cloud, a $k$-dimensional non-Gaussian subspace of interesting features. We use a projection pursuit approach -- we search for mutually orthogonal unit directions which maximise the 2-Wasserstein distance of the empirical distribution of data-projections along these directions from a standard Gaussian. Under a generative model, where there is a underlying (unknown) low-dimensional non-Gaussian subspace, we prove rigorous statistical guarantees on the accuracy of approximating this unknown subspace by the directions found by our projection pursuit approach. Our results operate in the regime where the data dimensionality is comparable to the sample size, and thus supplement the recent literature on the non-feasibility of locating interesting directions via projection pursuit in the complementary regime where the data dimensionality is much larger than the sample size.


title: Demonstration of a 25-picosecond single-photon time resolution with gaseous photomultiplication

abstract: Photosensitive gaseous detectors with a simple photoelectron multiplication mechanism of resistive plate chambers (RPCs) are expected to have both a large photocoverage and an excellent time resolution and to be low-cost. To demonstrate the time resolution of the RPC-based photodetectors, we built a prototype detector with a LaB$_6$ photocathode. It was tested with a picosecond pulse laser and the intrinsic time resolution for single photons was measured to be $25.0 \pm 1.1$ ps at a gain of $3.3 \times 10^6$.


title: Cross-Lingual Transfer of Cognitive Processing Complexity

abstract: When humans read a text, their eye movements are influenced by the structural complexity of the input sentences. This cognitive phenomenon holds across languages and recent studies indicate that multilingual language models utilize structural similarities between languages to facilitate cross-lingual transfer. We use sentence-level eye-tracking patterns as a cognitive indicator for structural complexity and show that the multilingual model XLM-RoBERTa can successfully predict varied patterns for 13 typologically diverse languages, despite being fine-tuned only on English data. We quantify the sensitivity of the model to structural complexity and distinguish a range of complexity characteristics. Our results indicate that the model develops a meaningful bias towards sentence length but also integrates cross-lingual differences. We conduct a control experiment with randomized word order and find that the model seems to additionally capture more complex structural information.


title: A realistic coalescence model for deuteron production

abstract: A microscopic understanding of (anti)deuteron production in hadron-hadron collisions is the subject of many experimental and theoretical efforts in nuclear physics. This topic is also very relevant for astrophysics, since the rare production of antinuclei in our Universe could be a doorway to discover new physics. In this work, we describe a new coalescence afterburner for event generators based on the Wigner function formalism and we apply it to the (anti)deuteron case, taking into account a realistic particle emitting source. The model performance is validated using the EPOS and PYTHIA event generators applied to proton-proton collisions at the centre-of-mass energy $\sqrt{s}=$ 13 TeV, triggered for high multiplicity events, and the experimental data measured by ALICE in the same collision system. The model relies on the direct measurement of the particle emitting source carried out by means of nucleon-nucleon femtoscopic correlations in the same collision system and energy. The resulting model is used to predict deuteron differential spectra assuming different deuteron wavefunctions within the Wigner function formalism. The predicted deuteron spectra show a clear sensitivity to the choice of the deuteron wavefunction. The Argonne $v_{18}$ wavefunction provides the best description of the experimental data. This model can now be used to study the production of (anti)deuterons over a wide range of collision energies and be extended to heavier nuclei.


title: Adaptive weighting of Bayesian physics informed neural networks for multitask and multiscale forward and inverse problems

abstract: In this paper, we present a novel methodology for automatic adaptive weighting of Bayesian Physics-Informed Neural Networks (BPINNs), and we demonstrate that this makes it possible to robustly address multi-objective and multi-scale problems. BPINNs are a popular framework for data assimilation, combining the constraints of Uncertainty Quantification (UQ) and Partial Differential Equation (PDE). The relative weights of the BPINN target distribution terms are directly related to the inherent uncertainty in the respective learning tasks. Yet, they are usually manually set a-priori, that can lead to pathological behavior, stability concerns, and to conflicts between tasks which are obstacles that have deterred the use of BPINNs for inverse problems with multi-scale dynamics. The present weighting strategy automatically tunes the weights by considering the multi-task nature of target posterior distribution. We show that this remedies the failure modes of BPINNs and provides efficient exploration of the optimal Pareto front. This leads to better convergence and stability of BPINN training while reducing sampling bias. The determined weights moreover carry information about task uncertainties, reflecting noise levels in the data and adequacy of the PDE model. We demonstrate this in numerical experiments in Sobolev training, and compare them to analytically $\epsilon$-optimal baseline, and in a multi-scale Lokta-Volterra inverse problem. We eventually apply this framework to an inpainting task and an inverse problem, involving latent field recovery for incompressible flow in complex geometries.


title: Towards UV-Models of Kinetic Mixing and Portal Matter III: Relating Portal Matter and R-H Neutrino Masses

abstract: The kinetic mixing (KM) of a dark photon (DP) with the familiar one of the Standard Model (SM) requires the existence of a new set of fields, called portal matter (PM), which carry both SM and dark sector quantum numbers, some whose masses may lie at the TeV scale. In the vanilla KM model, the dark gauge group is just the simple $G_{Dark}=U(1)_D$ needed to describe the DP while the SM gauge interactions are described by the usual $G_{SM}=SU(3)_c\times SU(2)_L\times U(1)_Y$. However, we need to go beyond this simple model to gain a better understanding of the interplay between $G_{SM}$ and $G_{Dark}$ and, in particular, determine how they both might fit into a more unified construction. Following our previous analyses, this generally requires $G_{Dark}$ to be extended to a non-abelian group, \eg, $SU(2)_I\times U(1)_{Y_I}$, under which both the PM and SM fields may transform non-trivially. In this paper, also inspired by our earlier work on top-down models, we consider extending the SM gauge group to that of the Left-Right Symmetric Model (LRM) and, in doing so, through common vacuum expectation values, link the mass scales associated with the breaking of $G_{Dark}\to U(1)_D$ and the PM fields to that of the RH-neutrino as well as the heavy gauge bosons of the LRM. This leads to an interesting interplay between the now coupled phenomenologies of both visible and dark sectors at least some of which may be probed at, \eg, the LHC and/or at the future FCC-hh.


title: Wall-and-chamber structures for finite-dimensional algebras and $\tau$-tilting theory

abstract: The wall-and-chamber structure is a geometric invariant that can be associated to any algebra. In this notes we give the definition of this object and we explain its relationship with torsion classes and $\tau$-tilting theory.


title: Accounting for Differential Rotation in Calculations of the Sun's Angular Momentum-loss Rate

abstract: Sun-like stars shed angular momentum due to the presence of magnetised stellar winds. Magnetohydrodynamic models have been successful in exploring the dependence of this "wind-braking torque" on various stellar properties, however the influence of surface differential rotation is largely unexplored. As the wind-braking torque depends on the rotation rate of the escaping wind, the inclusion of differential rotation should effectively modulate the angular momentum-loss rate based on the latitudinal variation of wind source regions. In order to quantify the influence of surface differential rotation on the angular momentum-loss rate of the Sun, we exploit the dependence of the wind-braking torque on the effective rotation rate of the coronal magnetic field. This quantity is evaluated by tracing field lines through a Potential Field Source Surface (PFSS) model, driven by ADAPT-GONG magnetograms. The surface rotation rates of the open magnetic field lines are then used to construct an open-flux weighted rotation rate, from which the influence on the wind-braking torque can be estimated. During solar minima, the rotation rate of the corona decreases with respect to the typical solid-body rate (the Carrington rotation period is 25.4 days), as the sources of the solar wind shift towards the slowly-rotating poles. With increasing activity, more solar wind emerges from the Sun's active latitudes which enforces a Carrington-like rotation. The effect of differential rotation on the Sun's current wind-braking torque is found to be small. The wind-braking torque is ~10-15% lower during solar minimum, than assuming solid body rotation, and a few percent larger during solar maximum. For more rapidly-rotating Sun-like stars, differential rotation may play a more significant role, depending on the configuration of the large-scale magnetic field.


title: Function spaces for decoupling

abstract: We introduce new function spaces $\mathcal{H}^{p,q;s}_{\mathrm{dec}}(\mathbb{R}^{n})$ that yield a natural reformulation of the $\ell^{q}$ decoupling inequalities for the sphere and the light cone. These spaces are invariant under the Euclidean half-wave propagators, but not under all Fourier integral operators unless $p=q$, in which case they coincide with the Hardy spaces for Fourier integral operators. We use these spaces to obtain improvements of the classical fractional integration theorem, and local smoothing estimates.


title: A Chisel Framework for Flexible Design Space Exploration through a Functional Approach

abstract: As the need for efficient digital circuits is ever growing in the industry, the design of such systems remains daunting, requiring both expertise and time. In an attempt to close the gap between software development and hardware design, powerful features such as functional and object-oriented programming have been used to define new languages, known as Hardware Construction Languages. In this article, we investigate the usage of such languages - more precisely, of Chisel - in the context of Design Space Exploration, and propose a novel design methodology to build custom and adaptable design flows. We apply a functional approach to define flexible strategies for design space exploration, based on combinations of basic exploration steps, and provide a proof-of-concept framework along with a library of basic strategies. We demonstrate our methodology through several use cases, illustrating how various metrics of interest can be considered to build exploration processes - in particular, we provide a quality of service-driven exploration example. The methodology presented in this work makes use of designers' expertise to reduce the time required for hardware design, in particular for Design Space Exploration, and its application should ease digital design and enhance hardware developpers' productivity.


title: Reflexive polytopes and discrete polymatroids

abstract: A classification of discrete polymatroids whose independence polytopes are reflexive will be presented.


title: The stellar population responsible for a kiloparsec size superbubble seen in the JWST "phantom" images of NGC628

abstract: We here study the multi-band properties of a kiloparsec-size superbubble in the late-type spiral galaxy NGC628. The superbubble is the largest of many holes seen in the early release images using JWST/MIRI filters that trace the Polycyclic Aromatic Hydrocarbon (PAH) emissions. The superbubble is located in the interarm region ~3 kpc from the galactic center in the south-east direction. The shell surrounding the superbubble is detected in HI, CO, and Halpha with an expansion velocity of 12 km/s, and contains as much as 2x10^7 Msun of mass in gas that is mostly in molecular form. We find a clear excess of blue, bright stars inside the bubble as compared to the surrounding disk on the HST/ACS images. These excess blue, bright stars are part of a stellar population of 10^5 Msun mass that is formed over the last 50 Myr in different star formation episodes, as determined from an analysis of color-magnitude diagrams using a Bayesian technique. The mechanical power injected by the massive stars of these populations is sufficient to provide the energy necessary for the expansion of the shell gas. Slow and steady, rather than violent, injection of energy is probably the reason for the maintenance of the shell structure over the kiloparsec scale. The expanding shell is currently the site for triggered star formation as inferred from the JWST 21 micron (F2100W filter) and the Halpha images.


title: Designing and simulating realistic spatial frequency domain imaging systems using open-source 3D rendering software

abstract: Spatial frequency domain imaging (SFDI) is a low-cost imaging technique that can deliver real-time maps of absorption and reduced scattering coefficients. However, there are a wide range of imaging geometries that practical SFDI systems must cope with including imaging flat samples ex vivo, imaging inside tubular lumen in vivo such as in an endoscopy, and measuring tumours or polyps of varying shapes, sizes and optical properties. There is a need for a design and simulation tool to accelerate design and fabrication of new SFDI systems. We present such a system implemented using open-source 3D design and ray-tracing software Blender that is capable of simulating media with realistic optical properties (mimicking healthy and cancerous tissue), a wide variety of shapes and size, and in both planar and tubular imaging geometries. We first demonstrate quantitative agreement between Monte-Carlo simulated scattering and absorption coefficients and those measured from our Blender system. Next, we show the ability of the system to simulate absorption, scattering and shape for flat samples with small simulated tumours and show that the improved contrast associated with SFDI is reproduced. Finally, to demonstrate the versatility of the system as a design tool we show that it can be used to generate a custom look-up-table for mapping from modulation amplitude values to absorption and scattering values in a tubular geometry, simulating a lumen. As a demonstrative example we show that longitudinal sectioning of the tube, with separate look-up tables for each section, significantly improves accuracy of SFDI, representing an important design insight for future systems. We therefore anticipate our simulation system will significantly aid in the design and development of novel SFDI systems, especially as such systems are miniaturised for deployment in endoscopic and laparoscopic systems.


title: Time dependent non-Abelian waves and their stochastic regimes for gauge fields coupled to external sources

abstract: In this paper we explore explicit exact solutions of the $SU(2)$ Yang-Mills (YM) and Yang-Mill-Higgs (YMH) equations with homogeneous and inhomogeneous external sources. Whereas in the case of YM we have confirmed our analytical findings with the numerical simulations, the numerical corroborations in the YMH case yielded the stochastic character of motion for the ensuing fields.


title: Friendly thoughts on thoughtful friendliness

abstract: We discuss Wiseman, Cavalcanti and Rieffel's "thoughtful" local friendliness no-go theorem and the experimental programme they propose to test local friendliness inequalities. We argue that, to prove the theorem, the assumptions need to be strengthened to exclude the possibility of variable numbers of thoughtful agents existing in different phases of the experiment. We argue further that this possibility may arise naturally, even in one-world versions of quantum theory. We also query whether the motivations they give for their assumptions hold up well under their definition of "thoughtfulness" as displaying human-level cognitive ability, and suggest that their justification requires replacing "thoughtfulness" by "consciousness" or "conscious thoughtfulness".


title: Long-term absolute frequency stabilization of a hybrid-integrated InP-Si3N4 diode laser

abstract: Hybrid integrated diode lasers based on combining semiconductor optical amplifiers with low-loss Si3N4-based feedback circuits enable great laser performance for advanced photonic circuits. In particular, using high-Q Si3N4 ring resonators for frequency-selective feedback provides wide spectral coverage, mode-hop free tuning, and high frequency stability on short timescales, showing as ultra-narrow intrinsic linewidths. However, many applications also require long-term stability, which can be provided by locking the laser frequency to a suitable reference. We present the stabilization of a hybrid-integrated laser, which is widely tunable around the central wavelength of 1550 nm, to a fiber-based optical frequency discriminator (OFD) and to an acetylene absorption line. By locking the laser to the OFD, the laser's fractional frequency stability is improved down to 2.1$\cdot$10$^{-12}$ over an averaging time of 0.5 ms. For absolute stability over longer times of several days, we successfully lock the laser frequency to an acetylene absorption line. This limits the frequency deviations of the laser to a range of less than 12 MHz over 5 days.


title: Sleep Model -- A Sequence Model for Predicting the Next Sleep Stage

abstract: As sleep disorders are becoming more prevalent there is an urgent need to classify sleep stages in a less disturbing way.In particular, sleep-stage classification using simple sensors, such as single-channel electroencephalography (EEG), electrooculography (EOG), electromyography (EMG), or electrocardiography (ECG) has gained substantial interest. In this study, we proposed a sleep model that predicts the next sleep stage and used it to improve sleep classification accuracy. The sleep models were built using sleep-sequence data and employed either statistical $n$-gram or deep neural network-based models. We developed beam-search decoding to combine the information from the sensor and the sleep models. Furthermore, we evaluated the performance of the $n$-gram and long short-term memory (LSTM) recurrent neural network (RNN)-based sleep models and demonstrated the improvement of sleep-stage classification using an EOG sensor. The developed sleep models significantly improved the accuracy of sleep-stage classification, particularly in the absence of an EEG sensor.


title: Electrode Clustering and Bandpass Analysis of EEG Data for Gaze Estimation

abstract: In this study, we validate the findings of previously published papers, showing the feasibility of an Electroencephalography (EEG) based gaze estimation. Moreover, we extend previous research by demonstrating that with only a slight drop in model performance, we can significantly reduce the number of electrodes, indicating that a high-density, expensive EEG cap is not necessary for the purposes of EEG-based eye tracking. Using data-driven approaches, we establish which electrode clusters impact gaze estimation and how the different types of EEG data preprocessing affect the models' performance. Finally, we also inspect which recorded frequencies are most important for the defined tasks.


title: FG-SSA: Features Gradient-based Signals Selection Algorithm of Linear Complexity for Convolutional Neural Networks

abstract: Recently, many convolutional neural networks (CNNs) for classification by time domain data of multisignals have been developed. Although some signals are important for correct classification, others are not. When data that do not include important signals for classification are taken as the CNN input layer, the calculation, memory, and data collection costs increase. Therefore, identifying and eliminating nonimportant signals from the input layer are important. In this study, we proposed features gradient-based signals selection algorithm (FG-SSA), which can be used for finding and removing nonimportant signals for classification by utilizing features gradient obtained by the calculation process of grad-CAM. When we define N as the number of signals, the computational complexity of the proposed algorithm is linear time O(N), that is, it has a low calculation cost. We verified the effectiveness of the algorithm using the OPPORTUNITY Activity Recognition dataset, which is an open dataset comprising acceleration signals of human activities. In addition, we checked the average 6.55 signals from a total of 15 acceleration signals (five triaxial sensors) that were removed by FG-SSA while maintaining high generalization scores of classification. Therefore, the proposed algorithm FG-SSA has an effect on finding and removing signals that are not important for CNN-based classification.


title: Amortised Invariance Learning for Contrastive Self-Supervision

abstract: Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong inductive biases. However these may or may not be helpful, depending on if they match the invariance requirements of downstream tasks or not. This has led to several attempts to learn task-specific invariances during pre-training, however, these methods are highly compute intensive and tedious to train. We introduce the notion of amortised invariance learning for contrastive self supervision. In the pre-training stage, we parameterize the feature extractor by differentiable invariance hyper-parameters that control the invariances encoded by the representation. Then, for any downstream task, both linear readout and task-specific invariance requirements can be efficiently and effectively learned by gradient-descent. We evaluate the notion of amortised invariances for contrastive learning over two different modalities: vision and audio, on two widely-used contrastive learning methods in vision: SimCLR and MoCo-v2 with popular architectures like ResNets and Vision Transformers, and SimCLR with ResNet-18 for audio. We show that our amortised features provide a reliable way to learn diverse downstream tasks with different invariance requirements, while using a single feature and avoiding task-specific pre-training. This provides an exciting perspective that opens up new horizons in the field of general purpose representation learning.


title: A Transformer-based Deep Learning Algorithm to Auto-record Undocumented Clinical One-Lung Ventilation Events

abstract: As a team studying the predictors of complications after lung surgery, we have encountered high missingness of data on one-lung ventilation (OLV) start and end times due to high clinical workload and cognitive overload during surgery. Such missing data limit the precision and clinical applicability of our findings. We hypothesized that available intraoperative mechanical ventilation and physiological time-series data combined with other clinical events could be used to accurately predict missing start and end times of OLV. Such a predictive model can recover existing miss-documented records and relieves the documentation burden by deploying it in clinical settings. To this end, we develop a deep learning model to predict the occurrence and timing of OLV based on routinely collected intraoperative data. Our approach combines the variables' spatial and frequency domain features, using Transformer encoders to model the temporal evolution and convolutional neural network to abstract frequency-of-interest from wavelet spectrum images. The performance of the proposed method is evaluated on a benchmark dataset curated from Massachusetts General Hospital (MGH) and Brigham and Women's Hospital (BWH). Experiments show our approach outperforms baseline methods significantly and produces a satisfactory accuracy for clinical use.


title: Russel and Rao Coefficient is a Suitable Substitute for Dice Coefficient in Studying Restriction Mapped Genetic Distances of Escherichia coli

abstract: Escherichia coli is one of many bacterial inhabitants found in human intestines and any adaptation as a result of mutations may affect its host. A commonly used technique employed to study these mutations is Restriction Fragment Length Polymorphism (RFLP) and is proceeded with a suitable distance coefficient to quantify genetic differences between 2 samples. Dice is considered a suitable distance coefficient in RFLP analyses, while others were left unstudied in its suitability for use. Hence, this study aims to identify substitutes for Dice. Experimental data was obtained by subculturing E. coli for 72 passages in 8 different adaptation media and RFLP profiles analyzed using 20 distance coefficients. Our results suggest that Dennis, Fossum, Matching and Russel and Rao to work as well or better than Dice. Dennis, Matching and Fossum coefficients had highest discriminatory abilities but are limited by the lack of upper or lower boundaries. Russel and Rao coefficient is highly correlated with Dice coefficient (r2 = 0.998), with both higher and lower boundaries, suggesting that Russel and Rao coefficient can be used to substitute Dice coefficient in studying genetic distances in E. coli.


title: Hiding Data Helps: On the Benefits of Masking for Sparse Coding

abstract: Sparse coding, which refers to modeling a signal as sparse linear combinations of the elements of a learned dictionary, has proven to be a successful (and interpretable) approach in applications such as signal processing, computer vision, and medical imaging. While this success has spurred much work on provable guarantees for dictionary recovery when the learned dictionary is the same size as the ground-truth dictionary, work on the setting where the learned dictionary is larger (or over-realized) with respect to the ground truth is comparatively nascent. Existing theoretical results in this setting have been constrained to the case of noise-less data. We show in this work that, in the presence of noise, minimizing the standard dictionary learning objective can fail to recover the elements of the ground-truth dictionary in the over-realized regime, regardless of the magnitude of the signal in the data-generating process. Furthermore, drawing from the growing body of work on self-supervised learning, we propose a novel masking objective for which recovering the ground-truth dictionary is in fact optimal as the signal increases for a large class of data-generating processes. We corroborate our theoretical results with experiments across several parameter regimes showing that our proposed objective also enjoys better empirical performance than the standard reconstruction objective.


title: Supervised Hierarchical Clustering using Graph Neural Networks for Speaker Diarization

abstract: Conventional methods for speaker diarization involve windowing an audio file into short segments to extract speaker embeddings, followed by an unsupervised clustering of the embeddings. This multi-step approach generates speaker assignments for each segment. In this paper, we propose a novel Supervised HierArchical gRaph Clustering algorithm (SHARC) for speaker diarization where we introduce a hierarchical structure using Graph Neural Network (GNN) to perform supervised clustering. The supervision allows the model to update the representations and directly improve the clustering performance, thus enabling a single-step approach for diarization. In the proposed work, the input segment embeddings are treated as nodes of a graph with the edge weights corresponding to the similarity scores between the nodes. We also propose an approach to jointly update the embedding extractor and the GNN model to perform end-to-end speaker diarization (E2E-SHARC). During inference, the hierarchical clustering is performed using node densities and edge existence probabilities to merge the segments until convergence. In the diarization experiments, we illustrate that the proposed E2E-SHARC approach achieves 53% and 44% relative improvements over the baseline systems on benchmark datasets like AMI and Voxconverse, respectively.


title: Statistical Inference with Stochastic Gradient Methods under $\phi$-mixing Data

abstract: Stochastic gradient descent (SGD) is a scalable and memory-efficient optimization algorithm for large datasets and stream data, which has drawn a great deal of attention and popularity. The applications of SGD-based estimators to statistical inference such as interval estimation have also achieved great success. However, most of the related works are based on i.i.d. observations or Markov chains. When the observations come from a mixing time series, how to conduct valid statistical inference remains unexplored. As a matter of fact, the general correlation among observations imposes a challenge on interval estimation. Most existing methods may ignore this correlation and lead to invalid confidence intervals. In this paper, we propose a mini-batch SGD estimator for statistical inference when the data is $\phi$-mixing. The confidence intervals are constructed using an associated mini-batch bootstrap SGD procedure. Using ``independent block'' trick from \cite{yu1994rates}, we show that the proposed estimator is asymptotically normal, and its limiting distribution can be effectively approximated by the bootstrap procedure. The proposed method is memory-efficient and easy to implement in practice. Simulation studies on synthetic data and an application to a real-world dataset confirm our theory.


title: Understanding the Impact of Competing Events on Heterogeneous Treatment Effect Estimation from Time-to-Event Data

abstract: We study the problem of inferring heterogeneous treatment effects (HTEs) from time-to-event data in the presence of competing events. Albeit its great practical relevance, this problem has received little attention compared to its counterparts studying HTE estimation without time-to-event data or competing events. We take an outcome modeling approach to estimating HTEs, and consider how and when existing prediction models for time-to-event data can be used as plug-in estimators for potential outcomes. We then investigate whether competing events present new challenges for HTE estimation -- in addition to the standard confounding problem --, and find that, because there are multiple definitions of causal effects in this setting -- namely total, direct and separable effects --, competing events can act as an additional source of covariate shift depending on the desired treatment effect interpretation and associated estimand. We theoretically analyze and empirically illustrate when and how these challenges play a role when using generic machine learning prediction models for the estimation of HTEs.


title: LISA Galactic binaries with astrometry from Gaia DR3

abstract: Galactic compact binaries with orbital periods shorter than a few hours emit detectable gravitational waves at low frequencies. Their gravitational wave signals can be detected with the future Laser Interferometer Space Antenna (LISA). Crucially, they may be useful in the early months of the mission operation in helping to validate LISA's performance in comparison to pre-launch expectations. We present an updated list of 55 candidate LISA binaries with measured properties, for which we derive distances based on Gaia Data release 3 astrometry. Based on the known properties from electromagnetic observations, we predict the LISA detectability after 1, 3, 6, and 48 months with state-of-the-art Bayesian analysis methods. We distinguish between verification and detectable binaries as being detectable after 3 and 48 months respectively. We find 18 verification binaries and 22 detectable sources, which triples the number of known LISA binaries over the last few years. These include detached double white dwarfs, AM CVn binaries, one ultracompact X-ray binary and two hot subdwarf binaries. We find that across this sample the gravitational wave amplitude is expected to be measured to $\approx10\%$ on average, while the inclination is expected to be determined with $\approx15^\circ$ precision. For detectable binaries these average errors increase to $\approx50\%$ and to $\approx40^\circ$ respectively.


title: Surface Recognition for e-Scooter Using Smartphone IMU Sensor

abstract: In recent years, as the use of micromobility gained popularity, technological challenges connected to e-scooters became increasingly important. This paper focuses on road surface recognition, an important task in this area. A reliable and accurate method for road surface recognition can help improve the safety and stability of the vehicle. Here a data-driven method is proposed to recognize if an e-scooter is on a road or a sidewalk. The proposed method uses only the widely available inertial measurement unit (IMU) sensors on a smartphone device. deep neural networks (DNNs) are used to infer whether an e-scooteris driving on a road or on a sidewalk by solving a binary classification problem. A data set is collected and several different deep models as well as classical machine learning approaches for the binary classification problem are applied and compared. Experiment results on a route containing the two surfaces are presented demonstrating the DNNs ability to distinguish between them.


title: LightTS: Lightweight Time Series Classification with Adaptive Ensemble Distillation -- Extended Version

abstract: Due to the sweeping digitalization of processes, increasingly vast amounts of time series data are being produced. Accurate classification of such time series facilitates decision making in multiple domains. State-of-the-art classification accuracy is often achieved by ensemble learning where results are synthesized from multiple base models. This characteristic implies that ensemble learning needs substantial computing resources, preventing their use in resource-limited environments, such as in edge devices. To extend the applicability of ensemble learning, we propose the LightTS framework that compresses large ensembles into lightweight models while ensuring competitive accuracy. First, we propose adaptive ensemble distillation that assigns adaptive weights to different base models such that their varying classification capabilities contribute purposefully to the training of the lightweight model. Second, we propose means of identifying Pareto optimal settings w.r.t. model accuracy and model size, thus enabling users with a space budget to select the most accurate lightweight model. We report on experiments using 128 real-world time series sets and different types of base models that justify key decisions in the design of LightTS and provide evidence that LightTS is able to outperform competitors.


title: New Active Asteroid 2015 VA108: A Citizen Science Discovery

abstract: We announce the discovery of activity, in the form of a distinct cometary tail, emerging from main-belt asteroid 2015 VA108. Activity was first identified by volunteers of the Citizen Science project Active Asteroids (a NASA Partner). We uncovered one additional image from the same observing run which also unambiguously shows 2015 VA108 with a tail oriented between the anti-solar and anti-motion vectors that are often correlated with activity orientation on sky. Both publicly available archival images were originally acquired UT 2015 October 11 with the Dark Energy Camera (DECam) on the Blanco 4 m telescope at the Cerro Tololo Inter-American Observatory (Chile) as part of the Dark Energy Camera Legacy Survey. Activity occurred near perihelion and, combined with its residence in the main asteroid belt, 2015 VA108 is a candidate main-belt comet, an active asteroid subset known for volatile sublimation.


title: JWST Observations of the Enigmatic Y Dwarf WISE 1828+2650: I. Limits to a Binary Companion

abstract: The Y-dwarf WISE 1828+2650 is one of the coldest known Brown Dwarfs with an effective temperature of $\sim$300 K. Located at a distance of just 10 pc, previous model-based estimates suggest WISE1828+2650 has a mass of $\sim$5-10 Mj, making it a valuable laboratory for understanding the formation, evolution and physical characteristics of gas giant planets. However, previous photometry and spectroscopy have presented a puzzle with the near-impossibility of simultaneously fitting both the short (0.9-2.0 microns) and long wavelength (3-5 microns) data. A potential solution to this problem has been the suggestion that WISE 1828+2650 is a binary system whose composite spectrum might provide a better match to the data. Alternatively, new models being developed to fit JWST/NIRSpec and MIRI spectroscopy might provide new insights. This article describes JWST/NIRCam observations of WISE 1828+2650 in 6 filters to address the binarity question and to provide new photometry to be used in model fitting. We also report Adaptive Optics imaging with the Keck 10 m telescope. We find no evidence for multiplicity for a companion beyond 0.5 AU with either JWST or Keck. Companion articles will present low and high resolution spectra of WISE 1828+2650 obtained with both NIRSpec and MIRI.


title: Blowup in $L^1(\Omega)$-norm and global existence for time-fractional diffusion equations with polynomial semilinear terms

abstract: This article is concerned with semilinear time-fractional diffusion equations with polynomial nonlinearity $u^p$ in a bounded domain $\Omega$ with the homogeneous Neumann boundary condition and positive initial values. In the case of $p>1$, we prove the blowup of solutions $u(x,t)$ in the sense that $\|u(\,\cdot\,,t)\|_{L^1(\Omega)}$ tends to $\infty$ as $t$ approaches some value, by using a comparison principle for the corresponding ordinary differential equations and constructing special lower solutions. Moreover, we provide an upper bound for the blowup time. In the case of $0<p<1$, we establish the global existence of solutions in time based on the Schauder fixed-point theorem.


title: Wigner State and Process Tomography on Near-Term Quantum Devices

abstract: We present an experimental scanning-based tomography approach for near-term quantum devices. The underlying method has previously been introduced in an ensemble-based NMR setting. Here we provide a tutorial-style explanation along with suitable software tools to guide experimentalists in its adaptation to near-term pure-state quantum devices. The approach is based on a Wigner-type representation of quantum states and operators. These representations provide a rich visualization of quantum operators using shapes assembled from a linear combination of spherical harmonics. These shapes (called droplets in the following) can be experimentally tomographed by measuring the expectation values of rotated axial tensor operators. We present an experimental framework for implementing the scanning-based tomography technique for circuit-based quantum computers and showcase results from IBM quantum experience. We also present a method for estimating the density and process matrices from experimentally tomographed Wigner functions (droplets). This tomography approach can be directly implemented using the Python-based software package \texttt{DROPStomo}.


title: Conditional Relative Risk: An association measure for longitudinal data analysis

abstract: In this paper, we propose a novel association measure for longitudinal studies based on the traditional definition of relative risk. In a Markovian fashion, such a proposal takes into account the information content regarding the previous time. We derive its corresponding confidence interval by means of the Delta method having in mind the crude association between factor and event. Also, we study the properties of our uncertainty quantification scheme through an exhaustive simulation study. Our findings show that the coverage probability is quite close to the level of confidence. Finally, our proposal has a reasonable interpretation from the epidemiological as well as the statistical point of view.


title: GEAR-RT: Towards Exa-Scale Moment Based Radiative Transfer For Cosmological Simulations Using Task-Based Parallelism And Dynamic Sub-Cycling with SWIFT

abstract: The development and implementation of GEAR-RT, a radiative transfer solver using the M1 closure in the open source code SWIFT, is presented, and validated using standard tests for radiative transfer. GEAR-RT is modeled after RAMSES-RT (Rosdahl et al. 2013) with some key differences. Firstly, while RAMSES-RT uses Finite Volume methods and an Adaptive Mesh Refinement (AMR) strategy, GEAR-RT employs particles as discretization elements and solves the equations using a Finite Volume Particle Method (FVPM). Secondly, GEAR-RT makes use of the task-based parallelization strategy of SWIFT, which allows for optimized load balancing, increased cache efficiency, asynchronous communications, and a domain decomposition based on work rather than on data. GEAR-RT is able to perform sub-cycles of radiative transfer steps w.r.t. a single hydrodynamics step. Radiation requires much smaller time step sizes than hydrodynamics, and sub-cycling permits calculations which are not strictly necessary to be skipped. Indeed, in a test case with gravity, hydrodynamics, and radiative transfer, the sub-cycling is able to reduce the runtime of a simulation by over 90%. Allowing only a part of the involved physics to be sub-cycled is a contrived matter when task-based parallelism is involved, and is an entirely novel feature in SWIFT. Since GEAR-RT uses a FVPM, a detailed introduction into Finite Volume methods and Finite Volume Particle Methods is presented. In astrophysical literature, two FVPM methods are written about: Hopkins (2015) have implemented one in their GIZMO code, while the one mentioned in Ivanova et al. (2013) isn't used to date. In this work, I test an implementation of the Ivanova et al. (2013) version, and conclude that in its current form, it is not suitable for use with particles which are co-moving with the fluid, which in turn is an essential feature for cosmological simulations.


title: Statistical Principles for Platform Trials

abstract: While within a clinical study there may be multiple doses and endpoints, across different studies each study will result in either an approval or a lack of approval of the drug compound studied. The term False Approval Rate (FAR) is the term this paper utilizes to represent the proportion of drug compounds that lack efficacy incorrectly approved by regulators. (In the U.S., compounds that have efficacy and are approved are not involved in the FAR consideration, according to our reading of the relevant U.S. Congressional statute). While Tukey's (1953) Error Rate Familywise (ERFw) is meant to be applied within a clinical study, Tukey's (1953) Error Rate per Family (ERpF), defined along-side ERFw, is meant to be applied across studies. We show that controlling Error Rate Familywise (ERFw) within a clinical study at 5% in turn controls Error Rate per Family (ERpF) across studies at 5-per-100, regardless of whether the studies are correlated or not. Further, we show that ongoing regulatory practice, the additive multiplicity adjustment method of controlling ERpF, is controlling False Approval Rate (FAR) exactly (not conservatively) at 5-per-100 (even for Platform trials). In contrast, if a regulatory agency chooses to control the False Discovery Rate (FDR) across studies at 5% instead, then this change in policy from ERpF control to FDR control will result in incorrectly approving drug compounds that lack efficacy at a rate higher than 5-per-100, because in essence it gives the industry additional rewards for successfully developing compounds that have efficacy and are approved. Seems to us the discussion of such a change in policy would be at a level higher than merely statistical, needing harmonizsation/harmonization (In the U.S., policy is set by the Congress).


title: Proca Fields in Step-index Optical Fibres

abstract: The topic of a photon mass has received justified attention over the years with strong theoretical reasoning for its existence. We derive a full description of mode solutions in step-index optical fibres on the basis of Proca's equation as a model for massive photons. The no-go theorem recently found in coaxial waveguides does not appear in the optical fibre case.


title: Reservoir-based deterministic loading of single-atom tweezer arrays

abstract: State-of-the-art individual-atom tweezer platforms have relied on loading schemes based on spatially superimposing the tweezer array with a cloud of cold atoms created beforehand. Together with immanent atom loss, this dramatically limits the data rate, as the application sequence must be alternated with the time-consuming phases of magneto-optical trapping and laser cooling. We introduce a modular scheme built on an additional cold-atom reservoir and an array of buffer traps effectively decoupling cold-atom accumulation and single-atom supply from the quantum-register operation. For this purpose, we connect a microlens-based tweezer array to a cloud of laser-cooled atoms held in an auxiliary large-focus dipole trap by utilizing atom transport and buffer traps for dedicated single-atom supply. We demonstrate deterministic loading of a hexagonal target structure with atoms solely originating from the reservoir trap. The results facilitate increased data rates and unlock a path to continuous operation of individual-atom tweezer arrays in quantum science, making use of discrete functional modules, operated in parallel and spatially separated.


title: Definition and Classification of Fermi Surface Anomalies

abstract: We propose that the Fermi surface anomaly of symmetry group $G$ in any dimension is universally classified by $G$-symmetric interacting fermionic symmetry-protected topological (SPT) phases in $(0+1)$-dimensional spacetime. The argument is based on the perspective that the gapless fermions on the Fermi surface can be viewed as the topological boundary modes of Chern insulators in the phase space (position-momentum space). Given the non-commutative nature of the phase space coordinates, we show that the momentum space dimensions should be counted as negative dimensions for SPT classification purposes. Therefore, the classification of phase-space Chern insulators (or, more generally fermionic SPT phases) always reduces to a $(0+1)$-dimensional problem, which can then be answered by the cobordism approach. In addition to the codimension-1 Fermi surface case, we also discuss the codimension-$p$ Fermi surface case briefly. We provide concrete examples to demonstrate the validity of our classification scheme, and make connections to the recent development of Fermi surface symmetric mass generation.

categories: cond-mat.str-el cond-mat.quant-gas cond-mat.supr-con hep-th quant-ph


title: Superconductor-ferromagnet hybrids for non-reciprocal electronics and detectors

abstract: We review the use of hybrid thin films composed of superconductors and ferromagnets for creating non-reciprocal electronic components and self-biased detectors of electromagnetic radiation. We begin by introducing the theory behind these effects, as well as discussing various potential materials that can be used in the fabrication of these components. We then proceed with a detailed discussion on the fabrication and characterization of Al/EuS/Cu and EuS/Al/Co-based detectors, along with their noise analysis. Additionally, we suggest some approaches for multiplexing such self-biased detectors.


title: Evaluating one-loop string amplitudes

abstract: We evaluate one-loop open-string amplitudes at finite $\alpha'$ for the first time. Our method involves a deformation of the integration contour over the modular parameter $\tau$ to a fractal contour introduced by Rademacher in the context of analytic number theory. This procedure leads to explicit and practical formulas for the one-loop four-point amplitudes in type-I superstring theory, amenable to numerical evaluation. We plot the amplitudes as a function of the Mandelstam invariants $s$ and $t$ and directly verify long-standing conjectures about their behaviour at high energies.


title: Enhancing Trace Visualizations for Microservices Performance Analysis

abstract: Performance analysis of microservices can be a challenging task, as a typical request to these systems involves multiple Remote Procedure Calls (RPC) spanning across independent services and machines. Practitioners primarily rely on distributed tracing tools to closely monitor microservices performance. These tools enable practitioners to trace, collect, and visualize RPC workflows and associated events in the context of individual end-to-end requests. While effective for analyzing individual end-to-end requests, current distributed tracing visualizations often fall short in providing a comprehensive understanding of the system's overall performance. To address this limitation, we propose a novel visualization approach that enables aggregate performance analysis of multiple end-to-end requests. Our approach builds on a previously developed technique for comparing structural differences of request pairs and extends it for aggregate performance analysis of sets of requests. This paper presents our proposal and discusses our preliminary ongoing progress in developing this innovative approach.


title: Regulating Clients' Noise Adding in Federated Learning without Verification

abstract: In federated learning (FL), clients cooperatively train a global model without revealing their raw data but gradients or parameters, while the local information can still be disclosed from local outputs transmitted to the parameter server. With such privacy concerns, a client may overly add artificial noise to his local updates to compromise the global model training, and we prove the selfish noise adding leads to an infinite price of anarchy (PoA). This paper proposes a novel pricing mechanism to regulate privacy-sensitive clients without verifying their parameter updates, unlike existing privacy mechanisms that assume the server's full knowledge of added noise. Without knowing the ground truth, our mechanism reaches the social optimum to best balance the global training error and privacy loss, according to the difference between a client's updated parameter and all clients' average parameter. We also improve the FL convergence bound by refining the aggregation rule at the server to account for different clients' noise variances. Moreover, we extend our pricing scheme to fit incomplete information of clients' privacy sensitivities, ensuring their truthful type reporting and the system's ex-ante budget balance. Simulations show that our pricing scheme greatly improves the system performance especially when clients have diverse privacy sensitivities.


title: Balanced Off-Policy Evaluation for Personalized Pricing

abstract: We consider a personalized pricing problem in which we have data consisting of feature information, historical pricing decisions, and binary realized demand. The goal is to perform off-policy evaluation for a new personalized pricing policy that maps features to prices. Methods based on inverse propensity weighting (including doubly robust methods) for off-policy evaluation may perform poorly when the logging policy has little exploration or is deterministic, which is common in pricing applications. Building on the balanced policy evaluation framework of Kallus (2018), we propose a new approach tailored to pricing applications. The key idea is to compute an estimate that minimizes the worst-case mean squared error or maximizes a worst-case lower bound on policy performance, where in both cases the worst-case is taken with respect to a set of possible revenue functions. We establish theoretical convergence guarantees and empirically demonstrate the advantage of our approach using a real-world pricing dataset.


title: A Model for Nonthermal Particle Acceleration in Relativistic Magnetic Reconnection

abstract: The past decade has seen an outstanding development of nonthermal particle acceleration in magnetic reconnection in magnetically-dominated systems, with clear signatures of power-law energy distributions as a common outcome of first-principles kinetic simulations. Here we propose a semi-analytical model for systematically investigating nonthermal particle acceleration in reconnection. We show particle energy distributions are well determined by particle injection, acceleration, and escape processes. Using a series of kinetic simulations, we accurately evaluate the energy- and time-dependent model coefficients. The resulting spectral characteristics, including the spectral index and lower and upper bounds of the power-law distribution, agree well with the simulation results. Finally, we apply the model to predict the power-law indices and break energies in astrophysical reconnection systems.


title: Emulation methods and adaptive sampling increase the efficiency of sensitivity analysis for computationally expensive models

abstract: Models with high-dimensional parameter spaces are common in many applications. Global sensitivity analyses can provide insights on how uncertain inputs and interactions influence the outputs. Many sensitivity analysis methods face nontrivial challenges for computationally demanding models. Common approaches to tackle these challenges are to (i) use a computationally efficient emulator and (ii) sample adaptively. However, these approaches still involve potentially large computational costs and approximation errors. Here we compare the results and computational costs of four existing global sensitivity analysis methods applied to a test problem. We sample different model evaluation time and numbers of model parameters. We find that the emulation and adaptive sampling approaches are faster than Sobol' method for slow models. The Bayesian adaptive spline surface method is the fastest for most slow and high-dimensional models. Our results can guide the choice of a sensitivity analysis method under computational resources constraints.


title: Symplectic charges in the Yang-Mills theory of the normal conformal Cartan connection: applications to gravity

abstract: It is known that a source-free Yang-Mills theory with the normal conformal Cartan connection used as the gauge potential gives rise to equations of motion equivalent to the vanishing of the Bach tensor. We investigate the conformally invariant presymplectic potential current obtained from this theory and find that on the solutions to the Einstein field equations, it can be decomposed into a topological term derived from the Euler density and a part proportional to the potential of the standard Einstein-Hilbert Lagrangian. The pullback of our potential to the asymptotic boundary of asymptotically de Sitter spacetimes turns out to coincide with the current obtained from the holographically renormalized gravitational action. This provides an alternative derivation of a symplectic structure on scri without resorting to holographic techniques. We also calculate our current at the null infinity of asymptotically flat spacetimes and in particular show that it vanishes for variations induced by the BMS symmetries. In addition, we calculate the Noether currents and charges corresponding to gauge transformations and diffeomorphisms.


title: The characteristic rupture height of the mediating air film beneath an impacting drop on atomically smooth mica

abstract: Before a droplet can contact a surface during impact, it must first displace the air beneath it. Over a wide range of impact velocities, the air is compressed into a thin film, slowing the progress of the liquid toward the surface. Below a critical impact velocity, the air film remains intact; the droplet rebounds off of the air film without making contact. Above this critical impact velocity, the droplet always makes contact. The initiation of contact formation occurs via a topological transition, whereby the initially connected gas domain is ruptured, and a liquid capillary bridge forms, binding the droplet to the surface. Here we probe this transition in detail around the critical impact velocity using calibrated total internal reflection (TIR) microscopy to monitor the air film profile at high speed during the impact process. Two air film rupture modalities are observed: nucleated contacts, which are isolated and don't correspond to the global minimum air film thickness, and spontaneous contacts, that occur always on a ring centered upon the impact axis where the air film reaches its global minimum. Our measurements show that for impact velocities exceeding the critical velocity for contact initiation, the air film ruptures at a nearly identical height h min ~ 20 nm, for two fluids - silicone oil and a water glycerol mixture. The height and time duration of the air film prior to contact, analyzed for over 180 droplet impact experiments, are consistent with a linear instability driven by van der Waals forces. Impact events of water solution droplets show different statistics for contact nucleation than the silicon oil; nevertheless, a critical impact velocity above which contact always occurs is identified for both liquids.


title: Descent distribution on Catalan words avoiding ordered pairs of Relations

abstract: This work is a continuation of some recent articles presenting enumerative results for Catalan words avoiding one or a pair of consecutive or classical patterns of length $3$. More precisely, we provide systematically the bivariate generating function for the number of Catalan words avoiding a given pair of relations with respect to the length and the number of descents. We also present several constructive bijections preserving the number of descents. As a byproduct, we deduce the generating function for the total number of descents on all Catalan words of a given length and avoiding a pair of ordered relations.


title: Manipulating solid-state spin concentration through charge transport

abstract: Solid-state spin defects are attractive candidates for developing quantum sensors and simulators. The spin and charge degrees of freedom in large defect ensembles are a promising platform to explore complex many-body dynamics and the emergence of quantum hydrodynamics. However, many interesting properties can be revealed only upon changes in the density of defects, which instead is usually fixed in material systems. Increasing the interaction strength by creating denser defect ensembles also brings more decoherence. Ideally one would like to control the spin concentration at will, while keeping fixed decoherence effects. Here we show that by exploiting charge transport, we can take some first steps in this direction, while at the same time characterizing charge transport and its capture by defects. By exploiting the cycling process of ionization and recombination of NV centers in diamonds, we pump electrons from the valence band to the conduction band. These charges are then transported to modulate the spin concentration by changing the charge state of material defects. By developing a wide-field imaging setup integrated with a fast single photon detector array, we achieve a direct and efficient characterization of the charge redistribution process by measuring the complete spectrum of the spin bath with micrometer-scale spatial resolution. We demonstrate the concentration increase of the dominant spin defects by a factor of 2 while keeping the $T_2$ of the NV center, which also provides a potential experimental demonstration of the suppression of spin flip-flops via hyperfine interactions. Our work paves the way to studying many-body dynamics with temporally and spatially tunable interaction strengths in hybrid charge-spin systems.


title: Fast wide-field quantum sensor based on solid-state spins integrated with a SPAD array

abstract: Achieving fast, sensitive, and parallel measurement of a large number of quantum particles is an essential task in building large-scale quantum platforms for different quantum information processing applications such as sensing, computation, simulation, and communication. Current quantum platforms in experimental atomic and optical physics based on CMOS sensors and CCD cameras are limited by either low sensitivity or slow operational speed. Here we integrate an array of single-photon avalanche diodes with solid-state spin defects in diamond to build a fast wide-field quantum sensor, achieving a frame rate up to 100~kHz. We present the design of the experimental setup to perform spatially resolved imaging of quantum systems. A few exemplary applications, including sensing DC and AC magnetic fields, temperature, strain, local spin density, and charge dynamics, are experimentally demonstrated using an NV ensemble diamond sample. The developed photon detection array is broadly applicable to other platforms such as atom arrays trapped in optical tweezers, optical lattices, donors in silicon, and rare earth ions in solids.


title: Anomalous NO2 emitting ship detection with TROPOMI satellite data and machine learning

abstract: Starting from 2021, more demanding $\text{NO}_\text{x}$ emission restrictions were introduced for ships operating in the North and Baltic Sea waters. Since all methods currently used for ship compliance monitoring are financially and time demanding, it is important to prioritize the inspection of ships that have high chances of being non-compliant. The current state-of-the-art approach for a large-scale ship $\text{NO}_\text{2}$ estimation is a supervised machine learning-based segmentation of ship plumes on TROPOMI/S5P images. However, challenging data annotation and insufficiently complex ship emission proxy used for the validation limit the applicability of the model for ship compliance monitoring. In this study, we present a method for the automated selection of potentially non-compliant ships using a combination of machine learning models on TROPOMI satellite data. It is based on a proposed regression model predicting the amount of $\text{NO}_\text{2}$ that is expected to be produced by a ship with certain properties operating in the given atmospheric conditions. The model does not require manual labeling and is validated with TROPOMI data directly. The differences between the predicted and actual amount of produced $\text{NO}_\text{2}$ are integrated over observations of the ship in time and are used as a measure of the inspection worthiness of a ship. To assure the robustness of the results, we compare the obtained results with the results of the previously developed segmentation-based method. Ships that are also highly deviating in accordance with the segmentation method require further attention. If no other explanations can be found by checking the TROPOMI data, the respective ships are advised to be the candidates for inspection.


title: A Simple Single Slot Finality Protocol For Ethereum

abstract: Currently, Gasper, the implemented consensus protocol of Ethereum, takes between 64 and 95 slots to finalize blocks. Because of that, a significant portion of the chain is susceptible to reorgs. The possibility to capture MEV (Maximum Extractable Value) through such reorgs can then disincentivize honestly following the protocol, breaking the desired correspondence of honest and rational behavior. Moreover, the relatively long time to finality forces users to choose between economic security and faster transaction confirmation. This motivates the study of the so-called single slot finality protocols: consensus protocols that finalize a block in each slot and, more importantly, that finalize the block proposed at a given slot within such slot. In this work we propose a simple, non-blackbox protocol that combines a synchronous dynamically available protocol with a partially synchronous finality gadget, resulting in a consensus protocol that can finalize one block per slot, paving the way to single slot finality within Ethereum. Importantly, the protocol we present can finalize the block proposed in a slot, within such slot.


title: Spanish Built Factual Freectianary (Spanish-BFF): the first AI-generated free dictionary

abstract: Dictionaries are one of the oldest and most used linguistic resources. Building them is a complex task that, to the best of our knowledge, has yet to be explored with generative Large Language Models (LLMs). We introduce the "Spanish Built Factual Freectianary" (Spanish-BFF) as the first Spanish AI-generated dictionary. This first-of-its-kind free dictionary uses GPT-3. We also define future steps we aim to follow to improve this initial commitment to the field, such as more additional languages.


title: Hodge-Tate stacks and non-abelian $p$-adic Hodge theory of v-perfect complexes on rigid spaces

abstract: Let $X$ be a quasi-compact quasi-separated $p$-adic formal scheme that is smooth either over a perfectoid $\mathbb{Z}_p$-algebra or over some ring of integers of a $p$-adic field. We construct a fully faithful functor from perfect complexes on the Hodge-Tate stack of $X$ up to isogeny to perfect complexes on the v-site of the generic fibre of $X$. Moreover, we describe perfect complexes on the Hodge-Tate stack in terms of certain derived categories of Higgs, resp. Higgs-Sen modules. This leads to a derived $p$-adic Simpson functor.


title: Creating nonlocality using geometric phases between partially distinguishable photons

abstract: The geometric (Berry-Pancharatnam) phase originates from the intrinsic geometry of the space of quantum states and can be observed in different situations, such as a cyclic evolution of a quantum system. Here, we utilize the geometric phase to obtain a surprising insight: It is possible to create nonlocal correlations in a fixed interferometer with independent photon inputs by varying the photons' internal states.In particular, we consider a cyclic interferometer that is fixed, i.e., that has no variable internal phase shifts or subsequent measurement settings. Instead, the measurement choices of the different parties correspond to the internal states of the input photons which influence the observed correlations via a collective $N$-photon geometric phase, constituting a different approach for the generation of nonlocality with respect to the usual paradigm. We observe a trade-off between the geometric phases and the visibility of the many-photon interference, impeding the generation of nonlocality. However, by making use of the dynamical quantum Zeno effect, we show that nonlocality can be created in the fixed cyclic interferometer using 12 (or more) independent photons.


title: SurvivalGAN: Generating Time-to-Event Data for Survival Analysis

abstract: Synthetic data is becoming an increasingly promising technology, and successful applications can improve privacy, fairness, and data democratization. While there are many methods for generating synthetic tabular data, the task remains non-trivial and unexplored for specific scenarios. One such scenario is survival data. Here, the key difficulty is censoring: for some instances, we are not aware of the time of event, or if one even occurred. Imbalances in censoring and time horizons cause generative models to experience three new failure modes specific to survival analysis: (1) generating too few at-risk members; (2) generating too many at-risk members; and (3) censoring too early. We formalize these failure modes and provide three new generative metrics to quantify them. Following this, we propose SurvivalGAN, a generative model that handles survival data firstly by addressing the imbalance in the censoring and event horizons, and secondly by using a dedicated mechanism for approximating time-to-event/censoring. We evaluate this method via extensive experiments on medical datasets. SurvivalGAN outperforms multiple baselines at generating survival data, and in particular addresses the failure modes as measured by the new metrics, in addition to improving downstream performance of survival models trained on the synthetic data.


title: A Uniform Quantum Computing Model Based on Virtual Quantum Processors

abstract: Quantum Computers, one fully realized, can represent an exponential boost in computing power. However, the computational power of the current quantum computers, referred to as Noisy Internediate Scale Quantum, or NISQ, is severely limited because of environmental and intrinsic noise, as well as the very low connectivity between qubits compared to their total amount. We propose a virtual quantum processor that emulates a generic hybrid quantum machine which can serve as a logical version of quantum computing hardware. This hybrid classical quantum machine powers quantum-logical computations which are substitutable by future native quantum processors.


title: Decomposition of matrices into a sum of invertible matrices and matrices of fixed index

abstract: For any $n\ge 2$ and fixed $k\ge 1$, we give necessary and sufficient conditions for an arbitrary nonzero square matrix in the matrix ring $\mathbb{M}_n(\mathbb{F})$ to be written as a sum of an invertible matrix $U$ and a nilpotent matrix $N$ with $N^k=0$ over an arbitrary field $\mathbb{F}$.


title: A generalization of Bondy's pancyclicity theorem

abstract: The bipartite independence number of a graph $G$, denoted as $\tilde\alpha(G)$, is the minimal number $k$ such that there exist positive integers $a$ and $b$ with $a+b=k+1$ with the property that for any two sets $A,B\subseteq V(G)$ with $|A|=a$ and $|B|=b$, there is an edge between $A$ and $B$. McDiarmid and Yolov showed that if $\delta(G)\geq\tilde \alpha(G)$ then $G$ is Hamiltonian, extending the famous theorem of Dirac which states that if $\delta(G)\geq |G|/2$ then $G$ is Hamiltonian. In 1973, Bondy showed that, unless $G$ is a complete bipartite graph, Dirac's Hamiltonicity condition also implies pancyclicity, i.e., existence of cycles of all the lengths from $3$ up to $n$. In this paper we show that $\delta(G)\geq\tilde \alpha(G)$ implies that $G$ is pancyclic or that $G=K_{\frac{n}{2},\frac{n}{2}}$, thus extending the result of McDiarmid and Yolov, and generalizing the classic theorem of Bondy.


title: Thermal history of the Erg Chech 002 parent body: Early accretion and early differentiation of a small asteroid

abstract: The history of accretion and differentiation processes in the planetesimals is provided by various groups of meteorites. Sampling different parent body layers, they reveal the circumstances of the metal-silicate segregation and the internal structures of the protoplanets. The ungrouped achondrite Erg Chech 002 (EC 002) added to the suite of samples from primitive igneous crusts. Here we present models that utilize thermo-chronological data for EC 002 and fit the accretion time and size of its parent body to these data. The U-corrected Pb-Pb, Al-Mg, and Ar-Ar ages used imply a best-fit planetesimal with a radius of 20-30 km that formed at 0.1 Ma after CAIs. Its interior melted early and differentiated by 0.5 Ma, allowing core and mantle formation with a transient lower mantle magma ocean, and a melt fraction of <25 % at the meteorite layering depth. EC 002 formed from this melt at a depth of 0.8 km in a partially differentiated region covered by an undifferentiated crust. By simulating collisions with impactors of different sizes and velocities, we analyzed the minimum ejection conditions of EC 002 from its original parent body and the surface composition of the impact site. The magma ocean region distinct from the layering depth of EC 002 implyes that it was not involved in the EC 002 genesis. Our models estimate closure temperatures for the Al-Mg ages as 1060 K to 1200 K. A fast parent body cooling attributes the late Ar-Ar age to a local reheating by another, late impact.


title: Approximate Monge solutions continuously depending on the parameter

abstract: We consider Kantorovich optimal transportation problem in the case where the cost function and marginal distributions continuously depend on a parameter with values in a metric space. We prove the existence of approximate optimal Monge mappings continuous with respect to the parameter.


title: A sharp symmetric integral form of the John-Nirenberg inequality

abstract: We find sharp constants in the symmetric integral form of the John-Nirenberg inequality. The result is based upon computation of a new interesting Bellman function.


title: Light Dark Matter Search with Nitrogen-Vacancy Centers in Diamonds

abstract: We propose new ideas to directly search for light dark matter, such as the axion or the dark photon, by using magnetometry with nitrogen-vacancy centers in diamonds. If the dark matter couples to the electron spin, it affects the evolution of the Bloch vectors consisting of the spin triplet states, which may be detected through several magnetometry techniques. We give several concrete examples with the use of dc and ac magnetometry and estimate the sensitivity on dark matter couplings.

categories: hep-ph cond-mat.mes-hall hep-ex quant-ph


title: Ensemble knowledge distillation of self-supervised speech models

abstract: Distilled self-supervised models have shown competitive performance and efficiency in recent years. However, there is a lack of experience in jointly distilling multiple self-supervised speech models. In our work, we performed Ensemble Knowledge Distillation (EKD) on various self-supervised speech models such as HuBERT, RobustHuBERT, and WavLM. We tried two different aggregation techniques, layerwise-average and layerwise-concatenation, to the representations of different teacher models and found that the former was more effective. On top of that, we proposed a multiple prediction head method for student models to predict different layer outputs of multiple teacher models simultaneously. The experimental results show that our method improves the performance of the distilled models on four downstream speech processing tasks, Phoneme Recognition, Speaker Identification, Emotion Recognition, and Automatic Speech Recognition in the hidden-set track of the SUPERB benchmark.


title: Defending Against Backdoor Attacks by Layer-wise Feature Analysis

abstract: Training deep neural networks (DNNs) usually requires massive training data and computational resources. Users who cannot afford this may prefer to outsource training to a third party or resort to publicly available pre-trained models. Unfortunately, doing so facilitates a new training-time attack (i.e., backdoor attack) against DNNs. This attack aims to induce misclassification of input samples containing adversary-specified trigger patterns. In this paper, we first conduct a layer-wise feature analysis of poisoned and benign samples from the target class. We find out that the feature difference between benign and poisoned samples tends to be maximum at a critical layer, which is not always the one typically used in existing defenses, namely the layer before fully-connected layers. We also demonstrate how to locate this critical layer based on the behaviors of benign samples. We then propose a simple yet effective method to filter poisoned samples by analyzing the feature differences between suspicious and benign samples at the critical layer. We conduct extensive experiments on two benchmark datasets, which confirm the effectiveness of our defense.


title: Modularity-based approach for tracking communities in dynamic social networks

abstract: Community detection is a crucial task to unravel the intricate dynamics of online social networks. The emergence of these networks has dramatically increased the volume and speed of interactions among users, presenting researchers with unprecedented opportunities to explore and analyze the underlying structure of social communities. Despite a growing interest in tracking the evolution of groups of users in real-world social networks, the predominant focus of community detection efforts has been on communities within static networks. In this paper, we introduce a novel framework for tracking communities over time in a dynamic network, where a series of significant events is identified for each community. Our framework adopts a modularity-based strategy and does not require a predefined threshold, leading to a more accurate and robust tracking of dynamic communities. We validated the efficacy of our framework through extensive experiments on synthetic networks featuring embedded events. The results indicate that our framework can outperform the state-of-the-art methods. Furthermore, we utilized the proposed approach on a Twitter network comprising over 60,000 users and 5 million tweets throughout 2020, showcasing its potential in identifying dynamic communities in real-world scenarios. The proposed framework can be applied to different social networks and provides a valuable tool to gain deeper insights into the evolution of communities in dynamic social networks.


title: Measuring the cross section of the $^{15}$N($\alpha$,$\gamma$)$^{19}$F reaction using a single-fluid bubble chamber

abstract: $^{15}$N($\alpha$,$\gamma$)$^{19}$F is believed to be the primary means of stellar nucleosynthesis of fluorine. Here we present the use of a single-fluid bubble chamber to measure the cross section of the time-inverse photo-dissociation reaction. The method benefits from a luminosity increase of several orders of magnitude due to the use of a thicker liquid target -- when compared to thin films or gas targets -- and from the reciprocity theorem. We discuss the results of an experiment at the Thomas Jefferson National Accelerator Facility, where the cross section of the photodisintegration process $^{19}$F($\gamma$, $\alpha$)$^{15}$N was measured by bombarding a superheated fluid of C$_3$F$_8$ with bremsstrahlung $\gamma$-rays produced by impinging a 4 - 5.5 MeV electron beam on a Cu radiator. From the photodissociation yield the cross section was extracted by performing a convolution with a Monte Carlo-generated $\gamma$-ray beam spectrum. The measurement produced a cross section that was then time inverted using the reciprocity theorem. The cross section for the $^{15}$N($\alpha$,$\gamma$)$^{19}$F reaction was determined down to a value in the range of hundreds of picobarns. With further improvements of the experimental setup the technique could potentially push cross section measurements down to the single picobarn range.


title: Randomized low-rank approximation of parameter-dependent matrices

abstract: This work considers the low-rank approximation of a matrix $A(t)$ depending on a parameter $t$ in a compact set $D \subset \mathbb{R}^d$. Application areas that give rise to such problems include computational statistics and dynamical systems. Randomized algorithms are an increasingly popular approach for performing low-rank approximation and they usually proceed by multiplying the matrix with random dimension reduction matrices (DRMs). Applying such algorithms directly to $A(t)$ would involve different, independent DRMs for every $t$, which is not only expensive but also leads to inherently non-smooth approximations. In this work, we propose to use constant DRMs, that is, $A(t)$ is multiplied with the same DRM for every $t$. The resulting parameter-dependent extensions of two popular randomized algorithms, the randomized singular value decomposition and the generalized Nystr\"{o}m method, are computationally attractive, especially when $A(t)$ admits an affine linear decomposition with respect to $t$. We perform a probabilistic analysis for both algorithms, deriving bounds on the expected value as well as failure probabilities for the approximation error when using Gaussian random DRMs. Both, the theoretical results and numerical experiments, show that the use of constant DRMs does not impair their effectiveness; our methods reliably return quasi-best low-rank approximations.


title: Random sparse generators of Markovian evolution and their spectral properties

abstract: The evolution of a complex multi-state system is often interpreted as a continuous-time Markovian process. To model the relaxation dynamics of such systems, we introduce an ensemble of random sparse matrices which can be used as generators of Markovian evolution. The sparsity is controlled by a parameter $\varphi$, which is the number of non-zero elements per row and column in the generator matrix. Thus, a member of the ensemble is characterized by the Laplacian of a directed regular graph with $D$ vertices (number of system states) and $2 \varphi D$ edges with randomly distributed weights. We study the effects of sparsity on the spectrum of the generator. Sparsity is shown to close the large spectral gap that is characteristic of non-sparse random generators. We show that the first moment of the eigenvalue distribution scales as $\sim \varphi$, while its variance is $\sim \sqrt{\varphi}$. By using extreme value theory, we demonstrate how the shape of the spectral edges is determined by the tails of the corresponding weight distributions, and clarify the behavior of the spectral gap as a function of $D$. Finally, we analyze complex spacing ratio statistics of ultra-sparse generators, $\varphi = \mathrm{const}$, and find that starting already at $\varphi \geqslant 2$, spectra of the generators exhibit universal properties typical of Ginibre's Orthogonal Ensemble.


title: Gaussian elimination for flexible systems of linear inclusions

abstract: Flexible systems are linear systems of inclusions in which the elements of the coefficient matrix are external numbers in the sense of nonstandard analysis. External numbers represent real numbers with small, individual error terms. Using Gaussian elimination, a flexible system can be put into a row-echelon form with increasing error terms at the right-hand side. Then parameters are assigned to the error terms and the resulting system is solved by common methods of linear algebra. The solution set may have indeterminacy not only in terms of linear spaces, but also of modules. We determine maximal robustness for flexible systems.


title: Modulating Pretrained Diffusion Models for Multimodal Image Synthesis

abstract: We present multimodal conditioning modules (MCM) for enabling conditional image synthesis using pretrained diffusion models. Previous multimodal synthesis works rely on training networks from scratch or fine-tuning pretrained networks, both of which are computationally expensive for large, state-of-the-art diffusion models. Our method uses pretrained networks but \textit{does not require any updates to the diffusion network's parameters}. MCM is a small module trained to modulate the diffusion network's predictions during sampling using 2D modalities (e.g., semantic segmentation maps, sketches) that were unseen during the original training of the diffusion model. We show that MCM enables user control over the spatial layout of the image and leads to increased control over the image generation process. Training MCM is cheap as it does not require gradients from the original diffusion net, consists of only $\sim$1$\%$ of the number of parameters of the base diffusion model, and is trained using only a limited number of training examples. We evaluate our method on unconditional and text-conditional models to demonstrate the improved control over the generated images and their alignment with respect to the conditioning inputs.


title: Strong equivariant positivity for homogeneous varieties and back-stable coproduct coefficients

abstract: Using a transversality argument, we demonstrate the positivity of certain coefficients in the equivariant cohomology and K-theory of a generalized flag manifold. This strengthens earlier equivariant positivity theorems (of Graham and Anderson-Griffeth-Miller) by further constraining the roots which can appear in these coefficients. As an application, we deduce that structure constants for comultiplication in the equivariant K-theory of an infinite flag manifold exhibit an unusual positivity property, establishing conjectures of Lam-Lee-Shimozono. Along the way, we present alternative formulas for the back stable Grothendieck polynomials defined by those authors, as well as a new method for computing the coproduct coefficients.


title: Language-Driven Representation Learning for Robotics

abstract: Recent work in visual representation learning for robotics demonstrates the viability of learning from large video datasets of humans performing everyday tasks. Leveraging methods such as masked autoencoding and contrastive learning, these representations exhibit strong transfer to policy learning for visuomotor control. But, robot learning encompasses a diverse set of problems beyond control including grasp affordance prediction, language-conditioned imitation learning, and intent scoring for human-robot collaboration, amongst others. First, we demonstrate that existing representations yield inconsistent results across these tasks: masked autoencoding approaches pick up on low-level spatial features at the cost of high-level semantics, while contrastive learning approaches capture the opposite. We then introduce Voltron, a framework for language-driven representation learning from human videos and associated captions. Voltron trades off language-conditioned visual reconstruction to learn low-level visual patterns, and visually-grounded language generation to encode high-level semantics. We also construct a new evaluation suite spanning five distinct robot learning problems $\unicode{x2013}$ a unified platform for holistically evaluating visual representations for robotics. Through comprehensive, controlled experiments across all five problems, we find that Voltron's language-driven representations outperform the prior state-of-the-art, especially on targeted problems requiring higher-level features.


title: Evolution on Sets

abstract: We introduce the notion of evolution on sets and study several sets endowed with this structure and obtain some results about this new notion.


title: New model of non-Euclidean plane

abstract: We present a new model of a non-Euclidean plane, in which angles in a triangle sum up to $\pi$. It is a subspace of the Cartesian plane over the field of hyperreal numbers $\mathbb{R}^*$. The model enables one to represent the negation of equivalent versions of the parallel axiom, such as the existence of the circumcircle of a triangle, and Wallis' or Lagendre's axioms, as well as the difference between non-Euclidean and hyperbolic planes. The model has unique educational advantages as expounding its crucial ideas requires only the basics of Cartesian geometry and non-Archimedean fields.


title: Probabilistic maps on bistable vibration energy harvesters

abstract: This paper analyzes the impact of parametric uncertainties on the dynamics of bistable energy harvesters, focusing on obtaining statistical information about how each parameter's variability affects the energy harvesting process. To model the parametric uncertainties, we use a probability distribution derived from the maximum entropy principle, while polynomial chaos is employed to propagate uncertainty. Conditional probabilities and probability maps are obtained to investigate the effect of uncertainty on harvesting energy. We consider different models of bistable energy harvesters that account for nonlinear piezoelectric coupling and asymmetries. Our findings suggest a higher probability of increasing harvested power in the intrawell motion regime as the excitation frequency increases. In contrast, increasing the excitation amplitude and piezoelectric coupling are more likely to increase power in the chaotic and interwell motion regimes, respectively. An illustrative example is presented to emphasize the importance of investigating the influence when all parameters vary simultaneously.

categories: math.DS cs.CE nlin.CD physics.class-ph stat.AP


title: Signalling for Electricity Demand Response: When is Truth Telling Optimal?

abstract: Utilities and transmission system operators (TSO) around the world implement demand response programs for reducing electricity consumption by sending information on the state of balance between supply demand to end-use consumers. We construct a Bayesian persuasion model to analyse such demand response programs. Using a simple model consisting of two time steps for contract signing and invoking, we analyse the relation between the pricing of electricity and the incentives of the TSO to garble information about the true state of the generation. We show that if the electricity is priced at its marginal cost of production, the TSO has no incentive to lie and always tells the truth. On the other hand, we provide conditions where overpricing of electricity leads the TSO to provide no information to the consumer.


title: Hybrid functionals for periodic systems in the density functional tight-binding method

abstract: Screened range-separated hybrid (SRSH) functionals within generalized Kohn-Sham density functional theory (GKS-DFT) have been shown to restore a general $1/(r\varepsilon)$ asymptotic decay of the electrostatic interaction in dielectric environments. Major achievements of SRSH include an improved description of optical properties of solids and correct prediction of polarization-induced fundamental gap renormalization in molecular crystals. The density functional tight-binding method (DFTB) is an approximate DFT that bridges the gap between first principles methods and empirical electronic structure schemes. While purely long-range corrected RSH are already accessible within DFTB for molecular systems, this work generalizes the theoretical foundation to also include screened range-separated hybrids, with conventional pure hybrid functionals as a special case. The presented formulation and implementation is also valid for periodic boundary conditions (PBC) beyond the $\Gamma$-point. To treat periodic Fock exchange and its integrable singularity in reciprocal space, we resort to techniques successfully employed by DFT, in particular a truncated Coulomb operator and the minimum image convention. Starting from the first principles Hartree-Fock operator, we derive suitable expressions for the DFTB method, using standard integral approximations and their efficient implementation in the DFTB+ software package. Convergence behavior is investigated and demonstrated for the polyacene series as well as two- and three-dimensional materials. Benzene and pentacene molecular and crystalline systems show the correct polarization-induced gap renormalization by SRSH-DFTB at heavily reduced computational cost compared to first principles methods.


title: FLSea: Underwater Visual-Inertial and Stereo-Vision Forward-Looking Datasets

abstract: Visibility underwater is challenging, and degrades as the distance between the subject and camera increases, making vision tasks in the forward-looking direction more difficult. We have collected underwater forward-looking stereo-vision and visual-inertial image sets in the Mediterranean and Red Sea. To our knowledge there are no other public datasets in the underwater environment acquired with this camera-sensor orientation published with ground-truth. These datasets are critical for the development of several underwater applications, including obstacle avoidance, visual odometry, 3D tracking, Simultaneous Localization and Mapping (SLAM) and depth estimation. The stereo datasets include synchronized stereo images in dynamic underwater environments with objects of known-size. The visual-inertial datasets contain monocular images and IMU measurements, aligned with millisecond resolution timestamps and objects of known size which were placed in the scene. Both sensor configurations allow for scale estimation, with the calibrated baseline in the stereo setup and the IMU in the visual-inertial setup. Ground truth depth maps were created offline for both dataset types using photogrammetry. The ground truth is validated with multiple known measurements placed throughout the imaged environment. There are 5 stereo and 8 visual-inertial datasets in total, each containing thousands of images, with a range of different underwater visibility and ambient light conditions, natural and man-made structures and dynamic camera motions. The forward-looking orientation of the camera makes these datasets unique and ideal for testing underwater obstacle-avoidance algorithms and for navigation close to the seafloor in dynamic environments. With our datasets, we hope to encourage the advancement of autonomous functionality for underwater vehicles in dynamic and/or shallow water environments.


title: Towards multi-task learning of speech and speaker recognition

abstract: We study multi-task learning for two orthogonal speech technology tasks: speech and speaker recognition. We use wav2vec2 as a base architecture with two task-specific output heads. We experiment with different architectural decisions to mix speaker and speech information in the output sequence as well as different optimization strategies. Our multi-task learning networks can produce a shared speaker and speech embedding, which on first glance achieve a performance comparable to separate single-task models. However, we show that the multi-task networks have strongly degraded performance on out-of-distribution evaluation data compared to the single-task models. Code and model checkpoints are available at https://github.com/nikvaessen/disjoint-mtl