title: ALCUNA: Large Language Models Meet New Knowledge

abstract: With the rapid development of NLP, large-scale language models (LLMs) excel in various tasks across multiple domains now. However, existing benchmarks may not adequately measure these models' capabilities, especially when faced with new knowledge. In this paper, we address the lack of benchmarks to evaluate LLMs' ability to handle new knowledge, an important and challenging aspect in the rapidly evolving world. We propose an approach called KnowGen that generates new knowledge by altering existing entity attributes and relationships, resulting in artificial entities that are distinct from real-world entities. With KnowGen, we introduce a benchmark named ALCUNA to assess LLMs' abilities in knowledge understanding, differentiation, and association. We benchmark several LLMs, reveals that their performance in face of new knowledge is not satisfactory, particularly in reasoning between new and internal knowledge. We also explore the impact of entity similarity on the model's understanding of entity knowledge and the influence of contextual entities. We appeal to the need for caution when using LLMs in new scenarios or with new knowledge, and hope that our benchmarks can help drive the development of LLMs in face of new knowledge.


title: Mysticeti: Reaching the Limits of Latency with Uncertified DAGs

abstract: We introduce Mysticeti-C the first DAG-based Byzantine consensus protocol to achieve the lower bounds of latency of 3 message rounds. Since Mysticeti-C is built over DAGs it also achieves high resource efficiency and censorship resistance. Mysticeti-C achieves this latency improvement by avoiding explicit certification of the DAG blocks and by proposing a novel commit rule such that every block can be committed without delays, resulting in optimal latency in the steady state and under crash failures. We further extend Mysticeti-C to Mysticeti-FPC, which incorporates a fast commit path that achieves even lower latency for transferring assets. Unlike prior fast commit path protocols, Mysticeti-FPC minimizes the number of signatures and messages by weaving the fast path transactions into the DAG. This frees up resources, which subsequently result in better performance. We prove the safety and liveness of the protocols in a Byzantine context. We evaluate Mysticeti and compare it with state-of-the-art consensus and fast path protocols to demonstrate its low latency and resource efficiency, as well as its more graceful degradation under crash failures. Mysticeti is the first Byzantine consensus protocol to achieve WAN latency of 0.5s for consensus commit while simultaneously maintaining state-of-the-art throughput of over 100k TPS. Finally, we report on integrating Mysticeti-C as the consensus protocol into a major blockchain, resulting in 4x latency reduction.


title: pyCOFBuilder: A python package for automated creation of Covalent Organic Framework models based on the reticular approach

abstract: Covalent Organic Frameworks (COFs) have gained significant popularity in recent years due to their unique ability to provide a high surface area and customizable pore geometry and chemistry. These traits make COFs a highly promising choice for a range of applications. However, with their vast potential structures, exploring COFs experimentally can be challenging and time-consuming, yet it remains an attractive avenue for computational high-throughput studies. However, generating COF structures can be a time-consuming and challenging task. To address this challenge, here we introduce the pyCOFBuilder, an open-source Python package designed to facilitate the generation of COF structures for computational studies. The pyCOFBuilder software provides an easy-to-use set of functionalities to generate COF structures following the reticular approach. In this paper, we describe the implementation, main features, and capabilities of the pyCOFBuilder demonstrating its utility for generating COF structures with varying topologies and chemical properties. pyCOFBuilder is freely available on GitHub at https://github.com/lipelopesoliveira/pyCOFBuilder.


title: Prompt-driven Target Speech Diarization

abstract: We introduce a novel task named `target speech diarization', which seeks to determine `when target event occurred' within an audio signal. We devise a neural architecture called Prompt-driven Target Speech Diarization (PTSD), that works with diverse prompts that specify the target speech events of interest. We train and evaluate PTSD using sim2spk, sim3spk and sim4spk datasets, which are derived from the Librispeech. We show that the proposed framework accurately localizes target speech events. Furthermore, our framework exhibits versatility through its impressive performance in three diarization-related tasks: target speaker voice activity detection, overlapped speech detection and gender diarization. In particular, PTSD achieves comparable performance to specialized models across these tasks on both real and simulated data. This work serves as a reference benchmark and provides valuable insights into prompt-driven target speech processing.


title: Blazhko effect and the Petersen diagram

abstract: Pulsations in RR Lyrae stars and classical Cepheids were thought to be relatively simple since they typically pulsate only in one or two radial modes. This picture changes at a closer look when modulation or additional low-amplitude signals are detected. I will review different multi-periodic groups known among classical pulsators, including stars showing the Blazhko modulation.


title: Fixed interval scheduling problem with minimal idle time with an application to music arrangement problem

abstract: The Operational Fixed Interval Scheduling Problem aims to find an assignment of jobs to machines that maximizes the total weight of the completed jobs. We introduce a new variant of the problem where we consider the additional goal of minimizing the idle time, the total duration during which the machines are idle. The problem is expressed using quadratic unconstrained binary optimization (QUBO) formulation, taking into account soft and hard constraints required to ensure that the number of jobs running at a time point is desirably equal to the number of machines. Our choice of QUBO representation is motivated by the increasing popularity of new computational architectures such as neuromorphic processors, coherent Ising machines, and quantum and quantum-inspired digital annealers for which QUBO is a natural input. An optimization problem that can be solved using the presented QUBO formulation is the music reduction problem, the process of reducing a given music piece for a smaller number of instruments. We use two music compositions to test the QUBO formulation and compare the performance of simulated, quantum, and hybrid annealing algorithms.


title: Sharp error bounds for imbalanced classification: how many examples in the minority class?

abstract: When dealing with imbalanced classification data, reweighting the loss function is a standard procedure allowing to equilibrate between the true positive and true negative rates within the risk measure. Despite significant theoretical work in this area, existing results do not adequately address a main challenge within the imbalanced classification framework, which is the negligible size of one class in relation to the full sample size and the need to rescale the risk function by a probability tending to zero. To address this gap, we present two novel contributions in the setting where the rare class probability approaches zero: (1) a non asymptotic fast rate probability bound for constrained balanced empirical risk minimization, and (2) a consistent upper bound for balanced nearest neighbors estimates. Our findings provide a clearer understanding of the benefits of class-weighting in realistic settings, opening new avenues for further research in this field.


title: Pseudo-orthogonal Yang-Mills theories and connections to gravity

abstract: We formulate gauge theories on noncompact Lorentzian manifolds. For definiteness we choose an SO(1,4) gauge theory -- the isometry group of the five dimensional Minkowski space. We make use of the natural inner product to construct the Yang-Mills gauge action on four dimensional spacetime, on which the natural tetrad and metric are induced, thus breaking the symmetry to that of general relativity. In the low energy limit -- if a suitable gauge field condensate develops -- the theory reduces to the Cartan-Einstein gravity, which harbors nondynamical torsion, and is consistent with all observations. We also discuss how to couple our gauge theory of gravity to scalar and vector matter. The Hamiltonian analysis shows that the theory possesses no Ostrogradsky instabilities, however it harbors a kinetic instability. We conjecture that such a kinetic instability can be removed either by generalizing the theory to the nonlinear Born-Infeld theory, or by constraining the kinetic instability. This work is an attempt to formulate gravity as a unitary, renormalizable gauge theory without instabilities, in which the fundamental propagating degrees of freedom are in the spin-one tetrad connection.


title: Divisibility and primality in random walks

abstract: In this paper we study the divisibility and primality properties of the Bernoulli random walk. We improve or extend some of our divisibility results to wide classes of iid or independent non iid random walks. We also obtain new primality results for the Rademacher random walk. We study the value distribution of divisors of the random walk in the Cram\'er model, and obtain a general estimate of a similar kind to that of the Bernouilli model. Earlier results on divisors and quasi-prime numbers in the Bernoulli model are recorded, as well as some other recent for the Cram\'er random model, based on an estimate due to Selberg.


title: Characterizing how 'distributional' NLP corpora distance metrics are

abstract: A corpus of vector-embedded text documents has some empirical distribution. Given two corpora, we want to calculate a single metric of distance (e.g., Mauve, Frechet Inception) between them. We describe an abstract quality, called `distributionality', of such metrics. A non-distributional metric tends to use very local measurements, or uses global measurements in a way that does not fully reflect the distributions' true distance. For example, if individual pairwise nearest-neighbor distances are low, it may judge the two corpora to have low distance, even if their two distributions are in fact far from each other. A more distributional metric will, in contrast, better capture the distributions' overall distance. We quantify this quality by constructing a Known-Similarity Corpora set from two paraphrase corpora and calculating the distance between paired corpora from it. The distances' trend shape as set element separation increases should quantify the distributionality of the metric. We propose that Average Hausdorff Distance and energy distance between corpora are representative examples of non-distributional and distributional distance metrics, to which other metrics can be compared, to evaluate how distributional they are.


title: Optimal bounds for the Dunkl kernel in the dihedral case

abstract: We establish sharp upper and lower estimates of the Dunkl kernel in the case of dihedral groups.


title: Formation of interstellar complex organic molecules on water-rich ices triggered by atomic carbon freezing

abstract: The reactivity of interstellar carbon atoms (C) on the water-dominated ices is one of the possible ways to form interstellar complex organic molecules (iCOMs). In this work, we report a quantum chemical study of the coupling reaction of C ($^3$P) with an icy water molecule, alongside possible subsequent reactions with the most abundant closed shell frozen species (NH$_3$, CO, CO$_2$ and H$_2$), atoms (H, N and O), and molecular radicals (OH, NH$_2$ and CH$_3$). We found that C spontaneously reacts with the water molecule, resulting in the formation of $^3$C-OH$_2$, a highly reactive species due to its triplet electronic state. While reactions with the closed-shell species do not show any reactivity, reactions with N and O form CN and CO, respectively, the latter ending up into methanol upon subsequent hydrogenation. The reactions with OH, CH$_3$ and NH$_2$ form methanediol, ethanol and methanimine, respectively, upon subsequent hydrogenation. We also propose an explanation for methane formation, observed in experiments through H additions to C in the presence of ices. The astrochemical implications of this work are: i) atomic C on water ice is locked into $^3$C-OH$_2$, making difficult the reactivity of bare C atoms on the icy surfaces, contrary to what is assumed in astrochemical current models; and ii) the extraordinary reactivity of $^3$C-OH$_2$ provides new routes towards the formation of iCOMs in a non-energetic way, in particular ethanol, mother of other iCOMs once in the gas-phase.


title: Feature Spectrum Topology

abstract: Topology is a fundamental aspect of quantum physics, and it has led to key breakthroughs and results in various fields of quantum materials. In condensed matters, this has culminated in the recent discovery of symmetry-protected topological phases. However, symmetry-based topological characterizations rely heavily on symmetry analysis and are incapable of detecting the topological phases in systems where the symmetry is broken, thus missing a large portion of interesting topological physics. Here, we propose a new approach to understanding the topological nature of quantum materials, which we call feature spectrum topology. In this framework, the ground-state is separated into different partitions by the eigenspectrum of a feature, a particular chosen internal quantum degree of freedom, such as spin or pseudo-spin, and the topological properties are determined by analysis of these ground-state partitions. We show that bulk-boundary correspondence guarantees gapless spectral flows in either one of the energy or feature spectrum. Most importantly, such 'feature-energy duality' of gapless spectral flows serves as a fundamental manifestation of a topological phase, thereby paving a new way towards topological characterizations beyond symmetry considerations. Our development reveals the topological nature of a quantum ground state hidden outside symmetry-based characterizations, hence, providing a platform for a more refined search of unconventional topological materials.


title: A large deviation principle for the normalized excursion of $\alpha$-stable L\'evy processes without negative jumps

abstract: We establish a large deviation principle for the normalized excursion and bridge of an $\alpha$-stable L\'evy process without negative jumps, with $1<\alpha<2$. Based on this, we derive precise asymptotics for the tail distributions of functionals of the normalized excursion and bridge, in particular, the area and maximum functionals. We advocate the use of the Skorokhod M1 topology, rather than the more usual J1 topology, as we believe it is better suited to large deviation principles for L\'evy processes in general.


title: Vanishing sheaves and the geometric Whittaker model

abstract: Let $G$ be a connected reductive algebraic group over an algebraically closed field $k$ of characteristic $p>0$ and let $\ell$ be a prime number different from $p$. Let $U\subset G$ be a maximal unipotent subgroup, and let $T$ be a maximal torus normalizing $U$ with normalizer $N=N_G(T)$. Let $W=N/T$ be the Weyl group of $G$. Let $\mathcal{L}$ be a non-degenerate $\ell$-adic multiplicative local system on $U$. In this paper we prove that the bi-Whittaker category, namely the triangulated monoidal category of $(U,\mathcal{L})$-bi-equivariant complexes on $G$, is monoidally equivalent to an explicit thick triangulated monoidal subcategory $\mathscr{D}^\circ_W(T)\subset \mathscr{D}_W(T)$ of ''$W$-equivariant central sheaves'' on the torus, answering a question raised by Drinfeld. In particular, the bi-Whittaker category has the structure of a symmetric monoidal category. We also study a certain thick triangulated monoidal subcategory $\mathscr{D}^\circ_G(G)\subset \mathscr{D}_G(G)$ of ''vanishing sheaves'' and prove that it is braided monoidally equivalent to an explicit thick triangulated monoidal subcategory $\mathscr{D}^\circ_N(T)\subset \mathscr{D}_N(T)$ of ''$N$-equivariant central sheaves'' on the torus. The above equivalence is given by an enhancement of the parabolic restriction functor restricted to the subcategory $\mathscr{D}^\circ_G(G)$.


title: Multiple exciton generation in VO2

abstract: Multiple exciton generation (MEG) is a widely studied phenomenon in semiconductor nanocrystals and quantum dots, aimed at improving the energy conversion efficiency of solar cells. MEG is the process wherein incident photon energy is significantly larger than the band gap, and the resulting photoexcited carriers relax by generating additional electron-hole pairs, rather than decaying by heat dissipation. Here, we present an experimental demonstration of MEG in a prototype strongly correlated material, VO2, through photocurrent spectroscopy and ultrafast transient reflectivity measurements, both of which are considered the most prominent ways for detecting MEG in working devices. The key result of this paper is the observation of MEG at room temperature (in a correlated insulating phase of VO2), and the estimated threshold for MEG is 3Eg. We demonstrate an escalated photocurrent due to MEG in VO2, and quantum efficiency is found to exceed 100%. Our studies suggest that this phenomenon is a manifestation of expeditious impact ionization due to stronger electron correlations and could be exploited in a large number of strongly correlated materials.


title: The role of intra- and inter-group Matthew effect in the social dilemma of public goods games

abstract: The Matthew effect describes the phenomenon where the rich tend to get richer. Such a success-driven mechanism has been studied in spatial public goods games in an inter-group way, where each individual's social power is enhanced across all groups. For instance, factors like knowledge can exert an advantage across various social contexts. In contrast, certain factors, especially local material goods, only enhance advantages within their current group. Building on this, we further explore the intra-group Matthew effect where the enhancement of social power is calculated separately in each group. Our findings indicate that the intra-group Matthew effect sustains cooperation more at high productivity, while the inter-group Matthew effect promotes cooperation at low productivity. Moreover, the mixture of the intra- and inter-group Matthew effect harms cooperation. This study provides insights into addressing social dilemmas by adjusting wealth accumulation across diverse social groups.

categories: physics.soc-ph cond-mat.stat-mech cs.GT nlin.CG


title: Harnessing Attention Mechanisms: Efficient Sequence Reduction using Attention-based Autoencoders

abstract: Many machine learning models use the manipulation of dimensions as a driving force to enable models to identify and learn important features in data. In the case of sequential data this manipulation usually happens on the token dimension level. Despite the fact that many tasks require a change in sequence length itself, the step of sequence length reduction usually happens out of necessity and in a single step. As far as we are aware, no model uses the sequence length reduction step as an additional opportunity to tune the models performance. In fact, sequence length manipulation as a whole seems to be an overlooked direction. In this study we introduce a novel attention-based method that allows for the direct manipulation of sequence lengths. To explore the method's capabilities, we employ it in an autoencoder model. The autoencoder reduces the input sequence to a smaller sequence in latent space. It then aims to reproduce the original sequence from this reduced form. In this setting, we explore the methods reduction performance for different input and latent sequence lengths. We are able to show that the autoencoder retains all the significant information when reducing the original sequence to half its original size. When reducing down to as low as a quarter of its original size, the autoencoder is still able to reproduce the original sequence with an accuracy of around 90%.


title: Calibration of Time-Series Forecasting: Detecting and Adapting Context-Driven Distribution Shift

abstract: Recent years have witnessed the success of introducing deep learning models to time series forecasting. From a data generation perspective, we illustrate that existing models are susceptible to distribution shifts driven by temporal contexts, whether observed or unobserved. Such context-driven distribution shift (CDS) introduces biases in predictions within specific contexts and poses challenges for conventional training paradigms. In this paper, we introduce a universal calibration methodology for the detection and adaptation of CDS with a trained model. To this end, we propose a novel CDS detector, termed the "residual-based CDS detector" or "Reconditionor", which quantifies the model's vulnerability to CDS by evaluating the mutual information between prediction residuals and their corresponding contexts. A high Reconditionor score indicates a severe susceptibility, thereby necessitating model adaptation. In this circumstance, we put forth a straightforward yet potent adapter framework for model calibration, termed the "sample-level contextualized adapter" or "SOLID". This framework involves the curation of a contextually similar dataset to the provided test sample and the subsequent fine-tuning of the model's prediction layer with a limited number of steps. Our theoretical analysis demonstrates that this adaptation strategy can achieve an optimal bias-variance trade-off. Notably, our proposed Reconditionor and SOLID are model-agnostic and readily adaptable to a wide range of models. Extensive experiments show that SOLID consistently enhances the performance of current forecasting models on real-world datasets, especially on cases with substantial CDS detected by the proposed Reconditionor, thus validating the effectiveness of the calibration approach.


title: ESVAE: An Efficient Spiking Variational Autoencoder with Reparameterizable Poisson Spiking Sampling

abstract: In recent years, studies on image generation models of spiking neural networks (SNNs) have gained the attention of many researchers. Variational autoencoders (VAEs), as one of the most popular image generation models, have attracted a lot of work exploring their SNN implementation. Due to the constrained binary representation in SNNs, existing SNN VAE methods implicitly construct the latent space by an elaborated autoregressive network and use the network outputs as the sampling variables. However, this unspecified implicit representation of the latent space will increase the difficulty of generating high-quality images and introduces additional network parameters. In this paper, we propose an efficient spiking variational autoencoder (ESVAE) that constructs an interpretable latent space distribution and design a reparameterizable spiking sampling method. Specifically, we construct the prior and posterior of the latent space as a Poisson distribution using the firing rate of the spiking neurons. Subsequently, we propose a reparameterizable Poisson spiking sampling method, which is free from the additional network. Comprehensive experiments have been conducted, and the experimental results show that the proposed ESVAE outperforms previous SNN VAE methods in reconstructed & generated images quality. In addition, experiments demonstrate that ESVAE's encoder is able to retain the original image information more efficiently, and the decoder is more robust. The source code is available at https://github.com/QgZhan/ESVAE.


title: Transparency at the Source: Evaluating and Interpreting Language Models With Access to the True Distribution

abstract: We present a setup for training, evaluating and interpreting neural language models, that uses artificial, language-like data. The data is generated using a massive probabilistic grammar (based on state-split PCFGs), that is itself derived from a large natural language corpus, but also provides us complete control over the generative process. We describe and release both grammar and corpus, and test for the naturalness of our generated data. This approach allows us to define closed-form expressions to efficiently compute exact lower bounds on obtainable perplexity using both causal and masked language modelling. Our results show striking differences between neural language modelling architectures and training objectives in how closely they allow approximating the lower bound on perplexity. Our approach also allows us to directly compare learned representations to symbolic rules in the underlying source. We experiment with various techniques for interpreting model behaviour and learning dynamics. With access to the underlying true source, our results show striking differences and outcomes in learning dynamics between different classes of words.


title: Exploring the circumstellar environment of Tycho's supernova remnant--I. The hydrodynamic evolution of the shock

abstract: Among Type Ia supernova remnants (SNRs), Tycho's SNR has been considered as a typical object from the viewpoints of its spectroscopic, morphological and environmental properties. A recent reanalysis of Chandra data shows that its forward shock is experiencing a substantial deceleration since around 2007, which suggests recent shock interactions with a dense medium as a consequence of the cavity-wall environment inside a molecular cloud. Such a non-uniform environment can be linked back to the nature and activities of its progenitor. In this study, we perform hydrodynamic simulations to characterize Tycho's cavity-wall environment using the latest multi-epoch proper motion measurements of the forward shock. A range of parameters for the environment is explored in the hydrodynamic models to fit with the observation data for each azimuthal region. Our results show that a wind-like cavity with $\rho(r)\propto r^{-2}$ reconciles with the latest data better than a uniform medium with a constant density. In addition, our best-fit model favors an anisotropic wind with an azimuthally varying wind parameter. The overall result indicates a mass-loss rate which is unusually high for the conventional single-degenerate explosion scenario.


title: Joint Non-Linear MRI Inversion with Diffusion Priors

abstract: Magnetic resonance imaging (MRI) is a potent diagnostic tool, but suffers from long examination times. To accelerate the process, modern MRI machines typically utilize multiple coils that acquire sub-sampled data in parallel. Data-driven reconstruction approaches, in particular diffusion models, recently achieved remarkable success in reconstructing these data, but typically rely on estimating the coil sensitivities in an off-line step. This suffers from potential movement and misalignment artifacts and limits the application to Cartesian sampling trajectories. To obviate the need for off-line sensitivity estimation, we propose to jointly estimate the sensitivity maps with the image. In particular, we utilize a diffusion model -- trained on magnitude images only -- to generate high-fidelity images while imposing spatial smoothness of the sensitivity maps in the reverse diffusion. The proposed approach demonstrates consistent qualitative and quantitative performance across different sub-sampling patterns. In addition, experiments indicate a good fit of the estimated coil sensitivities.


title: End-to-End Software Construction using ChatGPT: An Experience Report

abstract: In this paper, we explore the application of Large Language Models (LLMs) in the particular context of end-to-end software construction, i.e., in contexts where software developers have a set of requirements and have to design, implement, test, and validate a new software system. Particularly, we report an experiment where we asked three software developers to use ChatGPT to fully implement a Web-based application using mainstream software architectures and technologies. After that, we compare the apps produced by ChatGPT with a reference implementation that we manually implemented for our research. As a result, we document four categories of prompts that can be used by developers in similar contexts, including initialization prompts, feature requests, bug-fixing, and layout prompts. Additionally, we discuss the advantages and disadvantages of two prompt construction approaches: top-down (where we start with a high-level description of the target software, typically in the form of user stories) and bottom-up (where we request the construction of the system feature by feature).


title: Early Accretion Onset in Long-Period Isolated Pulsars

abstract: We model long-term magneto-rotational evolution of isolated neutron stars with long initial spin periods. This analysis is motivated by the recent discovery of young long-period neutron stars observed as periodic radio sources: PSR J0901-4046, GLEAM-X J1627-52, and GPM J1839-10. Our calculations demonstrate that for realistically rapid spin-down during the propeller stage isolated neutron stars with velocities $\lesssim100$ km s$^{-1}$ and assumed long initial spin periods can reach the stage of accretion from the interstellar medium within at most a few billion years as they are born already at the propeller stage or sufficiently close to the critical period of the ejector-propeller transition. If neutron stars with long initial spin periods form a relatively large fraction of all Galactic neutron stars then the number of isolated accretors is substantially larger than it has been predicted by previous studies.


title: ULTRA-DP: Unifying Graph Pre-training with Multi-task Graph Dual Prompt

abstract: Recent research has demonstrated the efficacy of pre-training graph neural networks (GNNs) to capture the transferable graph semantics and enhance the performance of various downstream tasks. However, the semantic knowledge learned from pretext tasks might be unrelated to the downstream task, leading to a semantic gap that limits the application of graph pre-training. To reduce this gap, traditional approaches propose hybrid pre-training to combine various pretext tasks together in a multi-task learning fashion and learn multi-grained knowledge, which, however, cannot distinguish tasks and results in some transferable task-specific knowledge distortion by each other. Moreover, most GNNs cannot distinguish nodes located in different parts of the graph, making them fail to learn position-specific knowledge and lead to suboptimal performance. In this work, inspired by the prompt-based tuning in natural language processing, we propose a unified framework for graph hybrid pre-training which injects the task identification and position identification into GNNs through a prompt mechanism, namely multi-task graph dual prompt (ULTRA-DP). Based on this framework, we propose a prompt-based transferability test to find the most relevant pretext task in order to reduce the semantic gap. To implement the hybrid pre-training tasks, beyond the classical edge prediction task (node-node level), we further propose a novel pre-training paradigm based on a group of $k$-nearest neighbors (node-group level). The combination of them across different scales is able to comprehensively express more structural semantics and derive richer multi-grained knowledge. Extensive experiments show that our proposed ULTRA-DP can significantly enhance the performance of hybrid pre-training methods and show the generalizability to other pre-training tasks and backbone architectures.


title: Gordian unlinks

abstract: A Gordian unlink is a finite number of not topologically linked unknots with prescribed length and thickness that cannot be disentangled to the trivial link by an isotopy preserving length and thickness throughout. In this note we provide the firsts examples of Gordian unlinks. As a consequence, we detect the existence of isotopy classes unknots different from those in classical knot theory. More generally, we present a one-parameter family of Gordian unlinks with thickness ranging in $[1, 2)$ to conclude that thinner normal tubes lead to different rope geometry from the ones so far considered. Knots or links in the one-parameter model here introduced are called thin knots or links, and when thickness is equal to 2 we obtain the standard model considered for geometric knots also called thick knots.


title: Laser Scanning Microscopy for Tomographic Imaging of Roughness and Point Absorbers in Optical Surfaces

abstract: High-precision laser interferometric instruments require optical surfaces with a close to perfect contour, as well as low scattering and absorption. Especially point absorbers are problematic because they heat up at high optical intensities and locally deform the otherwise flat surface, resulting in correlations between absorption and contour. Here, we present a laser scanning microscopy approach for the reconstruction of the two complementary images of an optical surface. The 'phase image' is related to the surface profile including roughness. The 'loss image' localizes point absorbers. Our experiment achieves a sensitivity of up to (3.1 $\pm$ 1.4) fm/$\sqrt{\mathrm{Hz}}$ and a (5.29 $\pm$ 0.06) $\mathrm{\mu}$m lateral resolution. The two images show correlations for some features proving the particular strength of our tomographic approach, which should help further improving optical surfaces or to understand dynamic processes of surface physics.


title: Zero-knowledge Proof Meets Machine Learning in Verifiability: A Survey

abstract: With the rapid advancement of artificial intelligence technology, the usage of machine learning models is gradually becoming part of our daily lives. High-quality models rely not only on efficient optimization algorithms but also on the training and learning processes built upon vast amounts of data and computational power. However, in practice, due to various challenges such as limited computational resources and data privacy concerns, users in need of models often cannot train machine learning models locally. This has led them to explore alternative approaches such as outsourced learning and federated learning. While these methods address the feasibility of model training effectively, they introduce concerns about the trustworthiness of the training process since computations are not performed locally. Similarly, there are trustworthiness issues associated with outsourced model inference. These two problems can be summarized as the trustworthiness problem of model computations: How can one verify that the results computed by other participants are derived according to the specified algorithm, model, and input data? To address this challenge, verifiable machine learning (VML) has emerged. This paper presents a comprehensive survey of zero-knowledge proof-based verifiable machine learning (ZKP-VML) technology. We first analyze the potential verifiability issues that may exist in different machine learning scenarios. Subsequently, we provide a formal definition of ZKP-VML. We then conduct a detailed analysis and classification of existing works based on their technical approaches. Finally, we discuss the key challenges and future directions in the field of ZKP-based VML.


title: Universal Domain Adaptation for Robust Handling of Distributional Shifts in NLP

abstract: When deploying machine learning systems to the wild, it is highly desirable for them to effectively leverage prior knowledge to the unfamiliar domain while also firing alarms to anomalous inputs. In order to address these requirements, Universal Domain Adaptation (UniDA) has emerged as a novel research area in computer vision, focusing on achieving both adaptation ability and robustness (i.e., the ability to detect out-of-distribution samples). While UniDA has led significant progress in computer vision, its application on language input still needs to be explored despite its feasibility. In this paper, we propose a comprehensive benchmark for natural language that offers thorough viewpoints of the model's generalizability and robustness. Our benchmark encompasses multiple datasets with varying difficulty levels and characteristics, including temporal shifts and diverse domains. On top of our testbed, we validate existing UniDA methods from computer vision and state-of-the-art domain adaptation techniques from NLP literature, yielding valuable findings: We observe that UniDA methods originally designed for image input can be effectively transferred to the natural language domain while also underscoring the effect of adaptation difficulty in determining the model's performance.


title: Fast computation and characterization of forced response surfaces via spectral submanifolds and parameter continuation

abstract: For mechanical systems subject to periodic excitation, forced response curves (FRCs) depict the relationship between the amplitude of the periodic response and the forcing frequency. For nonlinear systems, this functional relationship is different for different forcing amplitudes. Forced response surfaces (FRSs), which relate the response amplitude to both forcing frequency and forcing amplitude, are then required in such settings. Yet, FRSs have been rarely computed in the literature due to the higher numerical effort they require. Here, we use spectral submanifolds (SSMs) to construct reduced-order models (ROMs) for high-dimensional mechanical systems and then use multidimensional manifold continuation of fixed points of the SSM-based ROMs to efficiently extract the FRSs. Ridges and trenches in an FRS characterize the main features of the forced response. We show how to extract these ridges and trenches directly without computing the FRS via reduced optimization problems on the ROMs. We demonstrate the effectiveness and efficiency of the proposed approach by calculating the FRSs and their ridges and trenches for a plate with a 1:1 internal resonance and for a shallow shell with a 1:2 internal resonance.


title: Regularised optimal self-transport is approximate Gaussian mixture maximum likelihood

abstract: We investigate the link between regularised self-transport problems and maximum likelihood estimation in Gaussian mixture models (GMM). This link suggests that self-transport followed by a clustering technique leads to principled estimators at a reasonable computational cost. Also, robustness, sparsity and stability properties of the optimal transport plan arguably make the regularised self-transport a statistical tool of choice for the GMM.


title: Simulating the tidal disruption of stars by stellar-mass black holes using moving-mesh hydrodynamics

abstract: In the centers of dense star clusters, close encounters between stars and compact objects are likely to occur. We study tidal disruption events of main-sequence (MS) stars by stellar-mass black holes (termed $\mu$TDEs), which can shed light on the processes occurring in these clusters, including being an avenue in the mass growth of stellar-mass BHs. Using the moving-mesh hydrodynamics code \texttt{AREPO}, we perform a suite of hydrodynamics simulations of partial $\mu$TDEs of realistic, \texttt{MESA}-generated MS stars by varying the initial mass of the star ($0.5\,{\rm M}_{\rm \odot}$ and $1\,{\rm M}_{\rm \odot}$), the age of the star (zero-age, middle-age and terminal-age), the mass of the black hole ($10\,{\rm M}_{\rm \odot}$ and $40\,{\rm M}_{\rm \odot}$) and the impact parameter (yielding almost no mass loss to full disruption). We then examine the dependence of the masses, spins, and orbital parameters of the partially disrupted remnant on the initial encounter parameters. We find that the mass lost from a star decreases exponentially with increasing distance of approach and that a $1\,{\rm M}_{\rm \odot}$ star loses lesser mass than a $0.5\,{\rm M}_{\rm \odot}$. Moreover, a more evolved star is less susceptible to mass loss. Tidal torques at the closest approach spin up the remnant by factors of $10^2$--$10^4$ depending on the impact parameter. The remnant star can be bound (eccentric) or unbound (hyperbolic) to the black hole: hyperbolic orbits occur when the star's central density concentration is relatively low and the black hole-star mass ratio is high, which is the case for the disruption of a $0.5\,{\rm M}_{\rm \odot}$ star. Finally, we provide best-fit analytical formulae for a range of parameters that can be incorporated into cluster codes to model star-black hole interaction more accurately.


title: Adaptive Policy with Wait-$k$ Model for Simultaneous Translation

abstract: Simultaneous machine translation (SiMT) requires a robust read/write policy in conjunction with a high-quality translation model. Traditional methods rely on either a fixed wait-$k$ policy coupled with a standalone wait-$k$ translation model, or an adaptive policy jointly trained with the translation model. In this study, we propose a more flexible approach by decoupling the adaptive policy model from the translation model. Our motivation stems from the observation that a standalone multi-path wait-$k$ model performs competitively with adaptive policies utilized in state-of-the-art SiMT approaches. Specifically, we introduce DaP, a divergence-based adaptive policy, that makes read/write decisions for any translation model based on the potential divergence in translation distributions resulting from future information. DaP extends a frozen wait-$k$ model with lightweight parameters, and is both memory and computation efficient. Experimental results across various benchmarks demonstrate that our approach offers an improved trade-off between translation accuracy and latency, outperforming strong baselines.


title: Reservoir Engineering for Classical Nonlinear Fields

abstract: Reservoir engineering has become a prominent tool to control quantum systems. Recently, there have been first experiments applying it to many-body systems, especially with a view to engineer particle-conserving dissipation for quantum simulations using bosons. In this work, we explore the dissipative dynamics of these systems in the classical limit. We derive a general equation of motion capturing the effective nonlinear dissipation introduced by the bath and apply it to the special case of a Bose-Hubbard model, where it leads to an unconventional type of dissipative nonlinear Schr\"odinger equation. Building on that, we study the dynamics of one and two solitons in such a dissipative classical field theory.


title: Contextual Refinement of Translations: Large Language Models for Sentence and Document-Level Post-Editing

abstract: Large Language Models (LLM's) have demonstrated considerable success in various Natural Language Processing tasks, but they have yet to attain state-of-the-art performance in Neural Machine Translation (NMT). Nevertheless, their significant performance in tasks demanding a broad understanding and contextual processing shows their potential for translation. To exploit these abilities, we investigate using LLM's for MT and explore recent parameter-efficient fine-tuning techniques. Surprisingly, our initial experiments find that fine-tuning for translation purposes even led to performance degradation. To overcome this, we propose an alternative approach: adapting LLM's as Automatic Post-Editors (APE) rather than direct translators. Building on the LLM's exceptional ability to process and generate lengthy sequences, we also propose extending our approach to document-level translation. We show that leveraging Low-Rank-Adapter fine-tuning for APE can yield significant improvements across both sentence and document-level metrics while generalizing to out-of-domain data. Most notably, we achieve a state-of-the-art accuracy rate of 89\% on the ContraPro test set, which specifically assesses the model's ability to resolve pronoun ambiguities when translating from English to German. Lastly, we investigate a practical scenario involving manual post-editing for document-level translation, where reference context is made available. Here, we demonstrate that leveraging human corrections can significantly reduce the number of edits required for subsequent translations (Interactive Demo for integrating manual feedback can be found here: https://huggingface.co/spaces/skoneru/contextual_refinement_ende).


title: Inheritance of the exciton geometric structure from Bloch electrons in two-dimensional layered semiconductors

abstract: We theoretically studied the exciton geometric structure in layered semiconducting transition metal dichalcogenides. Based on a three-orbital tight-binding model for Bloch electrons which incorporates their geometric structures, an effective exciton Hamiltonian is constructed and solved perturbatively to reveal the relation between the exciton and its electron/hole constituent. We show that the electron-hole Coulomb interaction gives rise to a non-trivial inheritance of the exciton geometric structure from Bloch electrons, which manifests as a valley-dependent center-of-mass anomalous Hall velocity of the exciton when two external fields are applied on the electron and hole constituents, respectively. The obtained center-of-mass anomalous velocity is found to exhibit a non-trivial dependence on the fields, as well as the wave function and valley index of the exciton. These findings can serve as a general guide for the field-control of the valley-dependent exciton transport, enabling the design of novel quantum optoelectronic and valleytronic devices.


title: GDOP Based BS Selection for Positioning in mmWave 5G NR Networks

abstract: The fifth-generation (5G) of mobile communication supported by millimetre-wave (mmWave) technology and higher base station (BS) densification facilitate to enhance user equipment (UE) positioning. Therefore, 5G cellular system is designed with many positioning measurements and special positioning reference signals with a multitude of configurations for a variety of use cases, expecting stringent positioning accuracies. One of the major factors that the accuracy of a particular position estimate depends on is the geometry of the nodes in the system, which could be measured with the geometric dilution of precision (GDOP). Hence in this paper, we investigate the time difference of arrival (TDOA) measurements based UE positioning accuracy improvement, exploiting the geometric distribution of BSs in mixed LOS and NLOS environment. We propose a BS selection algorithm for UE positioning based on the GDOP of the BSs participating in the positioning process. Simulations are conducted for indoor and outdoor scenarios that use antenna arrays with beam-based mmWave NR communication. Results demonstrate that the proposed BS selection can achieve higher positioning accuracy with fewer radio resources compared to the other BS selection methods.


title: Dynamically Weighted Federated k-Means

abstract: Federated clustering, an integral aspect of federated machine learning, enables multiple data sources to collaboratively cluster their data, maintaining decentralization and preserving privacy. In this paper, we introduce a novel federated clustering algorithm named Dynamically Weighted Federated k-means (DWF k-means) based on Lloyd's method for k-means clustering, to address the challenges associated with distributed data sources and heterogeneous data. Our proposed algorithm combines the benefits of traditional clustering techniques with the privacy and scalability benefits offered by federated learning. The algorithm facilitates collaborative clustering among multiple data owners, allowing them to cluster their local data collectively while exchanging minimal information with the central coordinator. The algorithm optimizes the clustering process by adaptively aggregating cluster assignments and centroids from each data source, thereby learning a global clustering solution that reflects the collective knowledge of the entire federated network. We address the issue of empty clusters, which commonly arises in the context of federated clustering. We conduct experiments on multiple datasets and data distribution settings to evaluate the performance of our algorithm in terms of clustering score, accuracy, and v-measure. The results demonstrate that our approach can match the performance of the centralized classical k-means baseline, and outperform existing federated clustering methods like k-FED in realistic scenarios.


title: 3M-TRANSFORMER: A Multi-Stage Multi-Stream Multimodal Transformer for Embodied Turn-Taking Prediction

abstract: Predicting turn-taking in multiparty conversations has many practical applications in human-computer/robot interaction. However, the complexity of human communication makes it a challenging task. Recent advances have shown that synchronous multi-perspective egocentric data can significantly improve turn-taking prediction compared to asynchronous, single-perspective transcriptions. Building on this research, we propose a new multimodal transformer-based architecture for predicting turn-taking in embodied, synchronized multi-perspective data. Our experimental results on the recently introduced EgoCom dataset show a substantial performance improvement of up to 14.01% on average compared to existing baselines and alternative transformer-based approaches. The source code, and the pre-trained models of our 3M-Transformer will be available upon acceptance.


title: Adaptive Tuning of Robotic Polishing Skills based on Force Feedback Model

abstract: Acquiring human skills offers an efficient approach to tackle complex task planning challenges. When performing a learned skill model for a continuous contact task, such as robot polishing in an uncertain environment, the robot needs to be able to adaptively modify the skill model to suit the environment and perform the desired task. The environmental perturbation of the polishing task is mainly reflected in the variation of contact force. Therefore, adjusting the task skill model by providing feedback on the contact force deviation is an effective way to meet the task requirements. In this study, a phase-modulated diagonal recurrent neural network (PMDRNN) is proposed for force feedback model learning in the robotic polishing task. The contact between the tool and the workpiece in the polishing task can be considered a dynamic system. In comparison to the existing feedforward neural network phase-modulated neural network (PMNN), PMDRNN combines the diagonal recurrent network structure with the phase-modulated neural network layer to improve the learning performance of the feedback model for dynamic systems. Specifically, data from real-world robot polishing experiments are used to learn the feedback model. PMDRNN demonstrates a significant reduction in the training error of the feedback model when compared to PMNN. Building upon this, the combination of PMDRNN and dynamic movement primitives (DMPs) can be used for real-time adjustment of skills for polishing tasks and effectively improve the robustness of the task skill model. Finally, real-world robotic polishing experiments are conducted to demonstrate the effectiveness of the approach.


title: Achromatic, planar Fresnel-Reflector for a Single-beam Magneto-optical Trap

abstract: We present a novel achromatic, planar, periodic mirror structure for single-beam magneto-optical trapping and demonstrate its use in first- and second-stage cooling and trapping for different isotopes of strontium. We refer to it as Fresnel MOT as the structure is inspired by Fresnel lenses. By design, it avoids many of the problems that arise for multi-color cooling using planar structures based on diffraction gratings, which have been the dominant planar structures to be used for single-beam trapping thus far. In addition to a complex design process and cost-intensive fabrication, diffraction gratings suffer from their inherent chromaticity, which causes different axial displacements of trap volumes for the different wavelengths and necessitates tradeoffs in their diffraction properties and achievable trap depths. In contrast, the Fresnel reflector structure presented here is a versatile, easy-to-manufacture device that combines achromatic beam steering with the advantages of a planar architecture. It enables miniaturizing trapping systems for alkaline-earth-like atoms with multiple cooling transitions as well as multi-species trapping in the ideal tetrahedral configuration and within the same volume above the structure. Our design presents a novel approach for the miniaturization of cold-atom systems based on single-beam MOTs and enables the widespread adoption of these systems.


title: Characterization of the tree cycles with minimum positive entropy for any period

abstract: Consider, for any integer $n\ge3$, the set $\text{Pos}_n$ of all $n$-periodic tree patterns with positive topological entropy and the set $\text{Irr}_n\subset\text{Pos}_n$ of all $n$-periodic irreducible tree patterns. The aim of this paper is to determine the elements of minimum entropy in the families $\text{Pos}_n$, $\text{Irr}_n$ and $\text{Pos}_n\setminus\text{Irr}_n$. Let $\lambda_n$ be the unique real root of the polynomial $x^n-2x-1$ in $(1,+\infty)$. We explicitly construct an irreducible $n$-periodic tree pattern $\mathcal{Q}_n$ whose entropy is $\log(\lambda_n)$. We prove that this entropy is minimum in $\text{Pos}_n$. Since the pattern $\mathcal{Q}_n$ is irreducible, $\mathcal{Q}_n$ also minimizes the entropy in the family $\text{Irr}_n$. We also prove that the minimum positive entropy in the set $\text{Pos}_n\setminus\text{Irr}_n$ (which is nonempty only for composite integers $n\ge6$) is $\log(\lambda_{n/p})/p$, where $p$ is the least prime factor of $n$.


title: Paraphrase Types for Generation and Detection

abstract: Current approaches in paraphrase generation and detection heavily rely on a single general similarity score, ignoring the intricate linguistic properties of language. This paper introduces two new tasks to address this shortcoming by considering paraphrase types - specific linguistic perturbations at particular text positions. We name these tasks Paraphrase Type Generation and Paraphrase Type Detection. Our results suggest that while current techniques perform well in a binary classification scenario, i.e., paraphrased or not, the inclusion of fine-grained paraphrase types poses a significant challenge. While most approaches are good at generating and detecting general semantic similar content, they fail to understand the intrinsic linguistic variables they manipulate. Models trained in generating and identifying paraphrase types also show improvements in tasks without them. In addition, scaling these models further improves their ability to understand paraphrase types. We believe paraphrase types can unlock a new paradigm for developing paraphrase models and solving tasks in the future.


title: Diverse Priors for Deep Reinforcement Learning

abstract: In Reinforcement Learning (RL), agents aim at maximizing cumulative rewards in a given environment. During the learning process, RL agents face the dilemma of exploitation and exploration: leveraging existing knowledge to acquire rewards or seeking potentially higher ones. Using uncertainty as a guiding principle provides an active and effective approach to solving this dilemma and ensemble-based methods are one of the prominent avenues for quantifying uncertainty. Nevertheless, conventional ensemble-based uncertainty estimation lacks an explicit prior, deviating from Bayesian principles. Besides, this method requires diversity among members to generate less biased uncertainty estimation results. To address the above problems, previous research has incorporated random functions as priors. Building upon these foundational efforts, our work introduces an innovative approach with delicately designed prior NNs, which can incorporate maximal diversity in the initial value functions of RL. Our method has demonstrated superior performance compared with the random prior approaches in solving classic control problems and general exploration tasks, significantly improving sample efficiency.


title: First Chromospheric Activity and Doppler Imaging Study of PW And Using a New Doppler Imaging Code: SpotDIPy

abstract: Measuring coverage of dark spots on cool stars is important in understanding how stellar magnetic activity scales with the rotation rate and convection zone depth. In this respect, it is crucial to infer surface magnetic patterns on G and K stars, to reveal solar-like stellar dynamos in action. Molecular bands serve as invaluable indicators of cool spots on the surfaces of stars, as they play a crucial role in enabling accurate assessments of the extent of spot coverage across the stellar surface. Therefore, more reliable surface images can be obtained considering the inversion of atomic lines with molecular bands. In this context, we simultaneously carry out Doppler imaging (DI) using atomic lines as well as Titanium Oxide (TiO) band profiles of PW And (K2 V) and also investigate chromospheric activity indicators for the first time in the literature, using the high-resolution spectra. The surface spot distribution obtained from the inversion process represents both atomic line and TiO-band profiles quite accurately. The chromospheric emission is also correlated with photospheric spot coverage, except during a possible flare event during the observations. We detect frequent flare activity, using TESS photometry. We also introduce a new open-source, Python-based DI code SpotDIPy that allows performing surface reconstructions of single stars using the maximum entropy method. We test the code by comparing surface reconstruction simulations with the extensively used DoTS code. We show that the surface brightness distribution maps reconstructed via both codes using the same simulated data are consistent with each other.


title: A Study on Knowledge Graph Embeddings and Graph Neural Networks for Web Of Things

abstract: Graph data structures are widely used to store relational information between several entities. With data being generated worldwide on a large scale, we see a significant growth in the generation of knowledge graphs. Thing in the future is Orange's take on a knowledge graph in the domain of the Web Of Things (WoT), where the main objective of the platform is to provide a digital representation of the physical world and enable cross-domain applications to be built upon this massive and highly connected graph of things. In this context, as the knowledge graph grows in size, it is prone to have noisy and messy data. In this paper, we explore state-of-the-art knowledge graph embedding (KGE) methods to learn numerical representations of the graph entities and, subsequently, explore downstream tasks like link prediction, node classification, and triple classification. We also investigate Graph neural networks (GNN) alongside KGEs and compare their performance on the same downstream tasks. Our evaluation highlights the encouraging performance of both KGE and GNN-based methods on node classification, and the superiority of GNN approaches in the link prediction task. Overall, we show that state-of-the-art approaches are relevant in a WoT context, and this preliminary work provides insights to implement and evaluate them in this context.


title: Who's Watching Me?: Exploring the Impact of Audience Familiarity on Player Performance, Experience, and Exertion in Virtual Reality Exergames

abstract: Familiarity with audiences plays a significant role in shaping individual performance and experience across various activities in everyday life. This study delves into the impact of familiarity with non-playable character (NPC) audiences on player performance and experience in virtual reality (VR) exergames. By manipulating of NPC appearance (face and body shape) and voice familiarity, we explored their effect on game performance, experience, and exertion. The findings reveal that familiar NPC audiences have a positive impact on performance, creating a more enjoyable gaming experience, and leading players to perceive less exertion. Moreover, individuals with higher levels of self-consciousness exhibit heightened sensitivity to the familiarity with NPC audiences. Our results shed light on the role of familiar NPC audiences in enhancing player experiences and provide insights for designing more engaging and personalized VR exergame environments.


title: Assessing Step-by-Step Reasoning against Lexical Negation: A Case Study on Syllogism

abstract: Large language models (LLMs) take advantage of step-by-step reasoning instructions, e.g., chain-of-thought (CoT) prompting. Building on this, their ability to perform CoT-style reasoning robustly is of interest from a probing perspective. In this study, we inspect the step-by-step reasoning ability of LLMs with a focus on negation, which is a core linguistic phenomenon that is difficult to process. In particular, we introduce several controlled settings (e.g., reasoning in case of fictional entities) to evaluate the logical reasoning abilities of the models. We observed that dozens of modern LLMs were not robust against lexical negation (e.g., plausible ->implausible) when performing CoT-style reasoning, and the results highlight unique limitations in each LLM family.


title: Periodicity of p-adic Expansion of Rational Number

abstract: In this paper we give an algorithm to calculate the coefficients of the p-adic expansion of a rational numbers, and we give a method to decide whether this expansion is periodic or ultimately periodic.


title: We are Who We Cite: Bridges of Influence Between Natural Language Processing and Other Academic Fields

abstract: Natural Language Processing (NLP) is poised to substantially influence the world. However, significant progress comes hand-in-hand with substantial risks. Addressing them requires broad engagement with various fields of study. Yet, little empirical work examines the state of such engagement (past or current). In this paper, we quantify the degree of influence between 23 fields of study and NLP (on each other). We analyzed ~77k NLP papers, ~3.1m citations from NLP papers to other papers, and ~1.8m citations from other papers to NLP papers. We show that, unlike most fields, the cross-field engagement of NLP, measured by our proposed Citation Field Diversity Index (CFDI), has declined from 0.58 in 1980 to 0.31 in 2022 (an all-time low). In addition, we find that NLP has grown more insular -- citing increasingly more NLP papers and having fewer papers that act as bridges between fields. NLP citations are dominated by computer science; Less than 8% of NLP citations are to linguistics, and less than 3% are to math and psychology. These findings underscore NLP's urgent need to reflect on its engagement with various fields.


title: Oka tubes in holomorphic line bundles

abstract: Let $(E,h)$ be a semipositive hermitian holomorphic line bundle on a compact complex manifold $X$ with $\dim X>1$. Assume that for each point $x\in X$ there exists a divisor $D\in |E|$ in the complete linear system determined by $E$ whose complement $X\setminus D$ is a Stein neighbourhood of $x$ with the density property. Then, the disc bundle $\Delta_h(E)=\{e\in E:|e|_h<1\}$ is an Oka manifold while $E\setminus \overline{\Delta_h(E)}=\{e\in E:|e|_h>1\}$ is a Kobayashi hyperbolic domain. In particular, the zero section of $E$ admits a basis of Oka neighbourhoods $\{|e|_h<c\}$ with $c>0$. We show that this holds if $X$ is a projective space, a complex Grassmannian, or a product of Grassmannians. This phenomenon contributes to the heuristic principle that Oka properties are related to metric positivity of complex manifolds.


title: On the loss of mass for the heat equation in an exterior domain with general boundary conditions

abstract: In this work, we study the decay of mass for solutions to the heat equation in exterior domains, i.e., domains which are the complement of a compact set in $\mathbb{R}^N$. Different homogeneous boundary conditions are considered, including Dirichlet, Robin, and Neumann conditions. We determine the exact amount of mass loss and identify criteria for complete mass decay, in which the dimension of the space plays a key role. Furthermore, the paper provides explicit mass decay rates.


title: The hyperserial field of surreal numbers

abstract: For any ordinal $\alpha > 0$, we show how to define a hyperexponential $E_{\omega^{\alpha}}$ and a hyperlogarithm $L_{\omega^{\alpha}}$ on the class $\mathbf{No}^{>, \succ}$ of positive infinitely large surreal numbers. Such functions are archetypes of extremely fast and slowly growing functions at infinity. We also show that the surreal numbers form a so-called hyperserial field for our definition.


title: Newly Formed Dust within the Circumstellar Environment of SNIa-CSM 2018evt

abstract: Dust associated with various stellar sources in galaxies at all cosmic epochs remains a controversial topic, particularly whether supernovae (SNe) play an important role in dust production. We report evidence of dust formation in the cold, dense shell behind the ejecta-circumstellar medium (CSM) interaction in the Type Ia-CSM SN 2018evt three years after the explosion, characterized by a rise in the mid-infrared (MIR) emission accompanied by an accelerated decline in the optical radiation of the SN. Such a dust-formation picture is also corroborated by the concurrent evolution of the profiles of the Ha emission line. Our model suggests enhanced CSM dust concentration at increasing distances from the SN as compared to what can be expected from the density profile of the mass loss from a steady stellar wind. By the time of the last MIR observations at day +1041, a total amount of 1.2+-0.2x10^{-2} Msun of new dust has been formed by SN 2018evt, making SN 2018evt one of the most prolific dust factories among SNe with evidence of dust formation. The unprecedented witness of the intense production procedure of dust may shed light on the perceptions of dust formation in cosmic history.


title: Benefit of enhanced electrostatic and optical accelerometry for future gravimetry missions

abstract: Twenty years of gravity observations from various satellite missions have provided unique data about mass redistribution processes in the Earth system. This paper studies the benefit of enhanced electrostatic and novel optical accelerometers and gradiometers for the future gravimetry missions. One of the limiting factors in the current space gravimetry missions is the drift of the Electrostatic Accelerometers (EA). This study focuses on the modeling of enhanced EAs with laser-interferometric readout, so called 'optical accelerometers', and on evaluating their performance for gravity field recovery in future satellite missions. In this paper, we simulate gravimetry missions in multiple scopes, applying the various software modules for satellite dynamics integration, accelerometer (ACC) and gradiometer simulation and gravity field recovery. The total noise budget of the modeled enhanced Electrostatic and optical ACCs show a similar sensitivity as the ACC concepts from other research groups. Parametrization w.r.t. ACCs test mass (TM) weight and the gap between the test mass and surrounding electrode housing confirmed previously known results that an ACC with a heavier TM and larger gap will have better performance. Our results suggest that the anticipated gain of novel ACCs might at some point be potentially limited by noise from the inter-satellite laser ranging interferometry. In order to present the advantage of the novel sensors, time-variable background models and associated aliasing errors were not considered in our simulations. Utilization of enhanced EA and optical ACC show a significant improvement of accuracy w.r.t. current GRACE-like EA. Also, their benefit in double satellite pairs in a so called 'Bender' constellations as well as in the combination of low-low satellite-to-satellite tracking with cross-track gradiometry has been investigated.


title: Martian Lava Tube Exploration Using Jumping Legged Robots: A Concept Study

abstract: In recent years, robotic exploration has become increasingly important in planetary exploration. One area of particular interest for exploration is Martian lava tubes, which have several distinct features of interest. First, it is theorized that they contain more easily accessible resources such as water ice, needed for in-situ utilization on Mars. Second, lava tubes of significant size can provide radiation and impact shelter for possible future human missions to Mars. Third, lava tubes may offer a protected and preserved view into Mars' geological and possible biological past. However, exploration of these lava tubes poses significant challenges due to their sheer size, geometric complexity, uneven terrain, steep slopes, collapsed sections, significant obstacles, and unstable surfaces. Such challenges may hinder traditional wheeled rover exploration. To overcome these challenges, legged robots and particularly jumping systems have been proposed as potential solutions. Jumping legged robots utilize legs to both walk and jump. This allows them to traverse uneven terrain and steep slopes more easily compared to wheeled or tracked systems. In the context of Martian lava tube exploration, jumping legged robots would be particularly useful due to their ability to jump over big boulders, gaps, and obstacles, as well as to descend and climb steep slopes. This would allow them to explore and map such caves, and possibly collect samples from areas that may otherwise be inaccessible. This paper presents the specifications, design, capabilities, and possible mission profiles for state-of-the-art legged robots tailored to space exploration. Additionally, it presents the design, capabilities, and possible mission profiles of a new jumping legged robot for Martian lava tube exploration that is being developed at the Norwegian University of Science and Technology.


title: A non-unitary bulk-boundary correspondence: Non-unitary Haagerup RCFTs from S-fold SCFTs

abstract: We introduce a novel class of two-dimensional non-unitary rational conformal field theories (RCFTs) whose modular data are identical to the generalized Haagerup-Izumi modular data. Via the bulk-boundary correspondence, they are related to the three-dimensional non-unitary Haagerup topological field theories, recently constructed by a topological twisting of three-dimensional ${\cal N}=4$ rank-zero superconformal field theories (SCFTs), called S-fold SCFTs. We propose that, up to the overall factors, the half-indices of the rank-zero SCFTs give the explicit Nahm representation of four conformal characters of the RCFTs including the vacuum character. Using the theory of Bantay-Gannon, we can successfully complete them into the full admissible conformal characters of the RCFTs.


title: A note on the Hitczenko-Kwapien conjecture about a Rademacher sequence

abstract: Let $(\epsilon_i)$ be a Rademacher sequence, i.e., a sequence of independent and identically distributed random variables satisfying $P(\epsilon_i=1)=P(\epsilon_i=-1)=1/2$. Set $S_n=a_1\epsilon_1+\cdots+a_n\epsilon_n$ for $a=(a_1,\dots,a_n)\in \mathbb{R}^n$. The Hitczenko-Kwapien conjecture says that $P\left(\left|S_n\right|\geq\|a\|\right)\geq {7}/{32}$ for all $a\in \mathbb{R}^n$ and $n\in \mathbb{N}$. Up to now, we know that it holds when $n\leq 7$. In this note, we show that it holds when $n=8$.


title: Surreal numbers as hyperseries

abstract: Surreal numbers form the ultimate extension of the field of real numbers with infinitely large and small quantities and in particular with all ordinal numbers. Hyperseries can be regarded as the ultimate formal device for representing regular growth rates at infinity. In this paper, we show that any surreal number can naturally be regarded as the value of a hyperseries at the first infinite ordinal $\omega$. This yields a remarkable correspondence between two types of infinities: numbers and growth rates.


title: Can ChatGPT Perform Reasoning Using the IRAC Method in Analyzing Legal Scenarios Like a Lawyer?

abstract: Large Language Models (LLMs), such as ChatGPT, have drawn a lot of attentions recently in the legal domain due to its emergent ability to tackle a variety of legal tasks. However, it is still unknown if LLMs are able to analyze a legal case and perform reasoning in the same manner as lawyers. Therefore, we constructed a novel corpus consisting of scenarios pertain to Contract Acts Malaysia and Australian Social Act for Dependent Child. ChatGPT is applied to perform analysis on the corpus using the IRAC method, which is a framework widely used by legal professionals for organizing legal analysis. Each scenario in the corpus is annotated with a complete IRAC analysis in a semi-structured format so that both machines and legal professionals are able to interpret and understand the annotations. In addition, we conducted the first empirical assessment of ChatGPT for IRAC analysis in order to understand how well it aligns with the analysis of legal professionals. Our experimental results shed lights on possible future research directions to improve alignments between LLMs and legal experts in terms of legal reasoning.


title: Topological Portfolio Selection and Optimization

abstract: Modern portfolio optimization is centered around creating a low-risk portfolio with extensive asset diversification. Following the seminal work of Markowitz, optimal asset allocation can be computed using a constrained optimization model based on empirical covariance. However, covariance is typically estimated from historical lookback observations, and it is prone to noise and may inadequately represent future market behavior. As a remedy, information filtering networks from network science can be used to mitigate the noise in empirical covariance estimation, and therefore, can bring added value to the portfolio construction process. In this paper, we propose the use of the Statistically Robust Information Filtering Network (SR-IFN) which leverages the bootstrapping techniques to eliminate unnecessary edges during the network formation and enhances the network's noise reduction capability further. We apply SR-IFN to index component stock pools in the US, UK, and China to assess its effectiveness. The SR-IFN network is partially disconnected with isolated nodes representing lesser-correlated assets, facilitating the selection of peripheral, diversified and higher-performing portfolios. Further optimization of performance can be achieved by inversely proportioning asset weights to their centrality based on the resultant network.


title: On a Markov chain related to the individual lengths in the recursive construction of Kingman's coalescent

abstract: Kingman's coalescent is a widely used process to model sample genealogies in population genetics. Recently there have been studies on the inference of quantities related to the genealogy of additional individuals given a known sample. This paper explores the recursive (or sequential) construction which is a natural way of enlarging the sample size by adding individuals one after another to the sample genealogy via individual lineages to construct the Kingman's coalescent. Although the process of successively added lineage lengths is not Markovian, we show that it contains a Markov chain which records the information of the successive largest lineage lengths and we prove a limit theorem for this Markov chain.


title: Non-autoregressive Streaming Transformer for Simultaneous Translation

abstract: Simultaneous machine translation (SiMT) models are trained to strike a balance between latency and translation quality. However, training these models to achieve high quality while maintaining low latency often leads to a tendency for aggressive anticipation. We argue that such issue stems from the autoregressive architecture upon which most existing SiMT models are built. To address those issues, we propose non-autoregressive streaming Transformer (NAST) which comprises a unidirectional encoder and a non-autoregressive decoder with intra-chunk parallelism. We enable NAST to generate the blank token or repetitive tokens to adjust its READ/WRITE strategy flexibly, and train it to maximize the non-monotonic latent alignment with an alignment-based latency loss. Experiments on various SiMT benchmarks demonstrate that NAST outperforms previous strong autoregressive SiMT baselines.


title: Budgeted Embedding Table For Recommender Systems

abstract: At the heart of contemporary recommender systems (RSs) are latent factor models that provide quality recommendation experience to users. These models use embedding vectors, which are typically of a uniform and fixed size, to represent users and items. As the number of users and items continues to grow, this design becomes inefficient and hard to scale. Recent lightweight embedding methods have enabled different users and items to have diverse embedding sizes, but are commonly subject to two major drawbacks. Firstly, they limit the embedding size search to optimizing a heuristic balancing the recommendation quality and the memory complexity, where the trade-off coefficient needs to be manually tuned for every memory budget requested. The implicitly enforced memory complexity term can even fail to cap the parameter usage, making the resultant embedding table fail to meet the memory budget strictly. Secondly, most solutions, especially reinforcement learning based ones derive and optimize the embedding size for each each user/item on an instance-by-instance basis, which impedes the search efficiency. In this paper, we propose Budgeted Embedding Table (BET), a novel method that generates table-level actions (i.e., embedding sizes for all users and items) that is guaranteed to meet pre-specified memory budgets. Furthermore, by leveraging a set-based action formulation and engaging set representation learning, we present an innovative action search strategy powered by an action fitness predictor that efficiently evaluates each table-level action. Experiments have shown state-of-the-art performance on two real-world datasets when BET is paired with three popular recommender models under different memory budgets.


title: Location Estimation and Recovery using 5G Positioning: Thwarting GNSS Spoofing Attacks

abstract: The availability of cheap GNSS spoofers can prevent safe navigation and tracking of road users. It can lead to loss of assets, inaccurate fare estimation, enforcing the wrong speed limit, miscalculated toll tax, passengers reaching an incorrect location, etc. The techniques designed to prevent and detect spoofing by using cryptographic solutions or receivers capable of differentiating legitimate and attack signals are insufficient in detecting GNSS spoofing of road users. Recent studies, testbeds, and 3GPP standards are exploring the possibility of hybrid positioning, where GNSS data will be combined with the 5G-NR positioning to increase the security and accuracy of positioning. We design the Location Estimation and Recovery(LER) systems to estimate the correct absolute position using the combination of GNSS and 5G positioning with other road users, where a subset of road users can be malicious and collude to prevent spoofing detection. Our Location Verification Protocol extends the understanding of Message Time of Arrival Codes (MTAC) to prevent attacks against malicious provers. The novel Recovery and Meta Protocol uses road users' dynamic and unpredictable nature to detect GNSS spoofing. This protocol provides fast detection of GNSS spoofing with a very low rate of false positives and can be customized to a large family of settings. Even in a (highly unrealistic) worst-case scenario where each user is malicious with a probability of as large as 0.3, our protocol detects GNSS spoofing with high probability after communication and ranging with at most 20 road users, with a false positive rate close to 0. SUMO simulations for road traffic show that we can detect GNSS spoofing in 2.6 minutes since its start under moderate traffic conditions.


title: Deformations of $G$-valued pseudocharacters

abstract: We define a deformation space of V. Lafforgue's $G$-valued pseudocharacters of a profinite group $\Gamma$ for a possibly disconnected reductive group $G$. We show, that this definition generalizes Chenevier's construction. We show that the universal pseudodeformation ring is noetherian and that the functor of continuous $G$-pseudocharacters on affinoid $\mathbb{Q}_p$-algebras is represented by a quasi-Stein rigid analytic space, whenever $\Gamma$ is topologically finitely generated. We also show that the pseudodeformation ring is noetherian, when $\Gamma$ satisfies Mazur's condition $\Phi_p$ and $G$ satisfies a certain invariant-theoretic condition. For $G = \mathrm{Sp}_{2n}$ we describe three types of obstructed loci in the special fiber of the universal pseudodeformation space of an arbitrary residual pseudocharacter and give upper bounds for their dimension.


title: An Aluminum-coated sCMOS sensor for X-Ray Astronomy

abstract: In recent years, tremendous progress has been made on scientific Complementary Metal Oxide Semiconductor (sCMOS) sensors, making them a promising device for future space X-ray missions. We have customized a large-format sCMOS sensor, G1516BI, dedicated for X-ray applications. In this work, a 200 nm thick aluminum layer is successfully sputtered on the surface of this sensor. This Al-coated sensor, named EP4K, shows consistent performance with the uncoated version. The readout noise of the EP4K sensor is around 2.5 e- and the dark current is less than 0.01 e-/pixel/s at -30 degree. The maximum frame rate is 20 Hz in the current design. The ratio of single pixel events of the sensor is 45.0%. The energy resolution can reach 153.2 eV at 4.51 keV and 174.2 eV at 5.90 keV at -30 degree. The optical transmittance of the aluminum layer is approximately 1e-8 to 1e-10 for optical lights from 365 to 880 nm, corresponding to an effective aluminum thickness of around 140 to 160 nm. The good X-ray performance and low optical transmittance of this Al-coated sCMOS sensor make it a good choice for space X-ray missions. The Lobster Eye Imager for Astronomy (LEIA), which has been working in orbit for about one year, is equipped with four pieces of EP4K sensors. Furthermore, 48 pieces of EP4K sensors are used on the Wide-field X-ray Telescope (WXT) on the Einstein Probe (EP) satellite, which will be launched at the end of 2023.


title: Beyond Bayesian Model Averaging over Paths in Probabilistic Programs with Stochastic Support

abstract: The posterior in probabilistic programs with stochastic support decomposes as a weighted sum of the local posterior distributions associated with each possible program path. We show that making predictions with this full posterior implicitly performs a Bayesian model averaging (BMA) over paths. This is potentially problematic, as BMA weights can be unstable due to model misspecification or inference approximations, leading to sub-optimal predictions in turn. To remedy this issue, we propose alternative mechanisms for path weighting: one based on stacking and one based on ideas from PAC-Bayes. We show how both can be implemented as a cheap post-processing step on top of existing inference engines. In our experiments, we find them to be more robust and lead to better predictions compared to the default BMA weights.


title: First passage duality in $d>2$

abstract: In one and two dimensions, the first-passage time for a diffusing particle in the presence of a radial potential flow to hit a sphere, conditioned on actually hitting the sphere, is independent of the sign of the drift. Moreover, the first-passage distribution for an inward (negative) drift is identical to the first-passage distribution for outward (positive) drift when conditioned on hitting the sphere. This curious property was first observed in 2018 by Krapivsky and Redner, and in this work we extend this duality of first-passage times and their distributions to dimensions $d>2$. We show that the fundamental source of the symmetry is the fact that a reversal of the direction of the drift amounts to taking the adjoint of the spatial operator governing the evolution of the process, and the factor that converts between solutions of the forward and backward equations is precisely the non-transient behavior of the system with which to appropriately condition by.


title: Boosting for Bounding the Worst-class Error

abstract: This paper tackles the problem of the worst-class error rate, instead of the standard error rate averaged over all classes. For example, a three-class classification task with class-wise error rates of 10\%, 10\%, and 40\% has a worst-class error rate of 40\%, whereas the average is 20\% under the class-balanced condition. The worst-class error is important in many applications. For example, in a medical image classification task, it would not be acceptable for the malignant tumor class to have a 40\% error rate, while the benign and healthy classes have 10\% error rates.We propose a boosting algorithm that guarantees an upper bound of the worst-class training error and derive its generalization bound. Experimental results show that the algorithm lowers worst-class test error rates while avoiding overfitting to the training set.


title: SpeakEasy: A Conversational Intelligence Chatbot for Enhancing College Students' Communication Skills

abstract: Social interactions and conversation skills separate the successful from the rest and the confident from the shy. For college students in particular, the ability to converse can be an outlet for the stress and anxiety experienced on a daily basis along with a foundation for all-important career skills. In light of this, we designed SpeakEasy: a chatbot with some degree of intelligence that provides feedback to the user on their ability to engage in free-form conversations with the chatbot. SpeakEasy attempts to help college students improve their communication skills by engaging in a seven-minute spoken conversation with the user, analyzing the user's responses with metrics designed based on previous psychology and linguistics research, and providing feedback to the user on how they can improve their conversational ability. To simulate natural conversation, SpeakEasy converses with the user on a wide assortment of topics that two people meeting for the first time might discuss: travel, sports, and entertainment. Unlike most other chatbots with the goal of improving conversation skills, SpeakEasy actually records the user speaking, transcribes the audio into tokens, and uses macros-e.g., sequences that calculate the pace of speech, determine if the user has an over-reliance on certain words, and identifies awkward transitions-to evaluate the quality of the conversation. Based on the evaluation, SpeakEasy provides elaborate feedback on how the user can improve their conversations. In turn, SpeakEasy updates its algorithms based on a series of questions that the user responds to regarding SpeakEasy's performance.


title: Air-Decoding: Attribute Distribution Reconstruction for Decoding-Time Controllable Text Generation

abstract: Controllable text generation (CTG) aims to generate text with desired attributes, and decoding-time-based methods have shown promising performance on this task. However, in this paper, we identify the phenomenon of Attribute Collapse for the first time. It causes the fluency of generated text to rapidly decrease when the control strength exceeds a critical value, rendering the text completely unusable. This limitation hinders the effectiveness of decoding methods in achieving high levels of controllability. To address this problem, we propose a novel lightweight decoding framework named Air-Decoding. Its main idea is reconstructing the attribute distributions to balance the weights between attribute words and non-attribute words to generate more fluent text. Specifically, we train prefixes by prefix-tuning to obtain attribute distributions. Then we design a novel attribute distribution reconstruction method to balance the obtained distributions and use the reconstructed distributions to guide language models for generation, effectively avoiding the issue of Attribute Collapse. Experiments on multiple CTG tasks prove that our method achieves a new state-of-the-art control performance.


title: Data Drift Monitoring for Log Anomaly Detection Pipelines

abstract: Logs enable the monitoring of infrastructure status and the performance of associated applications. Logs are also invaluable for diagnosing the root causes of any problems that may arise. Log Anomaly Detection (LAD) pipelines automate the detection of anomalies in logs, providing assistance to site reliability engineers (SREs) in system diagnosis. Log patterns change over time, necessitating updates to the LAD model defining the `normal' log activity profile. In this paper, we introduce a Bayes Factor-based drift detection method that identifies when intervention, retraining, and updating of the LAD model are required with human involvement. We illustrate our method using sequences of log activity, both from unaltered data, and simulated activity with controlled levels of anomaly contamination, based on real collected log data.


title: Local Universal Explainer (LUX) -- a rule-based explainer with factual, counterfactual and visual explanations

abstract: Explainable artificial intelligence (XAI) is one of the most intensively developed area of AI in recent years. It is also one of the most fragmented with multiple methods that focus on different aspects of explanations. This makes difficult to obtain the full spectrum of explanation at once in a compact and consistent way. To address this issue, we present Local Universal Explainer (LUX), which is a rule-based explainer that can generate factual, counterfactual and visual explanations. It is based on a modified version of decision tree algorithms that allows for oblique splits and integration with feature importance XAI methods such as SHAP or LIME. It does not use data generation in opposite to other algorithms, but is focused on selecting local concepts in a form of high-density clusters of real data that have the highest impact on forming the decision boundary of the explained model. We tested our method on real and synthetic datasets and compared it with state-of-the-art rule-based explainers such as LORE, EXPLAN and Anchor. Our method outperforms the existing approaches in terms of simplicity, global fidelity, representativeness, and consistency.


title: Astronomical Anomalies: Their Role in the Quest for Extraterrestrial Life

abstract: Astronomers occasionally detect an object having unexpected shape, unexplainable photometry, or unprecedented spectra that are inconsistent with our contemporary knowledge of the universe. Upon careful assessment, many of these anomalies are discarded as mere noise, contamination, or faulty analysis. But some anomalies survive scrutiny to yield new astronomical objects and physical processes. Examples of validated anomalies include quasars, pulsars, and periodic Doppler shifts of Sun-like stars caused by the gravitational pull of orbiting planets. Other anomalies persist as mysteries, including Fast Radio Bursts, dark energy, 'Oumuamua as an alien spaceship, and simultaneously vanishing stars. Advanced technological life may present astronomers with anomalies that require carefully designed observations from multiple vantage points simultaneously and with real-time spectroscopy.


title: On the microscopic propagation speed of long-range quantum many-body systems

abstract: We consider the time-dependent Schr\"odinger equation that is generated on the bosonic Fock space by a long-range quantum many-body Hamiltonian. We derive the first bound on the maximal speed of particle transport in these systems that is thermodynamically stable and holds all the way down to microscopic length scales. For this, we develop a novel multiscale rendition of the ASTLO (adiabatic spacetime localization observables) method. Our result opens the door to deriving the first thermodynamically stable Lieb-Robinson bounds on general local operators for these long-range interacting bosonic systems.


title: The AIMI Initiative: AI-Generated Annotations for Imaging Data Commons Collections

abstract: The Image Data Commons (IDC) contains publicly available cancer radiology datasets that could be pertinent to the research and development of advanced imaging tools and algorithms. However, the full extent of its research capabilities is limited by the fact that these datasets have few if any, annotations associated with them. Through this study with the Artificial Intelligence (AI) AI in Medical Imaging (AIMI) initiative, we produced high-quality, AI-generated imaging annotations of tissues, organs, and/or cancers for 11 distinct medical imaging collections from the IDC. These collections have a variety of image modalities, computed tomography (CT), magnetic resonance imaging (MRI), and positron emission tomography (PET) imaging modalities. Furthermore, the imaging collections cover various body parities, such as the chest, breast, kidneys, prostate, and liver. Both publicly available and novel AI algorithms were adopted and further developed using open-sourced data coupled with expert annotations to create the AI-generated annotations. A portion of the AI annotations were reviewed and corrected by a radiologist to assess the AI model's performance. Both the AI's and the radiologist's annotations conformed to DICOM standards for seamless integration into the IDC collections as third-party analyses. All the models and datasets (images and annotations) are publicly accessible.


title: On Airy Solutions of P$_\mathrm{II}$ and Complex Cubic Ensemble of Random Matrices, I

abstract: We show that the one-parameter family of special solutions of P$_\mathrm{II}$, the second Painlev\'e equation, constructed from the Airy functions, as well as associated solutions of P$_\mathrm{XXXIV}$ and S$_\mathrm{II}$, can be expressed via the recurrence coefficients of orthogonal polynomials that appear in the analysis of the Hermitian random matrix ensemble with a cubic potential. Exploiting this connection we show that solutions of P$_\mathrm{II}$ that depend only on the first Airy function $ \mathrm{Ai} $ (but not on $ \mathrm{Bi} $) possess a scaling limit in the pole free region, which includes a disk around the origin whose radius grows with the parameter. We then use the scaling limit to show that these solutions are monotone in the parameter on the negative real axis.


title: Universal Knowledge Graph Embeddings

abstract: A variety of knowledge graph embedding approaches have been developed. Most of them obtain embeddings by learning the structure of the knowledge graph within a link prediction setting. As a result, the embeddings reflect only the semantics of a single knowledge graph, and embeddings for different knowledge graphs are not aligned, e.g., they cannot be used to find similar entities across knowledge graphs via nearest neighbor search. However, knowledge graph embedding applications such as entity disambiguation require a more global representation, i.e., a representation that is valid across multiple sources. We propose to learn universal knowledge graph embeddings from large-scale interlinked knowledge sources. To this end, we fuse large knowledge graphs based on the owl:sameAs relation such that every entity is represented by a unique identity. We instantiate our idea by computing universal embeddings based on DBpedia and Wikidata yielding embeddings for about 180 million entities, 15 thousand relations, and 1.2 billion triples. Moreover, we develop a convenient API to provide embeddings as a service. Experiments on link prediction show that universal knowledge graph embeddings encode better semantics compared to embeddings computed on a single knowledge graph. For reproducibility purposes, we provide our source code and datasets open access at https://github.com/dice-group/Universal_Embeddings


title: Non-volatile memory based on PZT/FeGa thin film memtranstor

abstract: The PZT/FeGa thin film memtranstor was prepared and the modulation of the magnetoelectric coefficient by external magnetic and electric fields was studied. The magnetoelectric coefficient of the PZT/FeGa memtranstor can be reversed by flipping the direction of magnetization of FeGa or ferroelectric polarization of PZT. Notably, the sign of the magnetoelectric coefficient can be switched repeatedly by reversing ferroelectric polarization of PZT when the external magnetic field remains constant. Moreover, the binary switching behavior can still be maintained under zero DC bias magnetic field. When the polarization direction remains stable, the magnetoelectric coefficient also does not change. This means that the magnetoelectric coefficient of PZT/FeGa is non-volatile. Furthermore, the retention and endurance characteristics of the PZT/FeGa thin film memtranstor have been investigated. These findings demonstrate the potential of the PZT/FeGa thin film memtranstor for non-volatile memory applications.


title: Series of Hessian-Vector Products for Tractable Saddle-Free Newton Optimisation of Neural Networks

abstract: Despite their popularity in the field of continuous optimisation, second-order quasi-Newton methods are challenging to apply in machine learning, as the Hessian matrix is intractably large. This computational burden is exacerbated by the need to address non-convexity, for instance by modifying the Hessian's eigenvalues as in Saddle-Free Newton methods. We propose an optimisation algorithm which addresses both of these concerns - to our knowledge, the first efficiently-scalable optimisation algorithm to asymptotically use the exact inverse Hessian with absolute-value eigenvalues. Our method frames the problem as a series which principally square-roots and inverts the squared Hessian, then uses it to precondition a gradient vector, all without explicitly computing or eigendecomposing the Hessian. A truncation of this infinite series provides a new optimisation algorithm which is scalable and comparable to other first- and second-order optimisation methods in both runtime and optimisation performance. We demonstrate this in a variety of settings, including a ResNet-18 trained on CIFAR-10.