title: On the Prediction Network Architecture in RNN-T for ASR

abstract: RNN-T models have gained popularity in the literature and in commercial systems because of their competitiveness and capability of operating in online streaming mode. In this work, we conduct an extensive study comparing several prediction network architectures for both monotonic and original RNN-T models. We compare 4 types of prediction networks based on a common state-of-the-art Conformer encoder and report results obtained on Librispeech and an internal medical conversation data set. Our study covers both offline batch-mode and online streaming scenarios. In contrast to some previous works, our results show that Transformer does not always outperform LSTM when used as prediction network along with Conformer encoder. Inspired by our scoreboard, we propose a new simple prediction network architecture, N-Concat, that outperforms the others in our on-line streaming benchmark. Transformer and n-gram reduced architectures perform very similarly yet with some important distinct behaviour in terms of previous context. Overall we obtained up to 4.1 % relative WER improvement compared to our LSTM baseline, while reducing prediction network parameters by nearly an order of magnitude (8.4 times).


title: A Multilingual Dataset of COVID-19 Vaccination Attitudes on Twitter

abstract: Vaccine hesitancy is considered as one main cause of the stagnant uptake ratio of COVID-19 vaccines in Europe and the US where vaccines are sufficiently supplied. Fast and accurate grasp of public attitudes toward vaccination is critical to address vaccine hesitancy, and social media platforms have proved to be an effective source of public opinions. In this paper, we describe the collection and release of a dataset of tweets related to COVID-19 vaccines. This dataset consists of the IDs of 2,198,090 tweets collected from Western Europe, 17,934 of which are annotated with the originators' vaccination stances. Our annotation will facilitate using and developing data-driven models to extract vaccination attitudes from social media posts and thus further confirm the power of social media in public health surveillance. To lay the groundwork for future research, we not only perform statistical analysis and visualisation of our dataset, but also evaluate and compare the performance of established text-based benchmarks in vaccination stance extraction. We demonstrate one potential use of our data in practice in tracking the temporal changes of public COVID-19 vaccination attitudes.


title: Quantum Uncertainty Dynamics

abstract: Quantum uncertainty relations have deep-rooted significance on the formalism of quantum mechanics. Heisenberg's uncertainty relations attracted a renewed interest for its applications in quantum information science. Robertson derived a general form of Heisenberg's uncertainty relations for a pair of arbitrary observables represented by Hermitian operators. In the present work, we discover a temporal version of the Heisenberg-Robertson uncertainty relations for the measurement of two observables at two different times, where the dynamical uncertainties crucially depend on the time evolution of the observables. The uncertainties not only depend on the choice of observables, but they also depend on the times at which the physical observables are measured. The time correlated two-time commutator dictates the trade-off between the dynamical uncertainties. We demonstrate the dynamics of these uncertainty relations for a spin-1/2 system and for a quantum harmonic oscillator. The temporal uncertainty relations discovered in this work can be experimentally verified with the present quantum technology.


title: Extracting Weighted Finite Automata from Recurrent Neural Networks for Natural Languages

abstract: Recurrent Neural Networks (RNNs) have achieved tremendous success in sequential data processing. However, it is quite challenging to interpret and verify RNNs' behaviors directly. To this end, many efforts have been made to extract finite automata from RNNs. Existing approaches such as exact learning are effective in extracting finite-state models to characterize the state dynamics of RNNs for formal languages, but are limited in the scalability to process natural languages. Compositional approaches that are scablable to natural languages fall short in extraction precision. In this paper, we identify the transition sparsity problem that heavily impacts the extraction precision. To address this problem, we propose a transition rule extraction approach, which is scalable to natural language processing models and effective in improving extraction precision. Specifically, we propose an empirical method to complement the missing rules in the transition diagram. In addition, we further adjust the transition matrices to enhance the context-aware ability of the extracted weighted finite automaton (WFA). Finally, we propose two data augmentation tactics to track more dynamic behaviors of the target RNN. Experiments on two popular natural language datasets show that our method can extract WFA from RNN for natural language processing with better precision than existing approaches. Our code is available at https://github.com/weizeming/Extract_WFA_from_RNN_for_NL.


title: The structuring effect of a Gottlieb element on the Sullivan minimal model of a space

abstract: We show a Gottlieb element in the rational homotopy of a simply connected space $X$ implies a structural result for the Sullivan minimal model, with different results depending on parity. In the even-degree case, we prove a rational Gottlieb element is a terminal homotopy element. This fact allows us to complete an argument of Dupont to prove an even-degree Gottlieb element gives a free factor in the rational cohomology of a formal space of finite type. We apply the odd-degree result to affirm a special case of the $2N$-conjecture on Gottlieb elements of a finite complex. We combine our results to make a contribution to the realization problem for the classifying space $B\mathrm{aut}_1(X)$. We prove a simply connected space $X$ satisfying $B\mathrm{aut}_1(X_{\mathbb{Q}}) \simeq S_{\mathbb{Q}}^{2n}$ must have infinite-dimensional rational homotopy and vanishing rational Gottlieb elements above degree $2n-1$ for $n= 1, 2, 3.$


title: Contextual Density Ratio for Language Model Biasing of Sequence to Sequence ASR Systems

abstract: End-2-end (E2E) models have become increasingly popular in some ASR tasks because of their performance and advantages. These E2E models directly approximate the posterior distribution of tokens given the acoustic inputs. Consequently, the E2E systems implicitly define a language model (LM) over the output tokens, which makes the exploitation of independently trained language models less straightforward than in conventional ASR systems. This makes it difficult to dynamically adapt E2E ASR system to contextual profiles for better recognizing special words such as named entities. In this work, we propose a contextual density ratio approach for both training a contextual aware E2E model and adapting the language model to named entities. We apply the aforementioned technique to an E2E ASR system, which transcribes doctor and patient conversations, for better adapting the E2E system to the names in the conversations. Our proposed technique achieves a relative improvement of up to 46.5% on the names over an E2E baseline without degrading the overall recognition accuracy of the whole test set. Moreover, it also surpasses a contextual shallow fusion baseline by 22.1 % relative.


title: Quantum Limits on the Capacity of Multispan Links with Phase-Sensitive Amplification

abstract: The capacity of a linear attenuating optical channel with the signal regenerated using quantum-limited phase-sensitive amplifiers is analyzed for conventional and generalized detection scenarios. The continuous model of distributed amplification determines the attainable capacity for long-haul links under the total power constraint.


title: From Kernel Methods to Neural Networks: A Unifying Variational Formulation

abstract: The minimization of a data-fidelity term and an additive regularization functional gives rise to a powerful framework for supervised learning. In this paper, we present a unifying regularization functional that depends on an operator and on a generic Radon-domain norm. We establish the existence of a minimizer and give the parametric form of the solution(s) under very mild assumptions. When the norm is Hilbertian, the proposed formulation yields a solution that involves radial-basis functions and is compatible with the classical methods of machine learning. By contrast, for the total-variation norm, the solution takes the form of a two-layer neural network with an activation function that is determined by the regularization operator. In particular, we retrieve the popular ReLU networks by letting the operator be the Laplacian. We also characterize the solution for the intermediate regularization norms $\|\cdot\|=\|\cdot\|_{L_p}$ with $p\in(1,2]$. Our framework offers guarantees of universal approximation for a broad family of regularization operators or, equivalently, for a wide variety of shallow neural networks, including the cases (such as ReLU) where the activation function is increasing polynomially. It also explains the favorable role of bias and skip connections in neural architectures.


title: Computational Discovery of Two-Dimensional Rare-Earth Iodides: Promising Ferrovalley Materials for Valleytronics

abstract: Two-dimensional Ferrovalley materials with intrinsic valley polarization are rare but highly promising for valley-based nonvolatile random access memory and valley filter. Using Kinetically Limited Minimization (KLM), an unconstrained crystal structure prediction algorithm, and prototype sampling based on first-principles calculations, we have discovered 17 new Ferrovalley materials (rare-earth iodides RI$_2$, where R is a rare-earth element belonging to Sc, Y, or La-Lu, and I is Iodine). The rare-earth iodides are layered and demonstrate 2H, 1T, or 1T$_d$ phase as the ground-state in bulk, analogous to transition metal dichalcogenides (TMDCs). The calculated exfoliation energy of monolayers is comparable to that of graphene and TMDCs, suggesting possible experimental synthesis. The monolayers in the 2H phase exhibit two-dimensional ferromagnetism due to unpaired electrons in $d$ and $f$ orbitals. Throughout the rare-earth series, $d$ bands show valley polarization at $K$ and $\bar{K}$ points in the Brillouin zone near the Fermi level. Due to strong magnetic exchange interaction and spin-orbit coupling, large intrinsic valley polarization in the range of 15-143 meV without external stimuli is observed, which can be tuned and enhanced by applying a biaxial strain. These valleys can selectively be probed and manipulated for information storage and processing, potentially offering superior performance beyond conventional electronics and spintronics. We further show that the 2H ferromagnetic phase of RI$_2$ monolayers possesses non-zero Berry curvature and exhibits the valley Hall effect with considerable anomalous Hall conductivity. Our work will incite exploratory synthesis of the predicted Ferrovalley materials and their application in valleytronics and beyond.


title: The fewest-big-jumps principle and an application to random graphs

abstract: We prove a large deviation principle for the sum of n independent heavy-tailed random variables, which are subject to a moving cut-off boundary at location n. Conditional on the sum being large at scale n, we show that a finite number of summands take values near the cut-off boundary, while the remaining variables still obey the law of large numbers. This generalises the well-known single-big-jump principle for random variables without cut-off to a situation where just the minimal necessary number of jumps occur. As an application, we consider a random graph with vertex set given by the lattice points of a torus with sidelength 2N+1. Every vertex is the centre of a ball with random radius sampled from a heavy-tailed distribution. Oriented edges are drawn from the central vertex to all other vertices in this ball. When this graph is conditioned on having an exceptionally large number of edges we use our main result to show that, as N goes to infinity, the excess outdegrees condense in a fixed, finite number of randomly scattered vertices of macroscopic outdegree. By contrast, no condensation occurs for the indegrees of the vertices, which all remain microscopic in size.


title: Comment on "Electron spin resonance and collective excitations in magic-angle twisted bilayer graphene"

abstract: This comment pertains the recent manuscript by Morissette {\it et al.} [arXiv:2206.08354v1]. The authors claim to have found signatures of collective excitations in electron spin resonance experiments that would be linked to the correlated structure of magic angle bilayer graphene. However, identical resonance features have already been reported in previous works on mono- and few-layer graphene, voiding their theoretical framework. A straight forward theoretical picture within the single-particle topologically non-trivial band structure of graphene delivers satisfactory explanations for the observation of the resonant features and applies as well to the data presented by Morissette {\it et al.}. However, this intuitive picture has been disregarded by the authors.


title: Goodness in $n$-angulated categories

abstract: We generalise the notions of good, middling good, and Verdier good morphisms of distinguished triangles in triangulated categories, first introduced by Neeman, to the setting of $n$-angulated categories, introduced in Geiss, Keller, and Oppermann. We then prove that all morphisms of $n$-angles in an $(n-2)$-cluster tilting $n$-angulated category are middling good for $n>3$.


title: Anomalous Higgs boson couplings in weak boson fusion production at NNLO in QCD

abstract: The production of Higgs bosons in weak boson fusion has the second largest cross section among Higgs-production processes at the LHC. As such, this process plays an important role in detailed studies of Higgs interactions with vector bosons. In this paper we extend the available description of Higgs boson production in weak boson fusion by considering anomalous $HVV$ interactions and NNLO QCD radiative corrections at the same time. We find that, while leading order QCD predictions are too uncertain to allow for detailed studies of the anomalous couplings, NLO QCD results are sufficiently precise, most of the time. The NNLO QCD corrections alter the NLO QCD predictions only marginally, but their availability enhances the credibility of conclusions based on NLO QCD computations.


title: Structurally stable subharmonic regime of a driven quantum Josephson circuit

abstract: Driven quantum nonlinear oscillators, while essential for quantum technologies, are generally prone to complex chaotic dynamics that fall beyond the reach of perturbative analysis. By focusing on subharmonic bifurcations of a harmonically driven oscillator, we provide a recipe for the choice of the oscillator's parameters that ensures a regular dynamical behavior independently of the driving strength. We show that this suppression of chaotic phenomena is compatible with a strong quantum nonlinear effect reflected by the confinement rate in the degenerate manifold spanned by stable subharmonic orbits.


title: Discovery of a Short Period Pulsator from Istanbul University Observatory

abstract: We report the discovery of a new short period pulsating variable in the field of exoplanet host star XO-2. Variable has been identified while it was being used as a comparison star. In order to verify the variability of the candidate, a follow-up program was carried out. Period analysis of multi-band light curves revealed a very prominent and consistent pulsation periodicity of $P\sim0.95$ hours. Given the variability period, amplitude and the color index, the object is most likely a \emph{Delta Scuti} type variable. Absolute magnitude ($M_{v}$) and the color index $(B-V)_{0}$ of the star determined as $2.76$ and $0.22$, respectively. This $(B-V)_{0}$ of the star corresponds to A7 spectral type with an approximate effective temperature of 7725 K. Machine-learning analysis of the time-series data also revealed that the object is of variable type DSCT with a probability of 78\%.


title: ESA-Ariel Data Challenge NeurIPS 2022: Introduction to exo-atmospheric studies and presentation of the Atmospheric Big Challenge (ABC) Database

abstract: This is an exciting era for exo-planetary exploration. The recently launched JWST, and other upcoming space missions such as Ariel, Twinkle and ELTs are set to bring fresh insights to the convoluted processes of planetary formation and evolution and its connections to atmospheric compositions. However, with new opportunities come new challenges. The field of exoplanet atmospheres is already struggling with the incoming volume and quality of data, and machine learning (ML) techniques lands itself as a promising alternative. Developing techniques of this kind is an inter-disciplinary task, one that requires domain knowledge of the field, access to relevant tools and expert insights on the capability and limitations of current ML models. These stringent requirements have so far limited the developments of ML in the field to a few isolated initiatives. In this paper, We present the Atmospheric Big Challenge Database (ABC Database), a carefully designed, organised and publicly available database dedicated to the study of the inverse problem in the context of exoplanetary studies. We have generated 105,887 forward models and 26,109 complementary posterior distributions generated with Nested Sampling algorithm. Alongside with the database, this paper provides a jargon-free introduction to non-field experts interested to dive into the intricacy of atmospheric studies. This database forms the basis for a multitude of research directions, including, but not limited to, developing rapid inference techniques, benchmarking model performance and mitigating data drifts. A successful application of this database is demonstrated in the NeurIPS Ariel ML Data Challenge 2022.


title: AI powered, automated discovery of polymer membranes for carbon capture

abstract: The generation of molecules with Artificial Intelligence (AI) is poised to revolutionize materials discovery. Potential applications range from development of potent drugs to efficient carbon capture and separation technologies. However, existing computational frameworks lack automated training data creation and physical performance validation at meso-scale where complex properties of amorphous materials emerge. The methodological gaps have so far limited AI design to small-molecule applications. Here, we report the first automated discovery of complex materials through inverse molecular design which is informed by meso-scale target features and process figures-of-merit. We have entered the new discovery regime by computationally generating and validating hundreds of polymer candidates designed for application in post-combustion carbon dioxide filtration. Specifically, we have validated each discovery step, from training dataset creation, via graph-based generative design of optimized monomer units, to molecular dynamics simulation of gas permeation through the polymer membranes. For the latter, we have devised a Representative Elementary Volume (REV) enabling permeability simulations at about 1,000x the volume of an individual, AI-generated monomer, obtaining quantitative agreement. The discovery-to-validation time per polymer candidate is on the order of 100 hours in a standard computing environment, offering a computational screening alternative prior to lab validation.


title: Prespecified-time observer-based distributed control of battery energy storage systems

abstract: This paper studies the state-of-charge (SoC) balancing and the total charging/discharging power tracking issues for battery energy storage systems (BESSs) with multiple distributed heterogeneous battery units. Different from the traditional cooperative control strategies based on the asymptotical or finite-time distributed observers, two distributed prespecified-time observers are proposed to estimate average battery units state and average desired power, respectively, which can be determined in advance and independent of initial states or control parameters. Finally, two simulation examples are given to verify the effectiveness and superiority of the proposed control strategy.


title: On Iwasawa invariants of modular forms with reducible and non-$p$-distinguished residual Galois representations

abstract: In the present paper, we study the $p$-adic $L$-functions and the (strict) Selmer groups over $\mathbb{Q}_{\infty}$, the cyclotomic $\mathbb{Z}_p$-extension of $\mathbb{Q}$, of the $p$-adic weight one cusp forms $f$, obtained via the $p$-stabilization of weight one Eisenstein series, under the assumption that a certain Eisenstein component of the $p$-ordinary universal cuspidal Hecke algebra is Gorenstein. As an application, we compute the Iwasawa invariants of ordinary modular forms of weight $k\geq 2$ with the same residual Galois representations as the one of $f$, which in our setting, is reducible and non-$p$-distinguished. Combining this with a result of Kato \cite[Theorem~17.4.2]{kato04}, we prove the Iwasawa main conjecture for these forms. Also, we give numerical examples that satisfy the Gorenstein hypothesis. The crucial point on the analytic counter part is that under the Gorenstein hypothesis, we are able to define, following Greenberg--Vatsal, the $p$-adic $L$-functions of $p$-adic weight one forms $f$ as an element in the one-dimensional Iwasawa algebra by using Mazur--Kitagawa two-variable $p$-adic $L$-function and then, to compute them explicitly via local explicit reciprocity law. On the algebraic counter part, we compute the (strict) Selmer groups of $f$ over $\mathbb{Q}_{\infty}$ via the knowledge of the Galois representations of $f$ studied in \cite{BDP}.


title: Assessing Intel's Memory Bandwidth Allocation for resource limitation in real-time systems

abstract: Industries are recently considering the adoption of cloud computing for hosting safety critical applications. However, the use of multicore processors usually adopted in the cloud introduces temporal anomalies due to contention for shared resources, such as the memory subsystem. In this paper we explore the potential of Intel's Memory Bandwidth Allocation (MBA) technology, available on Xeon Scalable processors. By adopting a systematic measurement approach on real hardware, we assess the indirect memory bandwidth limitation achievable by applying MBA delays, showing that only given delay values (namely 70, 80 and 90) are effective in our setting. We also test the derived bandwidth assured to a hypothetical critical core when interfering cores (e.g., generating a concurrent memory access workload) are present on the same machine. Our results can support designers by providing understanding of impact of the shared memory to enable predictable progress of safety critical applications in cloud environments.


title: An approach to the girth problem in cubic graphs

abstract: We offer a new, gradual approach to the largest girth problem for cubic graphs. It is easily observed that the largest possible girth of all $n$-vertex cubic graphs is attained by a $2$-connected graph $G=(V,E)$. By Petersen's graph theorem, $E$ is the disjoint union of a $2$-factor and a perfect matching $M$. We refer to the edges of $M$ as chords and classify the cycles in $G$ by their number of chords. We define $\gamma_k(n)$ to be the largest integer $g$ such that every cubic $n$-vertex graph with a given perfect matching $M$ has a cycle of length at most $g$ with at most $k$ chords. Here we determine this function up to small additive constant for $k= 1, 2$ and up to a small multiplicative constant for larger $k$.


title: DDKtor: Automatic Diadochokinetic Speech Analysis

abstract: Diadochokinetic speech tasks (DDK), in which participants repeatedly produce syllables, are commonly used as part of the assessment of speech motor impairments. These studies rely on manual analyses that are time-intensive, subjective, and provide only a coarse-grained picture of speech. This paper presents two deep neural network models that automatically segment consonants and vowels from unannotated, untranscribed speech. Both models work on the raw waveform and use convolutional layers for feature extraction. The first model is based on an LSTM classifier followed by fully connected layers, while the second model adds more convolutional layers followed by fully connected layers. These segmentations predicted by the models are used to obtain measures of speech rate and sound duration. Results on a young healthy individuals dataset show that our LSTM model outperforms the current state-of-the-art systems and performs comparably to trained human annotators. Moreover, the LSTM model also presents comparable results to trained human annotators when evaluated on unseen older individuals with Parkinson's Disease dataset.


title: Implications of the muon anomalous magnetic moment for the LHC and MUonE

abstract: We consider the anomalous magnetic moment of the muon $a_\mu$, which shows a significant deviation from the Standard Model expectation given the recent measurements at Fermilab and BNL. We focus on Standard Model Effective Field Theory (SMEFT) with the aim to identify avenues for the upcoming LHC runs and future experiments such as MUonE. To this end, we include radiative effects to $a_\mu$ in SMEFT to connect the muon anomaly to potentially interesting searches at the LHC, specifically Higgs decays into muon pairs and such decays with resolved photons. Our investigation shows that similar to results for concrete UV extensions of the Standard Model, the Fermilab/BNL result can indicate strong coupling within the EFT framework and $a_\mu$ is increasingly sensitive to a single operator direction for high scale UV completions. In such cases, there is some complementarity between expected future experimental improvements, yet with considerable statistical challenges to match the precision provided by the recent $a_\mu$ measurement.


title: Implicit and fully discrete approximation of the supercooled Stefan problem in the presence of blow-ups

abstract: We consider two implicit approximation schemes of the one-dimensional supercooled Stefan problem and prove their convergence, even in the presence of finite time blow-ups. All proofs are based on a probabilistic reformulation recently considered in the literature. The first scheme is a version of the time-stepping scheme studied in V. Kaushansky, C. Reisinger, M. Shkolnikov, and Z. Q. Song, arXiv:2010.05281, 2020, but here the flux over the free boundary and its velocity are coupled implicitly. Moreover, we extend the analysis to more general driving processes than Brownian motion. The second scheme is a Donsker-type approximation, also interpretable as an implicit finite difference scheme, for which global convergence is shown under minor technical conditions. With stronger assumptions, which apply in cases without blow-ups, we obtain additionally a convergence rate arbitrarily close to 1/2. Our numerical results suggest that this rate also holds for less regular solutions, in contrast to explicit schemes, and allow a sharper resolution of the discontinuous free boundary in the blow-up regime.


title: ESA-Ariel Data Challenge NeurIPS 2022: Inferring Physical Properties of Exoplanets From Next-Generation Telescopes

abstract: The study of extra-solar planets, or simply, exoplanets, planets outside our own Solar System, is fundamentally a grand quest to understand our place in the Universe. Discoveries in the last two decades have re-defined our understanding of planets, and helped us comprehend the uniqueness of our very own Earth. In recent years the focus has shifted from planet detection to planet characterisation, where key planetary properties are inferred from telescope observations using Monte Carlo-based methods. However, the efficiency of sampling-based methodologies is put under strain by the high-resolution observational data from next generation telescopes, such as the James Webb Space Telescope and the Ariel Space Mission. We are delighted to announce the acceptance of the Ariel ML Data Challenge 2022 as part of the NeurIPS competition track. The goal of this challenge is to identify a reliable and scalable method to perform planetary characterisation. Depending on the chosen track, participants are tasked to provide either quartile estimates or the approximate distribution of key planetary properties. To this end, a synthetic spectroscopic dataset has been generated from the official simulators for the ESA Ariel Space Mission. The aims of the competition are three-fold. 1) To offer a challenging application for comparing and advancing conditional density estimation methods. 2) To provide a valuable contribution towards reliable and efficient analysis of spectroscopic data, enabling astronomers to build a better picture of planetary demographics, and 3) To promote the interaction between ML and exoplanetary science. The competition is open from 15th June and will run until early October, participants of all skill levels are more than welcomed!


title: Simple and Effective Multi-sentence TTS with Expressive and Coherent Prosody

abstract: Generating expressive and contextually appropriate prosody remains a challenge for modern text-to-speech (TTS) systems. This is particularly evident for long, multi-sentence inputs. In this paper, we examine simple extensions to a Transformer-based FastSpeech-like system, with the goal of improving prosody for multi-sentence TTS. We find that long context, powerful text features, and training on multi-speaker data all improve prosody. More interestingly, they result in synergies. Long context disambiguates prosody, improves coherence, and plays to the strengths of Transformers. Fine-tuning word-level features from a powerful language model, such as BERT, appears to profit from more training data, readily available in a multi-speaker setting. We look into objective metrics on pausing and pacing and perform thorough subjective evaluations for speech naturalness. Our main system, which incorporates all the extensions, achieves consistently strong results, including statistically significant improvements in speech naturalness over all its competitors.


title: Optical properties of oxygen-containing yttrium hydride thin films during and after the deposition

abstract: The synthesis of the photochromic YHO films is based on the oxidation of deposited yttrium hydride in ambient conditions. The actual state of the films during the deposition process, which is influenced by the deposition pressure and the oxidation caused by the residual gases, is not completely known. We report on the YHxOy thin films deposited by reactive pulsed-DC magnetron sputtering. Since the visible light transmittance is closely related to the phase and chemical composition of the films, in-situ transmittance measurements during and after deposition are performed. Ex-situ spectroscopic ellipsometry is used to determine the optical constants of YHxOy throughout the film thickness. In order to obtain metallic YH2-x films, the densest possible structure with a high deposition rate is required, otherwise the films could already be partially transparent during the deposition. The transmittance is higher if deposition pressure is increased. This is because of the oxidation promoted by more porous growth of the microstructure that is observed at the surface and cross-section images of the films. The films exhibit a refractive index gradient perpendicular to the substrate surface, which is related to the porosity and variation of the chemical composition.


title: Real projective groups are formal

abstract: We prove that the mod 2-cohomology algebras of real projective groups are formal. As a consequence we derive the Hopkins-Wickelgren formality and the strong Massey vanishing conjecture for a large class of fields.


title: Superradiance of non-interacting atoms

abstract: Fully-excited two-level atoms separated by less than the transition wavelength cooperatively emit light in a short burst, a phenomenon called superradiance by R. Dicke in 1954. The burst is characterized by a maximum intensity scaling with the square of the number of atoms $N$ and a temporal width reduced by $N$ compared to the single atom spontaneous decay time. Both effects are usually attributed to a synchronization of the electric dipole moments of the atoms occurring during the process of light emission. Contrary to this explanation, it was recently shown by use of a quantum path description that the peak intensity results from the quantum correlations among the atoms when occupying symmetric Dicke states. Here we investigate from this perspective the temporal evolution of the ensemble, starting in the small sample limit, i.e., when the atoms have mutual separations much smaller than the transition wavelength $\lambda$ and pass down the ladder of symmetric Dicke states. In addition, we explore the temporal evolution for the case of non-interacting atoms with mutual separations much larger than $\lambda$. We show that in this case a similar superradiant burst of the emitted radiation is observed if the quantum correlations of the atoms are generated by conditional photon measurements retaining the atomic ensemble within or close to the symmetric subspace.


title: Meta-Wrapper: Differentiable Wrapping Operator for User Interest Selection in CTR Prediction

abstract: Click-through rate (CTR) prediction, whose goal is to predict the probability of the user to click on an item, has become increasingly significant in the recommender systems. Recently, some deep learning models with the ability to automatically extract the user interest from his/her behaviors have achieved great success. In these work, the attention mechanism is used to select the user interested items in historical behaviors, improving the performance of the CTR predictor. Normally, these attentive modules can be jointly trained with the base predictor by using gradient descents. In this paper, we regard user interest modeling as a feature selection problem, which we call user interest selection. For such a problem, we propose a novel approach under the framework of the wrapper method, which is named Meta-Wrapper. More specifically, we use a differentiable module as our wrapping operator and then recast its learning problem as a continuous bilevel optimization. Moreover, we use a meta-learning algorithm to solve the optimization and theoretically prove its convergence. Meanwhile, we also provide theoretical analysis to show that our proposed method 1) efficiencies the wrapper-based feature selection, and 2) achieves better resistance to overfitting. Finally, extensive experiments on three public datasets manifest the superiority of our method in boosting the performance of CTR prediction.


title: Two-Stage Neural Contextual Bandits for Personalised News Recommendation

abstract: We consider the problem of personalised news recommendation where each user consumes news in a sequential fashion. Existing personalised news recommendation methods focus on exploiting user interests and ignores exploration in recommendation, which leads to biased feedback loops and hurt recommendation quality in the long term. We build on contextual bandits recommendation strategies which naturally address the exploitation-exploration trade-off. The main challenges are the computational efficiency for exploring the large-scale item space and utilising the deep representations with uncertainty. We propose a two-stage hierarchical topic-news deep contextual bandits framework to efficiently learn user preferences when there are many news items. We use deep learning representations for users and news, and generalise the neural upper confidence bound (UCB) policies to generalised additive UCB and bilinear UCB. Empirical results on a large-scale news recommendation dataset show that our proposed policies are efficient and outperform the baseline bandit policies.


title: Cooperative Retriever and Ranker in Deep Recommenders

abstract: Deep recommender systems (DRS) are intensively applied in modern web services. To deal with the massive web contents, DRS employs a two-stage workflow: retrieval and ranking, to generate its recommendation results. The retriever aims to select a small set of relevant candidates from the entire items with high efficiency; while the ranker, usually more precise but time-consuming, is supposed to further refine the best items from the retrieved candidates. Traditionally, the two components are trained either independently or within a simple cascading pipeline, which is prone to poor collaboration effect. Though some latest works suggested to train retriever and ranker jointly, there still exist many severe limitations: item distribution shift between training and inference, false negative, and misalignment of ranking order. As such, it remains to explore effective collaborations between retriever and ranker.


title: Transport coefficients associated to black holes on the brane: analysis of the shear viscosity-to-entropy density ratio

abstract: In this thesis, we apply the AdS/CFT correspondence to space-times associated with extensions of General Relativity. We are particularly interested in calculating the transport coefficient, the shear viscosity, associated with the effective field theory whose dual is a black hole space-time in bulk. The correspondence also allows us to compute thermodynamic quantities, in which the entropy, plays a prominent role when the ratio between the shear viscosity-to-entropy density is taken. This ratio is conjectured to have a minimum value of $1/4{\pi}$, in natural units. The main results presented in this thesis consist of calculating the ratio for two different cases, and then applying the KSS conjecture - which establishes the minimum value for the ratio -, to investigate properties associated with the deformed space-time metrics. A brief review of General Relativity and Black Holes is presented. The so-called Brane World formalism is introduced, obtaining the equivalent of Einstein's equations and Black Hole solutions on the brane, which can be seen as extensions of solutions known in General Relativity. We discuss the formulation of AdS/CFT correspondence, and how to apply it to compute transport coefficients. Then applying this knowledge to compute transport coefficients associated with the solutions constituting an extension of General Relativity. Naturally, throughout the process of developing this work other interesting questions arise, therefore we include two studies related to these developments. In one we investigate the computation of transport coefficients when we have a fermionic sector in the model. The second is a proposal on how to evaluate the consistency of AdS/CFT correspondence via the calculation of the Weyl anomaly.


title: BoT-SORT: Robust Associations Multi-Pedestrian Tracking

abstract: The goal of multi-object tracking (MOT) is detecting and tracking all the objects in a scene, while keeping a unique identifier for each object. In this paper, we present a new robust state-of-the-art tracker, which can combine the advantages of motion and appearance information, along with camera-motion compensation, and a more accurate Kalman filter state vector. Our new trackers BoT-SORT, and BoT-SORT-ReID rank first in the datasets of MOTChallenge [29, 11] on both MOT17 and MOT20 test sets, in terms of all the main MOT metrics: MOTA, IDF1, and HOTA. For MOT17: 80.5 MOTA, 80.2 IDF1, and 65.0 HOTA are achieved. The source code and the pre-trained models are available at https://github.com/NirAharon/BOT-SORT


title: The 511-CAM Mission: A Pointed 511 keV Gamma-Ray Telescope with a Focal Plane Detector Made of Stacked Transition Edge Sensor Microcalorimeter Arrays

abstract: The 511 keV gamma-ray emission from the galactic center region may fully or partially originate from the annihilation of positrons from dark matter particles with electrons from the interstellar medium. Alternatively, the positrons could be created by astrophysical sources, involving exclusively standard model physics. We describe here a new concept for a 511 keV mission called 511-CAM (511 keV gamma-ray CAmera using Micro-calorimeters) that combines focusing gamma-ray optics with a stack of Transition Edge Sensor (TES) microcalorimeter arrays in the focal plane. The 511-CAM detector assembly has a projected 511 keV energy resolution of 390 eV Full Width Half Maximum (FWHM) or better, and improves by a factor of at least 11 on the performance of state-of-the-art Ge-based Compton telescopes. Combining this unprecedented energy resolution with sub-arcmin angular resolutions afforded by Laue lens or channeling optics could make substantial contributions to identifying the origin of the 511 keV emission by discovering and characterizing point sources and measuring line-of-sight velocities of the emitting plasmas.


title: Asymptotic analysis of Emden-Fowler type equation with an application to power flow models

abstract: Emden-Fowler type equations are nonlinear differential equations that appear in many fields such as mathematical physics, astrophysics and chemistry. In this paper, we perform an asymptotic analysis of a specific Emden-Fowler type equation that emerges in a queuing theory context as an approximation of voltages under a well-known power flow model. Thus, we place Emden-Fowler type equations in the context of electrical engineering. We derive properties of the continuous solution of this specific Emden-Fowler type equation and study the asymptotic behavior of its discrete analog. We conclude that the discrete analog has the same asymptotic behavior as the classical continuous Emden-Fowler type equation that we consider.


title: Radioactivity induced dark count rate for single near-infrared photon detection with a tungsten transition edge sensor at 80 mK

abstract: The intrinsic background count rate of tungsten superconducting transition-edge sensors (TES) is low, and the calorimeters using these sensors can resolve the energy of single photons. These facts make the sensors particularly interesting for the background-limited searches of new processes and particles. In this contribution, the intrinsic background of a tungsten TES has been investigated. After excluding other sources (e.g., cosmic muons, thermal background) relevant for the observed background rate of $10^{-4}$~s$^{-1}$ for the detection of photons with a wave length of 1064 nm, we investigate the impact of natural radioactivity. Dedicated measurements using gamma-emitters mounted outside the cryostat have been used to estimate the sensitivity of the TES setup for ionizing radiation. We have found that indeed an increased background can be observed in the presence of the radioactive sources. After selecting events which populate our signal region tuned for single photon detection at near-infrared, roughly 0.5% of the events produced by gamma-rays appear indistinguishable from those due to single photons with 1064~nm wave length. This ratio is consistent with that observed for the residual background detected with the TES at a rate of $10^{-4}$~s$^{-1}$. From this, we conclude that the bulk of the observed background count-rate in the signal region can be explained by natural radioactivity.


title: Topological bias: How haloes trace structural patterns in the cosmic web

abstract: We trace the connectivity of the cosmic web as defined by haloes in the Planck-Millennium simulation using a persistence and Betti curve analysis. We normalise clustering up to the second-order correlation function, and use our systematic topological analysis to correlate local information and properties of haloes with their multi-scale geometrical environment of the cosmic web (elongated filamentary bridges and sheetlike walls). We capture the multi-scale topology traced by the halo distribution through filtrations of the corresponding Delaunay tessellation. The resulting nested $\textit{alpha shapes}$ are sensitive to the local density, perfectly outline the local geometry, and contain the complete information on the multi-scale topology. We find a remarkable linear relationship between halo masses and topology: haloes of different mass trace environments with different topological signature. This is $\textit{topological bias}$, an environmental structure bias independent of the halo clustering bias associated with the two-point correlation function. This mass-dependent linear scaling relation allows us to take clustering into account and determine the overall connectivity from a limited sample of galaxies. The presence of topological bias has major implications for the study of voids and filaments in the observed distribution of galaxies. The (infra)structure and shape of these key cosmic web components will strongly depend on the underlying galaxy sample. Their use as cosmological probes, with their properties influenced by cosmological parameters, will have to account for the subtleties of topological bias. This is of particular relevance with the large upcoming galaxy surveys such as DESI, Euclid, and the Vera Rubin telescope surveys.


title: Robust Unlimited Sampling Beyond Modulo

abstract: Analog to digital converters (ADCs) act as a bridge between the analog and digital domains. Two important attributes of any ADC are sampling rate and its dynamic range. For bandlimited signals, the sampling should be above the Nyquist rate. It is also desired that the signals' dynamic range should be within that of the ADC's; otherwise, the signal will be clipped. Nonlinear operators such as modulo or companding can be used prior to sampling to avoid clipping. To recover the true signal from the samples of the nonlinear operator, either high sampling rates are required or strict constraints on the nonlinear operations are imposed, both of which are not desirable in practice. In this paper, we propose a generalized flexible nonlinear operator which is sampling efficient. Moreover, by carefully choosing its parameters, clipping, modulo, and companding can be seen as special cases of it. We show that bandlimited signals are uniquely identified from the nonlinear samples of the proposed operator when sampled above the Nyquist rate. Furthermore, we propose a robust algorithm to recover the true signal from the nonlinear samples. We show that our algorithm has the lowest mean-squared error while recovering the signal for a given sampling rate, noise level, and dynamic range of the compared to existing algorithms. Our results lead to less constrained hardware design to address the dynamic range issues while operating at the lowest rate possible.


title: Impact of Lorentz violation models on exoplanets dynamics

abstract: Many exoplanets were detected thanks to the radial velocity method, according to which the motion of a binary system around its center of mass can produce a periodical variation of the Doppler effect of the light emitted by the host star. These variations are influenced by both Newtonian and non-Newtonian perturbations to the dominant inverse-square acceleration; accordingly, exoplanetary systems lend themselves to test theories of gravity alternative to General Relativity. In this paper, we consider the impact of Standard Model Extension (a model that can be used to test all possible Lorentz violations) on the perturbation of radial velocity, and suggest that suitable exoplanets configurations and improvements in detection techniques may contribute to obtain new constraints on the model parameters.


title: Cut Inner Layers: A Structured Pruning Strategy for Efficient U-Net GANs

abstract: Pruning effectively compresses overparameterized models. Despite the success of pruning methods for discriminative models, applying them for generative models has been relatively rarely approached. This study conducts structured pruning on U-Net generators of conditional GANs. A per-layer sensitivity analysis confirms that many unnecessary filters exist in the innermost layers near the bottleneck and can be substantially pruned. Based on this observation, we prune these filters from multiple inner layers or suggest alternative architectures by completely eliminating the layers. We evaluate our approach with Pix2Pix for image-to-image translation and Wav2Lip for speech-driven talking face generation. Our method outperforms global pruning baselines, demonstrating the importance of properly considering where to prune for U-Net generators.


title: Language-Based Audio Retrieval with Converging Tied Layers and Contrastive Loss

abstract: In this paper, we tackle the new Language-Based Audio Retrieval task proposed in DCASE 2022. Firstly, we introduce a simple, scalable architecture which ties both the audio and text encoder together. Secondly, we show that using this architecture along with contrastive loss allows the model to significantly beat the performance of the baseline model. Finally, in addition to having an extremely low training memory requirement, we are able to use pretrained models as it is without needing to finetune them. We test our methods and show that using a combination of our methods beats the baseline scores significantly.


title: The THUEE System Description for the IARPA OpenASR21 Challenge

abstract: This paper describes the THUEE team's speech recognition system for the IARPA Open Automatic Speech Recognition Challenge (OpenASR21), with further experiment explorations. We achieve outstanding results under both the Constrained and Constrained-plus training conditions. For the Constrained training condition, we construct our basic ASR system based on the standard hybrid architecture. To alleviate the Out-Of-Vocabulary (OOV) problem, we extend the pronunciation lexicon using Grapheme-to-Phoneme (G2P) techniques for both OOV and potential new words. Standard acoustic model structures such as CNN-TDNN-F and CNN-TDNN-F-A are adopted. In addition, multiple data augmentation techniques are applied. For the Constrained-plus training condition, we use the self-supervised learning framework wav2vec2.0. We experiment with various fine-tuning techniques with the Connectionist Temporal Classification (CTC) criterion on top of the publicly available pre-trained model XLSR-53. We find that the frontend feature extractor plays an important role when applying the wav2vec2.0 pre-trained model to the encoder-decoder based CTC/Attention ASR architecture. Extra improvements can be achieved by using the CTC model finetuned in the target language as the frontend feature extractor.


title: Online vs. Offline Adaptive Domain Randomization Benchmark

abstract: Physics simulators have shown great promise for conveniently learning reinforcement learning policies in safe, unconstrained environments. However, transferring the acquired knowledge to the real world can be challenging due to the reality gap. To this end, several methods have been recently proposed to automatically tune simulator parameters with posterior distributions given real data, for use with domain randomization at training time. These approaches have been shown to work for various robotic tasks under different settings and assumptions. Nevertheless, existing literature lacks a thorough comparison of existing adaptive domain randomization methods with respect to transfer performance and real-data efficiency. In this work, we present an open benchmark for both offline and online methods (SimOpt, BayRn, DROID, DROPO), to shed light on which are most suitable for each setting and task at hand. We found that online methods are limited by the quality of the currently learned policy for the next iteration, while offline methods may sometimes fail when replaying trajectories in simulation with open-loop commands. The code used will be released at https://github.com/gabrieletiboni/adr-benchmark.


title: Self-consistent formation and steady-state characterisation of trapped high energy electron clouds in the presence of a neutral gas background

abstract: This study considers the self-consistent formation and dynamics of electron clouds interacting with a background neutral gas through elastic and inelastic (ionisation) collisions in coaxial geometries similar to gyrotron electron guns. These clouds remain axially trapped as the result of crossed magnetic field lines and electric equipotential lines creating potential wells similar to those used in Penning traps. Contrary to standard Penning traps, in this study we consider a strong externally applied radial electric field which is of the same order as that of the space-charge field. In particular, the combination of coaxial geometry, strong radial electric fields and electron collisions with the residual neutral gas (RNG) present in the chamber induce non-negligible radial particle transport and ionisation. In this paper, the dynamics of the cloud density and currents resulting from electron-neutral collisions are studied using a 2D3V particle-in-cell code. Simulation results and parametric scans are hereby presented. Finally, a fluid model is derived to explain and predict the cloud peak density and peak radial current depending on the externally applied electric and magnetic fields, and on the RNG pressure.


title: conformalInference.multi and conformalInference.fd: Twin Packages for Conformal Prediction

abstract: Building on top of a regression model, Conformal Prediction methods produce distribution free prediction sets, requiring only i.i.d. data. While R packages implementing such methods for the univariate response framework have been developed, this is not the case with multivariate and functional responses. conformalInference.multi and conformalInference.fd address this void, by extending classical and more advanced conformal prediction methods like full conformal, split conformal, jackknife+ and multi split conformal to deal with the multivariate and functional case. The extreme flexibility of conformal prediction, fully embraced by the structure of the package, which does not require any specific regression model, enables users to pass in any regression function as input while using basic regression models as reference. Finally, the issue of visualisation is addressed by providing embedded plotting functions to visualize prediction regions.


title: How John Wheeler lost his faith in the law

abstract: In 1972, at a symposium celebrating the 70th birthday of Paul Dirac, John Wheeler proclaimed that "the framework falls down for everything that one has ever called a law of physics". Responsible for this "breakage [...] among the laws of physics" was the general theory of relativity, more specifically its prediction of massive stars gravitationally collapsing to "black holes", a term Wheeler himself had made popular some years earlier. In our paper, we investigate how Wheeler reached the conclusion that gravitational collapse calls into question the lawfulness of physics and how, subsequently, he tried to develop a new worldview, rethinking in his own way the lessons of quantum mechanics as well as drawing inspiration from other disciplines, not least biology.


title: Tailoring of rhenium oxidation state in ReOx thin films during reactive HiPIMS deposition process and following annealing

abstract: Bulk rhenium trioxide (ReO3) has an unusually high electrical conductivity and, being nanosized, has promising catalytic properties. However, the production of pure ReO3 thin films is challenging due to the difficulty to stabilize rhenium in a 6+ oxidation state. Here we present a novel approach for the deposition of ReOx (x = 1.6-2.9) thin films using reactive high power impulse magnetron sputtering (r-HiPIMS) from a metallic rhenium target in a mixed Ar/O2 atmosphere. The thin films were deposited in the gas-sustained self-sputtering regime, observed during r-HiPIMS process according to current waveforms. The influence of the substrate temperature, the oxygen-to-argon flow ratio and post-annealing at 250 {\deg}C in the air for 3 h on the properties of the films were studied. The as-deposited films have an X-ray amorphous structure (a-ReOx) when deposited at room temperature while a nano-crystalline \b{eta}-ReO2 phase when deposited at elevated temperatures (150 or 250 {\deg}C). The amorphous a-ReOx can be converted into the crystalline ReO3 with a lattice parameter of 3.75 {\AA} upon annealing in the air. The surface morphology of the films is dense without detectable voids when elevated substrate temperatures are used. Various Re oxidation states are observed on the surface of the films in different ratios depending on the deposition parameters. All samples exhibit electrical resistivity on the order of 10-3 Ohmxcm and optical properties typical for thin metallic films.


title: Conditionally Elicitable Dynamic Risk Measures for Deep Reinforcement Learning

abstract: We propose a novel framework to solve risk-sensitive reinforcement learning (RL) problems where the agent optimises time-consistent dynamic spectral risk measures. Based on the notion of conditional elicitability, our methodology constructs (strictly consistent) scoring functions that are used as penalizers in the estimation procedure. Our contribution is threefold: we (i) devise an efficient approach to estimate a class of dynamic spectral risk measures with deep neural networks, (ii) prove that these dynamic spectral risk measures may be approximated to any arbitrary accuracy using deep neural networks, and (iii) develop a risk-sensitive actor-critic algorithm that uses full episodes and does not require any additional nested transitions. We compare our conceptually improved reinforcement learning algorithm with the nested simulation approach and illustrate its performance in two settings: statistical arbitrage and portfolio allocation on both simulated and real data.

categories: cs.LG q-fin.CP q-fin.PM q-fin.RM q-fin.TR


title: NNLO study of top-quark mass renormalization scheme uncertainties in Higgs boson production

abstract: The ambiguity in the choice of a renormalization scheme and scale for the top-quark mass leads to an additional source of theoretical uncertainty in the calculation of the Higgs boson production cross section via gluon fusion. These uncertainties were found to be dominant in the case of off-shell Higgs production at next-to-leading order in QCD for large values of the Higgs virtuality $m_H^*$. In this work, we study the uncertainties related to the top-quark mass definition up to next-to-next-to-leading order (NNLO) in QCD. We include the full top-quark mass dependence up to three loops in the virtual corrections, and evaluate the real contributions in the soft limit, therefore obtaining the so-called soft-virtual (SV) approximation. We construct NNLO-SV predictions for off-shell Higgs boson production renormalizing the top-quark mass within both the on-shell (OS) and the MSbar schemes, and study in detail the differences between them. While the differences between the two schemes are sizeable, we find that the predictions are always compatible within scale uncertainties. We also observe that the difference between renormalization schemes is largely reduced when increasing the order of the perturbative expansion. We analyze the quality of the convergence of the perturbative series in both schemes, and find that at large invariant masses the MSbar results present much larger corrections than their OS counterparts. We also comment on the more complicated case of Higgs boson pair production.


title: Score Matching for Truncated Density Estimation on a Manifold

abstract: When observations are truncated, we are limited to an incomplete picture of our dataset. Recent methods propose to use score matching for truncated density estimation, where the access to the intractable normalising constant is not required. We present a novel extension of truncated score matching to a Riemannian manifold with boundary. Applications are presented for the von Mises-Fisher and Kent distributions on a two dimensional sphere in $\mathbb{R}^3$, as well as a real-world application of extreme storm observations in the USA. In simulated data experiments, our score matching estimator is able to approximate the true parameter values with a low estimation error and shows improvements over a naive maximum likelihood estimator.


title: Towards a Data-Driven Requirements Engineering Approach: Automatic Analysis of User Reviews

abstract: We are concerned by Data Driven Requirements Engineering, and in particular the consideration of user's reviews. These online reviews are a rich source of information for extracting new needs and improvement requests. In this work, we provide an automated analysis using CamemBERT, which is a state-of-the-art language model in French. We created a multi-label classification dataset of 6000 user reviews from three applications in the Health & Fitness field. The results are encouraging and suggest that it's possible to identify automatically the reviews concerning requests for new features. Dataset is available at: https://github.com/Jl-wei/APIA2022-French-user-reviews-classification-dataset.


title: Deep Learning for Spin-Orbit Torque Characterizations with a Projected Vector Field Magnet

abstract: Spin-orbit torque characterizations on magnetic heterostructures with perpendicular anisotropy are demonstrated on a projected vector field magnet via hysteresis loop shift measurement and harmonic Hall measurement with planar Hall correction. Accurate magnetic field calibration of the vector magnet is realized with the help of deep learning models, which are able to capture the nonlinear behavior between the generated magnetic field and the currents applied to the magnet. The trained models can successfully predict the applied current combinations under the circumstances of magnetic field scans, angle scans, and hysteresis loop shift measurements. The validity of the models is further verified, complemented by the comparison of the spin-orbit torque characterization results obtained from the deep-learning-trained vector magnet system with those obtained from a conventional setup comprised of two separated electromagnets. The damping-like spin-orbit torque (DL-SOT) efficiencies (|$\xi_{DL}$|) extracted from the vector magnet and the traditional measurement configuration are consistent, where |$\xi_{DL}$| $\approx$ 0.22 for amorphous W and |$\xi_{DL}$| $\approx$ 0.02 for $\alpha$-W. Our work provides an advanced method to meticulously control a vector magnet and to conveniently perform various spin-orbit torque characterizations.


title: Bias in the distribution of holonomy on compact hyperbolic 3-manifolds

abstract: Ambient prime geodesic theorems provide an asymptotic count of closed geodesics by their length and holonomy and imply effective equidistribution of holonomy. We show that for a smoothed count of closed geodesics on compact hyperbolic 3-manifolds, there is a persistent bias in the secondary term which is controlled by the number of zero spectral parameters. In addition, we show that a normalized, smoothed bias count is distributed according to a probability distribution, which we explicate when all distinct, non-zero spectral parameters are linearly independent. Finally, we construct an example of dihedral forms which does not satisfy this linear independence condition.


title: Not Cheating on the Turing Test: Towards Grounded Language Learning in Artificial Intelligence

abstract: Recent hype surrounding the increasing sophistication of language processing models has renewed optimism regarding machines achieving a human-like command of natural language. Research in the area of natural language understanding (NLU) in artificial intelligence claims to have been making great strides in this area, however, the lack of conceptual clarity/consistency in how 'understanding' is used in this and other disciplines makes it difficult to discern how close we actually are. In this interdisciplinary research thesis, I integrate insights from cognitive science/psychology, philosophy of mind, and cognitive linguistics, and evaluate it against a critical review of current approaches in NLU to explore the basic requirements--and remaining challenges--for developing artificially intelligent systems with human-like capacities for language use and comprehension.


title: Deep Learning-Based Attenuation and Scatter Correction of Brain 18F-FDG PET Images in the Image Domain

abstract: Attenuation and scatter correction (AC) is crucial for quantitative Positron Emission Tomography (PET) imaging. Recently, direct application of AC in the image domain using deep learning approaches has been proposed for the hybrid PET/MR and dedicated PET systems that lack accompanying transmission or anatomical imaging. This study set out to investigate deep learning-based AC in the image domain using different input settings.


title: Signature Methods in Machine Learning

abstract: Signature-based techniques give mathematical insight into the interactions between complex streams of evolving data. These insights can be quite naturally translated into numerical approaches to understanding streamed data, and perhaps because of their mathematical precision, have proved useful in analysing streamed data in situations where the data is irregular, and not stationary, and the dimension of the data and the sample sizes are both moderate. Understanding streamed multi-modal data is exponential: a word in $n$ letters from an alphabet of size $d$ can be any one of $d^n$ messages. Signatures remove the exponential amount of noise that arises from sampling irregularity, but an exponential amount of information still remain. This survey aims to stay in the domain where that exponential scaling can be managed directly. Scalability issues are an important challenge in many problems but would require another survey article and further ideas. This survey describes a range of contexts where the data sets are small enough to remove the possibility of massive machine learning, and the existence of small sets of context free and principled features can be used effectively. The mathematical nature of the tools can make their use intimidating to non-mathematicians. The examples presented in this article are intended to bridge this communication gap and provide tractable working examples drawn from the machine learning context. Notebooks are available online for several of these examples. This survey builds on the earlier paper of Ilya Chevryev and Andrey Kormilitzin which had broadly similar aims at an earlier point in the development of this machinery. This article illustrates how the theoretical insights offered by signatures are simply realised in the analysis of application data in a way that is largely agnostic to the data type.

categories: stat.ML cs.LG cs.NA math.CA math.NA math.ST stat.ME stat.TH


title: Leptogenesis in $SO(10)$ Models with $A_4$ Modular Symmetry

abstract: We study the prediction for leptogenesis in two renormalizable supersymmetric $SO(10)\times A_4$ modular models in which the neutrino mass is dominantly generated by the type I seesaw mechanism. The evolution of the lepton asymmetries are described in terms of the three-flavored density matrix equations for three heavy Majorana neutrinos, where both vanishing initial condition and thermal initial condition of the right-handed neutrinos are considered. We also present an analytical approximation based on the Boltzmann equations. We find regions of parameter space compatible with the measured fermion masses and mixing parameters as well as the baryon asymmetry of the Universe. The predictions for the light neutrino masses, the effective mass in neutrinoless doble beta decay and the leptonic CP violation phases are discussed.


title: Spectral and transport properties from lattice QCD

abstract: In these lecture notes we will discuss recent progress in extracting spectral and transport properties from lattice QCD. We will focus on results of probes of the thermal QCD medium as well as transport coefficients which are important ingredients for hydrodynamic and transport models that describe the evolution of the produced medium. These include electromagnetic probes, like the rates of emitted photons and dileptons, quarkonium spectral functions as well as transport coefficients like the electrical conductivity or heavy flavor diffusion coefficients of the quark gluon plasma (QGP). All these real time quantities are encoded in the vector meson spectral function. A direct determination of the spectral functions is not possible in Euclidean lattice QCD calculations but they can be analytically continued from imaginary to real time. Therefore it is possible to relate the spectral function to the corresponding Euclidean correlation functions. In the following sections we will discuss the procedure to determine the required correlation functions and the extraction of the spectral functions from lattice QCD correlators. We will illustrate the concepts and methods to obtain spectral functions and related physical observables from continuum extrapolated correlation functions. We will focus here on results obtained from continuum extrapolated lattice correlation functions, which requires large and fine lattices, which so far was only possible in quenched approximation. We will only give a brief introduction to lattice QCD and refer to the textbooks [1,2,3,4] and lecture notes [5] for more detailed introductions to lattice field theory. For the topics addressed in this lecture note we also like to refer to the overview articles on QCD thermodynamics and the QCD phase transition [5,6,7] and quarkonium in extreme conditions [8].


title: Identifying anomalous radio sources in the EMU Pilot Survey using a complexity-based approach

abstract: The Evolutionary Map of the Universe (EMU) large-area radio continuum survey will detect tens of millions of radio galaxies, giving an opportunity for the detection of previously unknown classes of objects. To maximise the scientific value and make new discoveries, the analysis of this data will need to go beyond simple visual inspection. We propose the coarse-grained complexity, a simple scalar quantity relating to the minimum description length of an image, that can be used to identify unusual structures. The complexity can be computed without reference to the broader sample or existing catalogue data, making the computation efficient on new surveys at very large scales (such as the full EMU survey). We apply our coarse-grained complexity measure to data from the EMU Pilot Survey to detect and confirm anomalous objects in this data set and produce an anomaly catalogue. Rather than work with existing catalogue data using a specific source detection algorithm, we perform a blind scan of the area, computing the complexity using a sliding square aperture. The effectiveness of the complexity measure for identifying anomalous objects is evaluated using crowd-sourced labels generated via the Zooniverse.org platform. We find that the complexity scan identifies unusual sources, such as odd radio circles, by partitioning on complexity. We achieve partitions where 5\% of the data is estimated to be 86\% complete, and 0.5\% is estimated to be 94\% pure, with respect to anomalies and use this to produce an anomaly catalogue.


title: BiometryNet: Landmark-based Fetal Biometry Estimation from Standard Ultrasound Planes

abstract: Fetal growth assessment from ultrasound is based on a few biometric measurements that are performed manually and assessed relative to the expected gestational age. Reliable biometry estimation depends on the precise detection of landmarks in standard ultrasound planes. Manual annotation can be time-consuming and operator dependent task, and may results in high measurements variability. Existing methods for automatic fetal biometry rely on initial automatic fetal structure segmentation followed by geometric landmark detection. However, segmentation annotations are time-consuming and may be inaccurate, and landmark detection requires developing measurement-specific geometric methods. This paper describes BiometryNet, an end-to-end landmark regression framework for fetal biometry estimation that overcomes these limitations. It includes a novel Dynamic Orientation Determination (DOD) method for enforcing measurement-specific orientation consistency during network training. DOD reduces variabilities in network training, increases landmark localization accuracy, thus yields accurate and robust biometric measurements. To validate our method, we assembled a dataset of 3,398 ultrasound images from 1,829 subjects acquired in three clinical sites with seven different ultrasound devices. Comparison and cross-validation of three different biometric measurements on two independent datasets shows that BiometryNet is robust and yields accurate measurements whose errors are lower than the clinically permissible errors, outperforming other existing automated biometry estimation methods. Code is available at https://github.com/netanellavisdris/fetalbiometry.


title: Dihedral Lattice Gauge Theories on a Quantum Annealer

abstract: We study lattice gauge theory with discrete, non-Abelian gauge groups. We extend the formalism of previous studies on D-Wave's quantum annealer as a computing platform to finite, simply reducible gauge groups. As an example, we use the dihedral group $D_n$ with $n=3,4$ on a two plaquette ladder for which we provide proof-of-principle calculations of the ground-state and employ the known time evolution formalism with Feynman clock states.


title: Boundary structure of gauge and matter fields coupled to gravity

abstract: The boundary structure of $3+1$-dimensional gravity (in the Palatini-Cartan formalism) coupled to to gauge (Yang-Mills) and matter (scalar and spinorial) fields is described through the use of the Kijowski-Tulczijew construction. In particular, the reduced phase space is obtained as the reduction of a symplectic space by some first class constraints and a cohomological description (BFV) of it is presented.


title: Optimal quantum control via genetic algorithms for quantum state engineering in driven-resonator mediated networks

abstract: We employ a machine learning-enabled approach to quantum state engineering based on evolutionary algorithms. In particular, we focus on superconducting platforms and consider a network of qubits -- encoded in the states of artificial atoms with no direct coupling -- interacting via a common single-mode driven microwave resonator. The qubit-resonator couplings are assumed to be in the resonant regime and tunable in time. A genetic algorithm is used in order to find the functional time-dependence of the couplings that optimise the fidelity between the evolved state and a variety of targets, including three-qubit GHZ and Dicke states and four-qubit graph states. We observe high quantum fidelities (above 0.96 in the worst case setting of a system of effective dimension 96) and resilience to noise, despite the algorithm being trained in the ideal noise-free setting. These results show that the genetic algorithms represent an effective approach to control quantum systems of large dimensions.


title: Entangling remote microwave quantum computers with hybrid entanglement swap and variational distillation

abstract: Superconducting microwave circuits with Josephson junctions are a major platform for quantum computing. To unleash their full capabilities, the cooperative operation of multiple microwave superconducting circuits is required. Therefore, designing an efficient protocol to distribute microwave entanglement remotely becomes a crucial open problem. Here, we propose a continuous-variable entanglement-swap approach based on optical-microwave entanglement generation, which can boost the ultimate rate by two orders of magnitude at state-of-the-art parameter region, compared with traditional approaches. We further empower the protocol with a hybrid variational entanglement distillation component to provide huge advantage in the infidelity-versus-success-probability trade-off. Our protocol can be realized with near-term device performance, and is robust against non-perfections such as optical loss and noise. Therefore, our work provides a practical method to realize efficient quantum links for superconducting microwave quantum computers.


title: Computer-aided diagnosis and prediction in brain disorders

abstract: Computer-aided methods have shown added value for diagnosing and predicting brain disorders and can thus support decision making in clinical care and treatment planning. This chapter will provide insight into the type of methods, their working, their input data - such as cognitive tests, imaging and genetic data - and the types of output they provide. We will focus on specific use cases for diagnosis, i.e. estimating the current 'condition' of the patient, such as early detection and diagnosis of dementia, differential diagnosis of brain tumours, and decision making in stroke. Regarding prediction, i.e. estimation of the future 'condition' of the patient, we will zoom in on use cases such as predicting the disease course in multiple sclerosis and predicting patient outcomes after treatment in brain cancer. Furthermore, based on these use cases, we will assess the current state-of-the-art methodology and highlight current efforts on benchmarking of these methods and the importance of open science therein. Finally, we assess the current clinical impact of computer-aided methods and discuss the required next steps to increase clinical impact.


title: Smoothed Analysis of Social Choice, Revisited

abstract: A canonical problem in social choice is how to aggregate ranked votes: given $n$ voters' rankings over $m$ candidates, what voting rule $f$ should we use to aggregate these votes into a single winner? One standard method for comparing voting rules is by their satisfaction of axioms - properties that we want a "reasonable" rule to satisfy. Unfortunately, this approach leads to several impossibilities: no voting rule can simultaneously satisfy all the properties we want, at least in the worst case over all possible inputs. Motivated by this, we consider a relaxation of these worst case requirements. We do so using a "smoothed" model of social choice, where votes are perturbed with small amounts of noise. If, no matter which input profile we start with, the probability (post-noise) of an axiom being satisfied is large, we will consider the axiom as good as satisfied - called "smoothed-satisfied" - even if it may be violated in the worst case. Our model is a mild restriction of Lirong Xia's, and corresponds closely to that in Spielman and Teng's original work on smoothed analysis. Much work has been done so far in several papers by Xia on axiom satisfaction under such noise. In our paper, we aim to give a more cohesive overview on when smoothed analysis of social choice is useful. Within our model, we give simple sufficient conditions for smoothed-satisfaction or smoothed-violation of several previously-unstudied axioms and paradoxes, plus many of those studied by Xia. We then observe that, in a practically important subclass of noise models, although convergence eventually occurs, known rates may require an extremely large number of voters. Motivated by this, we prove bounds specifically within a canonical noise model from this subclass - the Mallows model. Here, we present a more nuanced picture on exactly when smoothed analysis can help.


title: Chemical Diversity in Protoplanetary Disks and Its Impact on the Formation History of Giant Planets

abstract: Giant planets can interact with multiple and chemically diverse environments in protoplanetary discs while they form and migrate to their final orbits. The way this interaction affects the accretion of gas and solids shapes the chemical composition of the planets and of their atmospheres. Here we investigate the effects of different chemical structures of the host protoplanetary disc on the planetary composition. We consider both scenarios of molecular (inheritance from the pre-stellar cloud) and atomic (complete chemical reset) initial abundances in the disc. We focus on four elemental tracers of different volatility: C, O, N, and S. We explore the entire extension of possible formation regions suggested by observations by coupling the disc chemical scenarios with N-body simulations of forming and migrating giant planets. The planet formation process produces giant planets with chemical compositions significantly deviating from that of the host disc. We find that the C/N, N/O, and S/N ratios follow monotonic trends with the extent of migration. The C/O ratio shows a more complex behaviour, dependent on the planet accretion history and on the chemical structure of the formation environment. The comparison between S/N* and C/N* (where * indicates normalisation to the stellar value), constrains the relative contribution of gas and solids to the total metallicity. Giant planets whose metallicity is dominated by the contribution of the gas are characterised by N/O* > C/O* > C/N* and allow for constraining the disc chemical scenario. When the planetary metallicity is instead dominated by the contribution of the solids we find that C/N* > C/O* > N/O*.


title: On the polarization of the non-prompt contribution to inclusive J/$\psi$ production in pp collisions

abstract: Of the J/$\psi$ mesons (inclusively) produced in pp collisions, a big fraction results from B decays, increasing with transverse momentum and exceeding 50\% for $p_{\rm T} > 20$ GeV. These events must be subtracted in measurements of the polarization of prompt J/$\psi$ mesons. While several studies have addressed the $\psi$(2S) and $\chi_c$ impact on the determination of the polarization of the directly-produced J/$\psi$ mesons, the theoretical and experimental knowledge of the non-prompt polarization is very poor. Furthermore, non-prompt J/$\psi$ polarization measurements can provide interesting information on quarkonium hadroproduction, complementing the studies of prompt production. We review the method of measuring the polarization of non-prompt J/$\psi$ mesons (produced in decays of unreconstructed B mesons and detected in the dilepton channel), in conditions typical of LHC experiments studying J/$\psi$ production. Realistic model-independent scenarios are validated with data from experiments studying $e^+e^- \to \Upsilon$(4S) interactions, converted to the high-momentum regime using B differential cross sections measured at the LHC. The non-prompt J/$\psi$ polarization measurements are seen to remain dependent on the event selection criteria, even after correcting for the dilepton acceptance and efficiencies. This implies that reproducible definitions of all relevant analysis choices must be reported with the polarization result, for rigorous comparisons with other measurements and/or theoretical calculations. We also discuss how the non-prompt J/$\psi$ polarization significantly depends on the relative importance of two complementary $\mathrm{B}\to {\rm J}/\psi$ decay topologies, two-body (reasonably dominated by singlet production) and multi-body (including octet contributions), providing, hence, valuable information for studies of the charmonium formation mechanisms.


title: Multi-scale Physical Representations for Approximating PDE Solutions with Graph Neural Operators

abstract: Representing physical signals at different scales is among the most challenging problems in engineering. Several multi-scale modeling tools have been developed to describe physical systems governed by \emph{Partial Differential Equations} (PDEs). These tools are at the crossroad of principled physical models and numerical schema. Recently, data-driven models have been introduced to speed-up the approximation of PDE solutions compared to numerical solvers. Among these recent data-driven methods, neural integral operators are a class that learn a mapping between function spaces. These functions are discretized on graphs (meshes) which are appropriate for modeling interactions in physical phenomena. In this work, we study three multi-resolution schema with integral kernel operators that can be approximated with \emph{Message Passing Graph Neural Networks} (MPGNNs). To validate our study, we make extensive MPGNNs experiments with well-chosen metrics considering steady and unsteady PDEs.


title: Conferences -- An Owner's Manual

abstract: I share my opinions on how to get the most out of conferences. I have some advice on giving talks, but most of the essay is devoted to the much larger share of the conference not spent giving talks: attending talks and socializing.


title: ShapePipe: A modular weak-lensing processing and analysis pipeline

abstract: We present the first public release of ShapePipe, an open-source and modular weak-lensing measurement, analysis, and validation pipeline written in Python. We describe the design of the software and justify the choices made. We provide a brief description of all the modules currently available and summarise how the pipeline has been applied to real Ultraviolet Near-Infrared Optical Northern Survey data. Finally, we mention plans for future applications and development. The code and accompanying documentation are publicly available on GitHub.


title: Transmission properties of space-time modulated metamaterials

abstract: We prove the possibility of achieving exponentially growing wave propagation in space-time modulated media and give an asymptotic analysis of the quasifrequencies in terms of the amplitude of the time modulation at the degenerate points of the folded band structure. Our analysis provides the first proof of existence of k-gaps in the band structures of space-time modulated systems of subwavelength resonators.

categories: math.AP cond-mat.mtrl-sci math-ph math.MP


title: Mass Perturbation Theory in the 2-Flavor Schwinger Model with Opposite Masses

abstract: I discuss the 2-flavor Schwinger model with $\theta=0$ and small equal and opposite fermion masses (or $\theta=\pi$ with equal masses). The massless model has an unparticle sector with unbroken conformal symmetry. I argue that this special mass term modifies the conformal sector without breaking the conformal symmetry. I show in detail how mass-perturbation-theory works for correlators of flavor-diagonal fermion scalar bilinears. The result provides quantitative evidence that the theory has no mass gap for small non-zero fermion masses. The massive fermions are bound into conformally invariant unparticle stuff. I show how the long-distance conformal symmetry is maintained when small fermion masses are turned on and calculate the relevant scaling dimensions for small mass. I calculate the corrections to the 2- and 4-point functions of the fermion-bilinear scalars to leading order in perturbation theory in the fermion mass and describe a straightforward procedure to extend the calculation to all higher scalar correlators. I hope that this model as a useful and non-trivial example of unparticle physics, a sector with unbroken conformal symmetry coupled to interacting massive particles, in which we can analyze the particle physics in a consistent approximation.


title: A Combination Theorem for Trees of Metric Bundles

abstract: Motivated by the work of Bestvina-Feighn ([BF92]) and Mj-Sardar ([MS12]), we define trees of metric bundles subsuming both the trees of metric spaces and the metric bundles. Then we prove a combination theorem for these spaces. More precisely, we prove that a tree of metric bundles is hyperbolic if the following hold (see Theorem 1.4). $(1)$ The fibers are uniformly hyperbolic metric spaces and the base is also hyperbolic metric space, $(2)$ barycenter maps for the fibers are uniformly coarsely surjective, $(3)$ the edge spaces are uniformly qi embedded in the corresponding fibers and $(4)$ Bestvina-Feighn's flaring condition is satisfied. As an application, we provide a combination theorem for certain complexes of groups over finite simplicial complex (see Theorem 1.2).


title: Graded von Neumann regularity of rings graded by semigroups

abstract: In this article, we give a complete characterization of semigroup graded rings which are graded von Neumann regular. We also demonstrate our results by applying them to several classes of examples, including matrix rings and groupoid graded rings.


title: Squirrels can remember little: A random walk with jump reversals induced by a discrete-time renewal process

abstract: We consider a class of discrete-time random walks with directed unit steps on the integer line. The direction of the steps is reversed at the time instants of events in a discrete-time renewal process and is maintained at uneventful time instants. This model represents a discrete-time semi-Markovian generalization of the telegraph process. We derive exact formulae for the propagator using generating functions. We prove that for geometrically distributed waiting times in the diffusive limit, this walk converges to the classical telegraph process. We consider the large-time asymptotics of the expected position: For waiting time densities with finite mean the walker remains in the average localized close to the departure site whereas escapes for fat-tailed waiting-time densities (i.e. densities with infinite mean) by a sublinear power-law. We explore anomalous diffusion features by accounting for the `aging effect' as a hallmark of non-Markovianity where the discrete-time version of the `aging renewal process' comes into play. By deriving pertinent distributions of this process we obtain explicit formulae for the variance when the waiting-times are Sibuya-distributed. In this case and generally for fat-tailed waiting time PDFs a $t^2$-ballistic superdiffusive scaling emerges in the large time limit. In contrast if the waiting time PDF between the step reversals is light-tailed (`narrow' with finite mean and variance) the walk exhibits normal diffusion and for `broad' waiting time PDFs (with finite mean and infinite variance) superdiffusive large time scaling. We also consider time-changed versions where the walk is subordinated to a continuous-time point process such as the time-fractional Poisson process. This defines a new class of biased continuous-time random walks exhibiting several regimes of anomalous diffusion.


title: Four eccentric mergers increase the evidence that LIGO--Virgo--KAGRA's binary black holes form dynamically

abstract: The growing population of compact binary mergers detected with gravitational waves contains multiple events that are challenging to explain through isolated binary evolution. Such events have higher masses than are expected in isolated binaries, component spin-tilt angles that are misaligned, and/or non-negligible orbital eccentricities. We investigate the orbital eccentricities of 62 binary black hole candidates from the third gravitational-wave transient catalogue of the LIGO-Virgo-KAGRA Collaboration with an aligned-spin, moderate-eccentricity waveform model. Within this framework, we find that at least four of these events show significant support for eccentricity $e_{10} \geq 0.1$ at a gravitational-wave frequency of $10$~Hz ($> 60\%$ credibility, under a log-uniform eccentricity prior that spans the range $10^{-4} < e_{10} < 0.2$). Two of these events are new additions to the population: GW191109 and GW200208\_22. If the four eccentric candidates are truly eccentric, our results suggest that densely-populated star clusters may produce 100\% of the observed mergers. However, it remains likely that other formation environments with higher yields of eccentric mergers -- for example, active galactic nuclei -- also contribute. We estimate that we will be able to confidently distinguish which formation channel dominates the eccentric merger rate after $\gtrsim 80$ detections of events with $e_{10} \geq 0.05$ at LIGO--Virgo sensitivity, with only $\sim 5$ detectably-eccentric events required to distinguish formation channels with third-generation gravitational-wave detectors.


title: Spin-Wave Optics in YIG by Ion-Beam Irradiation

abstract: We demonstrate direct focused ion beam (FIB) writing as an enabling technology for realizing spin-wave-optics devices. It is shown that ion-beam irradiation changes the characteristics of YIG films on a submicron scale in a highly controlled way, allowing to engineer the magnonic index of refraction adapted to desired applications. This technique does not physically remove material, and allows rapid fabrication of high-quality architectures of modified magnetization in magnonic media with minimal edge damage (compared to more common techniques such as etching or milling). By experimentally showing magnonic versions of a number of optical devices (lenses, gratings, Fourier-domain processors) we envision this technology as the gateway to building magnonic computing devices that rival their optical counterparts in their complexity and computational power.


title: Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarios

abstract: Recurrent State-space models (RSSMs) are highly expressive models for learning patterns in time series data and system identification. However, these models assume that the dynamics are fixed and unchanging, which is rarely the case in real-world scenarios. Many control applications often exhibit tasks with similar but not identical dynamics which can be modeled as a latent variable. We introduce the Hidden Parameter Recurrent State Space Models (HiP-RSSMs), a framework that parametrizes a family of related dynamical systems with a low-dimensional set of latent factors. We present a simple and effective way of learning and performing inference over this Gaussian graphical model that avoids approximations like variational inference. We show that HiP-RSSMs outperforms RSSMs and competing multi-task models on several challenging robotic benchmarks both on real-world systems and simulations.


title: There and Back Again: On Applying Data Reduction Rules by Undoing Others

abstract: Data reduction rules are an established method in the algorithmic toolbox for tackling computationally challenging problems. A data reduction rule is a polynomial-time algorithm that, given a problem instance as input, outputs an equivalent, typically smaller instance of the same problem. The application of data reduction rules during the preprocessing of problem instances allows in many cases to considerably shrink their size, or even solve them directly. Commonly, these data reduction rules are applied exhaustively and in some fixed order to obtain irreducible instances. It was often observed that by changing the order of the rules, different irreducible instances can be obtained. We propose to "undo" data reduction rules on irreducible instances, by which they become larger, and then subsequently apply data reduction rules again to shrink them. We show that this somewhat counter-intuitive approach can lead to significantly smaller irreducible instances. The process of undoing data reduction rules is not limited to "rolling back" data reduction rules applied to the instance during preprocessing. Instead, we formulate so-called backward rules, which essentially undo a data reduction rule, but without using any information about which data reduction rules were applied to it previously. In particular, based on the example of Vertex Cover we propose two methods applying backward rules to shrink the instances further. In our experiments we show that this way smaller irreducible instances consisting of real-world graphs from the SNAP and DIMACS datasets can be computed.


title: Validation and results of an approximate model for the stress of a Tokamak toroidal field coil at the inboard midplane

abstract: We present the verification, validation, and results of an approximate, analytic model for the radial profile of the stress, strain, and displacement within the toroidal field (TF) coil of a Tokamak at the inner midplane, where stress management is of the most concern. The model is designed to have high execution speed yet capture the essential physics, suitable for scoping studies, rapid evaluation of designs, and in the inner loop of an optimizer. It is implemented in the PROCESS fusion reactor systems code. The model solves a many-layer axisymmetric extended plane strain problem. It includes linear elastic deformation, Poisson effects, transverse-isotropic materials properties, radial Lorentz force profiles, and axial tension applied to layer subsets. The model does not include out-of-plane forces from poloidal field coils. We benchmark the model against 2D and 3D Finite Element Analyses (FEA) using Ansys and COMSOL. We find the Tresca stress accuracy of the model to be within 10\% of the FEA result. We show that this model allows PROCESS to optimize a fusion pilot plant, subject to the TF coil winding pack and coil case yield constraints. This model sets an upper limit on the magnetic field strength at the coil surface of $29$ Tesla for steel TF coil cases, with the practical limit being significantly below this.


title: Decomposition of Industrial Systems for Energy Efficiency Optimization with OptTopo

abstract: The operation of industrial facilities is a broad field for optimization. Industrial plants are often a) composed of several components, b) linked using network technology, c) physically interconnected and d) complex regarding the effect of set-points and operating points in every entity. This leads to the possibility of overall optimization but also to a high complexity of the emerging optimization problems. The decomposition of complex systems allows the modeling of individual models which can be structured according to the physical topology. A method for energy performance indicators (EnPI) helps to formulate an optimization problem. The optimization algorithm OptTopo achieves efficient set-points by traversing a graph representation of the overall system.