title: Collaboration is not Evil: A Systematic Look at Security Research for Industrial Use

abstract: Following the recent Internet of Things-induced trends on digitization in general, industrial applications will further evolve as well. With a focus on the domains of manufacturing and production, the Internet of Production pursues the vision of a digitized, globally interconnected, yet secure environment by establishing a distributed knowledge base. Background. As part of our collaborative research of advancing the scope of industrial applications through cybersecurity and privacy, we identified a set of common challenges and pitfalls that surface in such applied interdisciplinary collaborations. Aim. Our goal with this paper is to support researchers in the emerging field of cybersecurity in industrial settings by formalizing our experiences as reference for other research efforts, in industry and academia alike. Method. Based on our experience, we derived a process cycle of performing such interdisciplinary research, from the initial idea to the eventual dissemination and paper writing. This presented methodology strives to successfully bootstrap further research and to encourage further work in this emerging area. Results. Apart from our newly proposed process cycle, we report on our experiences and conduct a case study applying this methodology, raising awareness for challenges in cybersecurity research for industrial applications. We further detail the interplay between our process cycle and the data lifecycle in applied research data management. Finally, we augment our discussion with an industrial as well as an academic view on this research area and highlight that both areas still have to overcome significant challenges to sustainably and securely advance industrial applications. Conclusions. With our proposed process cycle for interdisciplinary research in the intersection of cybersecurity and industrial application, we provide a foundation for further research.


title: Composition operators on Sobolev spaces and weighted moduli inequalities

abstract: In this paper we study connections between composition operators on Sobolev spaces and mappings defined by $p$-moduli inequalities ($p$-capacity inequalities). We prove that weighted moduli inequalities lead to composition operators on corresponding Sobolev spaces and inverse, composition operators on Sobolev spaces imply weighted moduli inequalities.


title: External leg corrections as an origin of large logarithms

abstract: The appearance of large logarithmic corrections is a well-known phenomenon in the presence of widely separated mass scales. In this work, we point out the existence of large Sudakov-like logarithmic contributions related to external-leg corrections of heavy scalar particles which cannot be resummed straight-forwardly using renormalisation group equations. Based on a toy model, we discuss in detail how these corrections appear in theories containing at least one light and one heavy particle that couple to each other with a potentially large trilinear coupling. We show how the occurrence of the large logarithms is related to infrared singularities. In addition to a discussion at the one-loop level, we also explicitly derive the two-loop corrections containing the large logarithms. We point out in this context the importance of choosing an on-shell-like renormalisation scheme. As exemplary applications, we present results for the two-loop external-leg corrections for the decay of a gluino into a scalar top quark and a top quark in the Minimal Supersymmetric extension of the Standard Model as well as for a heavy Higgs boson decay into two tau leptons in the singlet-extended Two-Higgs-Doublet Model.


title: Zeroth-order Optimization for Composite Problems with Functional Constraints

abstract: In many real-world problems, first-order (FO) derivative evaluations are too expensive or even inaccessible. For solving these problems, zeroth-order (ZO) methods that only need function evaluations are often more efficient than FO methods or sometimes the only options. In this paper, we propose a novel zeroth-order inexact augmented Lagrangian method (ZO-iALM) to solve black-box optimization problems, which involve a composite (i.e., smooth+nonsmooth) objective and functional constraints. Under a certain regularity condition (also assumed by several existing works on FO methods), the query complexity of our ZO-iALM is $\tilde{O}(d\varepsilon^{-3})$ to find an $\varepsilon$-KKT point for problems with a nonconvex objective and nonconvex constraints, and $\tilde{O}(d\varepsilon^{-2.5})$ for nonconvex problems with convex constraints, where $d$ is the variable dimension. This appears to be the first work that develops an iALM-based ZO method for functional constrained optimization and meanwhile achieves query complexity results matching the best-known FO complexity results up to a factor of $d$. With an extensive experimental study, we show the effectiveness of our method. The applications of our method span from classical optimization problems to practical machine learning examples such as resource allocation in sensor networks and adversarial example generation.


title: Simulations of Cosmic Ray Ensembles originated nearby the Sun

abstract: Cosmic Ray Ensembles (CRE) are yet not observed groups of cosmic rays with a common primary interaction vertex or the same parent particle. One of the processes capable of initiating identifiable CRE is an interaction of an ultra-high energy (UHE) photon with the solar magnetic field which results in an electron pair production and the subsequent synchrotron radiation. The resultant electromagnetic cascade forms a very characteristic line-like front of a very small width ($\sim$ meters), stretching from tens of thousands to even many millions of kilometers. In this contribution we present the results of applying a toy model to simulate detections of such CRE at the ground level with an array of ideal detectors of different dimensions. The adopted approach allows us to assess the CRE detection feasibility for a specific configuration of a detector array. The process of initiation and propagation of an electromagnetic cascade originated from an UHE photon passing near the Sun, as well as the resultant particle distribution on ground, were simulated using the CORSIKA program with the PRESHOWER option, both modified accordingly. The studied scenario results in photons forming a cascade that extends even over tens of millions of kilometers when it arrives at the top of the Earth's atmosphere, and the photon energies span practically the whole cosmic ray energy spectrum. The topology of the signal consists of very extended CRE shapes, and the characteristic, very much elongated disk-shape of the particle distribution on ground illustrates the potential for identification of CRE of this type.


title: Temperature effects for $e^-+e^+\rightarrow \mu^-+\mu^+$ scattering in very special relativity

abstract: The electron-positron scattering process is investigated in the context of very special relativity (VSR). This theory assumes that the true symmetry of nature is not the full Lorentz group, but some of its subgroups, such as the subgroups $SIM(2)$ and $HOM(2)$. In this context, the cross-section for electron-positron scattering at finite temperature is calculated. The effects of temperature are introduced using the Thermo Field Dynamics (TFD) formalism. Our result shows that the cross-section is changed due to both effects, the VSR contributions and temperature effects. An estimated value for the VSR parameter using experimental data available in the literature is discussed.


title: Modeling and experimental research of the processes of radiation damage formation in the interaction of gamma quanta flows and relativistic electron beams with solution of organic dyes

abstract: The processes of interaction of an aqueous solution of methylene blue (MB) organic dye ($C_{16}H_{18}N_{3}SCl$ ) with gamma quanta and electrons have been investigated. A model has been developed, and the passage of electrons with an energy of 15 MeV through tungsten layers with a thickness of 1...8 mm has been simulated. A number of experiments were carried out on the basis of the simulation results. Analysis of the calculated and experimental data showed that one incident electron destroys 4 times more dye molecules than one incident gamma-quantum.


title: Size-and-Shape Space Gaussian Mixture Models for Structural Clustering of Molecular Dynamics Trajectories

abstract: Determining the optimal number and identity of structural clusters from an ensemble of molecular configurations continues to be a challenge. Recent structural clustering methods have focused on the use of internal coordinates due to the innate rotational and translational invariance of these features. The vast number of possible internal coordinates necessitates a feature space supervision step to make clustering tractable, but yields a protocol that can be system type specific. Particle positions offer an appealing alternative to internal coordinates, but suffer from a lack of rotational and translational invariance, as well as a perceived insensitivity to regions of structural dissimilarity. Here, we present a method, denoted shape-GMM, that overcomes the shortcomings of particle positions using a weighted maximum likelihood (ML) alignment procedure. This alignment strategy is then built into an expectation maximization Gaussian mixture model (GMM) procedure to capture metastable states in the free energy landscape. The resulting algorithm distinguishes between a variety of different structures, including those indistinguishable by RMSD and pair-wise distances, as demonstrated on several model systems. Shape-GMM results on an extensive simulation of the the fast-folding HP35 Nle/Nle mutant protein support a 4-state folding/unfolding mechanism which is consistent with previous experimental results and provides kinetic detail comparable to previous state of the art clustering approaches, as measured by the VAMP-2 score. Currently, training of shape-GMMs is recommended for systems (or subsystems) that can be represented by $\lesssim$ 200 particles and $\lesssim$ 100K configurations to estimate high-dimensional covariance matrices and balance computational expense. Once a shape-GMM is trained, it can be used to predict the cluster identities of millions of configurations.


title: On the K\"ahler-Hodge structure of superconformal manifolds

abstract: We show that conformal manifolds in $d\geq 3$ conformal field theories with at least 4 supercharges are K\"ahler-Hodge, thus extending to 3d ${\cal N}=2$ and 4d ${\cal N}=1$ similar results previously derived for 4d ${\cal N}=2$ and ${\cal N}=4$ and various types of 2d SCFTs. Conformal manifolds in SCFTs are equipped with a holomorphic line bundle ${\cal L}$, which encodes the operator mixing of supercharges under marginal deformations. Using conformal perturbation theory and superconformal Ward identities, we compute the curvature of ${\cal L}$ at a generic point on the conformal manifold. We show that the K\"ahler form of the Zamolodchikov metric is proportional to the first Chern class of ${\cal L}$, with a constant of proportionality given by the two-point function coefficient of the stress tensor, $C_T$. In cases where certain additional conditions about the nature of singular points on the conformal manifold hold, this implies a quantization condition for the total volume of the conformal manifold.


title: Lower bounds for Ramsey numbers as a statistical physics problem

abstract: Ramsey's theorem, concerning the guarantee of certain monochromatic patterns in large enough edge-coloured complete graphs, is a fundamental result in combinatorial mathematics. In this work, we highlight the connection between this abstract setting and a statistical physics problem. Specifically, we design a classical Hamiltonian that favours configurations in a way to establish lower bounds on Ramsey numbers. As a proof of principle we then use Monte Carlo methods to obtain such lower bounds, finding rough agreement with known literature values in a few cases we investigated. We discuss numerical limitations of our approach and indicate a path towards the treatment of larger graph sizes.


title: StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation

abstract: We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two main challenges in 3D-aware GANs: 1) high-resolution, view-consistent generation of the RGB images, and 2) detailed 3D shape. We achieve this by merging a SDF-based 3D representation with a style-based 2D generator. Our 3D implicit network renders low-resolution feature maps, from which the style-based network generates view-consistent, 1024x1024 images. Notably, our SDF-based 3D modeling defines detailed 3D surfaces, leading to consistent volume rendering. Our method shows higher quality results compared to state of the art in terms of visual and geometric quality.


title: Observation of the $B^0\rightarrow\overline{D}^{*0}K^{+}\pi^{-}$ and $B_s^0\rightarrow\overline{D}^{*0}K^{-}\pi^{+}$ decays

abstract: The first observations of $B^0\rightarrow\overline{D}^{*}(2007)^{0}K^{+}\pi^{-}$ and $B_s^0\rightarrow\overline{D}^{*}(2007)^{0}K^{-}\pi^{+}$ decays are presented, and their branching fractions relative to that of the $B^0\rightarrow\overline{D}^{*}(2007)^{0}\pi^{+}\pi^{-}$ decay are reported. These modes can potentially be used to investigate the spectroscopy of charm and charm-strange resonances and to determine the angle $\gamma$ of the CKM unitarity triangle. It is also important to understand them as a source of potential background in determinations of $\gamma$ from $B^{+}\rightarrow DK^{+}$ and $B^{0}\rightarrow DK^{+}\pi^{-}$ decays. The analysis is based on a sample corresponding to an integrated luminosity of $5.4 ~\rm{fb}^{-1}$ of proton--proton collision data at $13 ~\rm{TeV}$ centre-of-mass energy recorded with the LHCb detector. The $\overline{D}^{*}(2007)^{0}$ mesons are fully reconstructed in the $\overline{D}^{0}\pi^{0}$ and $\overline{D}^{0}\gamma$ channels, with the $\overline{D}^{0} \rightarrow K^{+}\pi^{-}$ decay. A novel weighting method is used to subtract background while simultaneously applying an event-by-event efficiency correction to account for resonant structures in the decays.


title: Machine Learning Emulation of Urban Land Surface Processes

abstract: Can we improve the modeling of urban land surface processes with machine learning (ML)? A prior comparison of urban land surface models (ULSMs) found that no single model is 'best' at predicting all common surface fluxes. Here, we develop an urban neural network (UNN) trained on the mean predicted fluxes from 22 ULSMs at one site. The UNN emulates the mean output of ULSMs accurately. When compared to a reference ULSM (Town Energy Balance; TEB), the UNN has greater accuracy relative to flux observations, less computational cost, and requires fewer input parameters. When coupled to the Weather Research Forecasting (WRF) model using TensorFlow bindings, WRF-UNN is stable and more accurate than the reference WRF-TEB. Although the application is currently constrained by the training data (1 site), we show a novel approach to improve the modeling of surface fluxes by combining the strengths of several ULSMs into one using ML.


title: Improved heralded single-photon source with a photon-number-resolving superconducting nanowire detector

abstract: Deterministic generation of single photons is essential for many quantum information technologies. A bulk optical nonlinearity emitting a photon pair, where the measurement of one of the photons heralds the presence of the other, is commonly used with the caveat that the single-photon emission rate is constrained due to a trade-off between multiphoton events and pair emission rate. Using an efficient and low noise photon-number-resolving superconducting nanowire detector we herald, in real time, a single photon at telecommunication wavelength. We perform a second-order photon correlation $g^{2}(0)$ measurement of the signal mode conditioned on the measured photon number of the idler mode for various pump powers and demonstrate an improvement of a heralded single-photon source. We develop an analytical model using a phase-space formalism that encompasses all multiphoton effects and relevant imperfections, such as loss and multiple Schmidt modes. We perform a maximum-likelihood fit to test the agreement of the model to the data and extract the best-fit mean photon number $\mu$ of the pair source for each pump power. A maximum reduction of $0.118 \pm 0.012$ in the photon $g^{2}(0)$ correlation function at $\mu = 0.327 \pm 0.007$ is obtained, indicating a strong suppression of multiphoton emissions. For a fixed $g^{2}(0) = 7e-3$, we increase the single pair generation probability by 25%. Our experiment, built using fiber-coupled and off-the-shelf components, delineates a path to engineering ideal sources of single photons.


title: Asteroids for $\mu$Hz gravitational-wave detection

abstract: A major challenge for gravitational-wave (GW) detection in the $\mu$Hz band is engineering a test mass (TM) with sufficiently low acceleration noise. We propose a GW detection concept using asteroids located in the inner Solar System as TMs. Our main purpose is to evaluate the acceleration noise of asteroids in the $\mu$Hz band. We show that a wide variety of environmental perturbations are small enough to enable an appropriate class of $\sim 10$ km-diameter asteroids to be employed as TMs. This would allow a sensitive GW detector in the band $\text{(few)} \times 10^{-7} \text{Hz} \lesssim f_{\text{GW}} \lesssim \text{(few)} \times 10^{-5} \text{Hz}$, reaching strain $h_c \sim 10^{-19}$ around $f_{\text{GW}} \sim 10 \mu$Hz, sufficient to detect a wide variety of sources. To exploit these asteroid TMs, human-engineered base stations could be deployed on multiple asteroids, each equipped with an electromagnetic transmitter/receiver to permit measurement of variations in the distance between them. We discuss a potential conceptual design with two base stations, each with a space-qualified optical atomic clock measuring the round-trip electromagnetic pulse travel time via laser ranging. Tradespace exists to optimize multiple aspects of this mission: for example, using a radio-ranging or interferometric link system instead of laser ranging. This motivates future dedicated technical design study. This mission concept holds exceptional promise for accessing this GW frequency band.

categories: gr-qc astro-ph.CO astro-ph.IM hep-ph physics.atom-ph


title: Inflation with antisymmetric tensor field: new candidates

abstract: We study classes of inflation models driven by antisymmetric tensor field, with minimal and nonminimal couplings to gravity, that address known issues of such models considered in the past. First we show that with a different choice of the background structure of antisymmetric tensor field, inflation is supported even for the minimal model with quadratic potential contrary to past results. We also include the nonminimal coupling to gravity and analyse perturbations to the antisymmetric tensor as well as the tensor modes of perturbed metric. The two models differ in terms of the behaviour of tensor modes, where the speed of gravitational wave can be tuned to $c$ in the latter model. The power spectrum and spectral index receive slight scale dependence. Finally, we consider a quartic potential motivated by the graceful exit to reheating phase, which requires a nonminimal coupling to support inflation. The two tensor modes of perturbed metric are found to evolve differently in this model, and give rise to a highly scale-dependent power spectrum.


title: Worldline instantons for nonlinear Breit-Wheeler pair production and Compton scattering

abstract: Worldline instantons have previously been used to study the probability of Schwinger pair production (both the exponential and pre-exponential parts) and photon-stimulated pair production (the exponential part). Previous studies obtained the pair-production probability on the probability level by using unitarity, i.e. the imaginary part of the effective action for Schwinger pair production or the imaginary part of the polarization tensor for photon-stimulated pair production. The corresponding instantons are closed loops in the complex plane. Here we show how to use instantons on the amplitude level, which means open instanton lines with start and end points representing fermions at asymptotic times. The amplitude is amputated with LSZ using, in general, field-dependent asymptotic states. We show how to use this formalism for photon-stimulated/Breit-Wheeler pair production and nonlinear Compton scattering.


title: A new method for exact results on Quasinormal Modes of Black Holes

abstract: We develop a new method for writing simple exact equations characterizing gravity solutions among which black holes and in particular the quasinormal modes. More precisely, we derive the full system of functional and Thermodynamic Bethe Ansatz non linear integral equations of quantum integrability. In particular, we prove that the Quasinormal Modes verify different equivalent exact quantization conditions and identify them with Bethe roots. We numerically solve the integral equation and compare the results with other methods. Eventually, we can definitely certify its simplicity, accuracy and effectiveness. Furthermore, this method connects different unexpected fields and paves the way for innovative ways of investigations in gravity and gauge theories.


title: Learned Queries for Efficient Local Attention

abstract: Vision Transformers (ViT) serve as powerful vision models. Unlike convolutional neural networks, which dominated vision research in previous years, vision transformers enjoy the ability to capture long-range dependencies in the data. Nonetheless, an integral part of any transformer architecture, the self-attention mechanism, suffers from high latency and inefficient memory utilization, making it less suitable for high-resolution input images. To alleviate these shortcomings, hierarchical vision models locally employ self-attention on non-interleaving windows. This relaxation reduces the complexity to be linear in the input size; however, it limits the cross-window interaction, hurting the model performance. In this paper, we propose a new shift-invariant local attention layer, called query and attend (QnA), that aggregates the input locally in an overlapping manner, much like convolutions. The key idea behind QnA is to introduce learned queries, which allow fast and efficient implementation. We verify the effectiveness of our layer by incorporating it into a hierarchical vision transformer model. We show improvements in speed and memory complexity while achieving comparable accuracy with state-of-the-art models. Finally, our layer scales especially well with window size, requiring up-to x10 less memory while being up-to x5 faster than existing methods. The code is publicly available at \url{https://github.com/moabarar/qna}.


title: Lyric document embeddings for music tagging

abstract: We present an empirical study on embedding the lyrics of a song into a fixed-dimensional feature for the purpose of music tagging. Five methods of computing token-level and four methods of computing document-level representations are trained on an industrial-scale dataset of tens of millions of songs. We compare simple averaging of pretrained embeddings to modern recurrent and attention-based neural architectures. Evaluating on a wide range of tagging tasks such as genre classification, explicit content identification and era detection, we find that averaging word embeddings outperform more complex architectures in many downstream metrics.


title: Light-cone cuts and hole-ography: explicit reconstruction of bulk metrics

abstract: In this paper, the two reconstruction methods, light-cone cuts method and hole-ography, are combined to provide complete bulk metrics of locally AdS$_3$ static spacetimes. As examples, our method is applied to the geometries of pure AdS$_3$, AdS$_3$ soliton, and BTZ black hole, and we see them successfully reconstructed. The light-cone cuts method is known to have difficulty in obtaining conformal factors, while the hole-ography in describing temporal components. Combining the two methods, we overcome the disadvantages and give complete metrics for a class of holographic theories such that entanglement wedge and causal wedge coincide. Light-cone cuts are identified by entanglement entropy in our method. We expect our study to lead to the discovery of a universal relation between the two methods, by which the combination would be applied to more generic cases.


title: Mixed Precision Low-bit Quantization of Neural Network Language Models for Speech Recognition

abstract: State-of-the-art language models (LMs) represented by long-short term memory recurrent neural networks (LSTM-RNNs) and Transformers are becoming increasingly complex and expensive for practical applications. Low-bit neural network quantization provides a powerful solution to dramatically reduce their model size. Current quantization methods are based on uniform precision and fail to account for the varying performance sensitivity at different parts of LMs to quantization errors. To this end, novel mixed precision neural network LM quantization methods are proposed in this paper. The optimal local precision choices for LSTM-RNN and Transformer based neural LMs are automatically learned using three techniques. The first two approaches are based on quantization sensitivity metrics in the form of either the KL-divergence measured between full precision and quantized LMs, or Hessian trace weighted quantization perturbation that can be approximated efficiently using matrix free techniques. The third approach is based on mixed precision neural architecture search. In order to overcome the difficulty in using gradient descent methods to directly estimate discrete quantized weights, alternating direction methods of multipliers (ADMM) are used to efficiently train quantized LMs. Experiments were conducted on state-of-the-art LF-MMI CNN-TDNN systems featuring speed perturbation, i-Vector and learning hidden unit contribution (LHUC) based speaker adaptation on two tasks: Switchboard telephone speech and AMI meeting transcription. The proposed mixed precision quantization techniques achieved "lossless" quantization on both tasks, by producing model size compression ratios of up to approximately 16 times over the full precision LSTM and Transformer baseline LMs, while incurring no statistically significant word error rate increase.


title: Automated Drug-Related Information Extraction from French Clinical Documents: ReLyfe Approach

abstract: Structuring medical data in France remains a challenge mainly because of the lack of medical data due to privacy concerns and the lack of methods and approaches on processing the French language. One of these challenges is structuring drug-related information in French clinical documents. To our knowledge, over the last decade, there are less than five relevant papers that study French prescriptions. This paper proposes a new approach for extracting drug-related information from French clinical scanned documents while preserving patients' privacy. In addition, we deployed our method in a health data management platform where it is used to structure drug medical data and help patients organize their drug schedules. It can be implemented on any web or mobile platform. This work closes the gap between theoretical and practical work by creating an application adapted to real production problems. It is a combination of a rule-based phase and a Deep Learning approach. Finally, numerical results show the outperformance and relevance of the proposed methodology.


title: A New Gauge for Asymptotically Flat Spacetime

abstract: We present a new gauge for asymptotically flat spacetime that can treat future and past null infinities ($\mathscr{I}^{+}$ or $\mathscr{I}^{-}$) democratically. Our gauge is complementary to Bondi and Ashtekar-Hansen gauges, and is adapted to the $S$-matrix being the natural observable. One new feature is that the holographic directions are null. We present a set of consistent fall-offs in terms of null coordinates at $\mathscr{I}^{+}$ and $\mathscr{I}^{-}$, with finite BMS$^{\pm}$ charges. The diagonal BMS$^0$ symmetry of the gravitational $S$-matrix emerges upon demanding {\em asymptotic} CPT invariance. Trivial diffeomorphisms, (absence of) log fall-offs, possible enhancements of BMS algebra, and the possibility of holographic renormalization of data at $\mathscr{I}^{+}_-$ and $\mathscr{I}^{-}_+$, play interesting roles. Gory details of the various new technical features that emerge, are elaborated in a companion paper to this letter.


title: NLP Techniques for Water Quality Analysis in Social Media Content

abstract: This paper presents our contributions to the MediaEval 2021 task namely "WaterMM: Water Quality in Social Multimedia". The task aims at analyzing social media posts relevant to water quality with particular focus on the aspects like watercolor, smell, taste, and related illnesses. To this aim, a multimodal dataset containing both textual and visual information along with meta-data is provided. Considering the quality and quantity of available content, we mainly focus on textual information by employing three different models individually and jointly in a late-fusion manner. These models include (i) Bidirectional Encoder Representations from Transformers (BERT), (ii) Robustly Optimized BERT Pre-training Approach (XLM-RoBERTa), and a (iii) custom Long short-term memory (LSTM) model obtaining an overall F1-score of 0.794, 0.717, 0.663 on the official test set, respectively. In the fusion scheme, all the models are treated equally and no significant improvement is observed in the performance over the best performing individual model.


title: Deliberation of Streaming RNN-Transducer by Non-autoregressive Decoding

abstract: We propose to deliberate the hypothesis alignment of a streaming RNN-T model with the previously proposed Align-Refine non-autoregressive decoding method and its improved versions. The method performs a few refinement steps, where each step shares a transformer decoder that attends to both text features (extracted from alignments) and audio features, and outputs complete updated alignments. The transformer decoder is trained with the CTC loss which facilitates parallel greedy decoding, and performs full-context attention to capture label dependencies. We improve Align-Refine by introducing cascaded encoder that captures more audio context before refinement, and alignment augmentation which enforces learning label dependency. We show that, conditioned on hypothesis alignments of a streaming RNN-T model, our method obtains significantly more accurate recognition results than the first-pass RNN-T, with only small amount of model parameters.


title: Theoretical Constraints on Neutron--Mirror-Neutron Oscillation

abstract: Mirror models lead to the possibility that neutron ($n$) can oscillate into its mirror partner ($n'$) inspiring several experimental searches for this phenomenon. The condition for observability of this oscillation is a high degree of degeneracy between the $n$ and $n'$ masses, which can be guaranteed if there is exact parity symmetry taking all particles to their mirror partners. However consistency of these models with big bang nucleosynthesis requires that this parity symmetry be broken in the early universe in a scenario called asymmetric inflation. In this paper we study the consistency of an observable $n-n'$ oscillations signal with asymmetric inflation and derive various theoretical constraints. In particular, we find that the reheat temperature after inflation should lie below 2.5 TeV, and predict a singlet fermion with a mass below 100 GeV. In simple models where the right-handed neutrino is a mediator of baryon number violating interactions we find that the light neutrinos are Dirac fermions with their masses arising radiatively through one-loop diagrams.


title: ESAN: Efficient Sentiment Analysis Network of A-Shares Research Reports for Stock Price Prediction

abstract: In this paper, we are going to develop a natural language processing model to help us to predict stocks in the long term. The whole network includes two modules. The first module is a natural language processing model which seeks out reliable factors from input reports. While the other is a time-series forecasting model which takes the factors as input and aims to predict stocks earnings yield. To indicate the efficiency of our model to combine the sentiment analysis module and the time-series forecasting module, we name our method ESAN.


title: Controversy Detection: a Text and Graph Neural Network Based Approach

abstract: Controversial content refers to any content that attracts both positive and negative feedback. Its automatic identification, especially on social media, is a challenging task as it should be done on a large number of continuously evolving posts, covering a large variety of topics. Most of the existing approaches rely on the graph structure of a topic-discussion and/or the content of messages. This paper proposes a controversy detection approach based on both graph structure of a discussion and text features. Our proposed approach relies on Graph Neural Network (gnn) to encode the graph representation (including its texts) in an embedding vector before performing a graph classification task. The latter will classify the post as controversial or not. Two controversy detection strategies are proposed. The first one is based on a hierarchical graph representation learning. Graph user nodes are embedded hierarchically and iteratively to compute the whole graph embedding vector. The second one is based on the attention mechanism, which allows each user node to give more or less importance to its neighbors when computing node embeddings. We conduct experiments to evaluate our approach using different real-world datasets. Conducted experiments show the positive impact of combining textual features and structural information in terms of performance.


title: Scaling Language Models: Methods, Analysis & Insights from Training Gopher

abstract: Language modelling provides a step towards intelligent communication systems by harnessing large repositories of written human knowledge to better predict and understand the world. In this paper, we present an analysis of Transformer-based language model performance across a wide range of model scales -- from models with tens of millions of parameters up to a 280 billion parameter model called Gopher. These models are evaluated on 152 diverse tasks, achieving state-of-the-art performance across the majority. Gains from scale are largest in areas such as reading comprehension, fact-checking, and the identification of toxic language, but logical and mathematical reasoning see less benefit. We provide a holistic analysis of the training dataset and model's behaviour, covering the intersection of model scale with bias and toxicity. Finally we discuss the application of language models to AI safety and the mitigation of downstream harms.


title: Multi-Modality Distillation via Learning the teacher's modality-level Gram Matrix

abstract: In the context of multi-modality knowledge distillation research, the existing methods was mainly focus on the problem of only learning teacher final output. Thus, there are still deep differences between the teacher network and the student network. It is necessary to force the student network to learn the modality relationship information of the teacher network. To effectively exploit transfering knowledge from teachers to students, a novel modality relation distillation paradigm by modeling the relationship information among different modality are adopted, that is learning the teacher modality-level Gram Matrix.


title: Temperature sensitivity of pest reproductive numbers in age-structured PDE models, with a focus on the invasive spotted lanternfly

abstract: Invasive pest establishment is a pervasive threat to global ecosystems, agriculture, and public health. The recent establishment of the invasive spotted lanternfly in the northeastern United States has proven devastating to farms and vineyards, necessitating urgent development of population dynamical models and effective control practices. In this paper, we propose a stage- and age-structured system of PDEs to model insect pest populations, in which underlying dynamics are dictated by ambient temperature through rates of development, fecundity, and mortality. The model incorporates diapause and non-diapause pathways, and is calibrated to experimental and field data on the spotted lanternfly. We develop a novel moving mesh method for capturing age-advection accurately, even for coarse discretization parameters. We define a one-year reproductive number ($R_0$) from the spectrum of a one-year solution operator, and study its sensitivity to variations in the mean and amplitude of the annual temperature profile. We quantify assumptions sufficient to give rise to the low-rank structure of the solution operator characteristic of part of the parameter domain. We discuss establishment potential as it results from the pairing of a favorable $R_0$ value and transient population survival, and address implications for pest control strategies.


title: Doubly-Valid/Doubly-Sharp Sensitivity Analysis for Causal Inference with Unmeasured Confounding

abstract: We consider the problem of constructing bounds on the average treatment effect (ATE) when unmeasured confounders exist but have bounded influence. Specifically, we assume that omitted confounders could not change the odds of treatment for any unit by more than a fixed factor. We derive the sharp partial identification bounds implied by this assumption by leveraging distributionally robust optimization, and we propose estimators of these bounds with several novel robustness properties. The first is double sharpness: our estimators consistently estimate the sharp ATE bounds when one of two nuisance parameters is misspecified and achieve semiparametric efficiency when all nuisance parameters are suitably consistent. The second is double validity: even when most nuisance parameters are misspecified, our estimators still provide valid but possibly conservative bounds for the ATE and our Wald confidence intervals remain valid even when our estimators are not asymptotically normal. As a result, our estimators provide a highly credible method for sensitivity analysis of causal inferences.


title: Max-Margin Contrastive Learning

abstract: Standard contrastive learning approaches usually require a large number of negatives for effective unsupervised learning and often exhibit slow convergence. We suspect this behavior is due to the suboptimal selection of negatives used for offering contrast to the positives. We counter this difficulty by taking inspiration from support vector machines (SVMs) to present max-margin contrastive learning (MMCL). Our approach selects negatives as the sparse support vectors obtained via a quadratic optimization problem, and contrastiveness is enforced by maximizing the decision margin. As SVM optimization can be computationally demanding, especially in an end-to-end setting, we present simplifications that alleviate the computational burden. We validate our approach on standard vision benchmark datasets, demonstrating better performance in unsupervised representation learning over state-of-the-art, while having better empirical convergence properties.


title: Theory input for $t\bar{t}j$ experimental analyses at the LHC

abstract: The precise measurement of the top quark mass, which is a fundamental SM parameter, constitutes one of the main goals of the LHC top physics program. One approach to measure this quantity uses the $\rho_\mathrm{s}$ distribution, an observable depending on the invariant mass of the $t\bar{t}j$ system. To fully exploit the experimental accuracy achievable in measuring top quark production cross sections at the LHC, the theory uncertainties associated to these measurements need to be well under control. To this end we present a study of the effect of varying the theoretical input parameters in the calculation of differential cross sections of the $t\bar{t}j$ process. Thereby we studied the influence of the jet reconstruction procedure, as well as the effect of various renormalization and factorization scale definitions and different PDF sets. The variation of the $R$ parameter in the jet reconstruction algorithm was found to have negligible influence on the scale variation uncertainty. A strong reduction of scale uncertainties and a better behaviour of the NLO/LO ratios using selected dynamical scales instead of a static one in the high energy tails of differential distributions was observed. This is particularly interesting in the context of the top quark mass measurements through the $\rho_\mathrm{s}$ distribution, in which the perturbative stability can be improved by applying the proposed dynamical scale definition.


title: Off-Shell Color-Kinematics Duality for Chern-Simons

abstract: Many gauge theories possess a hidden duality between color and kinematics in their on-shell scattering amplitudes. An open problem is to formulate an off-shell realization of the duality, thus manifesting a kinematic algebra. We show that 3D Chern-Simons (CS) theory in Lorenz gauge obeys off-shell color-kinematics duality. This holds both for the gauge field and the BRST ghosts, and the duality is manifest in the Feynman rules. A kinematic algebra can be formulated through a second-order differential operator (Poisson bracket) acting on the off-shell fields, and it corresponds to 3D volume-preserving diffeomorphisms, generated by functions in Lorenz gauge. We consider several admissible double-copy constructions of CS theory with Yang-Mills theory, a higher-derivative (DF)^2 gauge theory, or CS theory itself. To obtain non-vanishing amplitudes, we deform pure CS theory by including the maximum amount of adjoint matter that respects the on-shell duality. This gives a new formulation of an N=4 CS-matter theory, with fields of unusual statistics. We argue that the color-stripped tree amplitudes of this theory are equivalent to those of the Gaiotto-Witten N=4 CS theory with bi-fundamental matter. We further show that the double copy of the N=4 CS theory with itself corresponds to maximally supersymmetric N=8 Dirac-Born-Infeld theory.


title: The seeds of EFT double copy

abstract: We explore the double copy of effective field theories (EFTs), in the recently proposed generalized color-kinematics and Kawai-Lewellen-Tye (KLT) approaches. In the former, we systematically construct scalar numerators satisfying the Jacobi identities from simpler numerator "seeds" with trace-like permutation properties. This construction has the advantage of being easily applicable to any multiplicity, which we exemplify up to 6-point. It employs the linear map between color factors formed by single traces of generators and by products of the structure constants, which also relates the generalized KLT and color-kinematics formalisms, allowing to produce KLT kernels at arbitrary order in the EFT expansion. At 4-point, we show that all EFT kernels are generated and that they only yield double-copy amplitudes which can also be obtained from the traditional KLT kernel. We perform initial checks suggesting that the same conclusions also hold at 5-point. We focus on single-trace massless scalar EFTs which however also control the higher-derivative corrections to gauge and gravity theories.


title: GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping

abstract: Generating digital humans that move realistically has many applications and is widely studied, but existing methods focus on the major limbs of the body, ignoring the hands and head. Hands have been separately studied, but the focus has been on generating realistic static grasps of objects. To synthesize virtual characters that interact with the world, we need to generate full-body motions and realistic hand grasps simultaneously. Both sub-problems are challenging on their own and, together, the state-space of poses is significantly larger, the scales of hand and body motions differ, and the whole-body posture and the hand grasp must agree, satisfy physical constraints, and be plausible. Additionally, the head is involved because the avatar must look at the object to interact with it. For the first time, we address the problem of generating full-body, hand and head motions of an avatar grasping an unknown object. As input, our method, called GOAL, takes a 3D object, its position, and a starting 3D body pose and shape. GOAL outputs a sequence of whole-body poses using two novel networks. First, GNet generates a goal whole-body grasp with a realistic body, head, arm, and hand pose, as well as hand-object contact. Second, MNet generates the motion between the starting and goal pose. This is challenging, as it requires the avatar to walk towards the object with foot-ground contact, orient the head towards it, reach out, and grasp it with a realistic hand pose and hand-object contact. To achieve this, the networks exploit a representation that combines SMPL-X body parameters and 3D vertex offsets. We train and evaluate GOAL, both qualitatively and quantitatively, on the GRAB dataset. Results show that GOAL generalizes well to unseen objects, outperforming baselines. GOAL takes a step towards synthesizing realistic full-body object grasping.


title: Constraining Low-Scale Flavor Models with $\boldsymbol{(g-2)_{\mu}}$ and Lepton Flavor Violation

abstract: We present here two concrete examples of models where a sub-TeV scale breaking of their respective $\mathcal{T}_{13}$ and $A_5$ flavor symmetries is able to account for the recently observed discrepancy in the muon anomalous magnetic moment, $(g-2)_\mu$. Similarities in the flavor structures of the charged-lepton Yukawa matrix and dipole matrix yielding $(g-2)_\mu$ give rise to strong constraints on low-scale flavor models when bounds from lepton flavor violation (LFV) are imposed. These constraints place stringent limits on the off-diagonal Yukawa structure, suggesting a mostly (quasi-)diagonal texture for models with a low flavor breaking scale $\Lambda_f$. We argue that many of the popular flavor models in the literature designed to explain the fermion masses and mixings are not suitable for reproducing the observed discrepancy in $(g-2)_\mu$, which requires a delicate balance of maintaining a low flavor scale while simultaneously satisfying strong LFV constraints.


title: An Incremental Contact Model for Rough Surfaces of Strain Hardening Solids

abstract: The load-area relation of rough surfaces is of great interest in tribology. For elastic-plastic solids with strain hardening, an incremental model is adopted to analyze the contact of rough surfaces, in which the contact is modeled by accumulation of equivalent circular contacts with varying radius. For three typical rough surfaces with various material properties, comparisons with direct finite element calculations demonstrate the efficiency of this incremental contact model. An approximate linear relation between load and contact area is predicted by both methods up to a contact fraction of 15%. The influence of yield stress and strain hardening index on the load-area proportionality is presented. This work gives a simple while effective method to calculate the load-area relation for rough contact of strain hardening materials.


title: Simulation of many body localization and time crystals in two dimensions with the neighborhood tensor update

abstract: The Heisenberg antiferromagnet with discrete disorder on an infinite square lattice is evolved in time from an initial N\'eel state. The simulation is performed with the neighborhood tensor update (NTU) algorithm for an infinite projected entangled pair state (iPEPS) [Phys. Rev. B 104, 094411 (2021)]. Ancillary spins are used to average over $2$ or $5$ discrete values of disorder. With a bond dimension up to $20$, evolution times are long enough to identify a many body localized regime for a strong enough disorder. Furthermore, the same Hamiltonian is subject to periodic spin flips. Simulations of the Floquet dynamics show that it can sustain a time crystalline stage for a strong enough disorder.

categories: cond-mat.dis-nn cond-mat.mes-hall cond-mat.quant-gas quant-ph


title: Collapse dynamics of dry granular columns: from free-fall to quasi-static flow

abstract: Gravity-driven collapses involving large amounts of dense granular material, such as landslides, avalanches, or rockfalls, in a geophysical context, represent significant natural hazards. Understanding their complex dynamics is hence a key concern for risk assessment. In the present work, we report experiments on the collapse of quasi-two-dimensional dry granular columns under the effect of gravity, where both the velocity at which the grains are released and the aspect ratio of the column are varied to investigate the dynamics of the falling grains. At high release velocity, classical power laws for the final deposit are recovered, meaning those are representative of a free-fall like regime. For high enough aspect ratios, the top of the column undergoes an overall free-fall like motion. In addition, for all experiments, the falling grains also spread horizontally in a free-fall like motion, and the characteristic time of spreading is related to the horizontal extension reached by the deposit at all altitudes. At low release velocity, a quasi-static state is observed, with scaling laws for the final geometry identical to those of the viscous regime of granular-fluid flow. The velocity at which the grains are released governs the collapse dynamics. Between these two asymptotic regimes, the higher the release velocity, the smaller the impact on the collapse dynamics. The criterion $\overline{V} \geq 0.4\sqrt{gH_0}$, where $H_0$ is the initial height of the column, is found for the mean release velocity $\overline{V}$ not to influence the granular collapse.


title: Self-Supervised Learning based Monaural Speech Enhancement with Multi-Task Pre-Training

abstract: In self-supervised learning, it is challenging to reduce the gap between the enhancement performance on the estimated and target speech signals with existed pre-tasks. In this paper, we propose a multi-task pre-training method to improve the speech enhancement performance with self-supervised learning. Within the pre-training autoencoder (PAE), only a limited set of clean speech signals are required to learn their latent representations. Meanwhile, to solve the limitation of single pre-task, the proposed masking module exploits the dereverberated mask and estimated ratio mask to denoise the mixture as the second pre-task. Different from the PAE, where the target speech signals are estimated, the downstream task autoencoder (DAE) utilizes a large number of unlabeled and unseen reverberant mixtures to generate the estimated mixtures. The trained DAE is shared by the learned representations and masks. Experimental results on a benchmark dataset demonstrate that the proposed method outperforms the state-of-the-art approaches.


title: The Techno-politics of Crowdsourced Disaster Data in the Smart City

abstract: This article interrogates the techno-politics of crowdsourced data in the study of environmental hazards such as floods, storms, wildfires, and cyclones. We highlight some of the main debates around the use of citizen-generated data for assessing, monitoring, and responding to disasters. We then argue that, compared to the number of articles discussing the quality of citizen-generated data, little attention has been dedicated to discussing the social and political implications of this kind of practice. While this article does not intend to present definitive answers, it outlines inevitable challenges and indicates potential directions for future studies on the techno-politics of disaster data collection. Within a techno-politics approach, we argue for a model of political participation that recognizes citizens providing data to shape cities as equal experts in the production of knowledge and decision-making, rather than external contributors collecting data for formal authorities. This political participation approach, we believe, would increase the dependence of formal scientific knowledge on citizens' daily-lived experiences, create horizontal collaborations among diverse stakeholders, in terms of respect and recognition, and increase the humanization of marginalized communities, particularly from the Global South.


title: Deep Reinforcement Learning for Optimal Power Flow with Renewables Using Graph Information

abstract: Renewable energy resources (RERs) have been increasingly integrated into large-scale distributed power systems. Considering uncertainties and voltage fluctuation issues introduced by RERs, in this paper, we propose a deep reinforcement learning (DRL)-based strategy leveraging spatial-temporal (ST) graphical information of power systems, to dynamically search for the optimal operation, i.e., optimal power flow (OPF), of power systems with a high uptake of RERs. Specifically, we formulate the OPF problem as a multi-objective optimization problem considering generation cost, voltage fluctuation, and transmission loss, and employ deep deterministic policy gradient (DDPG) to learn an optimal allocation strategy for OPF. Moreover, given that the nodes in power systems are self-correlated and interrelated in temporal and spatial views, we develop a multi-grained attention-based spatial-temporal graph convolution network (MG-ASTGCN) for extracting ST graphical correlations and features, aiming to provide prior knowledge of power systems for its sequential DDPG algorithm to more effectively solve OPF. We validate our algorithm on modified IEEE 33, 69, and 118-bus radial distribution systems and demonstrate that our algorithm outperforms other benchmark algorithms. Our experimental results also reveal that our MG-ASTGCN can significantly accelerate DDPG's training process and performance in solving OPF.


title: Non-ideal MHD simulations of subcritical prestellar cores with non-equilibrium chemistry

abstract: Non-ideal magnetohydrodynamic (MHD) effects are thought to be gravity's closest ally in overcoming the support of magnetic fields and in forming stars. Here, we modify the publicly available version of the adaptive mesh refinement code FLASH (Fryxell et al. 2000; Dubey et al. 2008) to include a detailed treatment of non-ideal MHD and study such effects in collapsing prestellar cores. We implement two very extended non-equilibrium chemical networks, the largest of which is comprised of $\sim$ 300 species and includes a detailed description of deuterium chemistry. The ambipolar-diffusion, Ohmic and Hall resistivities are then self-consistently calculated from the abundances of charged species. We present a series of 2-dimensional axisymmetric simulations where we vary the chemical model, cosmic-ray ionization rate, and grain distribution. We benchmark our implementation against ideal MHD simulations and previously-published results. We show that, at high densities ($n_{\rm{H_2}}>~10^6~\rm{cm^{-3}}$), the ion that carries most of the perpendicular and parallel conductivities is not $\rm{H_3^+}$ as was previously thought, but is instead $\rm{D_3^+}$.


title: New Variable Hot Subdwarf Stars Identified from Anomalous Gaia Flux Errors, Observed by TESS, and Classified via Fourier Diagnostics

abstract: Hot subdwarf stars are mostly stripped red giants that can exhibit photometric variations due to stellar pulsations, eclipses, the reflection effect, ellipsoidal modulation, and Doppler beaming. Detailed studies of their light curves help constrain stellar parameters through asteroseismological analyses or binary light curve modeling and generally improve our capacity to draw a statistically meaningful picture of this enigmatic stage of stellar evolution. From an analysis of Gaia DR2 flux errors, we have identified around 1200 candidate hot subdwarfs with inflated flux errors for their magnitudes - a strong indicator of photometric variability. As a pilot study, we obtained 2-min cadence TESS Cycle 2 observations of 187 candidate hot subdwarfs with anomalous Gaia flux errors. More than 90% of our targets show significant photometric variations in their TESS light curves. Many of the new systems found are cataclysmic variables, but we report the discovery of several new variable hot subdwarfs, including HW Vir binaries, reflection effect systems, pulsating sdBVs stars, and ellipsoidally modulated systems. We determine atmospheric parameters for select systems using follow-up spectroscopy from the 3-m Shane telescope. Finally, we present a Fourier diagnostic plot for classifying binary light curves using the relative amplitudes and phases of their fundamental and harmonic signals in their periodograms. This plot makes it possible to identify certain types of variables efficiently, without directly investigating their light curves, and may assist in the rapid classification of systems observed in large photometric surveys.


title: Magic angle conditions for twisted 3D topological insulators

abstract: We derive a general low-energy theory for twisted moir\'e heterostructures comprised of Dirac materials. We apply our theory to heterostructures on the surface of a three dimensional topological insulator (3D TI). First, we consider the interface between two 3D TIs arranged with a relative twist angle. We prove that if the two TIs are identical, then a necessary condition for a magic angle where the Dirac cone velocity vanishes is to have an interlayer spin-flipping hopping term. Without this term, the Dirac cone velocities can still be significantly renormalized, decreasing to less than half of their original values, but they will not vanish. Second, we consider graphene on the surface of a TI arranged with a small twist angle. Again, a magic angle is only achievable with a spin-flipping hopping term. Without this term, the Dirac cone is renormalized, but not significantly. In both cases, our perturbative results are verified by computing the band structure of the continuum model. The enhanced density of states that results from decreasing the surface Dirac cone velocity provides a tunable route to realizing interacting topological phases.


title: Detecting High-Frequency Gravitational Waves with Microwave Cavities

abstract: We give a detailed treatment of electromagnetic signals generated by gravitational waves (GWs) in resonant cavity experiments. Our investigation corrects and builds upon previous studies by carefully accounting for the gauge dependence of relevant quantities. We work in a preferred frame for the laboratory, the proper detector frame, and show how to resum short-wavelength effects to provide analytic results that are exact for GWs of arbitrary wavelength. This formalism allows us to firmly establish that, contrary to previous claims, cavity experiments designed for the detection of axion dark matter only need to reanalyze existing data to search for high-frequency GWs with strains as small as $h\sim 10^{-22}-10^{-21}$. We also argue that directional detection is possible in principle using readout of multiple cavity modes. Further improvements in sensitivity are expected with cutting-edge advances in superconducting cavity technology.


title: The Piezoaxionic Effect

abstract: Axion dark matter (DM) constitutes an oscillating background that violates parity and time-reversal symmtries. Inside piezoelectric crystals, where parity is broken spontaneously, this axion background can result in a stress. We call this new phenomenon "the piezoaxionic effect". When the frequency of axion DM matches the natural frequency of a bulk acoustic normal mode of the piezoelectric crystal, the piezoaxionic effect is resonantly enhanced and can be read out electrically via the piezoelectric effect. We explore all axion couplings that can give rise to the piezoaxionic effect -- the most promising one is the defining coupling of the QCD axion, through the anomaly of the strong sector. We also point our another, subdominant phenomenon present in all dielectrics, namely the "electroaxionic effect". An axion background can produce an electric displacement field in a crystal which in turn will give rise to a voltage across the crystal. The electroaxionic effect is again largest for the axion coupling to gluons. We find that this model independent coupling of the QCD axion may be probed through the combination of the piezoaxionic and electroaxionic effects in piezoelectric crystals with aligned nuclear spins, with near-future experimental setups applicable for axion masses between $10^{-11}\,\mathrm{eV}$ and $10^{-7}\,\mathrm{eV}$, a challenging range for most other detection concepts.


title: The Desert and the Swampland

abstract: The most natural expectation away from asymptotic limits in moduli space of supergravity theories is the desert scenario, where there are few states between massless fields and the quantum gravity cutoff. In this paper we initiate a systematic study of these regions deep in the moduli space, and use it to place a bound on the number of massless modes by relating it to the black hole species problem. There exists a consistent sub-Planckian UV cutoff (the species scale) which resolves the black hole species problem without bounding the number of light modes. We reevaluate this in the context of supersymmetric string vacua in the desert region and show that even though heuristically the species scale is compatible with expectations, the BPS states of the actual string vacua lead to a stronger dependence of the cutoff scale on the number of massless modes. We propose that this discrepancy, which can be captured by the "BPS desert conjecture", resurrects the idea of a uniform bound on the number of light modes as a way to avoid the black hole species problem. This conjecture also implies a stronger form of the Tadpole Conjecture, which leads to an obstruction in stabilizing all moduli semi-classically for large number of moduli in flux compactifications.


title: Electroweak HEFT after LHC run 2

abstract: We analyze the electroweak interactions in the framework of the Higgs effective field theory using the available Higgs and electroweak diboson production results from LHC run 2 as well as the electroweak precision data. Assuming universality of the weak current, our study considers 25 possible anomalous couplings. To unveil the nature of the Higgs boson, i.e. isosinglet versus part of SU(2)L doublet, we explore the correlation effects between observables that are predicted to exist in the linear realization of the electroweak gauge symmetry but not in its non-linear counterpart. This improves previous studies aimed at investigating the Higgs nature and the origin of the electroweak symmetry breaking.


title: Quasiclassical boundary conditions for spin-orbit coupled interfaces with spin-charge conversion

abstract: The quasiclassical theory of superconductivity provides a methodology to study emergent phenomena in hybrid structures comprised of superconductors interfaced with other materials. A key component in this theory is the boundary condition that the Green functions describing the materials must satisfy. Recently, progress has been made toward formulating such a boundary condition for interfaces with spin-orbit coupling, the latter playing an important role for several phenomena in spintronics. Here, we derive a boundary condition for spin-orbit coupled interfaces that includes gradient terms which enables the description of spin-Hall like effects with superconductors due to such interfaces. As an example, we show that the boundary conditions predict that a supercurrent flowing through a superconductor that is coupled to a normal metal via a spin-orbit interface can induce a non-local magnetization in the normal metal.


title: CO(2-1)/CO(1-0) line ratio on $\sim$100 parsec scale in the nearby barred galaxy NGC1300

abstract: CO(2-1) emission is often used as a tracer of the giant molecular clouds (GMCs) as an alternative to CO(1-0) emission in recent years. Therefore, understanding the environmental dependence of the line ratio of CO(2-1)/CO(1-0), $R_{21}$, on GMC scale is important to accurately estimate the mass of the GMCs. We thus measured the $R_{21}$ in the strongly barred galaxy NGC1300, where star formation activity strongly depends on galactic structure, on $\sim 100$ pc scale. CO images were obtained from ALMA and Nobeyama 45-m telescope. The resultant typical $R_{21}$ in NGC1300 is $0.57 \pm 0.06$. We find environmental variations in $R_{21}$; it is the highest in the bar-end region ($0.72 \pm 0.08$), followed by arm ($0.60 \pm 0.07$) and bar regions ($0.50 \pm 0.06$). GMCs with H$\alpha$ emission show a systematically higher ratio ($0.67 \pm 0.07$) than those without H$\alpha$ ($0.47 \pm 0.05$). In the bar region, where massive star formation is suppressed, H$\alpha$ emission is not associated with most GMCs, resulting in the lowest $R_{21}$. These results raise a possibility that properties of GMCs derived from CO(2-1) observations with the assumption of a constant $R_{21}$ are different from those derived from CO(1-0) observations. Furthermore, we find the $R_{21}$ measured on kpc scale tends to be lower than that of the GMCs probably due to the presence of an extended diffuse molecular gas in NGC1300.


title: Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies

abstract: As AI systems demonstrate increasingly strong predictive performance, their adoption has grown in numerous domains. However, in high-stakes domains such as criminal justice and healthcare, full automation is often not desirable due to safety, ethical, and legal concerns, yet fully manual approaches can be inaccurate and time consuming. As a result, there is growing interest in the research community to augment human decision making with AI assistance. Besides developing AI technologies for this purpose, the emerging field of human-AI decision making must embrace empirical approaches to form a foundational understanding of how humans interact and work with AI to make decisions. To invite and help structure research efforts towards a science of understanding and improving human-AI decision making, we survey recent literature of empirical human-subject studies on this topic. We summarize the study design choices made in over 100 papers in three important aspects: (1) decision tasks, (2) AI models and AI assistance elements, and (3) evaluation metrics. For each aspect, we summarize current trends, discuss gaps in current practices of the field, and make a list of recommendations for future research. Our survey highlights the need to develop common frameworks to account for the design and research spaces of human-AI decision making, so that researchers can make rigorous choices in study design, and the research community can build on each other's work and produce generalizable scientific knowledge. We also hope this survey will serve as a bridge for HCI and AI communities to work together to mutually shape the empirical science and computational technologies for human-AI decision making.


title: Cool quark matter with perturbative quark masses

abstract: In perturbative thermal calculations, introducing nonzero quark masses causes considerable complications. In this article we describe an approximation scheme valid for sufficiently light masses which significantly simplifies the relevant calculations with only a small loss in accuracy. We apply the scheme to Quantum Chromodynamics, with two massless and one massive flavor, obtaining analytic results which are in excellent agreement with numerical non-approximated results. Our results are accurate to $O(g^5)$ in the strong coupling parameter $g$, as long as either the chemical potential $\mu$ of the quark species with nonzero mass $m$ satisfies $m = O(g \mu)$ or if the temperature $T$ satisfies $m = O(g T)$. We find that these conditions are always satisfied for the three lightest quarks for the values of $\mu$, $T$ where Quantum Chromodynamics is perturbatively convergent.


title: Quantum reference frames for an indefinite metric

abstract: The current theories of quantum physics and general relativity on their own do not allow us to study situations in which the gravitational source is quantum. Here, we propose a strategy to determine the dynamics of objects in the presence of mass configurations in superposition, and hence an indefinite spacetime metric, using quantum reference frame (QRF) transformations. Specifically, we show that, as long as the mass configurations in the different branches are related via relative-distance-preserving transformations, one can use an extension of the current framework of QRFs to change to a frame in which the mass configuration becomes definite. Assuming covariance of dynamical laws under quantum coordinate transformations, this allows to use known physics to determine the dynamics. We apply this procedure to find the motion of a probe particle and the behavior of clocks near the mass configuration, and thus find the time dilation caused by a gravitating object in superposition.


title: Stability of topological solitons, and black string to bubble transition

abstract: We study the existence of smooth topological solitons and black strings as locally-stable saddles of the Euclidean gravitational action of five dimensional Einstein-Maxwell theory. These objects live in the Kaluza-Klein background of four dimensional Minkowski with an $S^1$. We compute the off-shell gravitational action in the canonical ensemble with fixed boundary data corresponding to the asymptotic radius of $S^1$, and to the electric and magnetic charges that label the solitons and black strings. We show that these objects are locally-stable in large sectors of the phase space with varying lifetime. Furthermore, we determine the globally-stable phases for different regimes of the boundary data, and show that there can be Hawking-Page transitions between the locally-stable phases of the topological solitons and black strings. This analysis demonstrates the existence of a large family of globally-stable smooth solitonic objects in gravity beyond supersymmetry, and presents a mechanism through which they can arise from the black strings.


title: Chaotic dynamics of wide triples induced by galactic tides: a novel channel for producing compact binaries, mergers, and collisions

abstract: Recent surveys show that wide ($>10^4$ AU) binaries and triples are abundant in the field. We study the long-term evolution of wide hierarchical triple systems and the role played by the Galactic tidal (GT) field. We find that when the timescales of the secular von-Ziepel-Lidov-Kozai and the GT oscillations are comparable, triple evolution becomes chaotic which leads to extreme eccentricities. Consequently, the close pericentre approaches of the inner-binary components lead to strong interactions, mergers and collisions. We use a novel secular evolution code to quantify the key parameters and carry out a population-synthesis study of low and intermediate-mass wide-orbit triples. We find that in $\sim9\%$ of low-mass wide-triples the inner main-sequence binaries collide or tidally-inspiral within $10\ \rm Gyr$, with direct collisions are $6$ times more likely to occur. For the intermediate-mass sample, $\sim7.6\%$ of the systems merge or inspiral with roughly equal probabilities. We discuss the relative fractions of different stellar merger/inspiral outcomes as a function of their evolutionary stage (Main-Sequence, MS; Red-Giant, RG; or White-Dwarf, WD), their transient electromagnetic signatures and the final products of the merger/inspiral. In particular, the rate of WD-WD direct-collisions that lead to type-Ia Supernovae is comparable to other dynamical channels and accounts for at most $0.1\%$ of the observed rate. RG inspirals provide a novel channel for the formation of eccentric common-envelope-evolution binaries. The catalysis of mergers/collisions in triples due to GT could explain a significant fraction, or even the vast majority, of blue-stragglers in the field, produce progenitors for cataclysmic-variables, and give-rise to mergers/collisions of double-RG binaries.


title: Ultralight Millicharged Dark Matter via Misalignment

abstract: We explore the cosmology and phenomenology of millicharged and millicharge-like dark matter with masses from 1 eV to 10 keV and charges of $10^{-18}$ to $10^{-14}$. Dark matter in this mass range cannot be thermally produced, but can arise from non-thermal mechanisms. We propose a concrete model employing a spontaneously broken approximate global symmetry, in which millicharged dark matter is produced via the misalignment mechanism. We show that this production mechanism is cosmologically consistent and compatible with the observed dark matter abundance. This model can be implemented using either fundamental scalars or hidden-sector quarks, and coupled either to the Standard Model photon or to a hidden photon. We then consider the phenomenology of light millicharged dark matter, regardless of its cosmological origin, and determine the parameter space consistent with existing experiments and observations. A significant part of the new parameter space we consider may be accessible in the near future through direct deflection experiments, measurements of the cosmic microwave background blackbody spectrum, and future constraints on plasma instabilities due to dark matter self-interaction.


title: Symplectic quantization of multi-field Generalized Proca electrodynamics

abstract: We explicitly carry out the symplectic quantization of a family of multi-field Generalized Proca (GP) electrodynamics theories. In the process, we provide an independent derivation of the so-called secondary constraint enforcing relations -- consistency conditions that significantly restrict the allowed interactions in multi-field settings already at the classical level. Additionally, we unveil the existence of quantum consistency conditions, which apply in both single- and multi-field GP scenarios. Our newly found conditions imply that not all classically well-defined (multi-)GP theories are amenable to quantization. The extension of our results to the most general multi-GP class is conceptually straightforward, albeit algebraically cumbersome.


title: LSH methods for data deduplication in a Wikipedia artificial dataset

abstract: This paper illustrates locality sensitive hasing (LSH) models for the identification and removal of nearly redundant data in a text dataset. To evaluate the different models, we create an artificial dataset for data deduplication using English Wikipedia articles. Area-Under-Curve (AUC) over 0.9 were observed for most models, with the best model reaching 0.96. Deduplication enables more effective model training by preventing the model from learning a distribution that differs from the real one as a result of the repeated data.


title: AtteSTNet -- An attention and subword tokenization based approach for code-switched text hate speech detection

abstract: Recent advancements in technology have led to a boost in social media usage which has ultimately led to large amounts of user-generated data which also includes hateful and offensive speech. The language used in social media is often a combination of English and the native language in the region. In India, Hindi is used predominantly and is often code-switched with English, giving rise to the Hinglish (Hindi+English) language. Various approaches have been made in the past to classify the code-mixed Hinglish hate speech using different machine learning and deep learning-based techniques. However, these techniques make use of recurrence on convolution mechanisms which are computationally expensive and have high memory requirements. Past techniques also make use of complex data processing making the existing techniques very complex and non-sustainable to change in data. Proposed work gives a much simpler approach which is not only at par with these complex networks but also exceeds performance with the use of subword tokenization algorithms like BPE and Unigram, along with multi-head attention-based techniques, giving an accuracy of 87.41% and an F1 score of 0.851 on standard datasets. Efficient use of BPE and Unigram algorithms help handle the nonconventional Hinglish vocabulary making the proposed technique simple, efficient and sustainable to use in the real world.


title: On the Compression of Natural Language Models

abstract: Deep neural networks are effective feature extractors but they are prohibitively large for deployment scenarios. Due to the huge number of parameters, interpretability of parameters in different layers is not straight-forward. This is why neural networks are sometimes considered black boxes. Although simpler models are easier to explain, finding them is not easy. If found, a sparse network that can fit to a data from scratch would help to interpret parameters of a neural network. To this end, lottery ticket hypothesis states that typical dense neural networks contain a small sparse sub-network that can be trained to a reach similar test accuracy in an equal number of steps. The goal of this work is to assess whether such a trainable subnetwork exists for natural language models (NLM)s. To achieve this goal we will review state-of-the-art compression techniques such as quantization, knowledge distillation, and pruning.


title: Translating Human Mobility Forecasting through Natural Language Generation

abstract: Existing human mobility forecasting models follow the standard design of the time-series prediction model which takes a series of numerical values as input to generate a numerical value as a prediction. Although treating this as a regression problem seems straightforward, incorporating various contextual information such as the semantic category information of each Place-of-Interest (POI) is a necessary step, and often the bottleneck, in designing an effective mobility prediction model. As opposed to the typical approach, we treat forecasting as a translation problem and propose a novel forecasting through a language generation pipeline. The paper aims to address the human mobility forecasting problem as a language translation task in a sequence-to-sequence manner. A mobility-to-language template is first introduced to describe the numerical mobility data as natural language sentences. The core intuition of the human mobility forecasting translation task is to convert the input mobility description sentences into a future mobility description from which the prediction target can be obtained. Under this pipeline, a two-branch network, SHIFT (Translating Human Mobility Forecasting), is designed. Specifically, it consists of one main branch for language generation and one auxiliary branch to directly learn mobility patterns. During the training, we develop a momentum mode for better connecting and training the two branches. Extensive experiments on three real-world datasets demonstrate that the proposed SHIFT is effective and presents a new revolutionary approach to forecasting human mobility.


title: English2Gbe: A multilingual machine translation model for {Fon/Ewe}Gbe

abstract: Language is an essential factor of emancipation. Unfortunately, most of the more than 2,000 African languages are low-resourced. The community has recently used machine translation to revive and strengthen several African languages. However, the trained models are often bilingual, resulting in a potentially exponential number of models to train and maintain to cover all possible translation directions. Additionally, bilingual models do not leverage the similarity between some of the languages. Consequently, multilingual neural machine translation (NMT) is gaining considerable interest, especially for low-resourced languages. Nevertheless, its adoption by the community is still limited. This paper introduces English2Gbe, a multilingual NMT model capable of translating from English to Ewe or Fon. Using the BLEU, CHRF, and TER scores computed with the Sacrebleu (Post, 2018) package for reproducibility, we show that English2Gbe outperforms bilingual models (English to Ewe and English to Fon) and gives state-of-the-art results on the JW300 benchmark for Fon established by Nekoto et al. (2020). We hope this work will contribute to the massive adoption of Multilingual models inside the community. Our code is made accessible from Github.


title: BACON: Deep-Learning Powered AI for Poetry Generation with Author Linguistic Style Transfer

abstract: This paper describes BACON, a basic prototype of an automatic poetry generator with author linguistic style transfer. It combines concepts and techniques from finite state machinery, probabilistic models, artificial neural networks and deep learning, to write original poetry with rich aesthetic-qualities in the style of any given author. Extrinsic evaluation of the output generated by BACON shows that participants were unable to tell the difference between human and AI-generated poems in any statistically significant way.


title: CryptoMiniSat Switches-Optimization for Solving Cryptographic Instances

abstract: Performing hundreds of test runs and a source-code analysis, we empirically identified improved parameter configurations for the CryptoMiniSat (CMS) 5 for solving cryptographic CNF instances originating from algebraic known-plaintext attacks on 3 rounds encryption of the Small AES-64 model cipher SR$(3, 4, 4, 4)$. We finally became able to reconstruct 64-bit long keys in under an hour real time which, to our knowledge, has never been achieved so far. Especially, not without any assumptions or previous knowledge of key-bits (for instance in the form of side-channels, as in \cite{Mohamed2012algebraicSCA}). A statistical analysis of the non-deterministic solver runtimes was carried out and command line parameter combinations were defined to yield best runtimes which ranged from under an hour to a few hours in median at the beginning. We proceeded using an Automatic Algorithm Configuration (AAC) tool to systematically extend the search for even better solver configurations with success to deliver even shorter solving times. In this work we elaborate on the systematics we followed to reach our results in a traceable and reproducible way. The ultimate focus of our investigations is to find out if CMS, when appropriately tuned, is indeed capable to attack even bigger and harder problems than the here solved ones. For the domain of cryptographic research, the duration of the solving time plays an inferior role as compared to the practical feasibility of finding a solution to the problem. The perspective scalability of the here presented results is the object of further investigations.


title: On-the-fly Resource-Aware Model Aggregation for Federated Learning in Heterogeneous Edge

abstract: Edge computing has revolutionized the world of mobile and wireless networks world thanks to its flexible, secure, and performing characteristics. Lately, we have witnessed the increasing use of it to make more performing the deployment of machine learning (ML) techniques such as federated learning (FL). FL was debuted to improve communication efficiency compared to conventional distributed machine learning (ML). The original FL assumes a central aggregation server to aggregate locally optimized parameters and might bring reliability and latency issues. In this paper, we conduct an in-depth study of strategies to replace this central server by a flying master that is dynamically selected based on the current participants and/or available resources at every FL round of optimization. Specifically, we compare different metrics to select this flying master and assess consensus algorithms to perform the selection. Our results demonstrate a significant reduction of runtime using our flying master FL framework compared to the original FL from measurements results conducted in our EdgeAI testbed and over real 5G networks using an operational edge testbed.


title: A Faster Growth of Perturbations in an Early Matter Dominated Epoch: Primordial Black Holes and Gravitational Waves

abstract: We present a scenario for fast growth of cosmological perturbations; $\delta(t) \sim a(t)^s$, $a(t)$ being the scale factor, with $s > 10$ for the numerical examples reported in this article. The basic ingredients of the scenario are an early matter dominated era and the dark fermion which experiences a scalar mediated force during the epoch. Both of these arise in string/supergravity models. The fast growth occurs for sub-horizon density perturbations of the dark fermion. The fast growth has a rich set of phenomenological implications. We outline implications for the formation of primordial black holes and the production of gravitational waves. Primordial black holes in the sub-lunar mass range (which are ideal dark matter candidates) can be produced. Gravitational waves can be produced in a wide range of frequencies due to second order scalar perturbations and due to evaporation and merger of primordial black holes.


title: On the parallel complexity of Group Isomorphism via Weisfeiler-Leman

abstract: In this paper, we show that the constant-dimensional Weisfeiler-Leman algorithm for groups (Brachter & Schweitzer, LICS 2020) can be fruitfully used to improve parallel complexity upper bounds on isomorphism testing for several families of groups. In particular, we show: - Groups with an Abelian normal Hall subgroup whose complement is $O(1)$-generated are identified by constant-dimensional Weisfeiler-Leman using only a constant number of rounds. This places isomorphism testing for this family of groups into $\textsf{L}$; the previous upper bound for isomorphism testing was $\textsf{P}$ (Qiao, Sarma, & Tang, STACS 2011). - We use the individualize-and-refine paradigm to obtain a $\textsf{quasiSAC}^{1}$ isomorphism test for groups without Abelian normal subgroups, previously only known to be in $\textsf{P}$ (Babai, Codenotti, & Qiao, ICALP 2012). - We extend a result of Brachter & Schweitzer (arXiv, 2021) on direct products of groups to the parallel setting. Namely, we also show that Weisfeiler-Leman can identify direct products in parallel, provided it can identify each of the indecomposable direct factors in parallel. They previously showed the analogous result for $\textsf{P}$. We finally consider the count-free Weisfeiler-Leman algorithm, where we show that count-free WL is unable to even distinguish Abelian groups in polynomial-time. Nonetheless, we use count-free WL in tandem with bounded non-determinism and limited counting to obtain a new upper bound of $\beta_{1}\textsf{MAC}^{0}(\textsf{FOLL})$ for isomorphism testing of Abelian groups. This improves upon the previous $\textsf{TC}^{0}(\textsf{FOLL})$ upper bound due to Chattopadhyay, Tor\'an, & Wagner (ACM Trans. Comput. Theory, 2013).


title: Entanglement propagation and dynamics in non-additive quantum systems

abstract: The prominent collective character of long-range interacting quantum systems makes them promising candidates for quantum technological applications. Yet, lack of additivity overthrows the traditional picture for entanglement scaling and transport, due to the breakdown of the common mechanism based on excitations propagation and confinement. Here, we describe the dynamics of the entanglement entropy in many-body quantum systems with a diverging contribution of the long-range two body potential to the internal energy. While in the strict thermodynamic limit entanglement dynamics is shown to be suppressed, a rich mosaic of novel scaling regimes is observed at intermediate system sizes, due to the possibility to trigger multiple resonant modes in the global dynamics. Quantitative predictions on the shape and timescales of entanglement propagation are made, paving the way to the observation of these phases in current quantum simulators. This picture is connected and contrasted with the case of local many body systems subject to Floquet driving.


title: Full discretization and regularization for the Calder\'on problem

abstract: We consider the inverse conductivity problem with discontinuous conductivities. We show in a rigorous way, by a convergence analysis, that one can construct a completely discrete minimization problem whose solution is a good approximation of a solution to the inverse problem. The minimization problem contains a regularization term which is given by a total variation penalization and is characterized by a regularization parameter. The discretization involves at the same time the boundary measurements, by the use of the complete electrode model, the unknown conductivity and the solution to the direct problem. The electrodes are characterized by a parameter related to their size, which in turn controls the number of electrodes to be used. The discretization of the unknown and of the solution to the direct problem is characterized by another parameter related to the size of the mesh involved. In our analysis we show how to precisely choose the regularization, electrodes size and mesh size parameters with respect to the noise level in such a way that the solution to the discrete regularized problem is meaningful. In particular we obtain that the electrodes and mesh size parameters should decay polynomially with respect to the noise level.


title: Do Androids Dream of Electric Fences? Safety-Aware Reinforcement Learning with Latent Shielding

abstract: The growing trend of fledgling reinforcement learning systems making their way into real-world applications has been accompanied by growing concerns for their safety and robustness. In recent years, a variety of approaches have been put forward to address the challenges of safety-aware reinforcement learning; however, these methods often either require a handcrafted model of the environment to be provided beforehand, or that the environment is relatively simple and low-dimensional. We present a novel approach to safety-aware deep reinforcement learning in high-dimensional environments called latent shielding. Latent shielding leverages internal representations of the environment learnt by model-based agents to "imagine" future trajectories and avoid those deemed unsafe. We experimentally demonstrate that this approach leads to improved adherence to formally-defined safety specifications.


title: Adversarial Neural Networks for Error Correcting Codes

abstract: Error correcting codes are a fundamental component in modern day communication systems, demanding extremely high throughput, ultra-reliability and low latency. Recent approaches using machine learning (ML) models as the decoders offer both improved performance and great adaptability to unknown environments, where traditional decoders struggle. We introduce a general framework to further boost the performance and applicability of ML models. We propose to combine ML decoders with a competing discriminator network that tries to distinguish between codewords and noisy words, and, hence, guides the decoding models to recover transmitted codewords. Our framework is game-theoretic, motivated by generative adversarial networks (GANs), with the decoder and discriminator competing in a zero-sum game. The decoder learns to simultaneously decode and generate codewords while the discriminator learns to tell the differences between decoded outputs and codewords. Thus, the decoder is able to decode noisy received signals into codewords, increasing the probability of successful decoding. We show a strong connection of our framework with the optimal maximum likelihood decoder by proving that this decoder defines a Nash equilibrium point of our game. Hence, training to equilibrium has a good possibility of achieving the optimal maximum likelihood performance. Moreover, our framework does not require training labels, which are typically unavailable during communications, and, thus, seemingly can be trained online and adapt to channel dynamics. To demonstrate the performance of our framework, we combine it with the very recent neural decoders and show improved performance compared to the original models and traditional decoding algorithms on various codes.


title: Bottomonium suppression and elliptic flow in heavy-ion collisions

abstract: In this proceedings contribution I review recent progress concerning the suppression of bottomonium production in the quark-gluon plasma. Making use of open quantum system methods applied to potential non-relativistic quantum chromodynamics one can show that the dynamics of heavy-quarkonium bound states satisfying the scale hierarchy 1/a_0 >> pi T ~ m_D >> E obey a Lindblad equation whose solution provides the quantum evolution of the heavy-quarkonium reduced density matrix. To solve the resulting Lindblad equation we use a quantum trajectories algorithm which allows one to include all possible angular momentum states of the quark-antiquark probe in a scalable manner. We solve the Lindblad equation using a tuned 3+1D dissipative hydrodynamics code for the background temperature evolution. We then consider a large number of Monte-Carlo sampled bottomonium trajectories embedded in this background. This allows us to extract the centrality- and p_T-dependence of the nuclear suppression factor R_AA[Upsilon] and elliptic flow v_2[Upsilon]. We find good agreement between our model predictions and available sqrt(s_NN) = 5.02 TeV Pb-Pb collision experimental data from the ALICE, ATLAS, and CMS collaborations.


title: Thermodynamics of interacting many-body quantum systems

abstract: Technological and scientific advances have given rise to an era in which coherent quantum-mechanical phenomena can be probed and experimentally-realised over unprecedented timescales in condensed matter physics. In turn, scientific interest in non-equilibrium dynamics and irreversibility signatures of thermodynamics has taken place in recent decades, particularly in relation to cold-atom platforms and thermoelectric devices. In this PhD thesis I summarise some of the most important results obtained over the duration of my PhD, on the topic of thermodynamics involving interacting many-body quantum systems. The topics of discussion encompass three main themes: spin/particle transport in non-integrable systems, explorations in eigenstate thermalisation and finite-temperature transport in autonomous thermal machines. By questioning the effect of local integrability-breaking perturbations, I describe the subtle effects that may rise from conservation laws and their connection to linear response transport using microscopic models. Then, I describe thermalisation in the context of the eigenstate thermalisation hypothesis and its consequence to multipartite entanglement and high-order correlation functions. Finally, motivated by the necessity of describing quantum thermal machines in the finite-temperature regime, I introduce a novel tensor-network based method to investigate thermodynamic properties of autonomous machines that employ interacting many-body systems as working media.

categories: quant-ph cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el


title: Sentence Embeddings and High-speed Similarity Search for Fast Computer Assisted Annotation of Legal Documents

abstract: Human-performed annotation of sentences in legal documents is an important prerequisite to many machine learning based systems supporting legal tasks. Typically, the annotation is done sequentially, sentence by sentence, which is often time consuming and, hence, expensive. In this paper, we introduce a proof-of-concept system for annotating sentences "laterally." The approach is based on the observation that sentences that are similar in meaning often have the same label in terms of a particular type system. We use this observation in allowing annotators to quickly view and annotate sentences that are semantically similar to a given sentence, across an entire corpus of documents. Here, we present the interface of the system and empirically evaluate the approach. The experiments show that lateral annotation has the potential to make the annotation process quicker and more consistent.


title: Homological Quantum Mechanics

abstract: We provide a formulation of quantum mechanics based on the cohomology of the Batalin-Vilkovisky (BV) algebra. Focusing on quantum-mechanical systems without gauge symmetry we introduce a homotopy retract from the chain complex of the harmonic oscillator to finite-dimensional phase space. This induces a homotopy transfer from the BV algebra to the algebra of functions on phase space. Quantum expectation values for a given operator or functional are computed by the function whose pullback gives a functional in the same cohomology class. This statement is proved in perturbation theory by relating the perturbation lemma to Wick's theorem. We test this method by computing two-point functions for the harmonic oscillator for position eigenstates and coherent states. Finally, we derive the Unruh effect, illustrating that these methods are applicable to quantum field theory.


title: The $q$-canonical ensemble as a consequence of Bayesian superstatistics

abstract: Superstatistics is a generalization of equilibrium statistical mechanics that describes systems in nonequilibrium steady states. Among the possible superstatistical distributions, the $q$-canonical ensemble (also known as Tsallis' statistics, and in plasma physics as Kappa distributions) is probably the most widely used, however the current explanations of its origin are not completely consistent. In this work it is shown that, under a Bayesian interpretation of superstatistics, the origin of the $q$-canonical ensemble can be explained as the superstatistical distribution with maximum Shannon-Jaynes entropy under noninformative constraints. The $q$-canonical distributions are singled out by the mathematical structure of superstatistics itself, and thus no assumptions about the physics of the systems of interest, or regarding their complexity or range of interactions, are needed. These results support the thesis that the success of the $q$-canonical ensemble is information-theoretical in nature, and explainable in terms of the original maximum entropy principle by Jaynes.