title: Who Evaluates the Evaluators? On Automatic Metrics for Assessing AI-based Offensive Code Generators

abstract: AI-based code generators are an emerging solution for automatically writing programs starting from descriptions in natural language, by using deep neural networks (Neural Machine Translation, NMT). In particular, code generators have been used for ethical hacking and offensive security testing by generating proof-of-concept attacks. Unfortunately, the evaluation of code generators still faces several issues. The current practice uses output similarity metrics, i.e., automatic metrics that compute the textual similarity of generated code with ground-truth references. However, it is not clear what metric to use, and which metric is most suitable for specific contexts. This work analyzes a large set of output similarity metrics on offensive code generators. We apply the metrics on two state-of-the-art NMT models using two datasets containing offensive assembly and Python code with their descriptions in the English language. We compare the estimates from the automatic metrics with human evaluation and provide practical insights into their strengths and limitations.


title: An Approach for Improving Automatic Mouth Emotion Recognition

abstract: The study proposes and tests a technique for automated emotion recognition through mouth detection via Convolutional Neural Networks (CNN), meant to be applied for supporting people with health disorders with communication skills issues (e.g. muscle wasting, stroke, autism, or, more simply, pain) in order to recognize emotions and generate real-time feedback, or data feeding supporting systems. The software system starts the computation identifying if a face is present on the acquired image, then it looks for the mouth location and extracts the corresponding features. Both tasks are carried out using Haar Feature-based Classifiers, which guarantee fast execution and promising performance. If our previous works focused on visual micro-expressions for personalized training on a single user, this strategy aims to train the system also on generalized faces data sets.


title: Topological quantum criticality of the disordered Chern insulator

abstract: We consider the two-dimensional topological Chern insulator in the presence of static disorder. Generic quantum states in this system are Anderson localized. However, topology requires the presence of a subset of critical states, with diverging localization length (the Chern insulator analog of the `center of the Landau band states' of the quantum Hall insulator.) We discuss geometric criteria for the identification of these states at weak disorder, and their extension into the regime of strong disorder by analytical methods. In this way, we chart a critical surface embedded in a phase space spanned by energy, topological control parameter, and disorder strength. Our analytical predictions are supplemented by a numerical analysis of the position of the critical states, and their multifractal properties.


title: A Neural ODE Interpretation of Transformer Layers

abstract: Transformer layers, which use an alternating pattern of multi-head attention and multi-layer perceptron (MLP) layers, provide an effective tool for a variety of machine learning problems. As the transformer layers use residual connections to avoid the problem of vanishing gradients, they can be viewed as the numerical integration of a differential equation. In this extended abstract, we build upon this connection and propose a modification of the internal architecture of a transformer layer. The proposed model places the multi-head attention sublayer and the MLP sublayer parallel to each other. Our experiments show that this simple modification improves the performance of transformer networks in multiple tasks. Moreover, for the image classification task, we show that using neural ODE solvers with a sophisticated integration scheme further improves performance.


title: Constructing Nearby Commuting Matrices for Reducible Representations of $su(2)$ with an Application to Ogata's Theorem

abstract: Resolving a conjecture of von Neumann, Ogata's theorem in arXiv:1111.5933 showed the highly nontrivial result that arbitrarily many matrices corresponding to macroscopic observables with $N$ sites and a fixed site dimension $d$ are asymptotically nearby commuting observables as $N \to \infty$. In this paper, we develop a method to construct nearby commuting matrices for normalized highly reducible representations of $su(2)$ whose multiplicities of irreducible subrepresentations exhibit a certain monotonically decreasing behavior. We then provide a constructive proof of Ogata's theorem for site dimension $d=2$ with explicit estimates for how close the nearby observables are. Moreover, motivated by the application to time-reversal symmetry explored in arXiv:1012.3494, our construction has the property that real macroscopic observables are asymptotically nearby real commuting observables.

categories: quant-ph math-ph math.FA math.MP math.OA


title: The Stable Artist: Steering Semantics in Diffusion Latent Space

abstract: Large, text-conditioned generative diffusion models have recently gained a lot of attention for their impressive performance in generating high-fidelity images from text alone. However, achieving high-quality results is almost unfeasible in a one-shot fashion. On the contrary, text-guided image generation involves the user making many slight changes to inputs in order to iteratively carve out the envisioned image. However, slight changes to the input prompt often lead to entirely different images being generated, and thus the control of the artist is limited in its granularity. To provide flexibility, we present the Stable Artist, an image editing approach enabling fine-grained control of the image generation process. The main component is semantic guidance (SEGA) which steers the diffusion process along variable numbers of semantic directions. This allows for subtle edits to images, changes in composition and style, as well as optimization of the overall artistic conception. Furthermore, SEGA enables probing of latent spaces to gain insights into the representation of concepts learned by the model, even complex ones such as 'carbon emission'. We demonstrate the Stable Artist on several tasks, showcasing high-quality image editing and composition.


title: Reaction profiles for quantum chemistry-computed [3 + 2] cycloaddition reactions

abstract: Bio-orthogonal click chemistry based on [3 + 2] dipolar cycloadditions has had a profound impact on the field of biochemistry and significant effort has been devoted to identify promising new candidate reactions for this purpose. To gauge whether a prospective reaction could be a suitable bio-orthogonal click reaction, information about both on- and off-target activation and reaction energies is highly valuable. Here, we use an automated workflow, based on the autodE program, to compute over 5000 reaction profiles for [3 + 2] cycloadditions involving both synthetic dipolarophiles and a set of biologically-inspired structural motifs. Based on a succinct benchmarking study, the B3LYP-D3(BJ)/def2-TZVP//B3LYP-D3(BJ)/def2-SVP level of theory was selected for the DFT calculations, and standard conditions and an (aqueous) SMD model were imposed to mimic physiological conditions. We believe that this data, as well as the presented workflow for high-throughput reaction profile computation, will be useful to screen for new bio-orthogonal reactions, as well as for the development of novel machine learning models for the prediction of chemical reactivity more broadly.


title: IRS-aided UAV for Future Wireless Communications: A Survey and Research Opportunities

abstract: Both unmanned aerial vehicles (UAVs) and intelligent reflecting surfaces (IRS) are gaining traction as transformative technologies for upcoming wireless networks. The IRS-aided UAV communication, which introduces IRSs into UAV communications, has emerged in an effort to improve the system performance while also overcoming UAV communication constraints and issues. The purpose of this paper is to provide a comprehensive overview of IRSassisted UAV communications. First, we provide five examples of how IRSs and UAVs can be combined to achieve unrivaled potential in difficult situations. The technological features of the most recent relevant researches on IRS-aided UAV communications from the perspective of the main performance criteria, i.e., energy efficiency, security, spectral efficiency, etc. Additionally, previous research studies on technology adoption as machine learning algorithms. Lastly, some promising research directions and open challenges for IRS-aided UAV communication are presented.


title: Quantum Statistical Mechanics of Dissolving Vortices

abstract: The quantum partition function for dissolving Abelian Higgs vortices is calculated explicitly, using spectral data for the Beltrami Laplacian on the $N$-vortex moduli space $\mathbb{CP}^N$ with a scaled Fubini--Study metric. From the partition function, the pressure of the vortex gas is derived. There are three asymptotic regimes -- High, Intermediate and Low Temperature. The phase crossover from Intermediate to Low Temperature is modelled by a Bessel function. In the Low Temperature regime the free energy is not extensive but is proportional to $N^2$.


title: Dynamics-based quantumness certification of continuous variables using time-independent Hamiltonians with one degree of freedom

abstract: Dynamics-based certification of quantumness is an approach to witnessing the nonclassical character of some continuous-variable states, under the assumption that their dynamics is known. Contrary to other tests of nonclassicality for single systems, it does not require sequential measurements. This family of protocols was introduced for harmonic dynamics. In this work we discuss dynamics-based certification for one degree of freedom evolving under a generic time-independent Hamiltonian. We characterize the conditions under which such a certification is possible. Several examples are explicitly studied, some that are approximately harmonic in the limits of low energy (Kerr nonlinearities, the pendulum, and the Morse potential) and one that is not (the particle in an infinite well).


title: Interplay of longitudinal and transverse expansion in the kinetic dynamics of heavy-ion collisions

abstract: The early dynamics in heavy-ion collisions involves a rapid, far from equilibrium evolution. This early pre-equilibrium stage of the dynamics can be modeled using kinetic equations. The effect of this pre-equilibrium stage on final observables derived from transverse momenta of emitted particles is small. The kinetic equations in the relaxation time approximation for a non-boost invariant system are solved. The asymmetry of the flow with respect to the reaction plane at different rapidities is found to be very sensitive to the degree of non-equilibrium in the evolution. This suggests that the rapidity odd directed flow could be studied to identify the occurrence of non-equilibrium effects and to estimate the asymmetry of the pressure between the longitudinal and transverse directions in the collision.


title: Precision comparisons between theory and data in $t\bar{t}$-production at the LHC

abstract: NNLO QCD corrections to the production and decay of top-quark pairs allow performing precision phenomenology in inclusive and fiducial phase spaces. State-of-the-art predictions for top-quark pair production and their comparison to recent collider data are discussed.


title: Finitely generated simple sharply 2-transitive groups

abstract: We construct the first examples of infinite sharply 2-transitive groups which are finitely generated. Moreover, we construct such a group that has Kazhdan property (T), is simple, has exactly four conjugacy classes, and we show that this number is as small as possible.


title: A novel feature-scrambling approach reveals the capacity of convolutional neural networks to learn spatial relations

abstract: Convolutional neural networks (CNNs) are one of the most successful computer vision systems to solve object recognition. Furthermore, CNNs have major applications in understanding the nature of visual representations in the human brain. Yet it remains poorly understood how CNNs actually make their decisions, what the nature of their internal representations is, and how their recognition strategies differ from humans. Specifically, there is a major debate about the question of whether CNNs primarily rely on surface regularities of objects, or whether they are capable of exploiting the spatial arrangement of features, similar to humans. Here, we develop a novel feature-scrambling approach to explicitly test whether CNNs use the spatial arrangement of features (i.e. object parts) to classify objects. We combine this approach with a systematic manipulation of effective receptive field sizes of CNNs as well as minimal recognizable configurations (MIRCs) analysis. In contrast to much previous literature, we provide evidence that CNNs are in fact capable of using relatively long-range spatial relationships for object classification. Moreover, the extent to which CNNs use spatial relationships depends heavily on the dataset, e.g. texture vs. sketch. In fact, CNNs even use different strategies for different classes within heterogeneous datasets (ImageNet), suggesting CNNs have a continuous spectrum of classification strategies. Finally, we show that CNNs learn the spatial arrangement of features only up to an intermediate level of granularity, which suggests that intermediate rather than global shape features provide the optimal trade-off between sensitivity and specificity in object classification. These results provide novel insights into the nature of CNN representations and the extent to which they rely on the spatial arrangement of features for object classification.


title: Reduction by stages for finite W-algebras

abstract: Let $\mathfrak{g}$ be a semisimple Lie algebra: its dual space $\mathfrak{g}^*$ is a Poisson variety. It is well known that for each nilpotent element $f$ in $\mathfrak{g}^*$, it is possible to construct a new Poisson structure by Hamiltonian reduction which is isomorphic to some subvariety of $\mathfrak{g}^*$, the Slodowy slice $S_f$. We prove that, given two nilpotent elements $f_1$ and $f_2$, with some assumptions, it is possible to perform a Hamiltonian reduction by stages: the slice $S_{f_2}$ is a Hamiltonian reduction of the slice $S_{f_1}$. We also state an analogue result in the setting of finite W-algebras, which are quantizations of Slodowy slices. As corollary in type A, we prove the conjecture of Morgan stating that any hook-type W-algebra can be obtained as Hamiltonian reduction from any other hook type one. As an application, we establish a generalization of the Skryabin equivalence. Finally, we make some conjectures in the context of affine W-algebras.


title: Reconstructing Humpty Dumpty: Multi-feature Graph Autoencoder for Open Set Action Recognition

abstract: Most action recognition datasets and algorithms assume a closed world, where all test samples are instances of the known classes. In open set problems, test samples may be drawn from either known or unknown classes. Existing open set action recognition methods are typically based on extending closed set methods by adding post hoc analysis of classification scores or feature distances and do not capture the relations among all the video clip elements. Our approach uses the reconstruction error to determine the novelty of the video since unknown classes are harder to put back together and thus have a higher reconstruction error than videos from known classes. We refer to our solution to the open set action recognition problem as "Humpty Dumpty", due to its reconstruction abilities. Humpty Dumpty is a novel graph-based autoencoder that accounts for contextual and semantic relations among the clip pieces for improved reconstruction. A larger reconstruction error leads to an increased likelihood that the action can not be reconstructed, i.e., can not put Humpty Dumpty back together again, indicating that the action has never been seen before and is novel/unknown. Extensive experiments are performed on two publicly available action recognition datasets including HMDB-51 and UCF-101, showing the state-of-the-art performance for open set action recognition.


title: Circular motion subject to external alignment under active driving: nonlinear dynamics and the circle map

abstract: Hardly any real self-propelling or actively driven object is perfect. Thus, undisturbed motion will generally not follow straight lines but rather circular trajectories. We here address self-propelled or actively driven objects that move in discrete steps and additionally tempt to migrate towards a certain direction by discrete angular adjustment. Overreaction in the angular alignment is possible. This competition implies pronounced nonlinear dynamics including period doubling and chaotic behavior in a broad parameter regime. Such behavior directly affects the appearance of the trajectories, also during collective motion under spatial self-concentration.

categories: cond-mat.soft cond-mat.stat-mech nlin.CD physics.bio-ph physics.chem-ph


title: Sequential Cursed Equilibrium

abstract: We propose an extensive-form solution concept, with players that neglect information from hypothetical events, but make inferences from observed events. Our concept modifies cursed equilibrium (Eyster and Rabin, 2005), and allows that players can be 'cursed about' endogenous information.


title: Video Prediction by Efficient Transformers

abstract: Video prediction is a challenging computer vision task that has a wide range of applications. In this work, we present a new family of Transformer-based models for video prediction. Firstly, an efficient local spatial-temporal separation attention mechanism is proposed to reduce the complexity of standard Transformers. Then, a full autoregressive model, a partial autoregressive model and a non-autoregressive model are developed based on the new efficient Transformer. The partial autoregressive model has a similar performance with the full autoregressive model but a faster inference speed. The non-autoregressive model not only achieves a faster inference speed but also mitigates the quality degradation problem of the autoregressive counterparts, but it requires additional parameters and loss function for learning. Given the same attention mechanism, we conducted a comprehensive study to compare the proposed three video prediction variants. Experiments show that the proposed video prediction models are competitive with more complex state-of-the-art convolutional-LSTM based models. The source code is available at https://github.com/XiYe20/VPTR.


title: Bayesian Opponent Modeling in Multiplayer Imperfect-Information Games

abstract: In many real-world settings agents engage in strategic interactions with multiple opposing agents who can employ a wide variety of strategies. The standard approach for designing agents for such settings is to compute or approximate a relevant game-theoretic solution concept such as Nash equilibrium and then follow the prescribed strategy. However, such a strategy ignores any observations of opponents' play, which may indicate shortcomings that can be exploited. We present an approach for opponent modeling in multiplayer imperfect-information games where we collect observations of opponents' play through repeated interactions. We run experiments against a wide variety of real opponents and exact Nash equilibrium strategies in three-player Kuhn poker and show that our algorithm significantly outperforms all of the agents, including the exact Nash equilibrium strategies.


title: Upgrading MLSI to LSI for reversible Markov chains

abstract: For reversible Markov chains on finite state spaces, we show that the modified log-Sobolev inequality (MLSI) can be upgraded to a log-Sobolev inequality (LSI) at the surprisingly low cost of degrading the associated constant by $\log (1/p)$, where $p$ is the minimum non-zero transition probability. We illustrate this by providing the first log-Sobolev estimate for Zero-Range processes on arbitrary graphs. As another application, we determine the modified log-Sobolev constant of the Lamplighter chain on all bounded-degree graphs, and use it to provide negative answers to two open questions by Montenegro and Tetali (2006) and Hermon and Peres (2018). Our proof builds upon the `regularization trick' recently introduced by the last two authors.


title: Positive and negative moments for directed polymers in random environment in weak disorder

abstract: Very recently, Junk [11] showed that for directed polymers in bounded random environments, the weak disorder (uniform integrable) phase implies that the polymer martingale is bounded in $L^p$ for some $p>1$ and also in $L^q$ for some $q<0$. Here, we establish this characterization of the weak disorder phase without requiring the boundedness assumption on the environments.


title: Thirty years after: insights on the cultural origins of Kolmogorov's 1954 theorem from a short conversation with Arnold

abstract: Among the impressive contributions of Andrej N. Kolmogorov's to mathematics in the 20th century, his 1954 invariant tori theorem is still little understood from a historical point of view [Dumas 2014]. Vladimir I. Arnold, who entered Moscow State University that same year and would became a student of Kolmogorov, 30 years after asked him about the origin of a research program to which Arnold himself gave a big contribution. In this paper we compare and put in historical and biographical context two different account's by Arnold on this conversation.


title: Quantum Coherence of Critical Unstable Two-Level Systems

abstract: We study in detail the dynamics of unstable two-level quantum systems by adopting the Bloch-sphere formalism of qubits. By employing the Bloch-vector representation for such unstable qubit systems, we identify a novel class of critical scenarios in which the so-called energy-level and decay-width vectors, ${\bf E}$ and ${\bf\Gamma}$, are orthogonal to one another, and the parameter $r = |{\bf \Gamma}|/(2|{\bf E}|)$ is less than 1. Most remarkably, we find that critical unstable qubit systems exhibit atypical behaviours like coherence--decoherence oscillations when analysed in an appropriately defined co-decaying frame of the system. In the same frame, a unit Bloch vector ${\bf b}$ describing a pure critical qubit will sweep out unequal areas during equal intervals of time, while rotating about the vector ${\bf E}$. These phenomena emerge beyond the usual oscillatory pattern due to the energy-level difference of the two-level quantum system. Interestingly enough, we observe that these new features will persist even for quasi-critical scenarios, in which the vectors ${\bf E}$ and ${\bf\Gamma}$ are not perfectly orthogonal to each other. Applications of our results to quantum information and to unstable meson--antimeson and other systems are discussed.


title: Constraining Light Scalar Field with Torsion-Balance Gravity Experiments

abstract: The light scalar field with a coupling to standard model particles provide a possible source of the dark matter, long-range Yukawa forces or violation of the weak equivalence principle, which can be potentially explored by precision gravity experiments. We describe the searches for such light scalar fields with the three types of gravity experiments, including the $G$-measurement experiments, Inverse-Square Law (ISL) experiments, and equivalence principle experiments. We investigate the potential influences of the scalar field as a function of its mass, and focus on the experimental constraints from torsion-balance gravity experiments. HUST-18 $G$-measurement torsion-balance experiments place bounds on the photon coupling and electron coupling at up to $\Lambda_{\gamma}=7\times10^{17}$ GeV and $\Lambda_{e}=1\times10^{17}$ GeV in the mass ranges $10^{-9}-10^{-4}$ eV. Results from the ISL experiments by the Universities of Washington, Stanford, IUPUI, HUST, Colorado, Irvine, Yale and others allow us to set limits on the photon coupling and electron coupling at up to $\Lambda_{\gamma}=5\times10^{17}$ GeV and $\Lambda_{e}=3\times10^{16}$ GeV for scalar field mass ranges between $10^{-5}$ and $10^{-1}$ eV. Additionally, we also discuss the limits from equivalence principle experiments, and $MICROSCOPE$ final result updates the constrains on the coupling parameters at up to $\Lambda_{\gamma}=7\times10^{22}$ GeV and $\Lambda_{e}=4\times10^{21}$ GeV for mass ranges $\lesssim 10^{-13}$ eV. These results contribute experimental constraints to relatively unexplored mass regions of {light scalar field} parameter space and improve upon previous limits in some mass ranges. This work paves the way for long-range Yukawa forces mediated by light scalar fields in future high-precision gravity experiments.


title: Dust contribution to the panchromatic galaxy emission

abstract: We have developed a pipeline called \mentari to generate the far-ultraviolet to far-infrared spectral energy distribution (SED) of galaxies from the \dustysage semi-analytic galaxy formation model (SAM). \dustysage incorporates dust-related processes directly on top of the basic ingredients of galaxy formation like gas infall, cooling, star formation, feedback, and mergers. We derive a physically motivated attenuation model from the computed dust properties in \dustysage, so each galaxy has a self-consistent set of attenuation parameters based on the complicated dust physics that occurred across the galaxy's assembly history. Then, we explore several dust emission templates to produce infrared spectra. Our results show that a physically-motivated attenuation model is better for obtaining a consistent multi-wavelength description of galaxy formation and evolution, compared to using a constant attenuation. We compare our predictions with a compilation of observations and find that the fiducial model is in reasonable agreement with: (i) the observed $z=0$ luminosity functions from the far-ultraviolet to far-infrared simultaneously, and hence (ii) the local cosmic SED in the same range, (iii) the rest-frame K-band luminosity function across $0 < z < 3$, and (iv) the rest-frame far-ultraviolet luminosity function across $0 < z < 1$. Our model underproduces the far-ultraviolet emission at $z=2$ and $z=3$, which can be improved by altering the AGN feedback and dust processes in \dustysage. However, this combination thus worses the agreement at $z=0$, which suggests that more detailed treatment of such processes is required.


title: IMDB Spoiler Dataset

abstract: User-generated reviews are often our first point of contact when we consider watching a movie or a TV show. However, beyond telling us the qualitative aspects of the media we want to consume, reviews may inevitably contain undesired revelatory information (i.e. 'spoilers') such as the surprising fate of a character in a movie, or the identity of a murderer in a crime-suspense movie, etc. In this paper, we present a high-quality movie-review based spoiler dataset to tackle the problem of spoiler detection and describe various research questions it can answer.


title: News Headlines Dataset For Sarcasm Detection

abstract: Past studies in Sarcasm Detection mostly make use of Twitter datasets collected using hashtag-based supervision but such datasets are noisy in terms of labels and language. Furthermore, many tweets are replies to other tweets, and detecting sarcasm in these requires the availability of contextual tweets. To overcome the limitations related to noise in Twitter datasets, we curate News Headlines Dataset from two news websites: TheOnion aims at producing sarcastic versions of current events, whereas HuffPost publishes real news. The dataset contains about 28K headlines out of which 13K are sarcastic. To make it more useful, we have included the source links of the news articles so that more data can be extracted as needed. In this paper, we describe various details about the dataset and potential use cases apart from Sarcasm Detection.


title: The spatial accessibility of attractive parks in Chicago and a proposed planning support system to evaluate the accessibility of POIs

abstract: Urban parks play an essential role in meeting the ecological, social, and recreational requirements of residents. Access to urban parks reflects people's quality of life. The present research focused on the cumulative accessibility by walking and driving to attractive urban parks for different population groups in Chicago. The present study used the ratings and the number of reviews on Google Maps to evaluate each parks' attractiveness. The results present the cumulative accessibility scores using gravity, linear, and kernel models. In addition, the spatial distribution of the accessibility to parks for population groups of different races and levels of income are shown at the 90 m X 90 m land cell scale and at the community level. Highly attractive parks that people walk to receive a high accessibility score. However, parks with high accessibility scores that people drive to were along the major highways. The present study also determined that the Black and high-income populations have a higher accessibility score to parks than other population groups. Moreover, a planning supporting system is proposed that uses rating data that can be gathered from apps such as Google Maps and Yelp to evaluate all types of Points of Interest (POIs) in parks.


title: Chinese Discourse Annotation Reference Manual

abstract: This document provides extensive guidelines and examples for Rhetorical Structure Theory (RST) annotation in Mandarin Chinese. The guideline is divided into three sections. We first introduce preprocessing steps to prepare data for RST annotation. Secondly, we discuss syntactic criteria to segment texts into Elementary Discourse Units (EDUs). Lastly, we provide examples to define and distinguish discourse relations in different genres. We hope that this reference manual can facilitate RST annotations in Chinese and accelerate the development of the RST framework across languages.


title: Large Discourse Treebanks from Scalable Distant Supervision

abstract: Discourse parsing is an essential upstream task in Natural Language Processing with strong implications for many real-world applications. Despite its widely recognized role, most recent discourse parsers (and consequently downstream tasks) still rely on small-scale human-annotated discourse treebanks, trying to infer general-purpose discourse structures from very limited data in a few narrow domains. To overcome this dire situation and allow discourse parsers to be trained on larger, more diverse and domain-independent datasets, we propose a framework to generate "silver-standard" discourse trees from distant supervision on the auxiliary task of sentiment analysis.


title: Technological taxonomies for hypernym and hyponym retrieval in patent texts

abstract: This paper presents an automatic approach to creating taxonomies of technical terms based on the Cooperative Patent Classification (CPC). The resulting taxonomy contains about 170k nodes in 9 separate technological branches and is freely available. We also show that a Text-to-Text Transfer Transformer (T5) model can be fine-tuned to generate hypernyms and hyponyms with relatively high precision, confirming the manually assessed quality of the resource. The T5 model opens the taxonomy to any new technological terms for which a hypernym can be generated, thus making the resource updateable with new terms, an essential feature for the constantly evolving field of technological terminology.


title: Semantic Decomposition Improves Learning of Large Language Models on EHR Data

abstract: Electronic health records (EHR) are widely believed to hold a profusion of actionable insights, encrypted in an irregular, semi-structured format, amidst a loud noise background. To simplify learning patterns of health and disease, medical codes in EHR can be decomposed into semantic units connected by hierarchical graphs. Building on earlier synergy between Bidirectional Encoder Representations from Transformers (BERT) and Graph Attention Networks (GAT), we present H-BERT, which ingests complete graph tree expansions of hierarchical medical codes as opposed to only ingesting the leaves and pushes patient-level labels down to each visit. This methodology significantly improves prediction of patient membership in over 500 medical diagnosis classes as measured by aggregated AUC and APS, and creates distinct representations of patients in closely related but clinically distinct phenotypes.


title: Sentiment Analysis of Persian Language: Review of Algorithms, Approaches and Datasets

abstract: Sentiment analysis aims to extract people's emotions and opinion from their comments on the web. It widely used in businesses to detect sentiment in social data, gauge brand reputation, and understand customers. Most of articles in this area have concentrated on the English language whereas there are limited resources for Persian language. In this review paper, recent published articles between 2018 and 2022 in sentiment analysis in Persian Language have been collected and their methods, approach and dataset will be explained and analyzed. Almost all the methods used to solve sentiment analysis are machine learning and deep learning. The purpose of this paper is to examine 40 different approach sentiment analysis in the Persian Language, analysis datasets along with the accuracy of the algorithms applied to them and also review strengths and weaknesses of each. Among all the methods, transformers such as BERT and RNN Neural Networks such as LSTM and Bi-LSTM have achieved higher accuracy in the sentiment analysis. In addition to the methods and approaches, the datasets reviewed are listed between 2018 and 2022 and information about each dataset and its details are provided.


title: AD-BERT: Using Pre-trained contextualized embeddings to Predict the Progression from Mild Cognitive Impairment to Alzheimer's Disease

abstract: Objective: We develop a deep learning framework based on the pre-trained Bidirectional Encoder Representations from Transformers (BERT) model using unstructured clinical notes from electronic health records (EHRs) to predict the risk of disease progression from Mild Cognitive Impairment (MCI) to Alzheimer's Disease (AD). Materials and Methods: We identified 3657 patients diagnosed with MCI together with their progress notes from Northwestern Medicine Enterprise Data Warehouse (NMEDW) between 2000-2020. The progress notes no later than the first MCI diagnosis were used for the prediction. We first preprocessed the notes by deidentification, cleaning and splitting, and then pretrained a BERT model for AD (AD-BERT) based on the publicly available Bio+Clinical BERT on the preprocessed notes. The embeddings of all the sections of a patient's notes processed by AD-BERT were combined by MaxPooling to compute the probability of MCI-to-AD progression. For replication, we conducted a similar set of experiments on 2563 MCI patients identified at Weill Cornell Medicine (WCM) during the same timeframe. Results: Compared with the 7 baseline models, the AD-BERT model achieved the best performance on both datasets, with Area Under receiver operating characteristic Curve (AUC) of 0.8170 and F1 score of 0.4178 on NMEDW dataset and AUC of 0.8830 and F1 score of 0.6836 on WCM dataset. Conclusion: We developed a deep learning framework using BERT models which provide an effective solution for prediction of MCI-to-AD progression using clinical note analysis.


title: Introducing Hermes: Executing Clinical Quality Language (CQL) at over 66 Million Resources per Second (inexpensively)

abstract: Clinical Quality Language (CQL) has emerged as a standard for rule representation in Clinical Decision Support (CDS) and Electronic Clinical Quality Measurement (eCQM) in healthcare. While open-source reference implementations and a few commercial engines exist, there is still a market need for high-performance engines that can execute CQL queries on the scales of millions of patients. We introduce the \Hermes{} engine as the world's fastest commercial CQL execution engine.


title: $S^1$-localisation by pseudocycles, lifts to $S^1$-localisation of moduli spaces, and application to invariants of $S^1$-equivariant symplectic cohomology

abstract: We demonstrate a way to apply $S^1$-localisation to moduli spaces of holomorphic curves. We first prove a reinterpretation of Atyiah-Bott $S^1$-localisation, called {\it localisation by pseudocycles} (LbP), for a smooth semifree $S^1$-action on a manifold. We demonstrate that, for certain moduli spaces of holomorphic curves parametrised by some stratum of the homotopy quotient of a manifold, we may ``lift" the LbP procedure from the parameter space to the moduli space. As an application we deduce relations between equivariant symplectic classes and Gromov-Witten invariants, thus proving a conjecture of Seidel.


title: PERFEX: Classifier Performance Explanations for Trustworthy AI Systems

abstract: Explainability of a classification model is crucial when deployed in real-world decision support systems. Explanations make predictions actionable to the user and should inform about the capabilities and limitations of the system. Existing explanation methods, however, typically only provide explanations for individual predictions. Information about conditions under which the classifier is able to support the decision maker is not available, while for instance information about when the system is not able to differentiate classes can be very helpful. In the development phase it can support the search for new features or combining models, and in the operational phase it supports decision makers in deciding e.g. not to use the system. This paper presents a method to explain the qualities of a trained base classifier, called PERFormance EXplainer (PERFEX). Our method consists of a meta tree learning algorithm that is able to predict and explain under which conditions the base classifier has a high or low error or any other classification performance metric. We evaluate PERFEX using several classifiers and datasets, including a case study with urban mobility data. It turns out that PERFEX typically has high meta prediction performance even if the base classifier is hardly able to differentiate classes, while giving compact performance explanations.


title: Drivers of the decrease of patent similarities from 1976 to 2021

abstract: The citation network of patents citing prior art arises from the legal obligation of patent applicants to properly disclose their invention. One way to study the relationship between current patents and their antecedents is by analyzing the similarity between the textual elements of patents. Many patent similarity indicators have shown a constant decrease since the mid-70s. Although several explanations have been proposed, more comprehensive analyses of this phenomenon have been rare. In this paper, we use a computationally efficient measure of patent similarity scores that leverages state-of-the-art Natural Language Processing tools, to investigate potential drivers of this apparent similarity decrease. This is achieved by modeling patent similarity scores by means of generalized additive models. We found that non-linear modeling specifications are able to distinguish between distinct, temporally varying drivers of the patent similarity levels that explain more variation in the data ($R^2\sim 18\%$) compared to previous methods. Moreover, the model reveals an underlying trend in similarity scores that is fundamentally different from the one presented previously.


title: Spatiotemporal Impact Analysis of Hurricanes and Storm Surges on Power Systems

abstract: This paper develops a spatiotemporal probabilistic impact assessment framework to analyze and quantify the compounding effect of hurricanes and storm surges on the bulk power grid. The probabilistic synthetic hurricane tracks are generated using historical hurricane data, and storm surge scenarios are generated based on observed hurricane parameters. The system losses are modeled using a loss metric that quantifies the total load loss. The overall simulation is performed on the synthetic Texas 2000-bus system mapped on the geographical footprint of Texas. The results show that power substation inundation due to storm surge creates additional load losses as the hurricane traverses inland.


title: Machine Learning Approaches for Principle Prediction in Naturally Occurring Stories

abstract: Value alignment is the task of creating autonomous systems whose values align with those of humans. Past work has shown that stories are a potentially rich source of information on human values; however, past work has been limited to considering values in a binary sense. In this work, we explore the use of machine learning models for the task of normative principle prediction on naturally occurring story data. To do this, we extend a dataset that has been previously used to train a binary normative classifier with annotations of moral principles. We then use this dataset to train a variety of machine learning models, evaluate these models and compare their results against humans who were asked to perform the same task. We show that while individual principles can be classified, the ambiguity of what "moral principles" represent, poses a challenge for both human participants and autonomous systems which are faced with the same task.


title: CDialog: A Multi-turn Covid-19 Conversation Dataset for Entity-Aware Dialog Generation

abstract: The development of conversational agents to interact with patients and deliver clinical advice has attracted the interest of many researchers, particularly in light of the COVID-19 pandemic. The training of an end-to-end neural based dialog system, on the other hand, is hampered by a lack of multi-turn medical dialog corpus. We make the very first attempt to release a high-quality multi-turn Medical Dialog dataset relating to Covid-19 disease named CDialog, with over 1K conversations collected from the online medical counselling websites. We annotate each utterance of the conversation with seven different categories of medical entities, including diseases, symptoms, medical tests, medical history, remedies, medications and other aspects as additional labels. Finally, we propose a novel neural medical dialog system based on the CDialog dataset to advance future research on developing automated medical dialog systems. We use pre-trained language models for dialogue generation, incorporating annotated medical entities, to generate a virtual doctor's response that addresses the patient's query. Experimental results show that the proposed dialog models perform comparably better when supplemented with entity information and hence can improve the response quality.


title: Search for new particles at the ILC

abstract: The LHC experiments have searched for and excluded many proposed Beyond the Standard Model (BSM) theories. However, there are many scenarios where LHC has little or no sensitivity. Electron-positron colliders offers a different avenue for searches for such phenomena.In this talk, we will review the expectations for searches for number of BSM models at the International Linear Collider (ILC). We will discuss new Higgs-like scalars, indirect BSM via Standard Model Effective Field Theory (SMEFT) fits, mono-photons, and SUSY in strongly or moderately compressed models.


title: Evidence for Populations-dependent vertical motions and the Long-lived Non-Steady Lopsided Milky Way Warp

abstract: We present the Galactic disk vertical velocity analysis using OB type stars (OB), Red Clump stars (RC), and Main-Sequence-Turn-Off stars (MSTO) with different average age populations crossed matched with LAMOST DR5 and Gaia DR3. We reveal the vertical velocities of the three populations varies clearly with the Galactocentric distance ($R$) and the younger stellar population has stronger increasing trend in general. The bending and breathing modes indicated by the vertical motions are dependent on the populations and they are varying with spatial locations. These vertical motions may be due to the Galactic warp, or minor mergers, or non-equilibrium of the disk. Assuming the warp is the dominant component, we find that the warp amplitude ($\gamma$, $Z_\omega$) for OB (younger population) is larger than that for RC (medium population) and the later one is also larger than that for MSTO (older population), which is in agreement with other independent analyses of stellar density distribution, and supports the warp is long-lived, non-steady structure and has time evolution. This conclusion is robust whether or not the line-of-nodes $\phi_w$ is fixed or as a free parameter (with $\phi_w$ is around 3$-$8.5$^{\circ}$ as best fit). Furthermore, we find that warp is lopsided with asymmetries along azimuthal angle ($\phi$).


title: Going beyond richness: Modelling the BEF relationship using species identity, evenness, richness and species interactions via the DImodels R package

abstract: BEF studies aim to understand how ecosystems respond to a gradient of species diversity. Diversity-Interactions (DI) models are suitable for analysing the BEF relationship. These models relate an ecosystem function response of a community to the identity of the species in the community, their evenness (proportions) and interactions. The number of species in the community (richness) is also implicitly modelled through this approach. It is common in BEF studies to model an ecosystem function as a function of richness; while this can uncover trends in the BEF relationship, by definition, species diversity is much broader than richness alone, and important patterns in the BEF relationship may remain hidden. In this paper, we introduce the DImodels R package for implementing DI models. We also compare DI models to traditional modelling approaches to highlight the advantages of using a multi-dimensional definition of species diversity. We show that using DI models can lead to considerably improved model fit over other methods; it does this by incorporating variation due to the multiple facets of species diversity. Predicting from a DI model is not limited to the study design points, the model can extrapolate to predict for any species composition and proportions (assuming there is sufficient coverage of this space in the study design). Expressing the BEF relationship as a function of richness alone can be useful to capture overall trends. However, collapsing the multiple dimensions of species diversity to a single dimension (such as richness) can result in valuable ecological information being lost. DI modelling provides a framework to test the multiple components of species diversity in the BEF relationship. It facilitates uncovering a deeper ecological understanding of the BEF relationship and can lead to enhanced inference.


title: Relativistic Collisionless Shocks in Inhomogeneous Magnetized Plasmas

abstract: Relativistic collisionless shocks are associated with efficient particle acceleration when propagating into weakly magnetized homogeneous media; as the magnetization increases, particle acceleration becomes suppressed. We demonstrate that this changes when the upstream carries kinetic-scale inhomogeneities, as is often the case in astrophysical environments. We use fully-kinetic simulations to study relativistic perpendicular shocks in magnetized pair plasmas interacting with upstream density perturbations. For amplitudes of $\delta \rho/\rho \gtrsim 0.5$, the upstream fluctuations are found to corrugate the shock front and generate large-scale turbulent shear motions in the downstream, which in turn are capable of accelerating particles. This can revive relativistic magnetized shocks as viable energization sites in astrophysical systems, such as jets and accretion disks. The generation of large-scale magnetic structures also has important implications for polarization signals from blazars.


title: Geometrization 3.0: the black hole shadow

abstract: There have been three geometrizations in history. The first one is historically due to the Pythagorean school and Plato, the second one comes from Galileo, Kepler, Descartes and Newton, and the third is Einstein's geometrization of nature. The term geometrization of nature means the conception according to which nature (with its different meanings) is massively described by using geometry. In this article, I focus on the third geometrization, in which the black hole shadow phenomenon provides an interesting statement about the level of geometrization achieved by the theory of general relativity. With the black hole shadow described by the Einsteinian theory, the geometrical interpretation of nature relates shape to dynamics or, more specifically, the shadow silhouette to the angular momentum, regardless the matter content inside the black hole. As a consequence, spacetime symmetry could play the role of the formal cause in black hole physics.


title: Subgradient methods for non-smooth optimization problems with some relaxation of sharp minimum

abstract: In this paper we propose a generalized condition for a sharp minimum, somewhat similar to the inexact oracle proposed recently by Devolder-Glineur-Nesterov. The proposed approach makes it possible to extend the class of applicability of subgradient methods with the Polyak step-size, to the situation of inexact information about the value of the minimum, as well as the unknown Lipschitz constant of the objective function. Moreover, the use of local analogs of the global characteristics of the objective function makes it possible to apply the results of this type to wider classes of problems. We show the possibility of applying the proposed approach to strongly convex non-smooth problems, also, we make an experimental comparison with the known optimal subgradient method for such a class of problems. Moreover, there were obtained some results connected to the applicability of the proposed technique to some types of problems with convexity relaxations: the recently proposed notion of weak $\beta$-quasi-convexity and ordinary quasi-convexity. Also in the paper, we study a generalization of the described technique to the situation with the assumption that the $\delta$-subgradient of the objective function is available instead of the usual subgradient. For one of the considered methods, conditions are found under which, in practice, it is possible to escape the projection of the considered iterative sequence onto the feasible set of the problem.


title: Quantifying uncertainties due to optical potentials in one-neutron knockout reactions

abstract: One-neutron knockout reactions have been widely used to extract information about the single-particle structure of nuclei from the valley of stability to the driplines. The interpretation of knockout data relies on reaction models, where the uncertainties are typically not accounted for. In this work we quantify uncertainties of optical potentials used in these reaction models and propagate them, for the first time, to knockout observables using a Bayesian analysis. We study two reactions in the present paper, the first of which involves a loosely-bound halo projectile, $^{11}$Be, and the second a tightly-bound projectile, $^{12}$C. We first quantify the parametric uncertainties associated with phenomenological optical potentials. Complementing to this approach, we also quantify the model uncertainties associated with the chiral forces that can be used to construct microscopic optical potentials. For the phenomenological study, we investigate the impact of the imaginary terms of the optical potential on the breakup and stripping components of the knockout cross sections as well as the impact of the angular range. For the $^{11}$Be case, the theoretical uncertainty from the phenomenological method is on the order of the experiment uncertainty on the knockout observables; however, for the $^{12}$C case, the theoretical uncertainty is significantly larger. The widths of the confidence intervals for the knockout observables obtained for the microscopic study and the phenomenological approach are of similar order of magnitude. Based on this work we conclude that structure information inferred from the ratio of the knockout cross sections, will carry a theoretical uncertainty of at least $20\%$ for halo nuclei and at least $40\%$ for tightly-bound nuclei.


title: The Heisenberg-Wigner formalism for transverse fields

abstract: We discuss the Heisenberg-Wigner phase-space formalism in quantum electrodynamics as well as scalar quantum electrodynamics with respect to transverse fields. In regard to the special characteristics of such field types we derive modified transport equations such that particle momenta perpendicular to the propagation direction of the waves show up as external parameters only. In case of spatially oscillating fields we further demonstrate how to transform momentum derivative operators of infinite order into simple coupling terms.


title: Striped Jets in Post Neutron Star Merger Systems

abstract: Models invoking magnetic reconnection as the particle acceleration mechanism within relativistic jets often adopt a gradual energy dissipation profile within the jet. However, such a profile has yet to be reproduced in first-principles simulations. Here, we perform a suite of 3D general relativistic magnetohydrodynamic simulations of post-neutron star merger disks with an initially purely toroidal magnetic field. We explore the variations in both the microphysics (e.g., nuclear recombination, neutrino emission) and system parameters (e.g., disk mass). In all our simulations, we find the formation of magnetically striped jets. The stripes result from the reversals in the poloidal magnetic flux polarity generated in the accretion disk. The simulations display large variations in the distributions of stripe duration, $\tau$, and power, $\langle P_{\Phi} \rangle$. We find that more massive disks produce more powerful stripes, the most powerful of which reaches $\langle P_{\Phi} \rangle \sim 10^{49}$~erg~s$^{-1}$ at $\tau \sim 20$~ms. The power and variability that result from the magnetic reconnection of the stripes agree with those inferred in short duration gamma-ray bursts. We find that the dissipation profile of the cumulative energy is roughly a power-law in both radial distance, $z$, and $\tau$, with the slope in the range, $\sim 1.7-3$; more massive disks display larger slopes.


title: First-order heat content asymptotics on ${\sf RCD}(K,N)$ spaces

abstract: In this paper, we prove first-order asymptotics on a bounded open set of the heat content when the ambient space is an ${\sf RCD}(K,N)$ space, under a regularity condition for the boundary that we call measured interior geodesic condition of size $\epsilon$. We carefully study such a condition, relating it to the properties of the disintegration of the signed distance function from $\partial \Omega$ studied by Cavalletti and Mondino.


title: On Finite Difference Jacobian Computation in Deformable Image Registration

abstract: Producing spatial transformations that are diffeomorphic is a key goal in deformable image registration. As a diffeomorphic transformation should have positive Jacobian determinant |J| everywhere, the number of voxels with |J|<0 has been used to test for diffeomorphism and also to measure the irregularity of the transformation. For digital transformations, |J| is commonly approximated using a central difference, but this strategy can yield positive |J|'s for transformations that are clearly not diffeomorphic -- even at the voxel resolution level. To show this, we first investigate the geometric meaning of different finite difference approximations of |J|. We show that to determine if a deformation is diffeomorphic for digital images, the use of any individual finite difference approximation of |J| is insufficient. We further demonstrate that for a 2D transformation, four unique finite difference approximations of |J|'s must be positive to ensure that the entire domain is invertible and free of folding at the pixel level. For a 3D transformation, ten unique finite differences approximations of |J|'s are required to be positive. Our proposed digital diffeomorphism criteria solves several errors inherent in the central difference approximation of |J| and accurately detects non-diffeomorphic digital transformations. The source code of this work is available at https://github.com/yihao6/digital_diffeomorphism.


title: Mitigating disorder-induced zero-energy states in weakly-coupled semiconductor-superconductor hybrid systems

abstract: Disorder has appeared as one of the main mechanisms to induce topologically trivial zero-energy states in superconductor-semiconductor systems, thereby challenging the detection of topological superconductivity and Majorana bound states. Here we demonstrate that, for disorder in any part of the system, the formation of disorder-induced trivial zero-energy states can to a large extent be mitigated by keeping the coupling between the semiconductor and superconductor weak. The only exception is strong disorder in the semiconductor, where instead the strong coupling regime is somewhat more robust against disorder. Furthermore, we find that the topological phase in this weak coupling regime is robust against disorder, with a large and well-defined topological gap which is highly beneficial for topological protection. Our work shows the advantages and disadvantages of weak and strong couplings under disorder, important for designing superconductor-semiconductor hybrid structures.


title: Fractional Dirac Equations from Polynomial Linearization: Solutions and Difficulties

abstract: The linearization of a quadratic form gives rise to a Clifford algebra structure, as seen in Dirac's factorization of the d'Alembert operator. A similar structure known as a generalized Clifford algebra arises from the continuation of this procedure to higher order forms. This technique combined with the existence of a fractional derivative satisfying the semi-group property can be used to factor the d'Alembert operator further, producing a fractional partial differential matrix equation that has a similar form to Dirac's equation. We examine these equations, their solutions, and point out difficulties when attempting to make physical sense of them.


title: Analogous Hawking radiation from gapped excitations in a transonic flow of binary Bose-Einstein condensates

abstract: We have studied analytically the approximate solutions to the gapped mode equations in the hydrodynamic regime for a class of binary Bose-Einstein condensate acoustic black holes. The horizon from the transonic flow is formed by manipulating the phonon sound speed and the flow velocity with the experimentally accessible parameters. The asymptotic modes of various scattering processes are constructed from which to obtain scattering coefficients and then to further decompose the field operator in terms of the asymptotic states. Also, the Unruh state is introduced to be the appropriate state for the description of gravitational collapse of the black hole. The particle densities of the outgoing modes are computed. The effective energy gap term in the dispersion relation of the gapped excitations introduces the threshold frequency $\omega_r$ in the subsonic regime, below which the propagating modes do not exist. Thus, the particle spectrum of the analogous Hawking modes in the exterior of the horizon of the subsonic region significantly deviates from that of the gapless cases near the threshold frequency due to the modified graybody factor, which vanishes as the mode frequency is below $\omega_r$. However, in the interior region of the horizon of the supersonic region, the spectrum of the particle production of the Hawking partner has the nonthermal feature. The correlators between the analog Hawking mode and its partner of relevance to the experimental observations are also investigated and show some peaks near the threshold frequency $\omega_r$ resulting from the gap energy term to be seen in future experiments.


title: Reinforcement Learning Applied to Trading Systems: A Survey

abstract: Financial domain tasks, such as trading in market exchanges, are challenging and have long attracted researchers. The recent achievements and the consequent notoriety of Reinforcement Learning (RL) have also increased its adoption in trading tasks. RL uses a framework with well-established formal concepts, which raises its attractiveness in learning profitable trading strategies. However, RL use without due attention in the financial area can prevent new researchers from following standards or failing to adopt relevant conceptual guidelines. In this work, we embrace the seminal RL technical fundamentals, concepts, and recommendations to perform a unified, theoretically-grounded examination and comparison of previous research that could serve as a structuring guide for the field of study. A selection of twenty-nine articles was reviewed under our classification that considers RL's most common formulations and design patterns from a large volume of available studies. This classification allowed for precise inspection of the most relevant aspects regarding data input, preprocessing, state and action composition, adopted RL techniques, evaluation setups, and overall results. Our analysis approach organized around fundamental RL concepts allowed for a clear identification of current system design best practices, gaps that require further investigation, and promising research opportunities. Finally, this review attempts to promote the development of this field of study by facilitating researchers' commitment to standards adherence and helping them to avoid straying away from the RL constructs' firm ground.


title: HACA3: A Unified Approach for Multi-site MR Image Harmonization

abstract: The lack of standardization is a prominent issue in magnetic resonance (MR) imaging. This often causes undesired contrast variations in the acquired images due to differences in hardware and acquisition parameters. In recent years, image synthesis-based MR harmonization with disentanglement has been proposed to compensate for the undesired contrast variations. Despite the success of existing methods, we argue that three major improvements can be made. First, most existing methods are built upon the assumption that multi-contrast MR images of the same subject share the same anatomy. This assumption is questionable, since different MR contrasts are specialized to highlight different anatomical features. Second, these methods often require a fixed set of MR contrasts for training (e.g., both T1-weighted and T2-weighted images), limiting their applicability. Lastly, existing methods are generally sensitive to imaging artifacts. In this paper, we present Harmonization with Attention-based Contrast, Anatomy, and Artifact Awareness (HACA3), a novel approach to address these three issues. HACA3 incorporates an anatomy fusion module that accounts for the inherent anatomical differences between MR contrasts. Furthermore, HACA3 is also robust to imaging artifacts and can be trained and applied to any set of MR contrasts. HACA3 is developed and evaluated on diverse MR datasets acquired from 21 sites with varying field strengths, scanner platforms, and acquisition protocols. Experiments show that HACA3 achieves state-of-the-art performance under multiple image quality metrics. We also demonstrate the applicability and versatility of HACA3 on downstream tasks including white matter lesion segmentation and longitudinal volumetric analyses.


title: Natural cancellation of powerlike divergences in the SM by dark matter through gauged Higgs portal

abstract: We discuss the connection between the vacuum energy problem and the number of dark matter sectors and its relation to the cancellation of quadratic divergences both in the cosmological constant and simultaneously in the polarization tensor renormalizing the Higgs meson mass. In the absence of global supersymmetry, the cancellations of quartic and quadratic divergences call for a dark Higgs scalar sector. We estimate the number of hidden(dark) gauged Higgs field sectors to be equal to five. The masses of dark bosons may be of the order of the Standard Model boson masses. Then the following picture of the Standard Model emerges: 6 leptons and 6 quarks are accompanied by 6 boson sectors, only one of the latter is realized in the conventional Standard Model.


title: Photon-number moments and cumulants of Gaussian states

abstract: We develop closed-form expressions for the moments and cumulants of Gaussian states when measured in the photon-number basis. We express the photon-number moments of a Gaussian state in terms of the loop Hafnian, a function that when applied to a $(0,1)$-matrix representing the adjacency of a graph, counts the number of its perfect matchings. Similarly, we express the photon-number cumulants in terms of the Montrealer, a newly introduced matrix function that when applied to a $(0,1)$-matrix counts the number of Hamiltonian cycles of that graph. Based on these graph-theoretic connections, we show that the calculation of photon-number moments and cumulants are $#P$-hard. Moreover, we provide an exponential time algorithm to calculate Montrealers (and thus cumulants), matching well-known results for Hafnians. We then demonstrate that when a uniformly lossy interferometer is fed in every input with identical single-mode Gaussian states with zero displacement, all the odd-order cumulants but the first one are zero. Finally, we employ the expressions we derive to study the distribution of cumulants up to the fourth order for different input states in a Gaussian boson sampling setup where $K$ identical states are fed into an $\ell$-mode interferometer. We analyze the dependence of the cumulants as a function of the type of input state, squeezed, lossy squeezed, squashed, or thermal, and as a function of the number of non-vacuum inputs. We find that thermal states perform much worse than other classical states, such as squashed states, at mimicking the photon-number cumulants of lossy or lossless squeezed states.


title: Solving the Wide-band Inverse Scattering Problem via Equivariant Neural Networks

abstract: This paper introduces a novel deep neural network architecture for solving the inverse scattering problem in frequency domain with wide-band data, by directly approximating the inverse map, thus avoiding the expensive optimization loop of classical methods. The architecture is motivated by the filtered back-projection formula in the full aperture regime and with homogeneous background, and it leverages the underlying equivariance of the problem and compressibility of the integral operator. This drastically reduces the number of training parameters, and therefore the computational and sample complexity of the method. In particular, we obtain an architecture whose number of parameters scale sub-linearly with respect to the dimension of the inputs, while its inference complexity scales super-linearly but with very small constants. We provide several numerical tests that show that the current approach results in better reconstruction than optimization-based techniques such as full-waveform inversion, but at a fraction of the cost while being competitive with state-of-the-art machine learning methods.


title: VO$Q$L: Towards Optimal Regret in Model-free RL with Nonlinear Function Approximation

abstract: We study time-inhomogeneous episodic reinforcement learning (RL) under general function approximation and sparse rewards. We design a new algorithm, Variance-weighted Optimistic $Q$-Learning (VO$Q$L), based on $Q$-learning and bound its regret assuming completeness and bounded Eluder dimension for the regression function class. As a special case, VO$Q$L achieves $\tilde{O}(d\sqrt{HT}+d^6H^{5})$ regret over $T$ episodes for a horizon $H$ MDP under ($d$-dimensional) linear function approximation, which is asymptotically optimal. Our algorithm incorporates weighted regression-based upper and lower bounds on the optimal value function to obtain this improved regret. The algorithm is computationally efficient given a regression oracle over the function class, making this the first computationally tractable and statistically optimal approach for linear MDPs.


title: On the Number of Maintenance Cycles in Systems with Critical and Non-Critical Components

abstract: We present a novel mathematical framework for computing the number of maintenance cycles in a system with critical and non-critical components, where "critical" (CR) means that the component's failure is fatal for the system's operation and renders any more repairs inapplicable, whereas "noncritical" (NC) means that the component can undergo corrective maintenance (replacement or minimal repair) whenever it fails, provided that the CR component is still in operation. Whenever the NC component fails, the CR component can optionally be preventively replaced. We extend traditional renewal theory (whether classical or generalized) for various maintenance scenarios for a system composed of one CR and one NC component in order to compute the average number of renewals of NC under the restriction ("bound") necessitated by CR. We also develop approximations in closed form for the proposed "bounded" renewal functions. We validate our formulas by simulations on a variety of component lifetime distributions, including actual lifetime distributions of wind turbine components.


title: 3DSC - A New Dataset of Superconductors Including Crystal Structures

abstract: Data-driven methods, in particular machine learning, can help to speed up the discovery of new materials by finding hidden patterns in existing data and using them to identify promising candidate materials. In the case of superconductors, which are a highly interesting but also a complex class of materials with many relevant applications, the use of data science tools is to date slowed down by a lack of accessible data. In this work, we present a new and publicly available superconductivity dataset ('3DSC'), featuring the critical temperature $T_\mathrm{c}$ of superconducting materials additionally to tested non-superconductors. In contrast to existing databases such as the SuperCon database which contains information on the chemical composition, the 3DSC is augmented by the approximate three-dimensional crystal structure of each material. We perform a statistical analysis and machine learning experiments to show that access to this structural information improves the prediction of the critical temperature $T_\mathrm{c}$ of materials. Furthermore, we see the 3DSC not as a finished dataset, but we provide ideas and directions for further research to improve the 3DSC in multiple ways. We are confident that this database will be useful in applying state-of-the-art machine learning methods to eventually find new superconductors.


title: Tunneling effect of fermions in silicene through potential barrier

abstract: The influence of a rectangular potential barrier on the quantum transport of fermions in silicene is explored. Specifically, analytical solutions are presented to derive transmission and reflection probabilities together with conductance. It is shown that the transmission is highly sensitive to both the barrier height and incident energy. As a result, the occurrence of Klein and resonant tunnelings is observed, with a significant dependence on the barrier width. Notably, it is found that perfect transmission extends beyond normal incidence, occurring at various oblique angles. Moreover, the transmission pattern exhibits a more fragmented structure with increasing barrier width, reminiscent of Fabry-P\'erot resonances. In contrast, the conductance displays a non-monotonic dependence on incident energy and features rapid oscillations with a rising barrier height. However, at a constant barrier height, there is a minimal disparity among conductance profiles for high incident energy values. When incident energy equals the barrier height, the conductance experiences a local minimum. For a thin barrier, a substantial reduction in conductance is observed, unlike the oscillatory behavior seen with a thicker barrier. These findings underscore the progress in silicene research and offer a fresh perspective on the relativistic applications of tunneling in this material.


title: Why Does GDP Move Before G? It's all in the Measurement

abstract: We find that the early impact of defense news shocks on GDP is mainly due to a rise in business inventories, as contractors ramp up production for new defense contracts. These contracts do not affect government spending (G) until payment-on-delivery, which occurs 2-3 quarters later. Novel data on defense procurement obligations reveals that contract awards Granger-cause VAR-identified shocks to G, but not defense news shocks. This implies that the early GDP response relative to G is largely driven by the delayed accounting of defense contracts, while VAR-identified shocks to G miss the impact on inventories, resulting in lower multiplier estimates.


title: Regression with Label Differential Privacy

abstract: We study the task of training regression models with the guarantee of label differential privacy (DP). Based on a global prior distribution on label values, which could be obtained privately, we derive a label DP randomization mechanism that is optimal under a given regression loss function. We prove that the optimal mechanism takes the form of a "randomized response on bins", and propose an efficient algorithm for finding the optimal bin values. We carry out a thorough experimental evaluation on several datasets demonstrating the efficacy of our algorithm.


title: Evidence for Four-Top Quark Production at the LHC

abstract: The standard model production of four top quarks is predicted to have a cross section of the order of 12fb. The CMS Collaboration presents new results on this rare production mechanism for Run 2 data collected in 2016 through 2018 at 13 TeV, considering event signatures containing zero to four electrons or muons. This is the first time the all-hadronic channel is investigated in the study of four top quarks, made possible through novel machine learning based data-driven background estimation techniques.


title: Statistical properties of Galactic synchrotron temperature and polarization maps -- a multi-frequency comparison

abstract: Understanding the statistical properties of synchrotron emission from our Galaxy is valuable from the perspective of observations targeting signals of cosmological origin, as well as for understanding physical processes in our Galaxy. In this work, we extend the analysis of arXiv:2104.00419v2 to -- (a) all-sky observed maps of total foreground emissions at different frequencies provided by WMAP, Planck and Stockert-Villa, (b) component separated synchrotron temperature maps provided by WMAP, Planck and BeyondPlanck, and (c) component separated polarization maps provided by WMAP and Planck. The tools we use are Minkowski functionals and tensors. Our main goals are twofold. First, we determine the variation of morphological properties of the total foreground maps with observing frequency and compare with simulations. This elucidates how the morphology varies due to the relative dominance of different foreground components at different frequencies. Next, we analyze the nature of non-Gaussianity and statistical isotropy of synchrotron fluctuations on smaller scales using various component separated synchrotron temperature and polarization maps. We find that all maps exhibit kurtosis non-Gaussianity, in agreement with the Haslam map. This result can be an important input for the modelling of small-scale synchrotron fluctuations for component separation pipelines. This also suggests that residual synchrotron contamination in CMB will manifest as kurtosis. Studying different component separated maps, we find that BeyondPlanck and WMAP MCMC-e agree well with Haslam at all scales. The other maps show differences of varying statistical significance. Our analysis suggests a combination of residual AME and/or free-free emissions and point sources as contributing to these differences, and underscores the need for further improvement of the pipelines.


title: Bayesian modelling of the temporal evolution of seismicity using the ETAS.inlabru R-package

abstract: The Epidemic Type Aftershock Sequence (ETAS) model is widely used to model seismic sequences and underpins Operational Earthquake Forecasting (OEF). However, it remains challenging to assess the reliability of inverted ETAS parameters for a range of reasons. The most common algorithms just return point estimates with little quantification of uncertainty, and Bayesian Markov Chain Monte Carlo implementations remain slow to run, do not scale well and few have been extended to include spatial structure. Here we present a new approach to ETAS modelling using an alternative Bayesian method, the Integrated Nested Laplace Approximation (INLA). We have implemented this model in a new R-Package called ETAS.inlabru, which builds on the R packages R-INLA and inlabru . Whilst we just present the temporal component here, the model scales to a spatio-temporal model and may include a variety of spatial covariates. Using a series of synthetic case studies, we explore the robustness of our ETAS inversion method. We demonstrate that reliable estimates of the model parameters require that the catalogue data contains periods of relative quiescence as well as triggered sequences. We explore the robustness under stochastic uncertainty in the training data and show that the method is robust to a wide range of starting conditions. We show how the inclusion of historic earthquakes prior to the modelled domain affects the quality of the inversion. Finally, we show that rate dependent incompleteness after large earthquakes has a significant and detrimental effect on the ETAS posteriors. We believe that the speed of the inlabru inversion, which include a rigorous estimation of uncertainty, will enable a deeper exploration of how to use ETAS robustly for seismicity modelling and operational earthquake forecasting.


title: Non-smooth dynamics of buckling based metainterfaces: rocking-like motion and bifurcations

abstract: The non-smooth dynamics is investigated for an elastic planar metainterface composed by two layers of buckling elements, each one allowing motion on one side only. Through the analogy between buckling and unilateral contact and by assuming no-bouncing at impact, the motion of the relevant two degrees of freedom system is reduced to that of a single degree governed by a piecewise-smooth differential equation. The metainterface dynamics has strong similarities with the rocking motion of rigid blocks and displays several types of dynamic bifurcations in the presence of oscillatory forces, including period doubling, branch point cycle, grazing, as well as quasi-periodic and chaotic responses. Moreover, the multistable response is found to be broaden to conditions representative of monostable states within a quasi-static setting, disclosing a multistability anticipation by dynamics. The wide landscape of the dynamic response for the buckling based metainterface provides a novel theoretical framework to be exploited in the design of mechanical devices for vibration attenuation and for energy harvesting.


title: Robust Perception through Equivariance

abstract: Deep networks for computer vision are not reliable when they encounter adversarial examples. In this paper, we introduce a framework that uses the dense intrinsic constraints in natural images to robustify inference. By introducing constraints at inference time, we can shift the burden of robustness from training to the inference algorithm, thereby allowing the model to adjust dynamically to each individual image's unique and potentially novel characteristics at inference time. Among different constraints, we find that equivariance-based constraints are most effective, because they allow dense constraints in the feature space without overly constraining the representation at a fine-grained level. Our theoretical results validate the importance of having such dense constraints at inference time. Our empirical experiments show that restoring feature equivariance at inference time defends against worst-case adversarial perturbations. The method obtains improved adversarial robustness on four datasets (ImageNet, Cityscapes, PASCAL VOC, and MS-COCO) on image recognition, semantic segmentation, and instance segmentation tasks. Project page is available at equi4robust.cs.columbia.edu.


title: Logs with zeros? Some problems and solutions

abstract: When studying an outcome $Y$ that is weakly-positive but can equal zero (e.g. earnings), researchers frequently estimate an average treatment effect (ATE) for a "log-like" transformation that behaves like $\log(Y)$ for large $Y$ but is defined at zero (e.g. $\log(1+Y)$, $\mathrm{arcsinh}(Y)$). We argue that ATEs for log-like transformations should not be interpreted as approximating percentage effects, since unlike a percentage, they depend on the units of the outcome. In fact, we show that if the treatment affects the extensive margin, one can obtain a treatment effect of any magnitude simply by re-scaling the units of $Y$ before taking the log-like transformation. This arbitrary unit-dependence arises because an individual-level percentage effect is not well-defined for individuals whose outcome changes from zero to non-zero when receiving treatment, and the units of the outcome implicitly determine how much weight the ATE for a log-like transformation places on the extensive margin. We further establish a trilemma: when the outcome can equal zero, there is no treatment effect parameter that is an average of individual-level treatment effects, unit-invariant, and point-identified. We discuss several alternative approaches that may be sensible in settings with an intensive and extensive margin, including (i) expressing the ATE in levels as a percentage (e.g. using Poisson regression), (ii) explicitly calibrating the value placed on the intensive and extensive margins, and (iii) estimating separate effects for the two margins (e.g. using Lee bounds). We illustrate these approaches in three empirical applications.


title: Fast Learning of Multidimensional Hawkes Processes via Frank-Wolfe

abstract: Hawkes processes have recently risen to the forefront of tools when it comes to modeling and generating sequential events data. Multidimensional Hawkes processes model both the self and cross-excitation between different types of events and have been applied successfully in various domain such as finance, epidemiology and personalized recommendations, among others. In this work we present an adaptation of the Frank-Wolfe algorithm for learning multidimensional Hawkes processes. Experimental results show that our approach has better or on par accuracy in terms of parameter estimation than other first order methods, while enjoying a significantly faster runtime.


title: Modified propagation of gravitational waves from the early radiation era

abstract: We study the propagation of cosmological gravitational wave (GW) backgrounds from the early radiation era until the present day in modified theories of gravity. Comparing to general relativity (GR), we study the effects that modified gravity parameters, such as the GW friction $\alpha_{\rm M}$ and the tensor speed excess $\alpha_{\rm T}$, have on the present-day GW spectrum. We use both the WKB estimate, which provides an analytical description but fails at superhorizon scales, and numerical simulations that allow us to go beyond the WKB approximation. We show that a constant $\alpha_{\rm T}$ makes relatively insignificant changes to the GR solution, especially taking into account the constraints on its value from GW observations by the LIGO--Virgo collaboration, while $\alpha_{\rm M}$ can introduce modifications to the spectral slopes of the GW energy spectrum in the low-frequency regime depending on the considered time evolution of $\alpha_{\rm M}$. The latter effect is additional to the damping or growth occurring equally at all scales that can be predicted by the WKB approximation. In light of the recent observations by pulsar timing array (PTA) collaborations, and the potential observations by future detectors such as SKA, LISA, DECIGO, BBO, or ET, we show that, in most of the cases, constraints cannot be placed on the effects of $\alpha_{\rm M}$ and the initial GW energy density $\mathcal{E}_{\rm GW}^*$ separately, but only on the combined effects of the two, unless the signal is observed at different frequency ranges. In particular, we provide some constraints on the combined effects from the reported PTA observations.


title: Entanglement Negativity on Random Spin Networks

abstract: We investigate multipartite entanglement for quantum states of 3d space geometry, described via generalised random spin networks with fixed areas, in the context of background independent approaches to quantum gravity. We focus on entanglement negativity as a well defined witness of quantum correlations for mixed states, in our setting describing generic subregions of the boundary of a quantum 3d region of space. In particular, we consider a generic tripartition of the boundary of an open spin network state and we compute the typical R\'enyi negativity of two boundary subregions A and B immersed in the environment C, explicitly for a set of simple open random spin network states. We use the random character of the spin network to exploit replica and random average techniques to derive the typical R\'enyi negativty via a classical generalised Ising model correspondence, generally used for random tensor networks in the large bond regime. For trivially correlated random spin network states, with only local entanglement between spins located on the network edges, we find that typical log negativity displays a holographic character, in agreement with the results for random tensor networks, in large spin limit. When non-local bulk entanglement between intertwiners at the vertices is considered the negativity increases, while at the same time the holographic scaling is generally perturbed by the bulk contribution.


title: Hardware-efficient learning of quantum many-body states

abstract: Efficient characterization of highly entangled multi-particle systems is an outstanding challenge in quantum science. Recent developments have shown that a modest number of randomized measurements suffices to learn many properties of a quantum many-body system. However, implementing such measurements requires complete control over individual particles, which is unavailable in many experimental platforms. In this work, we present rigorous and efficient algorithms for learning quantum many-body states in systems with any degree of control over individual particles, including when every particle is subject to the same global field and no additional ancilla particles are available. We numerically demonstrate the effectiveness of our algorithms for estimating energy densities in a U(1) lattice gauge theory and classifying topological order using very limited measurement capabilities.


title: Slow inter-minima relaxation and its consequence for BEC of magnons

abstract: Two recent articles of the Munster University experimental team led by S.O. Demokritov displayed several important facts related to the Bose-Einstein condensation of magnons (BECM) under permanent pumping first discovered in 2006. They contradicted existing theories of this phenomenon, which predict the attractive interaction between magnons and strong spontaneous violation of the reflection symmetry. In this article, we show that these theories implicitly assumed all relaxation processes to be fast compared with the lifetime of the magnons, whereas one of them -- relaxation between two minima of energy -- is slow. We classify processes responsible for the inter-minima relaxation and present their analytic theory. We analyze how the slow inter-minima relaxation modifies the anticipated properties of a ferromagnet with the magnon condensate.


title: On de Sitter Spacetime and String Theory

abstract: We review various aspects of de Sitter spacetime in string theory: its status as an effective field theory spacetime solution, its relation to the vacuum energy problem in string theory, its (global) holographic definition in terms of two entangled and non-canonical conformal field theories, as well as a realization of a realistic de Sitter universe endowed with the observed visible matter and the necessary dark sector in order to reproduce the realistic cosmological structure. In particular, based on the new insight regarding the cosmological constant problem in string theory, we argue that in a doubled, T-duality-symmetric, phase-space-like and non-commutative generalized-geometric formulation, string theory can naturally lead to a small and positive cosmological constant that is radiatively stable and technically natural. Such a formulation is fundamentally based on a quantum spacetime, but in an effective spacetime description of this general formulation of string theory, the curvature of the dual spacetime is the cosmological constant of the observed spacetime, while the size of the dual spacetime is the gravitational constant of the same observed spacetime. Also, the three scales associated with intrinsic non-commutativity of string theory, the cosmological constant scale and the Planck scale, as well as the Higgs scale, can be arranged to satisfy various seesaw-like formulae. Along the way, we show that these new features of string theory can be implemented in a particular deformation of cosmic-string-like models.


title: Fast, broad-band magnetic resonance spectroscopy with diamond widefield relaxometry

abstract: We present an alternative to conventional Electron Paramagnetic Resonance (EPR) spectroscopy equipment. Avoiding the use of bulky magnets and magnetron equipment, we use the photoluminescence of an ensemble of Nitrogen-Vacancy centers at the surface of a diamond. Monitoring their relaxation time (or T1), we detected their cross-relaxation with a compound of interest. In addition, the EPR spectra are encoded through a localized magnetic field gradient. While recording previous data took 12 minutes per data point with individual NV centers, we were able to reconstruct a full spectrum at once in $3\; \textrm{seconds}$, over a range from $3$ to $11\; \textrm{Gauss}$. In terms of sensitivity, only $0.5\; {\mu}\textrm{L}$ of a $1\; {\mu}\textrm{M}$ hexaaquacopper (II) ion solution was necessary.


title: MIRA: Mental Imagery for Robotic Affordances

abstract: Humans form mental images of 3D scenes to support counterfactual imagination, planning, and motor control. Our abilities to predict the appearance and affordance of the scene from previously unobserved viewpoints aid us in performing manipulation tasks (e.g., 6-DoF kitting) with a level of ease that is currently out of reach for existing robot learning frameworks. In this work, we aim to build artificial systems that can analogously plan actions on top of imagined images. To this end, we introduce Mental Imagery for Robotic Affordances (MIRA), an action reasoning framework that optimizes actions with novel-view synthesis and affordance prediction in the loop. Given a set of 2D RGB images, MIRA builds a consistent 3D scene representation, through which we synthesize novel orthographic views amenable to pixel-wise affordances prediction for action optimization. We illustrate how this optimization process enables us to generalize to unseen out-of-plane rotations for 6-DoF robotic manipulation tasks given a limited number of demonstrations, paving the way toward machines that autonomously learn to understand the world around them for planning actions.


title: Hand-breathe: Non-Contact Monitoring of Breathing Abnormalities from Hand Palm

abstract: In post-covid19 world, radio frequency (RF)-based non-contact methods, e.g., software-defined radios (SDR)-based methods have emerged as promising candidates for intelligent remote sensing of human vitals, and could help in containment of contagious viruses like covid19. To this end, this work utilizes the universal software radio peripherals (USRP)-based SDRs along with classical machine learning (ML) methods to design a non-contact method to monitor different breathing abnormalities. Under our proposed method, a subject rests his/her hand on a table in between the transmit and receive antennas, while an orthogonal frequency division multiplexing (OFDM) signal passes through the hand. Subsequently, the receiver extracts the channel frequency response (basically, fine-grained wireless channel state information), and feeds it to various ML algorithms which eventually classify between different breathing abnormalities. Among all classifiers, linear SVM classifier resulted in a maximum accuracy of 88.1\%. To train the ML classifiers in a supervised manner, data was collected by doing real-time experiments on 4 subjects in a lab environment. For label generation purpose, the breathing of the subjects was classified into three classes: normal, fast, and slow breathing. Furthermore, in addition to our proposed method (where only a hand is exposed to RF signals), we also implemented and tested the state-of-the-art method (where full chest is exposed to RF radiation). The performance comparison of the two methods reveals a trade-off, i.e., the accuracy of our proposed method is slightly inferior but our method results in minimal body exposure to RF radiation, compared to the benchmark method.


title: Monotonicity of the logarithmic energy for random matrices

abstract: It is well-known that the semi-circle law, which is the limiting distribution in the Wigner theorem, is the minimizer of the logarithmic energy penalized by the second moment. A very similar fact holds for the Girko and Marchenko--Pastur theorems. In this work, we shed the light on an intriguing phenomenon suggesting that this functional is monotonic along the mean empirical spectral distribution in terms of the matrix dimension. This is reminiscent of the monotonicity of the Boltzmann entropy along the Boltzmann equation, the monotonicity of the free energy along ergodic Markov processes, and the Shannon monotonicity of entropy or free entropy along the classical or free central limit theorem. While we only verify this monotonicity phenomenon for the Gaussian unitary ensemble, the complex Ginibre ensemble, and the square Laguerre unitary ensemble, numerical simulations suggest that it is actually more universal. We obtain along the way explicit formulas of the logarithmic energy of the mentioned models which can be of independent interest.


title: Photoinduced Magnetic Transitions and Excitonic Order Enhancement in Spin Crossover Strongly Correlated Electron Systems

abstract: The effects associated with exciton Bose condensate formation in strongly correlated spin crossover systems are considered within the effective Hamiltonian obtained from the two-orbital Hubbard-Kanamori model. The collective excitations spectrum at various points of the temperature-crystal field phase diagram is calculated. The role of the electron-phonon interaction is discussed. The exciton and magnetic order photoenhancement (induction) in strongly correlated spin crossover systems a new mechanism based on the cooperative effect of electron-phonon and interatomic exchange interactions and the appearance of a massive collective phase mode is demonstrated.


title: A gradient flow for the Porous Medium Equations with Dirichlet boundary conditions

abstract: We consider the gradient flow structure of the porous medium equations with nonnegative constant boundary conditions. We prove that weak solutions to the equations can be obtained by the variational steepest descent scheme by considering an entropy functional with respect to Wb2 distance, which is a modified Wasserstein distance introduced by Figalli and Gigli [J. Math. Pures Appl. 94, (2010), pp. 107-130]. In addition, we establish an energy dissipation inequality.


title: A domain decomposition scheme for couplings between local and nonlocal equations

abstract: We study a natural alternating method of Schwarz type (domain decomposition) for certain class of couplings between local and nonlocal operators. We show that our method fits into Lion's framework and prove, as a consequence, convergence in both, the continuous and the discrete settings.


title: Prompting Is Programming: A Query Language for Large Language Models

abstract: Large language models have demonstrated outstanding performance on a wide range of tasks such as question answering and code generation. On a high level, given an input, a language model can be used to automatically complete the sequence in a statistically-likely way. Based on this, users prompt these models with language instructions or examples, to implement a variety of downstream tasks. Advanced prompting methods can even imply interaction between the language model, a user, and external tools such as calculators. However, to obtain state-of-the-art performance or adapt language models for specific tasks, complex task- and model-specific programs have to be implemented, which may still require ad-hoc interaction. Based on this, we present the novel idea of Language Model Programming (LMP). LMP generalizes language model prompting from pure text prompts to an intuitive combination of text prompting and scripting. Additionally, LMP allows constraints to be specified over the language model output. This enables easy adaption to many tasks while abstracting language model internals and providing high-level semantics. To enable LMP, we implement LMQL(short for Language Model Query Language), which leverages the constraints and control flow from an LMP prompt to generate an efficient inference procedure that minimizes the number of expensive calls to the underlying language model. We show that LMQL can capture a wide range of state-of-the-art prompting methods in an intuitive way, especially facilitating interactive flows that are challenging to implement with existing high-level APIs. Our evaluation shows that we retain or increase the accuracy on several downstream tasks, while also significantly reducing the required amount of computation or cost in the case of pay-to-use APIs (26-85% cost savings).