title: FastChem 2: An improved computer program to determine the gas-phase chemical equilibrium composition for arbitrary element distributions

abstract: The computation of complex neutral/ionised chemical equilibrium compositions is invaluable to obtain scientific insights of, for example, the atmospheres of extrasolar planets and cool stars. We present FastChem 2, a new version of the established semi-analytical thermochemical equilibrium code FastChem. Whereas the original version is limited to atmospheres containing a significant amount of hydrogen, FastChem 2 is also applicable to chemical mixtures dominated by any other species, such as CO$_2$ or N$_2$. The new C++ code and an optional Python module are publicly available under the GPLv3 license at https://github.com/exoclime/FastChem. The program is backward compatible so that the previous version can be easily substituted. We updated the thermochemical database by adding HNC, FeH, TiH, Ca$^-$, and some organic molecules. In total 523 species are now in the thermochemical database including 28 chemical elements. The user can reduce the total number of species to, for example, increase the computation performance or can add further species if the thermochemical data are available. The program is validated against its previous version and extensively tested over an extended pressure-temperature grid with pressures ranging from $10^{-13}\,\mathrm{bar}$ up to $10^3\,\mathrm{bar}$ and temperatures between $100\,\mathrm{K}$ and $6000\,\mathrm{K}$. FastChem 2 is successfully applied to a number of different scenarios including nitrogen, carbon, and oxygen-dominated atmospheres as well as test cases without hydrogen and helium. Averaged over the extended pressure-temperature grid FastChem 2 is up to 50 times faster than the previous version and is also applicable to situations not treatable with version 1.


title: Twin-width and types

abstract: We study problems connected to first-order logic in graphs of bounded twin-width. Inspired by the approach of Bonnet et al. [FOCS 2020], we introduce a robust methodology of local types and describe their behavior in contraction sequences -- the decomposition notion underlying twin-width. We showcase the applicability of the methodology by proving the following two algorithmic results. In both statements, we fix a first-order formula $\varphi(x_1,\ldots,x_k)$ and a constant $d$, and we assume that on input we are given a graph $G$ together with a contraction sequence of width at most $d$. (A) One can in time $O(n)$ construct a data structure that can answer the following queries in time $O(\log \log n)$: given $w_1,\ldots,w_k$, decide whether $\phi(w_1,\ldots,w_k)$ holds in $G$. (B) After $O(n)$-time preprocessing, one can enumerate all tuples $w_1,\ldots,w_k$ that satisfy $\phi(x_1,\ldots,x_k)$ in $G$ with $O(1)$ delay. In the case of (A), the query time can be reduced to $O(1/\varepsilon)$ at the expense of increasing the construction time to $O(n^{1+\varepsilon})$, for any fixed $\varepsilon>0$. Finally, we also apply our tools to prove the following statement, which shows optimal bounds on the VC density of set systems that are first-order definable in graphs of bounded twin-width. (C) Let $G$ be a graph of twin-width $d$, $A$ be a subset of vertices of $G$, and $\varphi(x_1,\ldots,x_k,y_1,\ldots,y_l)$ be a first-order formula. Then the number of different subsets of $A^k$ definable by $\phi$ using $l$-tuples of vertices from $G$ as parameters, is bounded by $O(|A|^l)$.


title: Commutativity and the emergence of classical objectivity

abstract: We examine how the ability of a system to redundantly proliferate relevant information about its pointer states is affected when it is coupled to multiple baths. To this end, we consider a system in contact with two baths: one -- termed the {\it accessible} environment -- which, on its own, induces a pure dephasing mechanism on the state of the system and satisfies the conditions for classical objectivity to be established. The second environment, which we dub as {\it inaccessible}, affects the system in two physically relevant ways. Firstly, we consider an interaction that commutes with the Hamiltonian describing the interaction between system and accessible bath. It thus also gives rise to dephasing of the system, albeit on different time scales. Secondly, we consider a thermalising interaction, which does not commute with the system-accessible environment Hamiltonian. While the former still allows the system to redundantly encode its state into the accessible environment, the latter degrades the correlations, eventually destroying them in the long-time limit, and thus leads to a loss of the conditions necessary for classical objectivity to be established. This sheds light on the role that commutativity between the various system-bath interaction terms plays when establishing the conditions for classical objectivity to be supported.


title: Bayesian estimation of the low-energy constants up to fourth order in the nucleon-nucleon sector of chiral effective field theory

abstract: We use Bayesian methods and Hamiltonian Monte Carlo (HMC) sampling to infer the posterior probability density (PDF) for the low-energy constants (LECs) up to next-to-next-to-next-to-leading order (N3LO) in a chiral effective field theory ($\chi$EFT) description of the nucleon-nucleon interaction. In a first step, we condition the inference on neutron-proton and proton-proton scattering data and account for uncorrelated $\chi$EFT truncation errors. We demonstrate how to successfully sample the 31-dimensional space of LECs at N3LO using a revised HMC inference protocol. In a second step we extend the analysis by means of importance sampling and an empirical determination of the neutron-neutron scattering length to infer the posterior PDF for the leading charge-dependent contact LEC in the $^{1}S_0$ neutron-neutron interaction channel. While doing so we account for the $\chi$EFT truncation error via a conjugate prior. We use the resulting posterior PDF to sample the posterior predictive distributions for the effective range parameters in the $^{1}S_0$ wave as well as the strengths of charge-symmetry breaking and charge-independence breaking. We conclude that empirical point-estimate results of isospin breaking in the $^{1}S_0$ channel are consistent with the PDFs obtained in our Bayesian analysis and that, when accounting for $\chi$EFT truncation errors, one must go to next-to-next-to-leading order to confidently detect isospin breaking effects.


title: Neural Network Interaction Potentials for para-Hydrogen with Flexible Molecules

abstract: The study of molecular impurities in $para$-hydrogen ($p$H$\rm_2$) clusters is key to push forward our understanding of intra- and intermolecular interactions including their impact on the superfluid response of this bosonic quantum solvent. This includes tagging with one or very few $p$H$\rm_2$, the microsolvation regime, and matrix isolation. However, the fundamental coupling between the bosonic $p$H$\rm_2$ environment and the (ro-)vibrational motion of molecular impurities remains poorly understood. Quantum simulations can in provide the necessary atomistic insight, but very accurate descriptions of the involved interactions are required. Here, we present a data-driven approach for the generation of $impurity\cdots p$H$\rm_2$ interaction potentials based on machine learning techniques which retain the full flexibility of the impurity. We employ the well-established adiabatic hindered rotor (AHR) averaging technique to include the impact of the nuclear spin statistics on the symmetry-allowed rotational quantum numbers of $p$H$\rm_2$. Embedding this averaging procedure within the high-dimensional neural network potential (NNP) framework enables the generation of highly-accurate AHR-averaged NNPs at coupled cluster accuracy, namely CCSD(T$^*$)-F12a/aVTZcp in an automated manner. We apply this methodology to the water and protonated water molecules, as representative cases for quasi-rigid and highly-flexible molecules respectively, and obtain AHR-averaged NNPs that reliably describe the H$\rm _2$O$\cdots p$H$\rm_2$ and H$\rm _3$O$^+\cdots p$H$\rm_2$ interactions. Using path integral simulations we show for the hydronium cation that umbrella-like tunneling inversion has a strong impact on the first and second $p$H$\rm_2$ microsolvation shells. The data-driven nature of our protocol opens the door to the study of bosonic $p$H$\rm_2$ quantum solvation for a wide range of embedded impurities.


title: On the Surprising Behaviour of node2vec

abstract: Graph embedding techniques are a staple of modern graph learning research. When using embeddings for downstream tasks such as classification, information about their stability and robustness, i.e., their susceptibility to sources of noise, stochastic effects, or specific parameter choices, becomes increasingly important. As one of the most prominent graph embedding schemes, we focus on node2vec and analyse its embedding quality from multiple perspectives. Our findings indicate that embedding quality is unstable with respect to parameter choices, and we propose strategies to remedy this in practice.


title: Weak $\Xi_{QQ} \to \Sigma_Q \ell^+ \ell^-$ decays induced by FCNC in QCD

abstract: With the discovery of the doubly heavy $\Xi_{cc}$ baryon, comprehensive studies of the properties of the doubly heavy baryons are started. In the present work, we examine the $\Xi_{bb} \to \Sigma_b \ell^+ \ell^-$ and $\Xi_{cc} \to \Sigma_c \ell^+ \ell^-$ decays induced by flavor-changing neutral currents (FCNC) in the framework of the light-cone sum rules. After obtaining the sum rules for the form factors induced by the tensor current, the branching ratios of the relevant transitions are estimated. We found that the branching ratio for the $c \to u$ transition is around five orders smaller than the $b \to d$ transition. Our findings are also compared with other approaches.


title: Conservation laws for potential vorticity in a salty ocean or cloudy atmosphere

abstract: One of the most important conservation laws in atmospheric and oceanic science is conservation of potential vorticity. The original derivation is approximately a century old, in the work of Rossby and Ertel, and it is related to the celebrated circulation theorems of Kelvin and Bjerknes. However, the laws apply to idealized fluids, and extensions to more realistic scenarios have been problematic. Here, these laws are extended to hold with additional fundamental complexities, including salinity in the ocean, or moisture and clouds in the atmosphere. In the absence of these additional complexities, it is known that potential vorticity is conserved following each fluid parcel; here, for a salty ocean or cloudy atmosphere, the general conserved quantity is potential vorticity integrated over certain pancake-shaped volumes. Furthermore, the conservation laws are also related to a symmetry in the Lagrangian, which brings a connection to the symmetry-conservation relationships seen in other areas of physics.


title: Gradient-Based Adversarial and Out-of-Distribution Detection

abstract: We propose to utilize gradients for detecting adversarial and out-of-distribution samples. We introduce confounding labels -- labels that differ from normal labels seen during training -- in gradient generation to probe the effective expressivity of neural networks. Gradients depict the amount of change required for a model to properly represent given inputs, providing insight into the representational power of the model established by network architectural properties as well as training data. By introducing a label of different design, we remove the dependency on ground truth labels for gradient generation during inference. We show that our gradient-based approach allows for capturing the anomaly in inputs based on the effective expressivity of the models with no hyperparameter tuning or additional processing, and outperforms state-of-the-art methods for adversarial and out-of-distribution detection.


title: Growing borophene on metal substrates: a theoretical study of the role of oxygen on Al(111)

abstract: Charge transfer from a metal substrate stabilizes honeycomb borophene, whose electron deficit would otherwise spoil the hexagonal order of a $\pi$-bonded 2D atomic network. However, the coupling between the substrate and the boron overlayer may result in the formation of strong chemical bonds that would compromise the electronic properties of the overlayer. In this paper we present a theoretical study, based on state-of-the-art density-functional and genetic-optimization techniques, of the electronic and structural properties of borophene grown on Al(111), with emphasis on the impact of oxygen on the strength of the coupling between substrate and overlayer. While our results confirm the formation of Al-B bonds, they also predict that oxygen doping reduces charge transfer between aluminum and borophene, thus allowing modulation of their strength and paving the way to engineering the electronic properties of 2D-supported borophene sheets for industrial applications. Our study is completed by a thorough study of the thermodynamic stability of the oxygenated borophene-Al(111) interface.


title: Gradient Descent for Low-Rank Functions

abstract: Several recent empirical studies demonstrate that important machine learning tasks, e.g., training deep neural networks, exhibit low-rank structure, where the loss function varies significantly in only a few directions of the input space. In this paper, we leverage such low-rank structure to reduce the high computational cost of canonical gradient-based methods such as gradient descent (GD). Our proposed \emph{Low-Rank Gradient Descent} (LRGD) algorithm finds an $\epsilon$-approximate stationary point of a $p$-dimensional function by first identifying $r \leq p$ significant directions, and then estimating the true $p$-dimensional gradient at every iteration by computing directional derivatives only along those $r$ directions. We establish that the "directional oracle complexities" of LRGD for strongly convex and non-convex objective functions are $\mathcal{O}(r \log(1/\epsilon) + rp)$ and $\mathcal{O}(r/\epsilon^2 + rp)$, respectively. When $r \ll p$, these complexities are smaller than the known complexities of $\mathcal{O}(p \log(1/\epsilon))$ and $\mathcal{O}(p/\epsilon^2)$ of {\gd} in the strongly convex and non-convex settings, respectively. Thus, LRGD significantly reduces the computational cost of gradient-based methods for sufficiently low-rank functions. In the course of our analysis, we also formally define and characterize the classes of exact and approximately low-rank functions.


title: ProGNNosis: A Data-driven Model to Predict GNN Computation Time Using Graph Metrics

abstract: Graph Neural Networks (GNN) show great promise in problems dealing with graph-structured data. One of the unique points of GNNs is their flexibility to adapt to multiple problems, which not only leads to wide applicability, but also poses important challenges when finding the best model or acceleration technique for a particular problem. An example of such challenges resides in the fact that the accuracy or effectiveness of a GNN model or acceleration technique generally depends on the structure of the underlying graph. In this paper, in an attempt to address the problem of graph-dependent acceleration, we propose ProGNNosis, a data-driven model that can predict the GNN training time of a given GNN model running over a graph of arbitrary characteristics by inspecting the input graph metrics. Such prediction is made based on a regression that was previously trained offline using a diverse synthetic graph dataset. In practice, our method allows making informed decisions on which design to use for a specific problem. In the paper, the methodology to build ProGNNosis is defined and applied for a specific use case, where it helps to decide which graph representation is better. Our results show that ProGNNosis helps achieve an average speedup of 1.22X over randomly selecting a graph representation in multiple widely used GNN models such as GCN, GIN, GAT, or GraphSAGE.


title: CLEF. A Linked Open Data native system for Crowdsourcing

abstract: Collaborative data collection initiatives are increasingly becoming pivotal to cultural institutions and scholars, to boost the population of born-digital archives. For over a decade, organisations have been leveraging Semantic Web technologies to design their workflows, ensure data quality, and a means for sharing and reusing (Linked Data). Crucially, scholarly projects that leverage cultural heritage data to collaboratively develop new resources would benefit from agile solutions to simplify the Linked Data production workflow via user-friendly interfaces. To date, only a few pioneers have abandoned legacy cataloguing and archiving systems to fully embrace the Linked Open Data (LOD) paradigm and manage their catalogues or research products through LOD-native management systems. In this article we present Crowdsourcing Linked Entities via web Form (CLEF), an agile LOD-native platform for collaborative data collection, peer-review, and publication. We detail design choices as motivated by two case studies, from the Cultural Heritage and scholarly domains respectively, and we discuss benefits of our solution in the light of prior works. In particular, the strong focus on user-friendly interfaces for producing FAIR data, the provenance-aware editorial process, and the integration with consolidated data management workflows, distinguish CLEF as a novel attempt to develop Linked Data platforms for cultural heritage.


title: From Bi-Level to One-Level: A Framework for Structural Attacks to Graph Anomaly Detection

abstract: The success of graph neural networks stimulates the prosperity of graph mining and the corresponding downstream tasks including graph anomaly detection (GAD). However, it has been explored that those graph mining methods are vulnerable to structural manipulations on relational data. That is, the attacker can maliciously perturb the graph structures to assist the target nodes to evade anomaly detection. In this paper, we explore the structural vulnerability of two typical GAD systems: unsupervised FeXtra-based GAD and supervised GCN-based GAD. Specifically, structural poisoning attacks against GAD are formulated as complex bi-level optimization problems. Our first major contribution is then to transform the bi-level problem into one-level leveraging different regression methods. Furthermore, we propose a new way of utilizing gradient information to optimize the one-level optimization problem in the discrete domain. Comprehensive experiments demonstrate the effectiveness of our proposed attack algorithm BinarizedAttack.


title: To Help or Disturb: Introduction of Crowdsourced WiFi to 5G Networks

abstract: After upgrading to 5G, a network operator still faces congestion when providing the ubiquitous wireless service to the crowd. To meet users' ever-increasing demand, some other operators (e.g., Fon) have been developing another crowdsourced WiFi network to combine many users' home WiFi access points and provide enlarged WiFi coverage to them. While the 5G network experiences negative network externality, the crowdsourced WiFi network helps offload traffic from 5G and its service coverage exhibits positive externality with its subscription number. To our best knowledge, we are the first to investigate how these two heterogeneous networks of diverse network externalities co-exist from an economic perspective. We propose a dynamic game theoretic model to analyze the hybrid interaction among the 5G operator, the crowdsourced WiFi operator, and users. Our user choice model with WiFi's complementarity for 5G allows users to choose both services, departing from the traditional economics literature where a user chooses one over another alternative. Despite of non-convexity of the operators' pricing problems, we prove that the 5G operator facing severe congestion may purposely lower his price to encourage users to add-on WiFi to offload, and he benefits from the introduction of crowdsourced WiFi. However, 5G operator with mild congestion tends to charge users more and all the users' payoffs may decrease.


title: Attention-wise masked graph contrastive learning for predicting molecular property

abstract: Accurate and efficient prediction of the molecular properties of drugs is one of the fundamental problems in drug research and development. Recent advancements in representation learning have been shown to greatly improve the performance of molecular property prediction. However, due to limited labeled data, supervised learning-based molecular representation algorithms can only search limited chemical space, which results in poor generalizability. In this work, we proposed a self-supervised representation learning framework for large-scale unlabeled molecules. We developed a novel molecular graph augmentation strategy, referred to as attention-wise graph mask, to generate challenging positive sample for contrastive learning. We adopted the graph attention network (GAT) as the molecular graph encoder, and leveraged the learned attention scores as masking guidance to generate molecular augmentation graphs. By minimization of the contrastive loss between original graph and masked graph, our model can capture important molecular structure and higher-order semantic information. Extensive experiments showed that our attention-wise graph mask contrastive learning exhibit state-of-the-art performance in a couple of downstream molecular property prediction tasks.


title: 'John ate 5 apples' != 'John ate some apples': Self-Supervised Paraphrase Quality Detection for Algebraic Word Problems

abstract: This paper introduces the novel task of scoring paraphrases for Algebraic Word Problems (AWP) and presents a self-supervised method for doing so. In the current online pedagogical setting, paraphrasing these problems is helpful for academicians to generate multiple syntactically diverse questions for assessments. It also helps induce variation to ensure that the student has understood the problem instead of just memorizing it or using unfair means to solve it. The current state-of-the-art paraphrase generation models often cannot effectively paraphrase word problems, losing a critical piece of information (such as numbers or units) which renders the question unsolvable. There is a need for paraphrase scoring methods in the context of AWP to enable the training of good paraphrasers. Thus, we propose ParaQD, a self-supervised paraphrase quality detection method using novel data augmentations that can learn latent representations to separate a high-quality paraphrase of an algebraic question from a poor one by a wide margin. Through extensive experimentation, we demonstrate that our method outperforms existing state-of-the-art self-supervised methods by up to 32% while also demonstrating impressive zero-shot performance.


title: Towards the Generation of Musical Explanations with GPT-3

abstract: Open AI's language model, GPT-3, has shown great potential for many NLP tasks, with applications in many different domains. In this work we carry out a first study on GPT-3's capability to communicate musical decisions through textual explanations when prompted with a textual representation of a piece of music. Enabling a dialogue in human-AI music partnerships is an important step towards more engaging and creative human-AI interactions. Our results show that GPT-3 lacks the necessary intelligence to really understand musical decisions. A major barrier to reach a better performance is the lack of data that includes explanations of the creative process carried out by artists for musical pieces. We believe such a resource would aid the understanding and collaboration with AI music systems.


title: Maximum Likelihood Training for Score-Based Diffusion ODEs by High-Order Denoising Score Matching

abstract: Score-based generative models have excellent performance in terms of generation quality and likelihood. They model the data distribution by matching a parameterized score network with first-order data score functions. The score network can be used to define an ODE ("score-based diffusion ODE") for exact likelihood evaluation. However, the relationship between the likelihood of the ODE and the score matching objective is unclear. In this work, we prove that matching the first-order score is not sufficient to maximize the likelihood of the ODE, by showing a gap between the maximum likelihood and score matching objectives. To fill up this gap, we show that the negative likelihood of the ODE can be bounded by controlling the first, second, and third-order score matching errors; and we further present a novel high-order denoising score matching method to enable maximum likelihood training of score-based diffusion ODEs. Our algorithm guarantees that the higher-order matching error is bounded by the training error and the lower-order errors. We empirically observe that by high-order score matching, score-based diffusion ODEs achieve better likelihood on both synthetic data and CIFAR-10, while retaining the high generation quality.


title: ANGLEr: A Next-Generation Natural Language Exploratory Framework

abstract: Natural language processing is used for solving a wide variety of problems. Some scholars and interest groups working with language resources are not well versed in programming, so there is a need for a good graphical framework that allows users to quickly design and test natural language processing pipelines without the need for programming. The existing frameworks do not satisfy all the requirements for such a tool. We, therefore, propose a new framework that provides a simple way for its users to build language processing pipelines. It also allows a simple programming language agnostic way for adding new modules, which will help the adoption by natural language processing developers and researchers. The main parts of the proposed framework consist of (a) a pluggable Docker-based architecture, (b) a general data model, and (c) APIs description along with the graphical user interface. The proposed design is being used for implementation of a new natural language processing framework, called ANGLEr.


title: Ratatouille: A tool for Novel Recipe Generation

abstract: Due to availability of a large amount of cooking recipes online, there is a growing interest in using this as data to create novel recipes. Novel Recipe Generation is a problem in the field of Natural Language Processing in which our main interest is to generate realistic, novel cooking recipes. To come up with such novel recipes, we trained various Deep Learning models such as LSTMs and GPT-2 with a large amount of recipe data. We present Ratatouille (https://cosylab.iiitd.edu.in/ratatouille2/), a web based application to generate novel recipes.


title: End-pulled polymer translocation through a many-body flexible pore

abstract: This paper studies the features of a homopolymer translocating through a flexible pore. The channel is modeled as a monolayer tube composed by monomers with two elastic parameters: spring-like two body interaction and bending three body recall interaction. In order to guarantee the stability of the system, the membrane is compounded by a lipid bilayer structure having hydrophobic body (internal), while the pore is hydrophilic in both edges. The polymer is end-pulled from the cis-side to the trans-side by a cantilever, to which is connected through a spring able to measure the force acting on the polymer during the translocation. All the structure reacts to the impacts of the monomers of the polymer with vibrations generated by the movement of its constituent bodies. In these conditions, the work done by the cantilever shows a nonmonotonic behavior with the elastic constant, revealing a resonant-like behavior in a parameter region. Moreover, the force spectroscopy registered as a function of time, is able to record the main kinetics of the polymer progression inside the pore.


title: Learning with little mixing

abstract: We study square loss in a realizable time-series framework with martingale difference noise. Our main result is a fast rate excess risk bound which shows that whenever a trajectory hypercontractivity condition holds, the risk of the least-squares estimator on dependent data matches the iid rate order-wise after a burn-in time. In comparison, many existing results in learning from dependent data have rates where the effective sample size is deflated by a factor of the mixing-time of the underlying process, even after the burn-in time. Furthermore, our results allow the covariate process to exhibit long range correlations which are substantially weaker than geometric ergodicity. We call this phenomenon learning with little mixing, and present several examples for when it occurs: bounded function classes for which the $L^2$ and $L^{2+\epsilon}$ norms are equivalent, ergodic finite state Markov chains, various parametric models, and a broad family of infinite dimensional $\ell^2(\mathbb{N})$ ellipsoids. By instantiating our main result to system identification of nonlinear dynamics with generalized linear model transitions, we obtain a nearly minimax optimal excess risk bound after only a polynomial burn-in time.


title: The Road to a Successful HRI: AI, Trust and ethicS-TRAITS

abstract: The aim of this workshop is to foster the exchange of insights on past and ongoing research towards effective and long-lasting collaborations between humans and robots. This workshop will provide a forum for representatives from academia and industry communities to analyse the different aspects of HRI that impact on its success. We particularly focus on AI techniques required to implement autonomous and proactive interactions, on the factors that enhance, undermine, or recover humans' acceptance and trust in robots, and on the potential ethical and legal concerns related to the deployment of such robots in human-centred environments. Website: https://sites.google.com/view/traits-hri-2022


title: A new method for clustered survival data]{A new method for clustered survival data: Estimation of treatment effect heterogeneity and variable selection

abstract: We recently developed a new method riAFT-BART to draw causal inferences about population treatment effect on patient survival from clustered and censored survival data while accounting for the multilevel data structure. The practical utility of this method goes beyond the estimation of population average treatment effect. In this work, we exposit how riAFT-BART can be used to solve two important statistical questions with clustered survival data: estimating the treatment effect heterogeneity and variable selection. Leveraging the likelihood-based machine learning, we describe a way in which we can draw posterior samples of the individual survival treatment effect from riAFT-BART model runs, and use the drawn posterior samples to perform an exploratory treatment effect heterogeneity analysis to identify subpopulations who may experience differential treatment effects than population average effects. There is sparse literature on methods for variable selection among clustered and censored survival data, particularly ones using flexible modeling techniques. We propose a permutation based approach using the predictor's variable inclusion proportion supplied by the riAFT-BART model for variable selection. To address the missing data issue frequently encountered in health databases, we propose a strategy to combine bootstrap imputation and riAFT-BART for variable selection among incomplete clustered survival data. We conduct an expansive simulation study to examine the practical operating characteristics of our proposed methods. Finally, we demonstrate the methods via a case study of predictors for in-hospital mortality among severe COVID-19 patients and estimating the heterogeneous treatment effects of three COVID-specific medications. The methods developed in this work are readily available in the $\R$ package $\textsf{riAFTBART}$.


title: Longitudinal detection of new MS lesions using Deep Learning

abstract: The detection of new multiple sclerosis (MS) lesions is an important marker of the evolution of the disease. The applicability of learning-based methods could automate this task efficiently. However, the lack of annotated longitudinal data with new-appearing lesions is a limiting factor for the training of robust and generalizing models. In this work, we describe a deep-learning-based pipeline addressing the challenging task of detecting and segmenting new MS lesions. First, we propose to use transfer-learning from a model trained on a segmentation task using single time-points. Therefore, we exploit knowledge from an easier task and for which more annotated datasets are available. Second, we propose a data synthesis strategy to generate realistic longitudinal time-points with new lesions using single time-point scans. In this way, we pretrain our detection model on large synthetic annotated datasets. Finally, we use a data-augmentation technique designed to simulate data diversity in MRI. By doing that, we increase the size of the available small annotated longitudinal datasets. Our ablation study showed that each contribution lead to an enhancement of the segmentation accuracy. Using the proposed pipeline, we obtained the best score for the segmentation and the detection of new MS lesions in the MSSEG2 MICCAI challenge.


title: Concentration of Data Encoding in Parameterized Quantum Circuits

abstract: Variational quantum algorithms have been acknowledged as a leading strategy to realize near-term quantum advantages in meaningful tasks, including machine learning and combinatorial optimization. When applied to tasks involving classical data, such algorithms generally begin with quantum circuits for data encoding and then train quantum neural networks (QNNs) to minimize target functions. Although QNNs have been widely studied to improve these algorithms' performance on practical tasks, there is a gap in systematically understanding the influence of data encoding on the eventual performance. In this paper, we make progress in filling this gap by considering the common data encoding strategies based on parameterized quantum circuits. We prove that, under reasonable assumptions, the distance between the average encoded state and the maximally mixed state could be explicitly upper-bounded with respect to the width and depth of the encoding circuit. This result in particular implies that the average encoded state will concentrate on the maximally mixed state at an exponential speed on depth. Such concentration seriously limits the capabilities of quantum classifiers, and strictly restricts the distinguishability of encoded states from a quantum information perspective. We further support our findings by numerically verifying these results on both synthetic and public data sets. Our results highlight the significance of quantum data encoding in machine learning tasks and may shed light on future encoding strategies.


title: Surface-directed and bulk spinodal decomposition compete to decide the morphology of bimetallic nanoparticles

abstract: An embedded-domain phase-field formalism is used for studying phase transformation pathways in bimetallic nanoparticles (BNPs). Competition of bulk and surface-directed spinodal decomposition processes and their interplay with capillarity are identified as the main determinants of BNP morphology. The former is characterized by an effective bulk driving force $\Delta\tilde{f}$ which increases with decreasing temperature, while the latter manifests itself through a balance of interfacial energies captured by the contact angle $\theta$. The simulated morphologies, namely, core-shell, Janus and inverse core-shell, cluster into distinct regions of the $\Delta\tilde{f}$-$\theta$ space. Variation of $\theta$ with $\Delta\tilde{f}$ in the Ag-Cu alloy system is computed as a function of temperature using a CALPHAD approach in which surface energies are estimated from a modified Butler equation. This $\theta-\Delta\tilde{f}$ trajectory for Ag-Cu, when superimposed on the morphology map, enables the prediction of different morphological transitions as a function of temperature. Therefore, the study establishes a unique thermodynamic framework coupled with phase-field simulations for predicting and tailoring nanoparticle morphology through a variation of processing temperature.


title: Rank the triplets: A ranking-based multiple instance learning framework for detecting HPV infection in head and neck cancers using routine H&E images

abstract: The aetiology of head and neck squamous cell carcinoma (HNSCC) involves multiple carcinogens such as alcohol, tobacco and infection with human papillomavirus (HPV). As the HPV infection influences the prognosis, treatment and survival of patients with HNSCC, it is important to determine the HPV status of these tumours. In this paper, we propose a novel triplet-ranking loss function and a multiple instance learning pipeline for HPV status prediction. This achieves a new state-of-the-art performance in HPV detection using only the routine H&E stained WSIs on two HNSCC cohorts. Furthermore, a comprehensive tumour microenvironment profiling was performed, which characterised the unique patterns between HPV+/- HNSCC from genomic, immunology and cellular perspectives. Positive correlations of the proposed score with different subtypes of T cells (e.g. T cells follicular helper, CD8+ T cells), and negative correlations with macrophages and connective cells (e.g. fibroblast) were identified, which is in line with clinical findings. Unique gene expression profiles were also identified with respect to HPV infection status, and is in line with existing findings.


title: Multiplicative structures and random walks in o-minimal groups

abstract: We prove structure theorems for o-minimal definable subsets $S\subset G$ of definable groups containing large multiplicative structures, and show definable groups do not have bounded torsion arbitrarily close to the identity. As an application, for certain models of $n$-step random walks $X$ in $G$ we show upper bounds $\mathbb{P}(X\in S)\le n^{-C}$ and a structure theorem for the steps of $X$ when $\mathbb{P}(X\in S)\ge n^{-C'}$.


title: A machine-generated catalogue of Charon's craters and implications for the Kuiper belt

abstract: In this paper we investigate Charon's craters size distribution using a deep learning model. This is motivated by the recent results of Singer et al. (2019) who, using manual cataloging, found a change in the size distribution slope of craters smaller than 12 km in diameter, translating into a paucity of small Kuiper Belt objects. These results were corroborated by Robbins and Singer (2021), but opposed by Morbidelli et al. (2021), necessitating an independent review. Our MaskRCNN-based ensemble of models was trained on Lunar, Mercurian, and Martian crater catalogues and both optical and digital elevation images. We use a robust image augmentation scheme to force the model to generalize and transfer-learn into icy objects. With no prior bias or exposure to Charon, our model find best fit slopes of q =-1.47+-0.33 for craters smaller than 10 km, and q =-2.91+-0.51 for craters larger than 15 km. These values indicate a clear change in slope around 15 km as suggested by Singer et al. (2019) and thus independently confirm their conclusions. Our slopes however are both slightly flatter than those found more recently by Robbins and Singer (2021). Our trained models and relevant codes are available online on github.com/malidib/ACID .


title: Securing Automotive Architectures with Named Data Networking

abstract: As in-vehicle communication becomes more complex, the automotive community is exploring various architectural options such as centralized and zonal architectures for their numerous benefits. Zonal architecture reduces the wiring cost by physically locating related operations and ECUs near their intended functions and the number of physical ECUs through function consolidation. Centralized architectures consolidate the number of ECUs into few, powerful compute units. Common characteristics of these architectures include the need for high-bandwidth communication and security, which have been elusive with standard automotive architectures. Further, as automotive communication technologies evolve, it is also likely that multiple link-layer technologies such as CAN and Automotive Ethernet will co-exist. These alternative architectures promise to integrate these diverse sets of technologies. However, architectures that allow such co-existence have not been adequately explored. In this work we explore a new network architecture called Named Data Networking (NDN) to achieve multiple goals: provide a foundational security infrastructure and bridge different link layer protocols such as CAN, LIN, and automotive Ethernet into a unified communication system. We created a proof-of-concept bench-top testbed using CAN HATS and Raspberry PIs that replay real traffic over CAN and Ethernet to demonstrate how NDN can provide a secure, high-speed bridge between different automotive link layers. We also show how NDN can support communication between centralized or zonal high-power compute components. Security is achieved through digitally signing all Data packets between these components, preventing unauthorized ECUs from injecting arbitrary data into the network. We also demonstrate NDN's ability to prevent DoS and replay attacks between different network segments connected through NDN.


title: Mean convergence of Lagrange interpolation

abstract: In this note we prove mean convergence of Lagrange interpolation at the zeros of para-orthogonal polynomials for measures in the unit circle which does not belong to Szeg\H{o}'s class in the unit circle. When the measure is in Szeg\H{o}'s class mean convergence of Lagrange interpolation is proved for functions in the disk algebra.


title: Measurement of the branching fraction of the $B^0 \to K_S^0 \pi^0 \gamma$ decay using 190 fb$^{-1}$ of Belle II data

abstract: We report the measurement of the branching fraction of the $B^0 \to K_S^0 \pi^0 \gamma$ decay in $e^+ e^- \to \Upsilon(4S) \to B \overline{B}$ data recorded by the Belle II experiment at the SuperKEKB asymmetric-energy collider and corresponding to 190 fb$^{-1}$ of integrated luminosity. The signal yield is measured to be $121\pm 29\,\hbox{(stat.)}$, leading to the branching fraction ${\cal B}\left(B^0 \to K_S^0 \pi^0 \gamma\right) = \left(7.3 \pm 1.8\,\hbox{(stat.)} \pm 1.0\,\hbox{(syst.)} \right)\times 10^{-6}$, which agrees with the known value.


title: Strain modulation of photocurrent in Weyl semimetal TaIrTe4

abstract: We study the effect of the strain on the energy bands of TaIrTe4 sheet and the photocurrent in the Cu-TaIrTe4-Cu heterojunction by using the quantum transport simulations. It is found that the Weyl points can be completely broken with increasing of the strain along z dirction. One can obtain a large photocurrent in the Cu-TaIrTe4-Cu heterojunction in the absence of the strain. While the photocurrent can be sharply enhanced by the strain and reach a large value. Accordingly, the maximum values of the photocurrent can be explained in terms of the transitions between peaks of density of states and band structures. The strain-induced energy bands and photocurrent exhibit anisotropic behaviors. Our results provide a novel route to effectively modulate the energy bands and the photocurrent by utilizing mechanical methods for TaIrTe4-based devices.


title: Hyperbolic angles from Heegner points

abstract: We study lattice points on hyperbolic circles centred at Heegner points of class number one. Our main result is that, on a density one subset of radii tending to infinity, the angles of such points equidistribute on the unit circle. To prove this, we establish a connection between lattice points and algebraic integers in the associated field having norm of a special form and satisfying a congruence condition. As a by-product of this, we obtain an explicit formulation of the classical hyperbolic circle problem as a shifted convolution sum for the function that counts the number of algebraic integers with given norm. Along the way, we also prove a lower bound for shifted B-numbers, which is done by sieve methods.


title: Constructing the Constructible Universe Constructively

abstract: We study the properties of the constructible universe, L, over intuitionistic theories. We give an extended set of fundamental operations which is sufficient to generate the universe over Intuitionistic Kripke-Platek set theory without Infinity. Following this, we investigate when L can fail to be an inner model in the traditional sense. Namely, we show that over Constructive Zermelo-Fraenkel (even with the Power Set axiom) one cannot prove that the Axiom of Exponentiation holds in L.


title: Macroscopic loops in the $3d$ double-dimer model

abstract: The double dimer model is defined as the superposition of two independent uniformly distributed dimer covers of a graph. Its configurations can be viewed as disjoint collections of self-avoiding loops. Our first result is that in $\mathbb{Z}^d$, $d>2$, the loops in the double dimer model are macroscopic. These are shown to behave qualitatively differently than in two dimensions. In particular, we show that, given two distant points of a large box, with uniformly positive probability there exists a loop visiting both points. Our second result involves the monomer double-dimer model, namely the double-dimer model in the presence of a density of monomers. These are vertices which are not allowed to be touched by any loop. This model depends on a parameter, the monomer activity, which controls the density of monomers. It is known from Betz and Taggi (2019) and Taggi (2021) that a finite critical threshold of the monomer activity exists, below which a self-avoiding walk forced through the system is macroscopic. Our paper shows that, when $d >2$, such a critical threshold is strictly positive. In other words, the self-avoiding walk is macroscopic even in the presence of a positive density of monomers.


title: On the structure of SbTeI

abstract: Antimony telluroiodide (SbTeI) is predicted to be a promising material in many technological applications based on theoretical simulations, however the bulk structure solution remains elusive. We consolidate SbTeI belonging to the base-centered monoclinic lattice with a space group C 2/m by combining single crystal X-ray diffraction and X-ray photoemission spectroscopy techniques. The atomic arrangement of the reported crystal structure is remarkable with one-dimensional double-chains forming two-dimensional blocks. In this structure, the Sb$^{3+}$ ion is surrounded by Te$^{2-}$ and I$^-$, which is distinguishable by an incomplete polyhedron resulting in the 5s$^2$ (Sb) lone pair electrons in the valence band. Manipulation of this material with pressure to induce novel structures and properties is highly anticipated.


title: The Question of Arnold on classification of co-artin subalgebras in singularity theory

abstract: In \cite[Section 5, p.32]{Arnold-1998}, Arnold writes: "Classification of singularities of curves can be interpreted in dual terms as a description of 'co-artin' subalgebras of finite co-dimension in the algebra of formal series in a single variable (up to isomorphism of the algebra of formal series)." In the paper, such a description is obtained but up to isomorphism of algebraic curves (i.e. this description is finer). Let $K$ be an algebraically closed field of arbitrary characteristic. The aim of the paper is to give a classification (up to isomorphism) of the set of subalgebras $\mathcal{A}$ of the polynomial algebra $K[x]$ that contains the ideal $x^mK[x]$ for some $m\geq 1$. It is proven that the set $\mathcal{A} = \coprod_{m, \Gamma }\mathcal{A} (m, \Gamma )$ is a disjoint union of affine algebraic varieties (where $\Gamma \coprod \{0, m, m+1, \ldots \}$ is the semigroup of the singularity and $m-1$ is the Frobenius number). It is proven that each set $\mathcal{A} (m, \Gamma )$ is an affine algebraic variety and explicit generators and defining relations are given for the algebra of regular functions on $\mathcal{A} (m ,\Gamma )$. An isomorphism criterion is given for the algebras in $\mathcal{A}$. For each algebra $A\in \mathcal{A} (m, \Gamma)$, explicit sets of generators and defining relations are given and the automorphism group ${\rm Aut}_K(A)$ is explicitly described. The automorphism group of the algebra $A$ is finite iff the algebra $A$ is not isomorphic to a monomial algebra, and in this case $|{\rm Aut}_K(A)|<{\rm dim}_K(A/\mathfrak{c}_A)$ where $\mathfrak{c}_A$ is the conductor of $A$. The set of orders of the automorphism groups of the algebras in $\mathcal{A} (m , \Gamma )$ is explicitly described.


title: Definition drives design: Disability models and mechanisms of bias in AI technologies

abstract: The increasing deployment of artificial intelligence (AI) tools to inform decision making across diverse areas including healthcare, employment, social benefits, and government policy, presents a serious risk for disabled people, who have been shown to face bias in AI implementations. While there has been significant work on analysing and mitigating algorithmic bias, the broader mechanisms of how bias emerges in AI applications are not well understood, hampering efforts to address bias where it begins. In this article, we illustrate how bias in AI-assisted decision making can arise from a range of specific design decisions, each of which may seem self-contained and non-biasing when considered separately. These design decisions include basic problem formulation, the data chosen for analysis, the use the AI technology is put to, and operational design elements in addition to the core algorithmic design. We draw on three historical models of disability common to different decision-making settings to demonstrate how differences in the definition of disability can lead to highly distinct decisions on each of these aspects of design, leading in turn to AI technologies with a variety of biases and downstream effects. We further show that the potential harms arising from inappropriate definitions of disability in fundamental design stages are further amplified by a lack of transparency and disabled participation throughout the AI design process. Our analysis provides a framework for critically examining AI technologies in decision-making contexts and guiding the development of a design praxis for disability-related AI analytics. We put forth this article to provide key questions to facilitate disability-led design and participatory development to produce more fair and equitable AI technologies in disability-related contexts.


title: Balancing Cost and Quality: An Exploration of Human-in-the-loop Frameworks for Automated Short Answer Scoring

abstract: Short answer scoring (SAS) is the task of grading short text written by a learner. In recent years, deep-learning-based approaches have substantially improved the performance of SAS models, but how to guarantee high-quality predictions still remains a critical issue when applying such models to the education field. Towards guaranteeing high-quality predictions, we present the first study of exploring the use of human-in-the-loop framework for minimizing the grading cost while guaranteeing the grading quality by allowing a SAS model to share the grading task with a human grader. Specifically, by introducing a confidence estimation method for indicating the reliability of the model predictions, one can guarantee the scoring quality by utilizing only predictions with high reliability for the scoring results and casting predictions with low reliability to human graders. In our experiments, we investigate the feasibility of the proposed framework using multiple confidence estimation methods and multiple SAS datasets. We find that our human-in-the-loop framework allows automatic scoring models and human graders to achieve the target scoring quality.


title: Switchable Representation Learning Framework with Self-compatibility

abstract: Real-world visual search systems involve deployments on multiple platforms with different computing and storage resources. Deploying a unified model that suits the minimal-constrain platforms leads to limited accuracy. It is expected to deploy models with different capacities adapting to the resource constraints, which requires features extracted by these models to be aligned in the metric space. The method to achieve feature alignments is called ``compatible learning''. Existing research mainly focuses on the one-to-one compatible paradigm, which is limited in learning compatibility among multiple models. We propose a Switchable representation learning Framework with Self-Compatibility (SFSC). SFSC generates a series of compatible sub-models with different capacities through one training process. The optimization of sub-models faces gradients conflict, and we mitigate this problem from the perspective of the magnitude and direction. We adjust the priorities of sub-models dynamically through uncertainty estimation to co-optimize sub-models properly. Besides, the gradients with conflicting directions are projected to avoid mutual interference. SFSC achieves state-of-the-art performance on the evaluated datasets.


title: Multi-path fading and interference mitigation with Reconfigurable Intelligent Surfaces

abstract: We exploit multi-path fading propagation to improve both the signal-to-interference-plus-noise-ratio and the stability of wireless communications within electromagnetic environments that support rich multipath propagation. Quasi-passive propagation control with multiple binary reconfigurable intelligent surfaces is adopted to control the stationary waves supported by a metallic cavity hosting a software-defined radio link. Results are demonstrated in terms of the error vector magnitude minimization of a quadrature phase-shift modulation scheme under no-line-of-sight conditions. It is found that the magnitude of fluctuation of received symbols is reduced to a stable constellation by increasing the number of individual surfaces, or elements, thus demonstrating channel hardening. By using a second software-defined radio device as a jammer, we demonstrate the ability of the RIS to mitigate the co-channel interference by channel hardening. Results are of particular interest in smart radio environments for mobile network architectures beyond 5G.


title: A geometric result for composite materials with $C^{1,\gamma}$-boundaries

abstract: In this paper, we obtain a geometric result for composite materials related to elliptic and parabolic partial differential equations. In the classical papers Li and Vogelius (2000), and Li and Nirenberg (2003), they assumed that for any scale and for any point there exists a coordinate system such that the boundaries of the individual components of a composite material locally become $C^{1,\gamma}$-graphs. We prove that if the individual components of a composite material are composed of $C^{1,\gamma}$-boundaries then such a coordinate system in Li and Vogelius (2000), and Li and Nirenberg (2003) exists, and therefore obtaining the gradient boundedness and the piecewise gradient H\"{o}lder continuity results for linear elliptic systems related to composite materials.


title: Closed-loop Position Control of a Pediatric Soft Robotic Wearable Device for Upper Extremity Assistance

abstract: This work focuses on closed-loop control based on proprioceptive feedback for a pneumatically-actuated soft wearable device aimed at future support of infant reaching tasks. The device comprises two soft pneumatic actuators (one textile-based and one silicone-casted) actively controlling two degrees-of-freedom per arm (shoulder adduction/abduction and elbow flexion/extension, respectively). Inertial measurement units (IMUs) attached to the wearable device provide real-time joint angle feedback. Device kinematics analysis is informed by anthropometric data from infants (arm lengths) reported in the literature. Range of motion and muscle co-activation patterns in infant reaching are considered to derive desired trajectories for the device's end-effector. Then, a proportional-derivative controller is developed to regulate the pressure inside the actuators and in turn move the arm along desired setpoints within the reachable workspace. Experimental results on tracking desired arm trajectories using an engineered mannequin are presented, demonstrating that the proposed controller can help guide the mannequin's wrist to the desired setpoints.


title: Linear Cross Entropy Benchmarking with Clifford Circuits

abstract: With the advent of quantum processors exceeding $100$ qubits and the high engineering complexities involved, there is a need for holistically benchmarking the processor to have quality assurance. Linear cross-entropy benchmarking (XEB) has been used extensively for systems with $50$ or more qubits but is fundamentally limited in scale due to the exponentially large computational resources required for classical simulation. In this work we propose conducting linear XEB with Clifford circuits, a scheme we call Clifford XEB. Since Clifford circuits can be simulated in polynomial time, Clifford XEB can be scaled to much larger systems. To validate this claim, we run numerical simulations for particular classes of Clifford circuits with noise and observe exponential decays. When noise levels are low, the decay rates are well-correlated with the noise of each cycle assuming a digital error model. We perform simulations of systems up to 1,225 qubits, where the classical processing task can be easily dealt with by a workstation. Furthermore, using the theoretical guarantees in Chen et al. (arXiv:2203.12703), we prove that Clifford XEB with our proposed Clifford circuits must yield exponential decays under a general error model for sufficiently low errors. Our theoretical results explain some of the phenomena observed in the simulations and shed light on the behavior of general linear XEB experiments.


title: Mixing time and expansion of non-negatively curved Markov chains

abstract: We establish three remarkable consequences of non-negative curvature for sparse Markov chains. First, their conductance decreases logarithmically with the number of states. Second, their displacement is at least diffusive until the mixing time. Third, they never exhibit the cutoff phenomenon. The first result provides a nearly sharp quantitative answer to a classical question of Ollivier, Milman and Naor. The second settles a conjecture of Lee and Peres for graphs with non-negative curvature. The third offers a striking counterpoint to the recently established cutoff for non-negatively curved chains with uniform expansion.


title: Non-uniformly hyperbolic endomorphisms

abstract: We show the existence of large $\mathcal C^1$ open sets of area preserving endomorphisms of the two-torus which have no dominated splitting and are non-uniformly hyperbolic, meaning that Lebesgue almost every point has a positive and a negative Lyapunov exponent. The integrated Lyapunov exponents vary continuously with the dynamics in the $\mathcal C^1$ topology and can be taken as far away from zero as desired. Explicit real analytic examples are obtained by deforming linear endomorphisms, including expanding ones. The technique works in nearly every homotopy class and the examples are stably ergodic (in fact Bernoulli), provided that the linear map has no eigenvalue of modulus one.


title: Finite temperature dielectric properties of KTaO$_3$ from first principles and machine learning: Phonon spectra, Barrett law, strain engineering and electrostriction

abstract: Despite important breakthroughs in the last decade, the calculation of temperature dependent properties of solids still remains a challenging task, especially in the vicinity of structural phase transitions. We show that the combination of machine-learning interatomic potentials with quantum self-consistent ab initio lattice dynamics allows to calculate efficiently the temperature dependence of dielectric properties of the quantum paraelectric perovskite KTaO$_3$, with a precision beyond what could be reasonably achieved using plain density functional theory. We first follow the strong anharmonic softening of the polar mode in this incipient ferroelectric material, and the resulting divergence of the dielectric constant that eventually saturates due to the interplay between temperature and quantum fluctuations. Further, we predict the stability range of the quantum paraelectric state under the application of epitaxial strain at 0 K and 300 K. Finally, we calculate the temperature dependence of electrostrictive tensors for this material and show that giant electrostriction in KTaO$_3$ is to be expected also at room temperature under the condition of strain engineering.


title: A Language Model With Million Sample Context For Raw Audio Using Transformer Architectures

abstract: Modeling long-term dependencies for audio signals is a particularly challenging problem, as even small-time scales yield on the order of a hundred thousand samples. With the recent advent of Transformers, neural architectures became good at modeling dependencies over longer time scales, but they suffered from quadratic constraints to scale them. We propose a generative auto-regressive architecture that can model audio waveforms over quite a large context, greater than 500,000 samples. Our work is adapted to learn time dependencies by learning a latent representation by a CNN front-end, and then learning dependencies over these representations using Transformer encoders, fully trained end-to-end: thereby allowing to learn representations as it deems fit for the next sample. Unlike previous works that compared different time scales to show improvement, we use a standard dataset, with the same number of parameters/context to show improvements. We achieve a state-of-the-art performance as compared to other approaches such as Wavenet, SaSHMI, and Sample-RNN on a standard dataset for modeling long-term structure. This work gives very exciting direction for the field, given improvements in context modeling that can be scaled with more data, as well as potentially better results by using billions/trillions of parameters.


title: Video Capsule Endoscopy Classification using Focal Modulation Guided Convolutional Neural Network

abstract: Video capsule endoscopy is a hot topic in computer vision and medicine. Deep learning can have a positive impact on the future of video capsule endoscopy technology. It can improve the anomaly detection rate, reduce physicians' time for screening, and aid in real-world clinical analysis. CADx classification system for video capsule endoscopy has shown a great promise for further improvement. For example, detection of cancerous polyp and bleeding can lead to swift medical response and improve the survival rate of the patients. To this end, an automated CADx system must have high throughput and decent accuracy. In this paper, we propose FocalConvNet, a focal modulation network integrated with lightweight convolutional layers for the classification of small bowel anatomical landmarks and luminal findings. FocalConvNet leverages focal modulation to attain global context and allows global-local spatial interactions throughout the forward pass. Moreover, the convolutional block with its intrinsic inductive/learning bias and capacity to extract hierarchical features allows our FocalConvNet to achieve favourable results with high throughput. We compare our FocalConvNet with other SOTA on Kvasir-Capsule, a large-scale VCE dataset with 44,228 frames with 13 classes of different anomalies. Our proposed method achieves the weighted F1-score, recall and MCC} of 0.6734, 0.6373 and 0.2974, respectively outperforming other SOTA methodologies. Furthermore, we report the highest throughput of 148.02 images/second rate to establish the potential of FocalConvNet in a real-time clinical environment. The code of the proposed FocalConvNet is available at https://github.com/NoviceMAn-prog/FocalConvNet.


title: Carbon-Enhanced Metal-Poor star candidates from BP/RP Spectra in $Gaia$ DR3

abstract: Carbon-enhanced metal-poor (CEMP) stars comprise almost a third of stars with [Fe/H] < --2, although their origins are still poorly understood. It is highly likely that one sub-class (CEMP-$s$ stars) is tied to mass-transfer events in binary stars, while another sub-class (CEMP-no stars) are enriched by the nucleosynthetic yields of the first generations of stars. Previous studies of CEMP stars have primarily concentrated on the Galactic halo, but more recently they have also been detected in the thick disk and bulge components of the Milky Way. $Gaia$ DR3 has provided an unprecedented sample of over 200 million low-resolution ($R\approx$ 50) spectra from the BP and RP photometers. Training on the CEMP catalog from the SDSS/SEGUE database, we use XGBoost to identify the largest all-sky sample of CEMP candidate stars to date. In total, we find 58,872 CEMP star candidates, with an estimated contamination rate of 12%. When comparing to literature high-resolution catalogs, we positively identify 60-68% of the CEMP stars in the data, validating our results and indicating a high completeness rate. Our final catalog of CEMP candidates spans from the inner to outer Milky Way, with distances as close as $r \sim$ 0.8 kpc from the Galactic center, and as far as $r >$ 30 kpc. Future higher-resolution spectroscopic follow-up of these candidates will provide validations of their classification and enable investigations of the frequency of CEMP-$s$ and CEMP-no stars throughout the Galaxy, to further constrain the nature of their progenitors.


title: Stake-governed tug-of-war and the biased infinity Laplacian

abstract: In tug-of-war, two players compete by moving a counter along edges of a graph, each winning the right to move at a given turn according to the flip of a possibly biased coin. The game ends when the counter reaches the boundary, a fixed subset of the vertices, at which point one player pays the other an amount determined by the boundary vertex. Economists and mathematicians have independently studied tug-of-war for many years, focussing respectively on resource-allocation forms of the game, in which players iteratively spend precious budgets in an effort to influence the bias of the coins that determine the turn victors; and on PDE arising in fine mesh limits of the constant-bias game in a Euclidean setting. In this article, we offer a mathematical treatment of a class of tug-of-war games with allocated budgets: each player is initially given a fixed budget which she draws on throughout the game to offer a stake at the start of each turn, and her probability of winning the turn is the ratio of her stake and the sum of the two stakes. We consider the game played on a tree, with boundary being the set of leaves, and the payment function being the indicator of a single distinguished leaf. We find the game value and the essentially unique Nash equilibrium of a leisurely version of the game, in which the move at any given turn is cancelled with constant probability after stakes have been placed. We show that the ratio of the players' remaining budgets is maintained at its initial value $\lambda$; game value is a biased infinity harmonic function; and the proportion of remaining budget that players stake at a given turn is given in terms of the spatial gradient and the $\lambda$-derivative of game value. We also indicate examples in which the solution takes a different form in the non-leisurely game.


title: Deinsum: Practically I/O Optimal Multilinear Algebra

abstract: Multilinear algebra kernel performance on modern massively-parallel systems is determined mainly by data movement. However, deriving data movement-optimal distributed schedules for programs with many high-dimensional inputs is a notoriously hard problem. State-of-the-art libraries rely on heuristics and often fall back to suboptimal tensor folding and BLAS calls. We present Deinsum, an automated framework for distributed multilinear algebra computations expressed in Einstein notation, based on rigorous mathematical tools to address this problem. Our framework automatically derives data movement-optimal tiling and generates corresponding distributed schedules, further optimizing the performance of local computations by increasing their arithmetic intensity. To show the benefits of our approach, we test it on two important tensor kernel classes: Matricized Tensor Times Khatri-Rao Products and Tensor Times Matrix chains. We show performance results and scaling on the Piz Daint supercomputer, with up to 19x speedup over state-of-the-art solutions on 512 nodes.


title: The prescribed point area estimate for minimal submanifolds in constant curvature

abstract: We prove a sharp area estimate for minimal submanifolds that pass through a prescribed point in a geodesic ball in hyperbolic space, in any dimension and codimension. In certain cases, we also prove the corresponding estimate in the sphere. Our estimates are analogous to those of Brendle and Hung in the Euclidean setting.


title: On Scaled Methods for Saddle Point Problems

abstract: Methods with adaptive scaling of different features play a key role in solving saddle point problems, primarily due to Adam's popularity for solving adversarial machine learning problems, including GANS training. This paper carries out a theoretical analysis of the following scaling techniques for solving SPPs: the well-known Adam and RmsProp scaling and the newer AdaHessian and OASIS based on Hutchison approximation. We use the Extra Gradient and its improved version with negative momentum as the basic method. Experimental studies on GANs show good applicability not only for Adam, but also for other less popular methods.


title: Adversarial Patch Attacks and Defences in Vision-Based Tasks: A Survey

abstract: Adversarial attacks in deep learning models, especially for safety-critical systems, are gaining more and more attention in recent years, due to the lack of trust in the security and robustness of AI models. Yet the more primitive adversarial attacks might be physically infeasible or require some resources that are hard to access like the training data, which motivated the emergence of patch attacks. In this survey, we provide a comprehensive overview to cover existing techniques of adversarial patch attacks, aiming to help interested researchers quickly catch up with the progress in this field. We also discuss existing techniques for developing detection and defences against adversarial patches, aiming to help the community better understand this field and its applications in the real world.


title: Collective Quantum Beats from Distant Multilevel Emitters

abstract: We analyze the dynamics of quantum beats in a system of two V-type three-level atoms coupled to a waveguide. We show that quantum beats can be collectively enhanced or suppressed, akin to Dicke super- and sub-radiance, depending on the interatomic separation and the initial correlations between the atoms. In particular, the interference properties of the collective beats are determined by the distance between the atoms modulo the beat wavelength. We study the collective atomic and field dynamics, illustrating a crossover from a Markovian to a non-Markovian regime as the atomic separation becomes sufficiently large to bring memory effects of the electromagnetic environment into consideration. In such a non-Markovian regime, collective quantum beats can be enhanced beyond the Markovian limit as a result of retardation effects. Our results demonstrate the rich interplay between multilevel and multiatom quantum interference effects arising in a system of distant quantum emitters.


title: A Comprehensive Eco-Driving Strategy for Connected and Autonomous Vehicles (CAVs) with Microscopic Traffic Simulation Testing Evaluation

abstract: In this paper, a comprehensive Eco-Driving strategy for CAVs is presented. In this setup, multiple driving modes calculate speed profiles ideal for their own set of constraints simultaneously to save fuel as much as possible, while a High Level (HL) controller ensures smooth transitions between the driving modes for Eco-Driving. This Eco-Driving deterministic controller for an ego CAV was equipped with Vehicle-to-Infrastructure (V2I) and Vehicle-to-Vehicle (V2V) algorithms. Simulation results are used to show that the HL controller ensures significant fuel economy improvement as compared to baseline driving modes with no collisions between the ego CAV and traffic vehicles while the driving mode of the ego CAV was set correctly under changing constraints.


title: Sharper Convergence Guarantees for Asynchronous SGD for Distributed and Federated Learning

abstract: We study the asynchronous stochastic gradient descent algorithm for distributed training over $n$ workers which have varying computation and communication frequency over time. In this algorithm, workers compute stochastic gradients in parallel at their own pace and return those to the server without any synchronization. Existing convergence rates of this algorithm for non-convex smooth objectives depend on the maximum gradient delay $\tau_{\max}$ and show that an $\epsilon$-stationary point is reached after $\mathcal{O}\!\left(\sigma^2\epsilon^{-2}+ \tau_{\max}\epsilon^{-1}\right)$ iterations, where $\sigma$ denotes the variance of stochastic gradients. In this work (i) we obtain a tighter convergence rate of $\mathcal{O}\!\left(\sigma^2\epsilon^{-2}+ \sqrt{\tau_{\max}\tau_{avg}}\epsilon^{-1}\right)$ without any change in the algorithm where $\tau_{avg}$ is the average delay, which can be significantly smaller than $\tau_{\max}$. We also provide (ii) a simple delay-adaptive learning rate scheme, under which asynchronous SGD achieves a convergence rate of $\mathcal{O}\!\left(\sigma^2\epsilon^{-2}+ \tau_{avg}\epsilon^{-1}\right)$, and does not require any extra hyperparameter tuning nor extra communications. Our result allows to show for the first time that asynchronous SGD is always faster than mini-batch SGD. In addition, (iii) we consider the case of heterogeneous functions motivated by federated learning applications and improve the convergence rate by proving a weaker dependence on the maximum delay compared to prior works. In particular, we show that the heterogeneity term in convergence rate is only affected by the average delay within each worker.


title: Deepfake histological images for enhancing digital pathology

abstract: An optical microscopic examination of thinly cut stained tissue on glass slides prepared from a FFPE tissue blocks is the gold standard for tissue diagnostics. In addition, the diagnostic abilities and expertise of any pathologist is dependent on their direct experience with common as well as rarer variant morphologies. Recently, deep learning approaches have been used to successfully show a high level of accuracy for such tasks. However, obtaining expert-level annotated images is an expensive and time-consuming task and artificially synthesized histological images can prove greatly beneficial. Here, we present an approach to not only generate histological images that reproduce the diagnostic morphologic features of common disease but also provide a user ability to generate new and rare morphologies. Our approach involves developing a generative adversarial network model that synthesizes pathology images constrained by class labels. We investigated the ability of this framework in synthesizing realistic prostate and colon tissue images and assessed the utility of these images in augmenting diagnostic ability of machine learning methods as well as their usability by a panel of experienced anatomic pathologists. Synthetic data generated by our framework performed similar to real data in training a deep learning model for diagnosis. Pathologists were not able to distinguish between real and synthetic images and showed a similar level of inter-observer agreement for prostate cancer grading. We extended the approach to significantly more complex images from colon biopsies and showed that the complex microenvironment in such tissues can also be reproduced. Finally, we present the ability for a user to generate deepfake histological images via a simple markup of sematic labels.


title: Pythae: Unifying Generative Autoencoders in Python -- A Benchmarking Use Case

abstract: In recent years, deep generative models have attracted increasing interest due to their capacity to model complex distributions. Among those models, variational autoencoders have gained popularity as they have proven both to be computationally efficient and yield impressive results in multiple fields. Following this breakthrough, extensive research has been done in order to improve the original publication, resulting in a variety of different VAE models in response to different tasks. In this paper we present Pythae, a versatile open-source Python library providing both a unified implementation and a dedicated framework allowing straightforward, reproducible and reliable use of generative autoencoder models. We then propose to use this library to perform a case study benchmark where we present and compare 19 generative autoencoder models representative of some of the main improvements on downstream tasks such as image reconstruction, generation, classification, clustering and interpolation. The open-source library can be found at https://github.com/clementchadebec/benchmark_VAE.


title: Turbulent Transport in Tokamak-plasmas: A Thermodynamic Approach

abstract: In previous work we provided the explicit form of the nonlinear PDEs, subjected to the appropriate boundary conditions, which have to be satisfied by transport coefficients for systems out of Onsager's region. Since the proposed PDEs are obtained without neglecting any term present in the balance equations (i.e., the mass, momentum, and energy balance equations), we propose them as a good candidate for describing also transport in thermodynamic systems in turbulent regimes. As a special case, we derive the nonlinear PDEs for transport coefficients when the thermodynamic system is subjected to two thermodynamic forces. In this case, the obtained PDE is, in thermodynamical field theory (TFT), analogous to Liouville's equation in Riemannian (or pseudo-Riemannian) geometry. The validity of our model is tested by analyzing a concrete example where Onsager's relations manifestly disagree with experience: transport in Tokamak-plasmas. More specifically, we compute the electron mass and energy losses in turbulent FTU (Frascati Tokamak Upgrade)-plasmas. We show the agreement between the theoretical predictions and experimental observations. This approach allows for predicting the values of the Bohm and the gyro-Bohm coefficients. To the best of our knowledge, it is the first time that such coefficients have been evaluated analytically. The aim of this series of works is to apply our approach to the Divertor Tokamak Test facility (DTT), to be built in Italy, and to ITER.


title: Continuous-Time Modeling of Counterfactual Outcomes Using Neural Controlled Differential Equations

abstract: Estimating counterfactual outcomes over time has the potential to unlock personalized healthcare by assisting decision-makers to answer ''what-iF'' questions. Existing causal inference approaches typically consider regular, discrete-time intervals between observations and treatment decisions and hence are unable to naturally model irregularly sampled data, which is the common setting in practice. To handle arbitrary observation patterns, we interpret the data as samples from an underlying continuous-time process and propose to model its latent trajectory explicitly using the mathematics of controlled differential equations. This leads to a new approach, the Treatment Effect Neural Controlled Differential Equation (TE-CDE), that allows the potential outcomes to be evaluated at any time point. In addition, adversarial training is used to adjust for time-dependent confounding which is critical in longitudinal settings and is an added challenge not encountered in conventional time-series. To assess solutions to this problem, we propose a controllable simulation environment based on a model of tumor growth for a range of scenarios with irregular sampling reflective of a variety of clinical scenarios. TE-CDE consistently outperforms existing approaches in all simulated scenarios with irregular sampling.


title: SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learning

abstract: We introduce SoundSpaces 2.0, a platform for on-the-fly geometry-based audio rendering for 3D environments. Given a 3D mesh of a real-world environment, SoundSpaces can generate highly realistic acoustics for arbitrary sounds captured from arbitrary microphone locations. Together with existing 3D visual assets, it supports an array of audio-visual research tasks, such as audio-visual navigation, mapping, source localization and separation, and acoustic matching. Compared to existing resources, SoundSpaces 2.0 has the advantages of allowing continuous spatial sampling, generalization to novel environments, and configurable microphone and material properties. To our knowledge, this is the first geometry-based acoustic simulation that offers high fidelity and realism while also being fast enough to use for embodied learning. We showcase the simulator's properties and benchmark its performance against real-world audio measurements. In addition, we demonstrate two downstream tasks -- embodied navigation and far-field automatic speech recognition -- and highlight sim2real performance for the latter. SoundSpaces 2.0 is publicly available to facilitate wider research for perceptual systems that can both see and hear.


title: A note on the inner products of pure states and their antidistinguishability

abstract: A set of d quantum states is said to be antidistinguishable if there exists a d-outcome POVM that can perfectly identify which state was not measured. A conjecture by Havl\'i\v{c}ek and Barrett states that if a set of d pure states has small pair-wise inner products, then the set must be antidistinguishable. In this note we provide a certificate of antidistinguishability via semidefinite programming duality and use it to provide a counterexample to this conjecture when d = 4.


title: On local existence of solutions for nonlinear systems of Cauchy-Riemann operator of any order in the plane

abstract: We prove a general local existence theorem for nonlinear systems of Cauchy-Riemann operator of any order in one complex variable with initial values at a given point, which is a counterpart of local existence of ODE.


title: Homologically area-minimizing surfaces with non-smoothable singularities

abstract: Let dimensions $d \ge 3$ and codimensions $c \ge 3$ be positive integers, and define the exceptional set $E = \{3, 4\}$. We prove that, for $d \notin E$ with arbitrary $c$, or for $d \in E$ with $c \le d$, for any $d$-dimensional integral homology class $[\Sigma]$ on a compact (not necessarily orientable) $(d+c)$-dimensional smooth manifold $M$, there exist open sets $\Omega_{[\Sigma]}$ in the space of smooth Riemannian metrics such that all area-minimizing integral currents in $[\Sigma]$ are singular for metrics in $\Omega_{[\Sigma]}$. This resolves a conjecture by White regarding the generic regularity of area-minimizing surfaces and provides a sharp dimension-wise answer. As a corollary, we determine the moduli space of area-minimizing currents in the vicinity of any area-minimizing transverse immersion with dimension $d \ge 3$ and codimension $c \ge 3$ that satisfies an angle condition of asymptotically sharp order in $d$. Analogous conclusions apply to mod $2$ area-minimizing surfaces.


title: Boosting the Adversarial Transferability of Surrogate Models with Dark Knowledge

abstract: Deep neural networks (DNNs) are vulnerable to adversarial examples. And, the adversarial examples have transferability, which means that an adversarial example for a DNN model can fool another model with a non-trivial probability. This gave birth to the transfer-based attack where the adversarial examples generated by a surrogate model are used to conduct black-box attacks. There are some work on generating the adversarial examples from a given surrogate model with better transferability. However, training a special surrogate model to generate adversarial examples with better transferability is relatively under-explored. This paper proposes a method for training a surrogate model with dark knowledge to boost the transferability of the adversarial examples generated by the surrogate model. This trained surrogate model is named dark surrogate model (DSM). The proposed method for training a DSM consists of two key components: a teacher model extracting dark knowledge, and the mixing augmentation skill enhancing dark knowledge of training data. We conducted extensive experiments to show that the proposed method can substantially improve the adversarial transferability of surrogate models across different architectures of surrogate models and optimizers for generating adversarial examples, and it can be applied to other scenarios of transfer-based attack that contain dark knowledge, like face verification. Our code is publicly available at \url{https://github.com/ydc123/Dark_Surrogate_Model}.


title: Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognition

abstract: Transformers have recently dominated the ASR field. Although able to yield good performance, they involve an autoregressive (AR) decoder to generate tokens one by one, which is computationally inefficient. To speed up inference, non-autoregressive (NAR) methods, e.g. single-step NAR, were designed, to enable parallel generation. However, due to an independence assumption within the output tokens, performance of single-step NAR is inferior to that of AR models, especially with a large-scale corpus. There are two challenges to improving single-step NAR: Firstly to accurately predict the number of output tokens and extract hidden variables; secondly, to enhance modeling of interdependence between output tokens. To tackle both challenges, we propose a fast and accurate parallel transformer, termed Paraformer. This utilizes a continuous integrate-and-fire based predictor to predict the number of tokens and generate hidden variables. A glancing language model (GLM) sampler then generates semantic embeddings to enhance the NAR decoder's ability to model context interdependence. Finally, we design a strategy to generate negative samples for minimum word error rate training to further improve performance. Experiments using the public AISHELL-1, AISHELL-2 benchmark, and an industrial-level 20,000 hour task demonstrate that the proposed Paraformer can attain comparable performance to the state-of-the-art AR transformer, with more than 10x speedup.


title: Planning and Formulations in Pursuit-Evasion: Keep-away Games and Their Strategies

abstract: We study a pursuit-evasion problem which can be viewed as an extension of the keep-away game. In the game, pursuer(s) will attempt to intersect or catch the evader, while the evader can visit a fixed set of locations, which we denote as the anchors. These anchors may or may not be stationary. When the velocity of the pursuers is limited and considered low compared to the evaders, we are interested in whether a winning strategy exists for the pursuers or the evaders, or the game will draw. When the anchors are stationary, we show an algorithm that can help answer the above question. The primary motivation for this study is to explore the boundaries between kinematic and dynamic constraints. In particular, whether the solution of the kinematic problem can be used to speed up the search for the problems with dynamic constraints and how to discretize the problem to utilize such relations best. In this work, we show that a geometric branch-and-bound type of approach can be used to solve the stationary anchor problem, and the approach and the solution can be extended to solve the dynamic problem where the pursuers have dynamic constraints, including velocity and acceleration bounds.


title: Analysis of arbitrary superconducting quantum circuits accompanied by a Python package: SQcircuit

abstract: Superconducting quantum circuits are a promising hardware platform for realizing a fault-tolerant quantum computer. Accelerating progress in this field of research demands general approaches and computational tools to analyze and design more complex superconducting circuits. We develop a framework to systematically construct a superconducting quantum circuit's quantized Hamiltonian from its physical description. As is often the case with quantum descriptions of multicoordinate systems, the complexity rises rapidly with the number of variables. Therefore, we introduce a set of coordinate transformations with which we can find bases to diagonalize the Hamiltonian efficiently. Furthermore, we broaden our framework's scope to calculate the circuit's key properties required for optimizing and discovering novel qubits. We implement the methods described in this work in an open-source Python package SQcircuit. In this manuscript, we introduce the reader to the SQcircuit environment and functionality. We show through a series of examples how to analyze a number of interesting quantum circuits and obtain features such as the spectrum, coherence times, transition matrix elements, coupling operators, and the phase coordinate representation of eigenfunctions.


title: Computer-aided quantization and numerical analysis of superconducting circuits

abstract: The development of new superconducting circuits and the improvement of existing ones rely on the accurate modeling of spectral properties which are key to achieving the needed advances in qubit performance. Systematic circuit analysis at the lumped-element level, starting from a circuit network and culminating in a Hamiltonian appropriately describing the quantum properties of the circuit, is a well-established procedure, yet cumbersome to carry out manually for larger circuits. We present work utilizing symbolic computer algebra and numerical diagonalization routines versatile enough to tackle a variety of circuits. Results from this work are accessible through a newly released module of the scqubits package.


title: Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learning

abstract: End-to-end learning for visual robotic manipulation is known to suffer from sample inefficiency, requiring large numbers of demonstrations. The spatial roto-translation equivariance, or the SE(3)-equivariance can be exploited to improve the sample efficiency for learning robotic manipulation. In this paper, we present SE(3)-equivariant models for visual robotic manipulation from point clouds that can be trained fully end-to-end. By utilizing the representation theory of the Lie group, we construct novel SE(3)-equivariant energy-based models that allow highly sample efficient end-to-end learning. We show that our models can learn from scratch without prior knowledge and yet are highly sample efficient (5~10 demonstrations are enough). Furthermore, we show that our models can generalize to tasks with (i) previously unseen target object poses, (ii) previously unseen target object instances of the category, and (iii) previously unseen visual distractors. We experiment with 6-DoF robotic manipulation tasks to validate our models' sample efficiency and generalizability. Codes are available at: https://github.com/tomato1mule/edf


title: On Effective Field Theories with Celestial Duals

abstract: We show that associativity of the tree-level OPE in a celestial CFT imposes constraints on the coupling constants of the corresponding bulk theory. These constraints are the same as those derived in arXiv:2111.11356 from the Jacobi identity of the algebra of soft modes. The constrained theories are interesting as apparently well-defined celestial CFTs with a deformed $w_{1+\infty}$ symmetry algebra. We explicitly work out the ramifications of these constraints on scattering amplitudes involving gluons, gravitons and scalars in these theories. We find that all four-point amplitudes constructible solely from holomorphic or anti-holomorphic three-point amplitudes vanish on the support of these constraints, which implies that all purely holomorphic or purely anti-holomorphic higher-point amplitudes vanish.


title: Signatures of graphs for bicommutative Hopf algebras

abstract: This article approaches the counting of subgraphs, in terms of signature-type functionals defined over combinatorial Hopf algebras of graphs. Well-known algebraic identities that arise in the context of counting subgraphs are then captured by their character property and a type of "Chen's identity". While different notions of subgraphs (and homomorphisms) correspond to different combinatorial Hopf algebras on graphs, we will show that they are all isomorphic to a polynomial Hopf algebra. In addition, the isomorphy between the Hopf algebras can be realized by maps that respect the counting operations.


title: Modeling, robust control synthesis and worst-case analysis for an on-orbit servicing mission with large flexible spacecraft

abstract: This paper outlines a complete methodology for modeling an on-orbit servicing mission scenario and designing a feedback control system for the attitude dynamics that is guaranteed to robustly meet pointing requirements, despite model uncertainties as well as large inertia and flexibility changes throughout the mission scenario. A model of the uncertain plant was derived, which fully captures the dynamics and couplings between all subsystems as well as the decoupled/coupled configurations of the chaser/target system in a single linear fractional representation (LFR). In addition, a new approach is proposed to model and analyze a closed-loop kinematic chain formed by the chaser and the target spacecraft through the chaser's robotic arm, which uses two local spring-damper systems with uncertain damping and stiffness. This approach offers the possibility to model the dynamical behaviour of a docking mechanism with dynamic stiffness and damping. The controller was designed by taking into account all the interactions between subsystems and uncertainties as well as the time-varying and coupled flexible dynamics. Lastly, the robust stability and worst-case performances were assessed by means of a structured singular value analysis.


title: Characteristics of Harmful Text: Towards Rigorous Benchmarking of Language Models

abstract: Large language models produce human-like text that drive a growing number of applications. However, recent literature and, increasingly, real world observations, have demonstrated that these models can generate language that is toxic, biased, untruthful or otherwise harmful. Though work to evaluate language model harms is under way, translating foresight about which harms may arise into rigorous benchmarks is not straightforward. To facilitate this translation, we outline six ways of characterizing harmful text which merit explicit consideration when designing new benchmarks. We then use these characteristics as a lens to identify trends and gaps in existing benchmarks. Finally, we apply them in a case study of the Perspective API, a toxicity classifier that is widely used in harm benchmarks. Our characteristics provide one piece of the bridge that translates between foresight and effective evaluation.


title: Global SMEFT Fits at Future Colliders

abstract: Based on the framework of Standard Model Effective Field Theory, we performed a few global fits, each containing a subset of dimension-6 operators, for the measurements that are expected at future colliders. The fit for the Higgs and electroweak sector improves what has been done for the European Strategy Update in 2020 on both EFT treatments and experimental inputs. A new comprehensive fit is performed focusing on 4-fermion interactions at future colliders. Top-quark sector is studied in a dedicated fit which restricts the operators and measurements to be directly related to top-quark. A small subset of CP-violating operators involving bosonic fields alone are also investigated. Various running scenarios for future e+e- and Muon Colliders that are suggested in the Snowmass 2021 discussion are considered in the global fits. The outcomes from each fit are expressed in terms of either direct constraint on Wilson Coefficients or precision on Higgs and electroweak effective couplings.


title: The BOSS bispectrum analysis at one loop from the Effective Field Theory of Large-Scale Structure

abstract: We analyze the BOSS power spectrum monopole and quadrupole, and the bispectrum monopole and quadrupole data, using the predictions from the Effective Field Theory of Large-Scale Structure (EFTofLSS). Specifically, we use the one loop prediction for the power spectrum and the bispectrum monopole, and the tree level for the bispectrum quadrupole. After validating our pipeline against numerical simulations as well as checking for several internal consistencies, we apply it to the observational data. We find that analyzing the bispectrum monopole to higher wavenumbers thanks to the one-loop prediction, as well as the addition of the tree-level quadrupole, significantly reduces the error bars with respect to our original analysis of the power spectrum at one loop and bispectrum monopole at tree level. After fixing the spectral tilt to Planck preferred value and using a Big Bang Nucleosynthesis prior, we measure $\sigma_8=0.794\pm 0.037$, $h = 0.692\pm 0.011$, and $\Omega_m = 0.311\pm 0.010$ to about $4.7\%$, $1.6\%$, and $3.2\%$, at $68\%$ CL, respectively. This represents an error bar reduction with respect to the power spectrum-only analysis of about $30\%$, $18\%$, and $13\%$ respectively. Remarkably, the results are compatible with the ones obtained with a power-spectrum-only analysis, showing the power of the EFTofLSS in simultaneously predicting several observables. We find no tension with Planck.