title: Detailed study of HWP non-idealities and their impact on future measurements of CMB polarization anisotropies from space

abstract: We study the propagation of a specific class of instrumental systematics to the reconstruction of the B-mode power spectrum of the cosmic microwave background (CMB). We focus on the non-idealities of the half-wave plate (HWP), a polarization modulator that is to be deployed by future CMB experiments, such as the phase-A satellite mission LiteBIRD. We study the effects of non-ideal HWP properties, such as transmittance, phase shift, and cross-polarization. To this end, we developed a simple, yet stand-alone end-to-end simulation pipeline adapted to LiteBIRD. We analyzed the effects of a possible mismatch between the measured frequency profiles of HWP properties (used in the mapmaking stage of the pipeline) and the actual profiles (used in the sky-scanning step). We simulated single-frequency, CMB-only observations to emphasize the effects of non-idealities on the BB power spectrum. We also considered multi-frequency observations to account for the frequency dependence of HWP properties and the contribution of foreground emission. We quantified the systematic effects in terms of a bias $\Delta r$ on the tensor-to-scalar ratio, $r$, with respect to the ideal case without systematic effects. We derived the accuracy requirements on the measurements of HWP properties by requiring $\Delta r < 10^{-5}$ (1% of the expected LiteBIRD sensitivity on $r$). Our analysis is introduced by a detailed presentation of the mathematical formalism employed in this work, including the use of the Jones and Mueller matrix representations.


title: On Liu morphisms in non-Archimedean geometry

abstract: We define Liu morphisms and quasi-Liu morphisms between Berkovich analytic spaces. We show that Liu morphisms and quasi-Liu morphisms behave exactly as affine morphisms and quasi-affine morphisms of schemes.


title: Selecting a Match: Exploration vs Decision

abstract: In a dynamic matching market, such as a marriage or job market, how should agents balance accepting a proposed match with the cost of continuing their search? We consider this problem in a discrete setting, in which agents have cardinal values and finite lifetimes, and proposed matches are random. We seek to quantify how well the agents can do. We provide upper and lower bounds on the collective losses of the agents, with a polynomially small failure probability, where the notion of loss is with respect to a plausible baseline we define. These bounds are tight up to constant factors. We highlight two aspects of this work. First, in our model, agents have a finite time in which to enjoy their matches, namely the minimum of their remaining lifetime and that of their partner; this implies that unmatched agents become less desirable over time, and suggests that their decision rules should change over time. Second, we use a discrete rather than a continuum model for the population. The discreteness causes variance which induces localized imbalances in the two sides of the market. One of the main technical challenges we face is to bound these imbalances. In addition, we present the results of simulations on moderate-sized problems for both the discrete and continuum versions. For these size problems, there are substantial ongoing fluctuations in the discrete setting whereas the continuum version converges reasonably quickly.


title: Real-Time Denoising of Volumetric Path Tracing for Direct Volume Rendering

abstract: Direct Volume Rendering (DVR) using Volumetric Path Tracing (VPT) is a scientific visualization technique that simulates light transport with objects' matter using physically-based lighting models. Monte Carlo (MC) path tracing is often used with surface models, yet its application for volumetric models is difficult due to the complexity of integrating MC light-paths in volumetric media with none or smooth material boundaries. Moreover, auxiliary geometry-buffers (G-buffers) produced for volumes are typically very noisy, failing to guide image denoisers relying on that information to preserve image details. This makes existing real-time denoisers, which take noise-free G-buffers as their input, less effective when denoising VPT images. We propose the necessary modifications to an image-based denoiser previously used when rendering surface models, and demonstrate effective denoising of VPT images. In particular, our denoising exploits temporal coherence between frames, without relying on noise-free G-buffers, which has been a common assumption of existing denoisers for surface-models. Our technique preserves high-frequency details through a weighted recursive least squares that handles heterogeneous noise for volumetric models. We show for various real data sets that our method improves the visual fidelity and temporal stability of VPT during classic DVR operations such as camera movements, modifications of the light sources, and editions to the volume transfer function.


title: Unconventional Materials: the mismatch between electronic charge centers and atomic positions

abstract: The complete band representations (BRs) have been constructed in the work of topological quantum chemistry. Each BR is expressed by either a localized orbital at a Wyckoff site in real space, or by a set of irreducible representations in momentum space. In this work, we define unconventional materials with a common feature of the mismatch between average electronic centers and atomic positions. They can be effectively diagnosed as whose occupied bands can be expressed as a sum of elementary BRs (eBRs), but not a sum of atomic-orbital-induced BRs (aBRs). The existence of an essential BR at an empty site is described by nonzero real-space invariants (RSIs). The "valence" states can be derived by the aBR decomposition, and unconventional materials are supposed to have an uncompensated total "valence" state. The high-throughput screening for unconventional materials has been performed through the first-principles calculations. We have discovered 423 unconventional compounds, including thermoelectronic materials, higher-order topological insulators, electrides, hydrogen storage materials, hydrogen evolution reaction electrocatalysts, electrodes, and superconductors. The diversity of these interesting properties and applications would be widely studied in the future.


title: Measurement of the Iron Spectrum in Cosmic Rays from 10 GeV$/n$ to 2.0 TeV$/n$ with the Calorimetric Electron Telescope on the International Space Station

abstract: The Calorimetric Electron Telescope (CALET), in operation on the International Space Station since 2015, collected a large sample of cosmic-ray iron over a wide energy interval. In this Letter a measurement of the iron spectrum is presented in the range of kinetic energy per nucleon from 10 GeV$/n$ to 2.0 TeV$/n$ allowing the inclusion of iron in the list of elements studied with unprecedented precision by space-borne instruments. The measurement is based on observations carried out from January 2016 to May 2020. The CALET instrument can identify individual nuclear species via a measurement of their electric charge with a dynamic range extending far beyond iron (up to atomic number $Z$ = 40). The energy is measured by a homogeneous calorimeter with a total equivalent thickness of 1.2 proton interaction lengths preceded by a thin (3 radiation lengths) imaging section providing tracking and energy sampling. The analysis of the data and the detailed assessment of systematic uncertainties are described and results are compared with the findings of previous experiments. The observed differential spectrum is consistent within the errors with previous experiments. In the region from 50 GeV$/n$ to 2 TeV$/n$ our present data are compatible with a single power law with spectral index -2.60 $\pm$ 0.03.


title: The Possible, the Plausible, and the Desirable: Event-Based Modality Detection for Language Processing

abstract: Modality is the linguistic ability to describe events with added information such as how desirable, plausible, or feasible they are. Modality is important for many NLP downstream tasks such as the detection of hedging, uncertainty, speculation, and more. Previous studies that address modality detection in NLP often restrict modal expressions to a closed syntactic class, and the modal sense labels are vastly different across different studies, lacking an accepted standard. Furthermore, these senses are often analyzed independently of the events that they modify. This work builds on the theoretical foundations of the Georgetown Gradable Modal Expressions (GME) work by Rubinstein et al. (2013) to propose an event-based modality detection task where modal expressions can be words of any syntactic class and sense labels are drawn from a comprehensive taxonomy which harmonizes the modal concepts contributed by the different studies. We present experiments on the GME corpus aiming to detect and classify fine-grained modal concepts and associate them with their modified events. We show that detecting and classifying modal expressions is not only feasible, but also improves the detection of modal events in their own right.


title: Mean Embeddings with Test-Time Data Augmentation for Ensembling of Representations

abstract: Averaging predictions over a set of models -- an ensemble -- is widely used to improve predictive performance and uncertainty estimation of deep learning models. At the same time, many machine learning systems, such as search, matching, and recommendation systems, heavily rely on embeddings. Unfortunately, due to misalignment of features of independently trained models, embeddings, cannot be improved with a naive deep ensemble like approach. In this work, we look at the ensembling of representations and propose mean embeddings with test-time augmentation (MeTTA) simple yet well-performing recipe for ensembling representations. Empirically we demonstrate that MeTTA significantly boosts the quality of linear evaluation on ImageNet for both supervised and self-supervised models. Even more exciting, we draw connections between MeTTA, image retrieval, and transformation invariant models. We believe that spreading the success of ensembles to inference higher-quality representations is the important step that will open many new applications of ensembling.


title: Pair production in the millisecond pulsar J0030+0451

abstract: The electric field accelerating electrons in the Timokhin-Arons polar-cap model as applied to millisecond pulsars is so high that the electron Lorentz factors are limited either by radiation reaction or by the Breit-Wheeler process. In the former case, it is possible to obtain an upper limit for curvature radiation momentum components perpendicular to the local magnetic field which is independent of the flux-line radius of curvature. The threshold value for single-photon conversion to pairs is high but is possibly reached in J0030+0451. However, owing to the high polar-cap temperature reported, direct pair production by the Breit-Wheeler process is probably more important. If the existence of coherent radio emission in millisecond pulsars is assumed to need a high-multiplicity pair plasma, then it follows that the primary electrons also produce gamma-rays in the Fermi-LAT energy band for which the magnetosphere is completely transparent. The absence of these, in phase with the radio emission, would be an immediate indication that ultra-high energy electrons and an active Timokhin-Arons polar cap are not present in J0030+0451.


title: Modeling the Magnetization Dynamics for Large Ensembles of Immobilized Magnetic Nanoparticles in Multi-dimensional Magnetic Particle Imaging

abstract: Magnetic nanoparticles (MNPs) play an important role in biomedical applications including imaging modalities such as MRI and magnetic particle imaging (MPI). The latter one exploits the non-linear magnetization response of a large ensemble of magnetic nanoparticles to magnetic fields which allows determining the spatial distribution of the MNP concentration from measured voltage signals. Currently, modeling the voltage signals of large ensembles of MNPs in an MPI environment is not yet accurately possible, especially for liquid tracers in multi-dimensional magnetic excitation fields. Thus, the voltage-to-image mapping is still obtained in a time consuming calibration procedure. While the ferrofluidic case can be seen as the typical setting, more recently immobilized and potentially oriented MNPs have received considerable attention. By aligning the particles during immobilization, one can encode the angle of the easy axis into the magnetization response providing a sophisticated benchmark system for model-based approaches. In this work, we address the modeling problem for immobilized, oriented MNPs in the context of MPI. We investigate a model-based approach where the magnetization response is simulated by a N\'eel rotation model for the particle's magnetic moments and the ensemble magnetization is obtained by solving a Fokker-Planck equation approach. Since the parameters of the model are a-priori unknown, we investigate different methods for performing a parameter identification and discuss two models: One where a single function vector is used from the space spanned by the model parameters and another where a superposition of function vectors is considered. We show that our model can much more accurately reproduce the orientation dependent signal response when compared to the equilibrium model, which marks the current state-of-the-art for model-based system matrix simulations in MPI.


title: The BDF3/EP3 scheme for MBE with no slope selection is stable

abstract: We consider the classical molecular beam epitaxy (MBE) model with logarithmic type potential known as no-slope-selection. We employ a third order backward differentiation (BDF3) in time with implicit treatment of the surface diffusion term. The nonlinear term is approximated by a third order explicit extrapolation (EP3) formula. We exhibit mild time step constraints under which the modified energy dissipation law holds. We break the second Dahlquist barrier and develop a new theoretical framework to prove unconditional uniform energy boundedness with no size restrictions on the time step. This is the first unconditional result for third order BDF methods applied to the MBE models without introducing any stabilization terms or fictitious variables. A novel theoretical framework is also established for the error analysis of high order methods.


title: Hotel Recognition via Latent Image Embedding

abstract: We approach the problem of hotel recognition with deep metric learning. We overview the existing approaches and propose a modification to Contrastive loss called Contrastive-Triplet loss. We construct a robust pipeline for benchmarking metric learning models and perform experiments on Hotels-50K and CUB200 datasets. Contrastive-Triplet loss is shown to achieve better retrieval on Hotels-50k. We open-source our code.


title: CausalNLP: A Practical Toolkit for Causal Inference with Text

abstract: Causal inference is the process of estimating the effect or impact of a treatment on an outcome with other covariates as potential confounders (and mediators) that may need to be controlled. The vast majority of existing methods and systems for causal inference assume that all variables under consideration are categorical or numerical (e.g., gender, price, enrollment). In this paper, we present CausalNLP, a toolkit for inferring causality with observational data that includes text in addition to traditional numerical and categorical variables. CausalNLP employs the use of meta learners for treatment effect estimation and supports using raw text and its linguistic properties as a treatment, an outcome, or a "controlled-for" variable (e.g., confounder). The library is open source and available at: https://github.com/amaiya/causalnlp.


title: Inducing and optimizing Markovian Mpemba effect with stochastic reset

abstract: A hot Markovian system can cool down faster than a colder one: this is known as the Mpemba effect. Here, we show that a non-equilibrium driving via stochastic reset can induce this phenomenon, when absent. Moreover, we derive an optimal driving protocol simultaneously optimizing the appearance time of the Mpemba effect, and the total energy dissipation into the environment, revealing the existence of a Pareto front. Building upon previous experimental results, our findings open up the avenue of possible experimental realizations of optimal cooling protocols in Markovian systems.


title: Object detection and Autoencoder-based 6D pose estimation for highly cluttered Bin Picking

abstract: Bin picking is a core problem in industrial environments and robotics, with its main module as 6D pose estimation. However, industrial depth sensors have a lack of accuracy when it comes to small objects. Therefore, we propose a framework for pose estimation in highly cluttered scenes with small objects, which mainly relies on RGB data and makes use of depth information only for pose refinement. In this work, we compare synthetic data generation approaches for object detection and pose estimation and introduce a pose filtering algorithm that determines the most accurate estimated poses. We will make our


title: Collective skyrmion motion under the influence of an additional interfacial spin-transfer torque

abstract: Here we study the effect of an additional interfacial spin-transfer torque, as well as the well established spin-orbit torque and bulk spin-transfer torque, on skyrmion collections - group of skyrmions dense enough that they are not isolated from on another - in ultrathin heavy metal / ferromagnetic multilayers, by comparing modelling with experimental results. Using a skyrmion collection with a range of skyrmion diameters and landscape disorder, we study the dependence of the skyrmion Hall angle on diameter and velocity, as well as the velocity as a function of diameter. We show the experimental results are in good agreement with modelling when including the interfacial spin-transfer torque, and cannot be reproduced by using the spin-orbit torque alone. We also show that for skyrmion collections the velocity is approximately independent of diameter, in marked contrast to the motion of isolated skyrmions, as the group of skyrmions move together at an average group velocity. Moreover, the calculated skyrmion velocities are comparable to those obtained in experiments when the interfacial spin-transfer torque in included, whilst modelling using the spin-orbit torque alone shows large discrepancies with the experimental data. Our results thus show the significance of the interfacial spin-transfer torque in ultrathin magnetic multilayers, which is of similar strength to the spin-orbit torque, and both significantly larger than the bulk spin-transfer torque. Due to the good agreement with experiments, we conclude that the interfacial spin-transfer torque should be included in numerical modelling for correct reproduction of experimental results.


title: Comparisons of Australian Mental Health Distributions

abstract: Bayesian nonparametric estimates of Australian mental health distributions are obtained to assess how the mental health status of the population has changed over time and to compare the mental health status of female/male and indigenous/non-indigenous population subgroups. First- and second-order stochastic dominance are used to compare distributions, with results presented in terms of the posterior probability of dominance and the posterior probability of no dominance. Our results suggest mental health has deteriorated in recent years, that males mental health status is better than that of females, and non-indigenous health status is better than that of the indigenous population.


title: Epidemic modelling of multiple virus strains: a case study of SARS-CoV-2 B.1.1.7 in Moscow

abstract: During a long-running pandemic a pathogen can mutate, producing new strains with different epidemiological parameters. Existing approaches to epidemic modelling only consider one virus strain. We have developed a modified SEIR model to simulate multiple virus strains within the same population. As a case study, we investigate the potential effects of SARS-CoV-2 strain B.1.1.7 on the city of Moscow. Our analysis indicates a high risk of a new wave of infections in September-October 2021 with up to 35 000 daily infections at peak. We open-source our code and data.


title: Demographic Fairness in Face Identification: The Watchlist Imbalance Effect

abstract: Recently, different researchers have found that the gallery composition of a face database can induce performance differentials to facial identification systems in which a probe image is compared against up to all stored reference images to reach a biometric decision. This negative effect is referred to as "watchlist imbalance effect". In this work, we present a method to theoretically estimate said effect for a biometric identification system given its verification performance across demographic groups and the composition of the used gallery. Further, we report results for identification experiments on differently composed demographic subsets, i.e. females and males, of the public academic MORPH database using the open-source ArcFace face recognition system. It is shown that the database composition has a huge impact on performance differentials in biometric identification systems, even if performance differentials are less pronounced in the verification scenario. This study represents the first detailed analysis of the watchlist imbalance effect which is expected to be of high interest for future research in the field of facial recognition.


title: Residual Reinforcement Learning from Demonstrations

abstract: Residual reinforcement learning (RL) has been proposed as a way to solve challenging robotic tasks by adapting control actions from a conventional feedback controller to maximize a reward signal. We extend the residual formulation to learn from visual inputs and sparse rewards using demonstrations. Learning from images, proprioceptive inputs and a sparse task-completion reward relaxes the requirement of accessing full state features, such as object and target positions. In addition, replacing the base controller with a policy learned from demonstrations removes the dependency on a hand-engineered controller in favour of a dataset of demonstrations, which can be provided by non-experts. Our experimental evaluation on simulated manipulation tasks on a 6-DoF UR5 arm and a 28-DoF dexterous hand demonstrates that residual RL from demonstrations is able to generalize to unseen environment conditions more flexibly than either behavioral cloning or RL fine-tuning, and is capable of solving high-dimensional, sparse-reward tasks out of reach for RL from scratch.


title: Convergence of the KPZ line ensemble

abstract: In this paper we study the KPZ line ensembles under the KPZ scaling. Based on their Gibbs property, we derive quantitative local fluctuation estimates for the scaled KPZ line ensembles. This allows us to show that the family of scaled KPZ line ensembles is tight. Together with the recent progress in [QS20], [Vir], and [DM], the tightness result yields the conjectural convergence of the scaled KPZ line ensembles to the Airy line ensemble.


title: Brownian regularity for the KPZ line ensemble

abstract: This paper seeks a quantitative comparison between the curves in the KPZ line ensemble [CH16] and a standard Brownian bridge under the $t^{1/3}$ vertical and $t^{2/3}$ horizontal scaling. The estimate we obtained is parallel to the one established in [Ham1], where the Airy line ensemble was studied. Our main tool is the soft Brownian Gibbs property enjoyed by the KPZ line ensemble. In view of the Gibbs property, the KPZ line ensemble differs from the Airy line ensemble mainly due to the intersecting nature of its curves, which results in the main technical difficulty in this paper. We develop a resampling framework, the soft jump ensemble, to tackle this difficulty. Our method is highly inspired by the jump ensemble technique developed in [Ham1].


title: On the Power of Multitask Representation Learning in Linear MDP

abstract: While multitask representation learning has become a popular approach in reinforcement learning (RL), theoretical understanding of why and when it works remains limited. This paper presents analyses for the statistical benefit of multitask representation learning in linear Markov Decision Process (MDP) under a generative model. In this paper, we consider an agent to learn a representation function $\phi$ out of a function class $\Phi$ from $T$ source tasks with $N$ data per task, and then use the learned $\hat{\phi}$ to reduce the required number of sample for a new task. We first discover a \emph{Least-Activated-Feature-Abundance} (LAFA) criterion, denoted as $\kappa$, with which we prove that a straightforward least-square algorithm learns a policy which is $\tilde{O}(H^2\sqrt{\frac{\mathcal{C}(\Phi)^2 \kappa d}{NT}+\frac{\kappa d}{n}})$ sub-optimal. Here $H$ is the planning horizon, $\mathcal{C}(\Phi)$ is $\Phi$'s complexity measure, $d$ is the dimension of the representation (usually $d\ll \mathcal{C}(\Phi)$) and $n$ is the number of samples for the new task. Thus the required $n$ is $O(\kappa d H^4)$ for the sub-optimality to be close to zero, which is much smaller than $O(\mathcal{C}(\Phi)^2\kappa d H^4)$ in the setting without multitask representation learning, whose sub-optimality gap is $\tilde{O}(H^2\sqrt{\frac{\kappa \mathcal{C}(\Phi)^2d}{n}})$. This theoretically explains the power of multitask representation learning in reducing sample complexity. Further, we note that to ensure high sample efficiency, the LAFA criterion $\kappa$ should be small. In fact, $\kappa$ varies widely in magnitude depending on the different sampling distribution for new task. This indicates adaptive sampling technique is important to make $\kappa$ solely depend on $d$. Finally, we provide empirical results of a noisy grid-world environment to corroborate our theoretical findings.


title: Rough paths and regularization

abstract: Calculus via regularizations and rough paths are two methods to approach stochastic integration and calculus close to pathwise calculus. The origin of rough paths theory is purely deterministic, calculus via regularization is based on deterministic techniques but there is still a probability in the background. The goal of this paper is to establish a connection between stochastically controlled-type processes, a concept reminiscent from rough paths theory, and the so-called weak Dirichlet processes. As a by-product, we present the connection between rough and Stratonovich integrals for c{\`a}dl{\`a}g weak Dirichlet processes integrands and continuous semimartingales integrators.


title: Loop space decompositions of $(2n-2)$-connected $(4n-1)$-dimensional Poincar\'{e} Duality complexes

abstract: Beben and Wu showed that if $M$ is a $(2n-2)$-connected $(4n-1)$-dimensional Poincar\'{e} Duality complex such that $n\geq 3$ and $H^{2n}(M;\mathbb{Z})$ consists only of odd torsion, then $\Omega M$ can be decomposed up to homotopy as a product of simpler, well studied spaces. We use a result from \cite{BT2} to greatly simplify and enhance Beben and Wu's work and to extend it in various directions.


title: Coupled Gradient Estimators for Discrete Latent Variables

abstract: Training models with discrete latent variables is challenging due to the high variance of unbiased gradient estimators. While low-variance reparameterization gradients of a continuous relaxation can provide an effective solution, a continuous relaxation is not always available or tractable. Dong et al. (2020) and Yin et al. (2020) introduced a performant estimator that does not rely on continuous relaxations; however, it is limited to binary random variables. We introduce a novel derivation of their estimator based on importance sampling and statistical couplings, which we extend to the categorical setting. Motivated by the construction of a stick-breaking coupling, we introduce gradient estimators based on reparameterizing categorical variables as sequences of binary variables and Rao-Blackwellization. In systematic experiments, we show that our proposed categorical gradient estimators provide state-of-the-art performance, whereas even with additional Rao-Blackwellization, previous estimators (Yin et al., 2019) underperform a simpler REINFORCE with a leave-one-out-baseline estimator (Kool et al., 2019).


title: The $(k,l)$-Euler theorem and the combinatorics of $(k,l)$-sequences

abstract: In 1997, Bousquet-M\'elou and Eriksson stated a broad generalization of Euler's distinct-odd partition theorem, namely the $(k,l)$-Euler theorem. Their identity involved the $(k,l)$-lecture-hall partitions, which, unlike usual difference conditions of partitions in Rogers-Ramanujan type identities, satisfy some ratio constraints. In a 2008 paper, in response to a question suggested by Richard Stanley, Savage and Yee provided a simple bijection for the $l$-lecture-hall partitions (the case $k=l$), whose specialization in $l=2$ corresponds to Sylvester's bijection. Subsequently, as an open question, a generalization of their bijection was suggested for the case $k,l\geq 2$. In the spirit of Savage and Yee's work, we provide and prove in this paper slight variations of the suggested bijection, not only for the case $k,l\geq 2$ but also for the cases $(k,1)$ and $(1,k)$ with $k\geq 4$. Furthermore, we show that our bijections equal the recursive bijections given by Bousquet-M\'elou and Eriksson in their recursive proof of the $(k,l)$-lecture hall and finally provide the analogous recursive bijection for the $(k,l)$-Euler theorem.


title: Partial $\gamma$-Positivity for Quasi-Stirling Permutations of Multisets

abstract: We prove that the enumerative polynomials of quasi-Stirling permutations of multisets with respect to the statistics of plateaux, descents and ascents are partial $\gamma$-positive, thereby confirming a recent conjecture posed by Lin, Ma and Zhang. This is accomplished by proving the partial $\gamma$-positivity of the enumerative polynomials of certain ordered labeled trees, which are in bijection with quasi-Stirling permutations of multisets. As an application, we provide an alternative proof of the partial $\gamma$-positivity of the enumerative polynomials on Stirling permutations of multisets.


title: Real-time Pose and Shape Reconstruction of Two Interacting Hands With a Single Depth Camera

abstract: We present a novel method for real-time pose and shape reconstruction of two strongly interacting hands. Our approach is the first two-hand tracking solution that combines an extensive list of favorable properties, namely it is marker-less, uses a single consumer-level depth camera, runs in real time, handles inter- and intra-hand collisions, and automatically adjusts to the user's hand shape. In order to achieve this, we embed a recent parametric hand pose and shape model and a dense correspondence predictor based on a deep neural network into a suitable energy minimization framework. For training the correspondence prediction network, we synthesize a two-hand dataset based on physical simulations that includes both hand pose and shape annotations while at the same time avoiding inter-hand penetrations. To achieve real-time rates, we phrase the model fitting in terms of a nonlinear least-squares problem so that the energy can be optimized based on a highly efficient GPU-based Gauss-Newton optimizer. We show state-of-the-art results in scenes that exceed the complexity level demonstrated by previous work, including tight two-hand grasps, significant inter-hand occlusions, and gesture interaction.


title: Privacy Assessment of Federated Learning using Private Personalized Layers

abstract: Federated Learning (FL) is a collaborative scheme to train a learning model across multiple participants without sharing data. While FL is a clear step forward towards enforcing users' privacy, different inference attacks have been developed. In this paper, we quantify the utility and privacy trade-off of a FL scheme using private personalized layers. While this scheme has been proposed as local adaptation to improve the accuracy of the model through local personalization, it has also the advantage to minimize the information about the model exchanged with the server. However, the privacy of such a scheme has never been quantified. Our evaluations using motion sensor dataset show that personalized layers speed up the convergence of the model and slightly improve the accuracy for all users compared to a standard FL scheme while better preventing both attribute and membership inferences compared to a FL scheme using local differential privacy.


title: Relation Modeling in Spatio-Temporal Action Localization

abstract: This paper presents our solution to the AVA-Kinetics Crossover Challenge of ActivityNet workshop at CVPR 2021. Our solution utilizes multiple types of relation modeling methods for spatio-temporal action detection and adopts a training strategy to integrate multiple relation modeling in end-to-end training over the two large-scale video datasets. Learning with memory bank and finetuning for long-tailed distribution are also investigated to further improve the performance. In this paper, we detail the implementations of our solution and provide experiments results and corresponding discussions. We finally achieve 40.67 mAP on the test set of AVA-Kinetics.


title: SSMix: Saliency-Based Span Mixup for Text Classification

abstract: Data augmentation with mixup has shown to be effective on various computer vision tasks. Despite its great success, there has been a hurdle to apply mixup to NLP tasks since text consists of discrete tokens with variable length. In this work, we propose SSMix, a novel mixup method where the operation is performed on input text rather than on hidden vectors like previous approaches. SSMix synthesizes a sentence while preserving the locality of two original texts by span-based mixing and keeping more tokens related to the prediction relying on saliency information. With extensive experiments, we empirically validate that our method outperforms hidden-level mixup methods on a wide range of text classification benchmarks, including textual entailment, sentiment classification, and question-type classification. Our code is available at https://github.com/clovaai/ssmix.


title: Unit-regular and semi-balanced elements in various semigroups of transformations

abstract: Let $T(X)$ be the full transformation semigroup on a set $X$, and let $L(V)$ be the semigroup under composition of all linear transformations on a vector space $V$ over a field. For a subset $Y$ of $X$ and a subspace $W$ of $V$, consider the semigroups $\overline{T}(X, Y) = \{f\in T(X)\colon Yf \subseteq Y\}$ and $\overline{L}(V, W) = \{f\in L(V)\colon Wf \subseteq W\}$ under composition. We describe unit-regular elements in $\overline{T}(X, Y)$ and $\overline{L}(V, W)$. Using these, we determine when $\overline{T}(X, Y)$ and $\overline{L}(V, W)$ are unit-regular. We prove that $f\in L(V)$ is unit-regular if and only if ${\rm nullity}(f) = {\rm corank}(f)$. We alternatively prove that $L(V)$ is unit-regular if and only if $V$ is finite-dimensional. A semi-balanced semigroup is a transformation semigroup whose all elements are semi-balanced. We give necessary and sufficient conditions for $\overline{T}(X, Y)$, $\overline{L}(V, W)$ and $L(V)$ to be semi-balanced.


title: Generating Contrastive Explanations for Inductive Logic Programming Based on a Near Miss Approach

abstract: In recent research, human-understandable explanations of machine learning models have received a lot of attention. Often explanations are given in form of model simplifications or visualizations. However, as shown in cognitive science as well as in early AI research, concept understanding can also be improved by the alignment of a given instance for a concept with a similar counterexample. Contrasting a given instance with a structurally similar example which does not belong to the concept highlights what characteristics are necessary for concept membership. Such near misses have been proposed by Winston (1970) as efficient guidance for learning in relational domains. We introduce an explanation generation algorithm for relational concepts learned with Inductive Logic Programming (\textsc{GeNME}). The algorithm identifies near miss examples from a given set of instances and ranks these examples by their degree of closeness to a specific positive instance. A modified rule which covers the near miss but not the original instance is given as an explanation. We illustrate \textsc{GeNME} with the well known family domain consisting of kinship relations, the visual relational Winston arches domain and a real-world domain dealing with file management. We also present a psychological experiment comparing human preferences of rule-based, example-based, and near miss explanations in the family and the arches domains.


title: Strong Lagrangian solutions of the (relativistic) Vlasov-Poisson system for non-smooth, spherically symmetric data

abstract: We prove a local existence and uniqueness result for the non-relativistic and relativistic Vlasov-Poisson system for data which need not even be continuous. The corresponding solutions preserve all the standard conserved quantities and are constant along their pointwise defined characteristic flow so that these solutions are suitable for the stability analysis of not necessarily smooth steady states. They satisfy the well-known continuation criterion and are global in the non-relativistic case. The only unwanted requirement on the data is that they be spherically symmetric.


title: Re-examining the Philosophical Underpinnings of the Melting Pot vs. Multiculturalism in the Current Immigration Debate in the United States

abstract: Immigration to the United States is certainly not a new phenomenon, and it is therefore natural for immigration, culture and identity to be given due attention by the public and policy makers. However, current discussion of immigration, legal and illegal, and the philosophical underpinnings is lost in translation, not necessarily on ideological lines, but on political orientation. In this paper we reexamine the philosophical underpinnings of the melting pot versus multiculturalism as antecedents and precedents of current immigration debate and how the core issues are lost in translation. We take a brief look at immigrants and the economy to situate the current immigration debate. We then discuss the two philosophical approaches to immigration and how the understanding of the philosophical foundations can help streamline the current immigration debate.


title: Stochastic fluctuations in protein interaction networks are nearly Poissonian

abstract: Gene regulatory networks are comprised of biochemical reactions, which are inherently stochastic. Each reaction channel contributes to this stochasticity in different measure. In this paper we study the stochastic dynamics of protein interaction networks (PIN) that are made up of monomers and dimers. The network is defined by the dimers, which are formed by hybridizing two monomers. The size of a PIN was defined as the number of monomers that interacts with at least one other monomer (including itself). We generated 4200 random PIN of sizes between 2 and 8 (600 per size) and simulated via the Gillespie algorithm the stochastic evolution of copy numbers of all monomers and dimers until they reached a steady state. The simulations revealed that the Fano factors of both monomers and dimers in all networks and for all time points were close to one, either from below or above. Only 10% of Fano factors for monomers were above 1.3 and 10% of Fano factors for dimers were above 1.17, with 5.54 and 3.47 as the maximum value recorded for monomers and dimers, respectively. These findings suggests that PIN in real biological setting contribute to the overall stochastic noise that is close to Poisson. Our results also show a correlation between stochastic noise, network size and network connectivity: for monomers, the Fano factors tend towards 1 from above, while the Fano factors for dimers tend towards 1 from below. For monomers, this tendency is amplified with increased network connectivity.


title: An Analytical Theory of Curriculum Learning in Teacher-Student Networks

abstract: In humans and animals, curriculum learning -- presenting data in a curated order - is critical to rapid learning and effective pedagogy. Yet in machine learning, curricula are not widely used and empirically often yield only moderate benefits. This stark difference in the importance of curriculum raises a fundamental theoretical question: when and why does curriculum learning help? In this work, we analyse a prototypical neural network model of curriculum learning in the high-dimensional limit, employing statistical physics methods. Curricula could in principle change both the learning speed and asymptotic performance of a model. To study the former, we provide an exact description of the online learning setting, confirming the long-standing experimental observation that curricula can modestly speed up learning. To study the latter, we derive performance in a batch learning setting, in which a network trains to convergence in successive phases of learning on dataset slices of varying difficulty. With standard training losses, curriculum does not provide generalisation benefit, in line with empirical observations. However, we show that by connecting different learning phases through simple Gaussian priors, curriculum can yield a large improvement in test performance. Taken together, our reduced analytical descriptions help reconcile apparently conflicting empirical results and trace regimes where curriculum learning yields the largest gains. More broadly, our results suggest that fully exploiting a curriculum may require explicit changes to the loss function at curriculum boundaries.


title: Cyclic and Linear Graph Partitions and Normal Ordering

abstract: The Stirling number of a simple graph is the number of partitions of its vertex set into a specific number of non-empty independent sets. In 2015, Engbers et al. showed that the coefficients in the normal ordering of a word $w$ in the alphabet $\{x,D\}$ subject to the relation $Dx=xD+1$ are equal to the Stirling number of certain graphs constructed from $w$. In this paper, we introduce graphical versions of the Stirling numbers of the first kind and the Lah numbers and show how they occur as coefficients in other normal ordering settings. Identities involving their $q$-analogues are also obtained.


title: Constraining Wormhole Geometries using the Orbit of S2 Star and the Event Horizon Telescope

abstract: In this paper we study the possibility of having a wormhole (WH) as a candidate for the Sgr A$^\star$ central object and test this idea by constraining their geometry using the motion of S2 star and the reconstructed shadow images. In particular, we consider three WH models, including WHs in Einstein theory, brane-world gravity, and Einstein-Dirac-Maxwell theory. To this end, we have constrained the WH throat using the motion of S2 star and shown that the flare out condition is satisfied. We also consider the accretion of infalling gas model and study the accretion rate and the intensity of the electromagnetic radiation as well as the shadow images.


title: Photoelectron circular dichroism of O 1$s$-photoelectrons of uniaxially oriented trifluoromethyloxirane: Energy dependence and sensitivity to molecular configuration

abstract: The photoelectron circular dichroism (PECD) of the O 1s-photoelectrons of trifluoromethyloxirane(TFMOx) is studied experimentally and theoretically for different photoelectron kinetic energies. The experiments were performed employing circularly polarized synchrotron radiation and coincidentelectron and fragment ion detection using Cold Target Recoil Ion Momentum Spectroscopy. The corresponding calculations were performed by means of the Single Center method within the relaxed-core Hartree-Fock approximation. We concentrate on the energy dependence of the differential PECD of uniaxially oriented TFMOx molecules, which is accessible through the employed coincident detection. We also compare results for differential PECD of TFMOx to those obtained for the equivalent fragmentation channel and similar photoelectron kinetic energy of methyloxirane (MOx), studied in our previous work. Thereby, we investigate the influence of the substitution of the methyl-group by the trifluoromethyl-group at the chiral center on the molecular chiral response. Finally, the presently obtained angular distribution parameters are compared to those available in literature.


title: Full Bitcoin Blockchain Data Made Easy

abstract: Despite the fact that it is publicly available, collecting and processing the full bitcoin blockchain data is not trivial. Its mere size, history, and other features indeed raise quite specific challenges, that we address in this paper. The strengths of our approach are the following: it relies on very basic and standard tools, which makes the procedure reliable and easily reproducible; it is a purely lossless procedure ensuring that we catch and preserve all existing data; it provides additional indexing that makes it easy to further process the whole data and select appropriate subsets of it. We present our procedure in details and illustrate its added value on large-scale use cases, like address clustering. We provide an implementation online, as well as the obtained dataset.


title: Mutation Sensitive Correlation Filter for Real-Time UAV Tracking with Adaptive Hybrid Label

abstract: Unmanned aerial vehicle (UAV) based visual tracking has been confronted with numerous challenges, e.g., object motion and occlusion. These challenges generally introduce unexpected mutations of target appearance and result in tracking failure. However, prevalent discriminative correlation filter (DCF) based trackers are insensitive to target mutations due to a predefined label, which concentrates on merely the centre of the training region. Meanwhile, appearance mutations caused by occlusion or similar objects usually lead to the inevitable learning of wrong information. To cope with appearance mutations, this paper proposes a novel DCF-based method to enhance the sensitivity and resistance to mutations with an adaptive hybrid label, i.e., MSCF. The ideal label is optimized jointly with the correlation filter and remains temporal consistency. Besides, a novel measurement of mutations called mutation threat factor (MTF) is applied to correct the label dynamically. Considerable experiments are conducted on widely used UAV benchmarks. The results indicate that the performance of MSCF tracker surpasses other 26 state-of-the-art DCF-based and deep-based trackers. With a real-time speed of _38 frames/s, the proposed approach is sufficient for UAV tracking commissions.


title: On Star Expressions and Coalgebraic Completeness Theorems

abstract: An open problem posed by Milner asks for a proof that a certain axiomatisation, which Milner showed is sound with respect to bisimilarity for regular expressions, is also complete. One of the main difficulties of the problem is the lack of a full Kleene theorem, since there are automata that can not be specified, up to bisimilarity, by an expression. Grabmayer and Fokkink (2020) characterise those automata that can be expressed by regular expressions without the constant 1, and use this characterisation to give a positive answer to Milner's question for this subset of expressions. In this paper, we analyse Grabmayer and Fokkink's proof of completeness from the perspective of universal coalgebra, and thereby give an abstract account of their proof method. We then compare this proof method to another approach to completeness proofs from coalgebraic language theory. This culminates in two abstract proof methods for completeness, what we call the local and global approaches, and a description of when one method can be used in place of the other.


title: Quantum algorithm for matrix functions by Cauchy's integral formula

abstract: For matrix $A$, vector $\boldsymbol{b}$ and function $f$, the computation of vector $f(A)\boldsymbol{b}$ arises in many scientific computing applications. We consider the problem of obtaining quantum state $\lvert f \rangle$ corresponding to vector $f(A)\boldsymbol{b}$. There is a quantum algorithm to compute state $\lvert f \rangle$ using eigenvalue estimation that uses phase estimation and Hamiltonian simulation $\mathrm{e}^{\mathrm{{\bf i}} A t}$. However, the algorithm based on eigenvalue estimation needs $\textrm{poly}(1/\epsilon)$ runtime, where $\epsilon$ is the desired accuracy of the output state. Moreover, if matrix $A$ is not Hermitian, $\mathrm{e}^{\mathrm{{\bf i}} A t}$ is not unitary and we cannot run eigenvalue estimation. In this paper, we propose a quantum algorithm that uses Cauchy's integral formula and the trapezoidal rule as an approach that avoids eigenvalue estimation. We show that the runtime of the algorithm is $\mathrm{poly}(\log(1/\epsilon))$ and the algorithm outputs state $\lvert f \rangle$ even if $A$ is not Hermitian.


title: Quantum Algorithms based on the Block-Encoding Framework for Matrix Functions by Contour Integrals

abstract: The matrix functions can be defined by Cauchy's integral formula and can be approximated by the linear combination of inverses of shifted matrices using a quadrature formula. In this paper, we show a concrete construction of a framework to implement the linear combination of the inverses on quantum computers and propose a quantum algorithm for matrix functions based on the framework. Compared with the previous study [S. Takahira, A. Ohashi, T. Sogabe, and T.S. Usuda, Quant. Inf. Comput., 20, 1&2, 14--36, (Feb. 2020)] that proposed a quantum algorithm to compute a quantum state for the matrix function based on the circular contour centered at the origin, the quantum algorithm in the present paper can be applied to a more general contour. Moreover, the algorithm is described by the block-encoding framework. Similarly to the previous study, the algorithm can be applied even if the input matrix is not a Hermitian or normal matrix.


title: Computer-aided Interpretable Features for Leaf Image Classification

abstract: Plant species identification is time consuming, costly, and requires lots of efforts, and expertise knowledge. In recent, many researchers use deep learning methods to classify plants directly using plant images. While deep learning models have achieved a great success, the lack of interpretability limit their widespread application. To overcome this, we explore the use of interpretable, measurable and computer-aided features extracted from plant leaf images. Image processing is one of the most challenging, and crucial steps in feature-extraction. The purpose of image processing is to improve the leaf image by removing undesired distortion. The main image processing steps of our algorithm involves: i) Convert original image to RGB (Red-Green-Blue) image, ii) Gray scaling, iii) Gaussian smoothing, iv) Binary thresholding, v) Remove stalk, vi) Closing holes, and vii) Resize image. The next step after image processing is to extract features from plant leaf images. We introduced 52 computationally efficient features to classify plant species. These features are mainly classified into four groups as: i) shape-based features, ii) color-based features, iii) texture-based features, and iv) scagnostic features. Length, width, area, texture correlation, monotonicity and scagnostics are to name few of them. We explore the ability of features to discriminate the classes of interest under supervised learning and unsupervised learning settings. For that, supervised dimensionality reduction technique, Linear Discriminant Analysis (LDA), and unsupervised dimensionality reduction technique, Principal Component Analysis (PCA) are used to convert and visualize the images from digital-image space to feature space. The results show that the features are sufficient to discriminate the classes of interest under both supervised and unsupervised learning settings.


title: Time-free solution to independent set problem using P systems with active membranes

abstract: Membrane computing is a branch of natural computingwhich abstracts fromthe structure and the functioning of living cells. The computation models obtained in the field of membrane computing are usually called P systems. P systems have been used to solve computationally hard problems efficiently on the assumption that the execution of each rule is completed in exactly one time-unit (a global clock is assumed for timing and synchronizing the execution of rules). However, in biological reality, different biological processes take different times to be completed, which can also be influenced by many environmental factors. In this work, with this biological reality, we give a time-free solution to independent set problemusing P systems with active membranes, which solve the problem independent of the execution time of the involved rules.


title: Ergodicity and equidistribution in Hilbert geometry

abstract: We show that dynamical and counting results characteristic of negatively-curved Riemannian geometry, or more generally CAT($-1$) or rank-one CAT($0$) spaces, also hold for rank-one properly convex projective structures, equipped with their Hilbert metrics, admitting finite Sullivan measures built from appropriate conformal densities. In particular, this includes geometrically finite convex projective structures. More specifically, with respect to the Sullivan measure, the Hilbert geodesic flow is strongly mixing, and orbits and primitive closed geodesics equidistribute, allowing us to asymptotically enumerate these objects.


title: Epidemic dynamics on metapopulation networks with node2vec mobility

abstract: Metapopulation models have been a powerful tool for both theorizing and simulating epidemic dynamics. In a metapopulation model, one considers a network composed of subpopulations and their pairwise connections, and individuals are assumed to migrate from one subpopulation to another obeying a given mobility rule. While how different mobility rules affect epidemic dynamics in metapopulation models has been studied, there have been relatively few efforts on comparison of the effects of simple (i.e., unbiased) random walks and more complex mobility rules. Here we study a susceptible-infectious-susceptible (SIS) dynamics in a metapopulation model, in which individuals obey a parametric second-order random-walk mobility rule called the node2vec. We map the second-order mobility rule of the node2vec to a first-order random walk in a network whose each node is a directed edge connecting a pair of subpopulations and then derive the epidemic threshold. For various networks, we find that the epidemic threshold is large (therefore, epidemic spreading tends to be suppressed) when the individuals infrequently backtrack or infrequently visit the common neighbors of the currently visited and the last visited subpopulations than when the individuals obey the simple random walk. The amount of change in the epidemic threshold induced by the node2vec mobility is in general not as large as, but is sometimes comparable with, the one induced by the change in the diffusion rate for individuals.


title: Center regions as a solution to the Gribov problem of the center vortex model

abstract: The center vortex model, capable of explaining confinement and chiral symmetry breaking, has been plagued by the lattice equivalent of Gribov copies: different maxima of the gauge functional lead to different predictions of the string tension. It is possible to resolve this problem using center regions, loops evaluating to center elements, as guide for the gauge fixing procedure. The success of this approach was already shown, but the algorithms came with an arbitrary free parameter. In recent development this parameter has been fixed, even improving the results.


title: Double Calculus

abstract: We present a streamlined, slightly modified version, in the two-variable situation, of a beautiful, but not so well known, theory by B\"{o}gel, already from the 1930s, on an alternative higher dimensional calculus of real functions, a double calculus, which includes two-variable extensions of many classical results from single variable calculus, such as Rolle's theorem, Lagrange's mean value theorem, Cauchy's mean value theorem, Fermat's extremum theorem, the first derivative test, and the first and second fundamental theorems of calculus.


title: Cardinality-constrained optimization problems in general position and beyond

abstract: We study cardinality-constrained optimization problems (CCOP) in general position, i. e. those optimization-related properties that are fulfilled for a dense and open subset of their defining functions. We show that the well-known cardinality-constrained linear independence constraint qualification (CC-LICQ) is generic in this sense. For M-stationary points we define nondegeneracy and show that it is a generic property too. In particular, the sparsity constraint turns out to be active at all minimizers of a generic CCOP. Moreover, we describe the global structure of CCOP in the sense of Morse theory, emphasizing the strength of the generic approach. Here, we prove that multiple cells need to be attached, each of dimension coinciding with the proposed M-index of nondegenerate M-stationary points. Beyond this generic viewpoint, we study singularities of CCOP. For that, the relation between nondegeneracy and strong stability in the sense of Kojima (1980) is examined. We show that nondegeneracy implies the latter, while the reverse implication is in general not true. To fill the gap, we fully characterize the strong stability of M-stationary points under CC-LICQ by first- and second-order information of CCOP defining functions. Finally, we compare nondegeneracy and strong stability of M-stationary points with second-order sufficient conditions recently introduced in the literature.


title: Asymptotic analysis of domain decomposition for optimal transport

abstract: Large optimal transport problems can be approached via domain decomposition, i.e. by iteratively solving small partial problems independently and in parallel. Convergence to the global minimizers under suitable assumptions has been shown in the unregularized and entropy regularized setting and its computational efficiency has been demonstrated experimentally. An accurate theoretical understanding of its convergence speed in geometric settings is still lacking. In this article we work towards such an understanding by deriving, via $\Gamma$-convergence, an asymptotic description of the algorithm in the limit of infinitely fine partition cells. The limit trajectory of couplings is described by a continuity equation on the product space where the momentum is purely horizontal and driven by the gradient of the cost function. Convergence hinges on a regularity assumption that we investigate in detail. Global optimality of the limit trajectories remains an interesting open problem, even when global optimality is established at finite scales. Our result provides insights about the efficiency of the domain decomposition algorithm at finite resolutions and in combination with coarse-to-fine schemes.


title: Natural continual learning: success is a journey, not (just) a destination

abstract: Biological agents are known to learn many different tasks over the course of their lives, and to be able to revisit previous tasks and behaviors with little to no loss in performance. In contrast, artificial agents are prone to 'catastrophic forgetting' whereby performance on previous tasks deteriorates rapidly as new ones are acquired. This shortcoming has recently been addressed using methods that encourage parameters to stay close to those used for previous tasks. This can be done by (i) using specific parameter regularizers that map out suitable destinations in parameter space, or (ii) guiding the optimization journey by projecting gradients into subspaces that do not interfere with previous tasks. However, these methods often exhibit subpar performance in both feedforward and recurrent neural networks, with recurrent networks being of interest to the study of neural dynamics supporting biological continual learning. In this work, we propose Natural Continual Learning (NCL), a new method that unifies weight regularization and projected gradient descent. NCL uses Bayesian weight regularization to encourage good performance on all tasks at convergence and combines this with gradient projection using the prior precision, which prevents catastrophic forgetting during optimization. Our method outperforms both standard weight regularization techniques and projection based approaches when applied to continual learning problems in feedforward and recurrent networks. Finally, the trained networks evolve task-specific dynamics that are strongly preserved as new tasks are learned, similar to experimental findings in biological circuits.


title: Decomposition of Global Feature Importance into Direct and Associative Components (DEDACT)

abstract: Global model-agnostic feature importance measures either quantify whether features are directly used for a model's predictions (direct importance) or whether they contain prediction-relevant information (associative importance). Direct importance provides causal insight into the model's mechanism, yet it fails to expose the leakage of information from associated but not directly used variables. In contrast, associative importance exposes information leakage but does not provide causal insight into the model's mechanism. We introduce DEDACT - a framework to decompose well-established direct and associative importance measures into their respective associative and direct components. DEDACT provides insight into both the sources of prediction-relevant information in the data and the direct and indirect feature pathways by which the information enters the model. We demonstrate the method's usefulness on simulated examples.


title: CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmark

abstract: Artificial Intelligence (AI), along with the recent progress in biomedical language understanding, is gradually changing medical practice. With the development of biomedical language understanding benchmarks, AI applications are widely used in the medical field. However, most benchmarks are limited to English, which makes it challenging to replicate many of the successes in English for other languages. To facilitate research in this direction, we collect real-world biomedical data and present the first Chinese Biomedical Language Understanding Evaluation (CBLUE) benchmark: a collection of natural language understanding tasks including named entity recognition, information extraction, clinical diagnosis normalization, single-sentence/sentence-pair classification, and an associated online platform for model evaluation, comparison, and analysis. To establish evaluation on these tasks, we report empirical results with the current 11 pre-trained Chinese models, and experimental results show that state-of-the-art neural models perform by far worse than the human ceiling. Our benchmark is released at \url{https://tianchi.aliyun.com/dataset/dataDetail?dataId=95414&lang=en-us}.


title: Heterogeneous Multi-sensor Fusion with Random Finite Set Multi-object Densities

abstract: This paper addresses the density based multi-sensor cooperative fusion using random finite set (RFS) type multi-object densities (MODs). Existing fusion methods use scalar weights to characterize the relative information confidence among the local MODs, and in this way the portion of contribution of each local MOD to the fused global MOD can be tuned via adjusting these weights. Our analysis shows that the fusion mechanism of using a scalar coefficient can be oversimplified for practical scenarios, as the information confidence of an MOD is complex and usually space-varying due to the imperfection of sensor ability and the various impacts from surveillance environment. Consequently, severe fusion performance degradation can be observed when these scalar weights fail to reflect the actual situation. We make two contributions towards addressing this problem. Firstly, we propose a novel heterogeneous fusion method to perform the information averaging among local RFS MODs. By factorizing each local MODs into a number of smaller size sub-MODs, it can transform the original complicated fusion problem into a much easier parallelizable multi-cluster fusion problem. Secondly, as the proposed fusion strategy is a general procedure without any particular model assumptions, we further derive the detailed heterogeneous fusion equations, with centralized network architecture, for both the probability hypothesis density (PHD) filter and the multi-Bernoulli (MB) filter. The Gaussian mixture implementations of the proposed fusion algorithms are also presented. Various numerical experiments are designed to demonstrate the efficacy of the proposed fusion methods.


title: Patterson--Sullivan densities in convex projective geometry

abstract: For any rank-one convex projective manifold with a compact convex core, we prove that there exists a unique probability measure of maximal entropy on the set of unit tangent vectors whose geodesic is contained in the convex core, and that it is mixing. We use this to establish asymptotics for the number of closed geodesics. In order to construct the measure of maximal entropy, we develop a theory of Patterson--Sullivan densities for general rank-one convex projective manifolds. In particular, we establish a Hopf--Tsuji--Sullivan--Roblin dichotomy, and prove that, when it is finite, the measure on the unit tangent bundle induced by a Patterson--Sullivan density is mixing under the action of the geodesic flow.


title: Tensors in computations

abstract: The notion of a tensor captures three great ideas: equivariance, multilinearity, separability. But trying to be three things at once makes the notion difficult to understand. We will explain tensors in an accessible and elementary way through the lens of linear algebra and numerical linear algebra, elucidated with examples from computational and applied mathematics.


title: Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels

abstract: Thermal images reveal medically important physiological information about human stress, signs of inflammation, and emotional mood that cannot be seen on visible images. Providing a method to generate thermal faces from visible images would be highly valuable for the telemedicine community in order to show this medical information. To the best of our knowledge, there are limited works on visible-to-thermal (VT) face translation, and many current works go the opposite direction to generate visible faces from thermal surveillance images (TV) for law enforcement applications. As a result, we introduce favtGAN, a VT GAN which uses the pix2pix image translation model with an auxiliary sensor label prediction network for generating thermal faces from visible images. Since most TV methods are trained on only one data source drawn from one thermal sensor, we combine datasets from faces and cityscapes. These combined data are captured from similar sensors in order to bootstrap the training and transfer learning task, especially valuable because visible-thermal face datasets are limited. Experiments on these combined datasets show that favtGAN demonstrates an increase in SSIM and PSNR scores of generated thermal faces, compared to training on a single face dataset alone.


title: The one-dimensional Bose gas with strong two-body losses: the effect of the harmonic confinement

abstract: We study the dynamics of a one-dimensional Bose gas in presence of strong two-body losses. In this dissipative quantum Zeno regime, the gas fermionises and its dynamics can be described with a simple set of rate equations. Employing the local density approximation and a Boltzmann-like dynamical equation, the description is easily extended to take into account an external potential. We show that in the absence of confinement the population is depleted in an anomalous way and that the gas behaves as a low-temperature classical gas. The harmonic confinement accelerates the depopulation of the gas and introduces a novel decay regime, which we thoroughly characterise.


title: Large Deviations for the Right-Most Position of a Last Progeny Modified Branching Random Walk

abstract: In this work, we consider a modification of the usual Branching Random Walk (BRW), where we give certain independent and identically distributed (i.i.d.) displacements to all the particles at the $n$-th generation, which may be different from the driving increment distribution. This model was first introduced by Bandyopadhyay and Ghosh (2021) and they termed it as Last Progeny Modified Branching Random Walk (LPM-BRW). Under very minimal assumptions, we derive the large deviation principle (LDP) for the right-most position of a particle in generation $n$. As a byproduct, we also complete the LDP for the classical model, which complements the earlier work by Gantert and H\"{o}felsauer (2018).


title: Cine-MRI detection of abdominal adhesions with spatio-temporal deep learning

abstract: Adhesions are an important cause of chronic pain following abdominal surgery. Recent developments in abdominal cine-MRI have enabled the non-invasive diagnosis of adhesions. Adhesions are identified on cine-MRI by the absence of sliding motion during movement. Diagnosis and mapping of adhesions improves the management of patients with pain. Detection of abdominal adhesions on cine-MRI is challenging from both a radiological and deep learning perspective. We focus on classifying presence or absence of adhesions in sagittal abdominal cine-MRI series. We experimented with spatio-temporal deep learning architectures centered around a ConvGRU architecture. A hybrid architecture comprising a ResNet followed by a ConvGRU model allows to classify a whole time-series. Compared to a stand-alone ResNet with a two time-point (inspiration/expiration) input, we show an increase in classification performance (AUROC) from 0.74 to 0.83 ($p<0.05$). Our full temporal classification approach adds only a small amount (5%) of parameters to the entire architecture, which may be useful for other medical imaging problems with a temporal dimension.


title: Two-photon exchange corrections to the $g$ factor of Li-like ions

abstract: We report calculations of QED corrections to the $g$ factor of Li-like ions induced by the exchange of two virtual photons between the electrons. The calculations are performed within QED theory to all orders in the nuclear binding strength parameter $Z\alpha$, where $Z$ is the nuclear charge number and $\alpha$ is the fine-structure constant. In the region of low nuclear charges we compare results from three different methods: QED, relativistic many-body perturbation theory, and nonrelativistic QED. All three methods are shown to yield consistent results. With our calculations we improve the accuracy of the theoretical predictions of the $g$ factor of the ground state of Li-like carbon and oxygen by about an order of magnitude. Our theoretical results agree with those from previous calculations but differ by 3-4 standard deviations from the experimental results available for silicon and calcium.


title: Integrable Hamiltonian systems on the symplectic realizations of $\textbf{e}(3)^*$

abstract: The phase space of a gyrostat with a fixed point and a heavy top is the Lie-Poisson space $\textbf{e}(3)^*\cong \mathbb{R}^3\times \mathbb{R}^3$ dual to the Lie algebra $\textbf{e}(3)$ of Euclidean group $E(3)$. One has three naturally distinguished Poisson submanifolds of $\textbf{e}(3)^*$: (i) the dense open submanifold $\mathbb{R}^3\times \dot{\mathbb{R}}^3\subset \textbf{e}(3)^*$ which consists of all $4$-dimensional symplectic leaves ($\vec{\Gamma}^2>0$); (ii) the $5$-dimensional Poisson submanifold of $\mathbb{R}^3\times \dot{\mathbb{R}}^3$ defined by $\vec{J}\cdot \vec{\Gamma} = \mu ||\vec{\Gamma}||$; (iii) the $5$-dimensional Poisson submanifold of $\mathbb{R}^3\times \dot{\mathbb{R}}^3$ defined by $\vec{\Gamma}^2 = \nu^2$, where $\dot{\mathbb{R}}^3:= \mathbb{R}^3\backslash \{0\}$, $(\vec{J}, \vec{\Gamma})\in \mathbb{R}^3\times \mathbb{R}^3\cong \textbf{e}(3)^*$ and $\nu < 0 $, $\mu$ are some fixed real parameters. Basing on the $U(2,2)$-invariant symplectic structure of Penrose twistor space we find full and complete $E(3)$-equivariant symplectic realizations of these Poisson submanifolds which are $8$-dimensional for (i) and $6$-dimensional for (ii) and (iii). As a consequence of the above Hamiltonian systems on $\textbf{e}(3)^*$ lift to the ones on the above symplectic realizations. In such a way after lifting integrable cases of gyrostat with a fixed point, as well as of heavy top, we obtain a large family of integrable Hamiltonian systems on the phase spaces defined by these symplectic realizations.


title: Reservoir optimization and Machine Learning methods

abstract: After showing the efficiency of feedforward networks to estimate control in high dimension in the global optimization of some storages problems, we develop a modification of an algorithm based on some dynamic programming principle. We show that classical feedforward networks are not effective to estimate Bellman values for reservoir problems and we propose some neural networks giving far better results. At last, we develop a new algorithm mixing LP resolution and conditional cuts calculated by neural networks to solve some stochastic linear problems.


title: A Hierarchical Multi-Objective Programming Approach to Planning Locations for Macro and Micro Fire Stations

abstract: Fire stations are among the most crucial emergency facilities in urban emergency control system in terms of their quick response to fires and other emergencies. Location plannings for fire stations have a significant influence on their effectiveness and capability of emergency responses trading off with the cost of constructions. To obtain efficient and practical siting plans for fire stations, various major requirements including effectiveness maximization, distance constraint and workload limitation are required to be considered in location models, especially for multi-level fire facility systems with macro and micro fire stations having specific aims and construction requirements. This paper proposes a novel hierarchical optimization approach taking all the major requirements for location planning into consideration and bonds functional connections between different levels of fire stations at the same time. A single-objective and a multi-objective optimization model are established to solve the location siting problems for macro and micro fire stations simultaneously. Genetic algorithm with elitist reservation and Pareto-based multi-objective evolutionary algorithm are adopted to solve the problem with NP-hard nature. The proposed hierarchical location model is further performed in a case study of Futian District in Shenzhen, and the siting result justifies the effectiveness and practicality of our novel approach.


title: On the Steiner property for planar minimizing clusters. The anisotropic case

abstract: In this paper we discuss the Steiner property for minimal clusters in the plane with an anisotropic double density. This means that we consider the classical isoperimetric problem for clusters, but volume and perimeter are defined by using two densities. In particular, the perimeter density may also depend on the direction of the normal vector. The classical "Steiner property" for the Euclidean case (which corresponds to both densities being equal to $1$) says that minimal clusters are made by finitely many ${\rm C}^{1,\gamma}$ arcs, meeting in finitely many "triple points". We can show that this property holds under very weak assumptions on the densities. In the parallel paper "On the Steiner property for planar minimizing clusters. The isotropic case" we consider the isotropic case, i.e., when the perimeter density does not depend on the direction, which makes most of the construction much simpler. In particular, in the present case the three arcs at triple points do not necessarily meet with three angles of $120^\circ$, which is instead what happens in the isotropic case.


title: Degree sequences of sufficiently dense random uniform hypergraphs

abstract: We find an asymptotic enumeration formula for the number of simple $r$-uniform hypergraphs with a given degree sequence, when the number of edges is sufficiently large. The formula is given in terms of the solution of a system of equations. We give sufficient conditions on the degree sequence which guarantee existence of a solution to this system. Furthermore, we solve the system and give an explicit asymptotic formula when the degree sequence is close to regular. This allows us to establish several properties of the degree sequence of a random $r$-uniform hypergraph with a given number of edges. More specifically, we compare the degree sequence of a random $r$-uniform hypergraph with a given number edges to certain models involving sequences of binomial or hypergeometric random variables conditioned on their sum.


title: The quantum annealing gap and quench dynamics in the exact cover problem

abstract: Quenching and annealing are extreme opposites in the time evolution of a quantum system: Annealing explores equilibrium phases of a Hamiltonian with slowly changing parameters and can be exploited as a tool for solving complex optimization problems. In contrast, quenches are sudden changes of the Hamiltonian, producing a non-equilibrium situation. Here, we investigate the relation between the two cases. Specifically, we show that the minimum of the annealing gap, which is an important bottleneck of quantum annealing algorithms, can be revealed from a dynamical quench parameter which describes the dynamical quantum state after the quench. Combined with statistical tools including the training of a neural network, the relation between quench and annealing dynamics can be exploited to reproduce the full functional behavior of the annealing gap from the quench data. We show that the partial or full knowledge about the annealing gap which can be gained in this way can be used to design optimized quantum annealing protocols with a practical time-to-solution benefit. Our results are obtained from simulating random Ising Hamiltonians, representing hard-to-solve instances of the exact cover problem.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech physics.app-ph physics.data-an


title: The road to solving the Gribov problem of the center vortex model in quantum chromo dynamics

abstract: The center vortex model of the QCD vacuum is very successful in explaining the non-perturbative properties of QCD, especially confinement, chiral symmetry breaking and the topological charge of vacuum configurations. On the other hand, the center vortex model still suffers from a Gribov problem: Direct maximal center gauge and center projection can lead to an underestimation of the string tension in smooth configurations or after persistent simulated annealing. We discuss methods to identify center regions, whose boundaries evaluate to center elements, and want to improve the vortex detection: these regions might help to recognize vortices in configurations where maximal center gauge lost the vortex finding property.


title: On the Steiner property for planar minimizing clusters. The isotropic case

abstract: We consider the isoperimetric problem for clusters in the plane with a double density, that is, perimeter and volume depend on two weights. In this paper we consider the isotropic case, in the parallel paper "On the Steiner property for planar minimizing clusters. The anisotropic case", the anisotropic case is studied. Here we prove that, in a wide generality, minimal clusters enjoy the "Steiner property", which means that the boundaries are made by ${\rm C}^{1,\gamma}$ regular arcs, meeting in finitely many triple points with the $120^\circ$ property.


title: Detect and remove watermark in deep neural networks via generative adversarial networks

abstract: Deep neural networks (DNN) have achieved remarkable performance in various fields. However, training a DNN model from scratch requires a lot of computing resources and training data. It is difficult for most individual users to obtain such computing resources and training data. Model copyright infringement is an emerging problem in recent years. For instance, pre-trained models may be stolen or abuse by illegal users without the authorization of the model owner. Recently, many works on protecting the intellectual property of DNN models have been proposed. In these works, embedding watermarks into DNN based on backdoor is one of the widely used methods. However, when the DNN model is stolen, the backdoor-based watermark may face the risk of being detected and removed by an adversary. In this paper, we propose a scheme to detect and remove watermark in deep neural networks via generative adversarial networks (GAN). We demonstrate that the backdoor-based DNN watermarks are vulnerable to the proposed GAN-based watermark removal attack. The proposed attack method includes two phases. In the first phase, we use the GAN and few clean images to detect and reverse the watermark in the DNN model. In the second phase, we fine-tune the watermarked DNN based on the reversed backdoor images. Experimental evaluations on the MNIST and CIFAR10 datasets demonstrate that, the proposed method can effectively remove about 98% of the watermark in DNN models, as the watermark retention rate reduces from 100% to less than 2% after applying the proposed attack. In the meantime, the proposed attack hardly affects the model's performance. The test accuracy of the watermarked DNN on the MNIST and the CIFAR10 datasets drops by less than 1% and 3%, respectively.


title: Employing an Adjusted Stability Measure for Multi-Criteria Model Fitting on Data Sets with Similar Features

abstract: Fitting models with high predictive accuracy that include all relevant but no irrelevant or redundant features is a challenging task on data sets with similar (e.g. highly correlated) features. We propose the approach of tuning the hyperparameters of a predictive model in a multi-criteria fashion with respect to predictive accuracy and feature selection stability. We evaluate this approach based on both simulated and real data sets and we compare it to the standard approach of single-criteria tuning of the hyperparameters as well as to the state-of-the-art technique "stability selection". We conclude that our approach achieves the same or better predictive performance compared to the two established approaches. Considering the stability during tuning does not decrease the predictive accuracy of the resulting models. Our approach succeeds at selecting the relevant features while avoiding irrelevant or redundant features. The single-criteria approach fails at avoiding irrelevant or redundant features and the stability selection approach fails at selecting enough relevant features for achieving acceptable predictive accuracy. For our approach, for data sets with many similar features, the feature selection stability must be evaluated with an adjusted stability measure, that is, a measure that considers similarities between features. For data sets with only few similar features, an unadjusted stability measure suffices and is faster to compute.


title: CoV-Spectrum: Analysis of globally shared SARS-CoV-2 data to Identify and Characterize New Variants

abstract: Summary: The CoV-Spectrum website supports the identification of new SARS-CoV-2 variants of concern and the tracking of known variants. Its flexible amino acid and nucleotide mutation search allows querying of variants before they are designated by a lineage nomenclature system. The platform brings together SARS-CoV-2 data from different sources and applies analyses. Results include the proportion of different variants over time, their demographic and geographic distributions, common mutations, hospitalization and mortality probabilities, estimates for transmission fitness advantage and insights obtained from wastewater samples. Availability and Implementation: CoV-Spectrum is available at https://cov-spectrum.ethz.ch. The code is released under the GPL-3.0 license at https://github.com/cevo-public/cov-spectrum-website


title: ResDepth: A Deep Residual Prior For 3D Reconstruction From High-resolution Satellite Images

abstract: Modern optical satellite sensors enable high-resolution stereo reconstruction from space. But the challenging imaging conditions when observing the Earth from space push stereo matching to its limits. In practice, the resulting digital surface models (DSMs) are fairly noisy and often do not attain the accuracy needed for high-resolution applications such as 3D city modeling. Arguably, stereo correspondence based on low-level image similarity is insufficient and should be complemented with a-priori knowledge about the expected surface geometry beyond basic local smoothness. To that end, we introduce ResDepth, a convolutional neural network that learns such an expressive geometric prior from example data. ResDepth refines an initial, raw stereo DSM while conditioning the refinement on the images. I.e., it acts as a smart, learned post-processing filter and can seamlessly complement any stereo matching pipeline. In a series of experiments, we find that the proposed method consistently improves stereo DSMs both quantitatively and qualitatively. We show that the prior encoded in the network weights captures meaningful geometric characteristics of urban design, which also generalize across different districts and even from one city to another. Moreover, we demonstrate that, by training on a variety of stereo pairs, ResDepth can acquire a sufficient degree of invariance against variations in imaging conditions and acquisition geometry.


title: Opto-thermal transport engineering in hybrid organic-inorganic lead halide perovskites metasurfaces

abstract: Halide perovskites have recently gained widespread attention for their exceptional optoelectronic properties which have been illuminated by extensive spectroscopic investigations. In this article, nanophotonic surface-engineering using soft-lithography has been used to reproduce nanostructures with enhanced functionalities. A non-invasive optical technique based on Raman and photolumines-cence (PL) spectroscopy is employed to investigate the interactive effect of the thermal and optical behaviour in surface-patterned hybrid organic-inorganic halide perovskite thin films. The thermophys-ical properties of the engineered perovskite films are extracted from the softening of the representa-tive peak positions in the Raman and PL spectra of the samples which act as temperature markers. The investigation suggests a comparatively higher rise in the local temperature for the patterned thin films resulting from their enhanced absorption. Therefore, a cross-talk between the opto-thermal transport phenomena in imprinted perovskite thin films pertaining to both enhancing device properties along with maintaining device stability is established.


title: Sequence-regular commutative DG-rings

abstract: We introduce a new class of commutative noetherian DG-rings which generalizes the class of regular local rings. These are defined to be local DG-rings $(A,\bar{\mathfrak{m}})$ such that the maximal ideal $\bar{\mathfrak{m}} \subseteq \mathrm{H}^0(A)$ can be generated by an $A$-regular sequence. We call these DG-rings sequence-regular DG-rings, and make a detailed study of them. Using methods of Cohen-Macaulay differential graded algebra, we prove that the Auslander-Buchsbaum-Serre theorem about localization generalizes to this setting. This allows us to define global sequence-regular DG-rings, and to introduce this regularity condition to derived algebraic geometry. It is shown that these DG-rings share many properties of classical regular local rings, and in particular we are able to construct canonical residue DG-fields in this context. Finally, we show that sequence-regular DG-rings are ubiquitous, and in particular, any eventually coconnective derived algebraic variety over a perfect field is generically sequence-regular.


title: Quasifibrations in configuration Lie groupoids and orbifold braid groups

abstract: In [19] we studied a Fadell-Neuwirth type fibration theorem for orbifolds, and gave a short exact sequence of fundamental groups of configuration Lie groupoids of Lie groupoids corresponding to the genus zero 2-dimensional orbifolds with cone points, and at least one puncture. In this paper we extend this work to all genus $\geq 1$, 2-dimensional orbifolds with cone points. As a consequence, we prove the Farrell-Jones Isomorphism conjecture for the fundamental groups of the associated configuration Lie groupoids. This answers a substantial part of a question we posed in [[18], Problem]. In [19] we also showed that for all global quotient type orbifolds, the fibration theorem does not hold. Here, we give some nontrivial examples of orbifolds where a Fadell-Neuwirth type quasifibration theorem holds. Finally, we state an Asphericity conjecture and a Quasifibration conjecture for orbifolds.


title: Crystallinity of the homogenized energy density of periodic lattice systems

abstract: We study the homogenized energy densities of periodic ferromagnetic Ising systems. We prove that, for finite range interactions, the homogenized energy density, identifying the effective limit, is crystalline, i.e. its Wulff crystal is a polytope, for which we can (exponentially) bound the number of vertices. This is achieved by deriving a dual representation of the energy density through a finite cell formula. This formula also allows easy numerical computations: we show a few experiments where we compute periodic patterns which minimize the anisotropy of the surface tension.


title: Contextualizing Meta-Learning via Learning to Decompose

abstract: Meta-learning has emerged as an efficient approach for constructing target models based on support sets. For example, the meta-learned embeddings enable the construction of target nearest-neighbor classifiers for specific tasks by pulling instances closer to their same-class neighbors. However, a single instance can be annotated from various latent attributes, making visually similar instances inside or across support sets have different labels and diverse relationships with others. Consequently, a uniform meta-learned strategy for inferring the target model from the support set fails to capture the instance-wise ambiguous similarity. To this end, we propose Learning to Decompose Network (LeadNet) to contextualize the meta-learned ``support-to-target'' strategy, leveraging the context of instances with one or mixed latent attributes in a support set. In particular, the comparison relationship between instances is decomposed w.r.t. multiple embedding spaces. LeadNet learns to automatically select the strategy associated with the right attribute via incorporating the change of comparison across contexts} with polysemous embeddings. We demonstrate the superiority of LeadNet in various applications, including exploring multiple views of confusing data, out-of-distribution recognition, and few-shot image classification.


title: Colossal Atomic Force Response in van der Waals Materials Arising From Electronic Correlations

abstract: Understanding static and dynamic phenomena in complex materials at different length scales requires reliably accounting for van der Waals (vdW) interactions, which stem from long-range electronic correlations. While the important role of many-body vdW interactions has been extensively documented when it comes to the stability of materials, much less is known about the coupling between vdW interactions and atomic forces. Here we analyze the Hessian force response matrix for a single and two vdW-coupled atomic chains to show that a many-body description of vdW interactions yields atomic force response magnitudes that exceed the expected pairwise decay by 3-5 orders of magnitude for a wide range of separations between the perturbed and the observed atom. Similar findings are confirmed for graphene and carbon nanotubes. This colossal force enhancement suggests implications for phonon spectra, free energies, interfacial adhesion, and collective dynamics in materials with many interacting atoms.


title: Leopard: Towards High Throughput-Preserving BFT for Large-scale Systems

abstract: With the emergence of large-scale decentralized applications, a scalable and efficient Byzantine Fault Tolerant (BFT) protocol of hundreds of replicas is desirable. Although the throughput of existing leader-based BFT protocols has reached a high level of $10^5$ requests per second for a small scale of replicas, it drops significantly when the number of replicas increases, which leads to a lack of practicality. This paper focuses on the scalability of BFT protocols and identifies a major bottleneck to leader-based BFT protocols due to the excessive workload of the leader at large scales. A new metric of scaling factor is defined to capture whether a BFT protocol will get stuck when it scales out, which can be used to measure the performance of efficiency and scalability of BFT protocols. We propose "Leopard", the first leader-based BFT protocol that scales to multiple hundreds of replicas, and more importantly, preserves a high efficiency. We remove the bottleneck by introducing a technique of achieving a constant scaling factor, which takes full advantage of the idle resource and adaptively balances the workload of the leader among all replicas. We implement Leopard and evaluate its performance compared to HotStuff, the state-of-the-art BFT protocol. We run extensive experiments on the two systems with up to 600 replicas. The results show that Leopard achieves significant performance improvements both on throughput and scalability. In particular, the throughput of Leopard remains at a high level of $10^5$ when the system scales out to 600 replicas. It achieves a $5\times$ throughput over HotStuff when the scale is 300 (which is already the largest scale we can see the progress of the latter in our experiments), and the gap becomes wider as the number of replicas further increases.


title: Archify: A Recommender System of Architectural Design Decisions

abstract: Software architectures play a critical role in software quality assurance. However, small and medium companies (SMC) often suffer from the absence of professionals with skills and expertise in software architecture. That situation potentially affects the final quality of the software products and pressures projects budget with extra costs with consulting. This paper presents a recommender system of architectural design decisions called Archify. The goal is to support SMC companies in part of the effort of architecturally designing their products. Archify implements a wizard-styled interface that guides the developer or project manager through a set of specific questions. While the user answers these questions, Archify buffers a set of corresponding architectural decision recommendations. As the final result, the system recommends a set of architectural decisions matching the project's needs according to the requirements (as provided by the user) of the software under development. Nineteen professionals from academia and industry evaluated Archify through two surveys. The findings reveal that 94.7% of the participants approved Archify as a supporting tool. Respondents also highlighted the lack of tools supporting software architecture design, remarking the relevance of the proposed system.


title: Duality Relations for Overlaps of Integrable Boundary States in AdS/dCFT

abstract: The encoding of all possible sets of Bethe equations for a spin chain with SU(N|M) symmetry into a QQ-system calls for an expression of spin chain overlaps entirely in terms of Q-functions. We take a significant step towards deriving such a universal formula in the case of overlaps between Bethe eigenstates and integrable boundary states, of relevance for AdS/dCFT, by determining the transformation properties of the overlaps under fermionic as well as bosonic dualities which allows us to move between any two descriptions of the spin chain encoded in the QQ-system. An important part of our analysis involves introducing a suitable regularization for singular Bethe root configurations.


title: Semantic Representation and Inference for NLP

abstract: Semantic representation and inference is essential for Natural Language Processing (NLP). The state of the art for semantic representation and inference is deep learning, and particularly Recurrent Neural Networks (RNNs), Convolutional Neural Networks (CNNs), and transformer Self-Attention models. This thesis investigates the use of deep learning for novel semantic representation and inference, and makes contributions in the following three areas: creating training data, improving semantic representations and extending inference learning. In terms of creating training data, we contribute the largest publicly available dataset of real-life factual claims for the purpose of automatic claim verification (MultiFC), and we present a novel inference model composed of multi-scale CNNs with different kernel sizes that learn from external sources to infer fact checking labels. In terms of improving semantic representations, we contribute a novel model that captures non-compositional semantic indicators. By definition, the meaning of a non-compositional phrase cannot be inferred from the individual meanings of its composing words (e.g., hot dog). Motivated by this, we operationalize the compositionality of a phrase contextually by enriching the phrase representation with external word embeddings and knowledge graphs. Finally, in terms of inference learning, we propose a series of novel deep learning architectures that improve inference by using syntactic dependencies, by ensembling role guided attention heads, incorporating gating layers, and concatenating multiple heads in novel and effective ways. This thesis consists of seven publications (five published and two under review).