title: An odd feature of the `most classical' states of $SU(2)$ invariant quantum mechanical systems

abstract: Complex and spinorial techniques of general relativity are used to determine all the states of the $SU(2)$ invariant quantum mechanical systems in which the equality holds in the uncertainty relations for the components of the angular momentum vector operator in two given directions. The expectation values depend on a discrete quantum number and two parameters, one of them is the angle between the two angular momentum components and the other is the quotient of the two standard deviations. Allowing the angle between the two angular momentum components to be arbitrary, \emph{a new genuine quantum mechanical phenomenon emerges}: It is shown that although the standard deviations change continuously, one of the expectation values changes \emph{discontinuously} on this parameter space. Since physically neither of the angular momentum components is distinguished over the other, this discontinuity suggests that the genuine parameter space must be a \emph{double cover} of this classical one: It must be diffeomorphic to a \emph{Riemann surface} known in connection with the complex function $\sqrt{z}$. Moreover, the angle between the angular momentum components plays the role of the parameter of an interpolation between the continuous range of the expectation values found in the special case of the orthogonal angular momentum components and the discrete point spectrum of one angular momentum component. The consequences in the \emph{simultaneous} measurements of these angular momentum components are also discussed briefly.


title: High-Quality Hypergraph Partitioning

abstract: This paper considers the balanced hypergraph partitioning problem, which asks for partitioning the vertices into $k$ disjoint blocks of bounded size while minimizing an objective function over the hyperedges. Here, we consider the most commonly used connectivity metric. We describe our open source hypergraph partitioner KaHyPar which is based on the successful multi-level approach -- driving it to the extreme of one level for (almost) every vertex. Using carefully designed data structures and dynamic update techniques, this approach offers a very good time-quality tradeoff. We present two preprocessing techniques -- pin sparsification using locality sensitive hashing and community detection based on the Louvain algorithm. The community structure is used to guide the coarsening process that incrementally contracts vertices. Portfolio-based partitioning of the contracted hypergraph already achieves good initial solutions. While reversing the contractions, a combination of highly-localized direct $k$-way local search and flow-based techniques that take a more global view, refine the partition to achieve high quality. Optionally, a memetic algorithm evolves a pool of solution candidates to obtain even higher quality. We evaluate KaHyPar on a large set of instances from a wide range of application domains. With respect to quality, KaHyPar outperforms all previously considered systems that can handle large hypergraphs such as hMETIS, PaToH, Mondriaan, or Zoltan. KaHyPar is also faster than most of these systems except for PaToH which represents a different speed-quality tradeoff. The results even extend to the special case of graph partitioning, where specialized systems such as KaHIP should have an advantage.


title: Phonon Screening of Excitons in Semiconductors: Halide Perovskites and Beyond

abstract: The ab initio Bethe-Salpeter equation (BSE) approach, an established method for the study of excitons in materials, is typically solved in a limit where only static screening from electrons is captured. Here, we generalize this framework to also include dynamical screening from phonons at lowest order in the electron-phonon interaction. We apply this generalized BSE approach to a series of inorganic lead halide perovskites, CsPbX3, with X = Cl, Br, and I. We find that inclusion of screening from phonons significantly reduces the computed exciton binding energies of these systems. By deriving a simple expression for phonon screening effects, we reveal general trends for the importance of phonon screening effects in semiconductors and insulators, based on a hydrogenic exciton model. We demonstrate that the magnitude of the phonon screening correction in isotropic materials can be reliably predicted using four material specific parameters: the reduced effective mass, the static and optical dielectric constants, and the phonon frequency of the most strongly coupled LO phonon mode. This framework helps to elucidate the importance of phonon screening and its relation to excitonic properties in a broad class of semiconductors.


title: Mass gap for a monopole interacting with a nonlinear spinor field

abstract: Within SU(2) Yang-Mills theory with a source of the non-Abelian gauge field in the form of a classical spinor field, we study the dependence of the mass gap on the coupling constant between the gauge and nonlinear spinor fields. It is shown that the total dimensionless energy of the monopole interacting with the nonlinear spinor fields depends only on the dimensionless coupling constant.


title: Strong nonlocal sets of UPB

abstract: The unextendible product bases (UPBs) are interesting members from the family of orthogonal product states. In this paper, we investigate the construction of 3-qubit UPB with strong nonlocality of different sizes. First, a UPB set in ${{C}^{3}}\otimes {{C}^{3}}\otimes {{C}^{3}}$ of size 12 is presented based on the Shifts UPB, the structure of which is described by mapping the system to a $3\times 3\times 3$ Rubik's Cube. After observing the orthogonal graph of each qubit, we provide a general method of constructing UPB in ${{C}^{d}}\otimes {{C}^{d}}\otimes {{C}^{d}}$ of size ${{\left( d-1 \right)}^{3}}+3\left( d-2 \right)+1$. Second, for the more general case where the dimensions of qubits are different, we extend the tile structure to 3-qubit system and propose a Tri-tile structure for 3-qubit UPB. Then, by means of this structure, a ${{C}^{4}}\otimes {{C}^{4}}\otimes {{C}^{5}}$ system of size 30 is obtained based on a ${{C}^{3}}\otimes {{C}^{3}}\otimes {{C}^{4}}$ system. Similarly, we generalize this approach to ${{C}^{{{d}_{1}}}}\otimes {{C}^{{{d}_{2}}}}\otimes {{C}^{{{d}_{3}}}}$ system which has a similar composition to ${{C}^{d}}\otimes {{C}^{d}}\otimes {{C}^{d}}$. Our research provides a positive answer to the open questions raised in [Halder, et al., PRL, 122, 040403 (2019)], indicating that there do exist multi-qubit UPBs that can exhibit strong quantum nonlocality without entanglement.


title: Topology Distillation for Recommender System

abstract: Recommender Systems (RS) have employed knowledge distillation which is a model compression technique training a compact student model with the knowledge transferred from a pre-trained large teacher model. Recent work has shown that transferring knowledge from the teacher's intermediate layer significantly improves the recommendation quality of the student. However, they transfer the knowledge of individual representation point-wise and thus have a limitation in that primary information of RS lies in the relations in the representation space. This paper proposes a new topology distillation approach that guides the student by transferring the topological structure built upon the relations in the teacher space. We first observe that simply making the student learn the whole topological structure is not always effective and even degrades the student's performance. We demonstrate that because the capacity of the student is highly limited compared to that of the teacher, learning the whole topological structure is daunting for the student. To address this issue, we propose a novel method named Hierarchical Topology Distillation (HTD) which distills the topology hierarchically to cope with the large capacity gap. Our extensive experiments on real-world datasets show that the proposed method significantly outperforms the state-of-the-art competitors. We also provide in-depth analyses to ascertain the benefit of distilling the topology for RS.


title: Universal and specific features of Ukrainian economic research: publication analysis based on Crossref data

abstract: Our study is one of the first examples of multidimensional and longitudinal disciplinary analysis at the national level based on Crossref data. We present a large-scale quantitative analysis of Ukrainian economics. This study is not yet another example of research aimed at ranking of local journals, authors or institutions, but rather exploring general tendencies that can be compared to other countries or regions. We study different aspects of Ukrainian economics output. In particular, the collaborative nature, geographic landscape and some peculiarities of citation statistics are investigated. We have found that Ukrainian economics is characterized by a comparably small share of co-authored publications, however, it demonstrates the tendency towards more collaborative output. Based on our analysis, we discuss specific and universal features of Ukrainian economic research. The importance of supporting various initiatives aimed at enriching open scholarly metadata is considered. A comprehensive and high-quality meta description of publications is probably the shortest path to a better understanding of national trends, especially for non-English speaking countries. The results of our analysis can be used to better understand Ukrainian economic research and support research policy decisions.


title: A Review of Lithium-Ion Battery Models in Techno-economic Analyses of Power Systems

abstract: The penetration of the lithium-ion battery energy storage system (BESS) into the power system environment occurs at a colossal rate worldwide. This is mainly because it is considered as one of the major tools to decarbonize, digitalize, and democratize the electricity grid. The economic viability and technical reliability of projects with batteries require appropriate assessment because of high capital expenditures, deterioration in charging/discharging performance and uncertainty with regulatory policies. Most of the power system economic studies employ a simple power-energy representation coupled with an empirical description of degradation to model the lithium-ion battery. This approach to modelling may result in violations of the safe operation and misleading estimates of the economic benefits. Recently, the number of publications on techno-economic analysis of BESS with more details on the lithium-ion battery performance has increased. The aim of this review paper is to explore these publications focused on the grid-scale BESS applications and to discuss the impacts of using more sophisticated modelling approaches. First, an overview of the three most popular battery models is given, followed by a review of the applications of such models. The possible directions of future research of employing detailed battery models in power systems' techno-economic studies are then explored.


title: Source Separation-based Data Augmentation for Improved Joint Beat and Downbeat Tracking

abstract: Due to advances in deep learning, the performance of automatic beat and downbeat tracking in musical audio signals has seen great improvement in recent years. In training such deep learning based models, data augmentation has been found an important technique. However, existing data augmentation methods for this task mainly target at balancing the distribution of the training data with respect to their tempo. In this paper, we investigate another approach for data augmentation, to account for the composition of the training data in terms of the percussive and non-percussive sound sources. Specifically, we propose to employ a blind drum separation model to segregate the drum and non-drum sounds from each training audio signal, filtering out training signals that are drumless, and then use the obtained drum and non-drum stems to augment the training data. We report experiments on four completely unseen test sets, validating the effectiveness of the proposed method, and accordingly the importance of drum sound composition in the training data for beat and downbeat tracking.


title: Memorization and Generalization in Neural Code Intelligence Models

abstract: Deep Neural Networks (DNNs) are increasingly being used in software engineering and code intelligence tasks. These are powerful tools that are capable of learning highly generalizable patterns from large datasets through millions of parameters. At the same time, their large capacity can render them prone to memorizing data points. Recent work suggests that the memorization risk manifests especially strongly when the training dataset is noisy, involving many ambiguous or questionable samples, and memorization is the only recourse. The goal of this paper is to evaluate and compare the extent of memorization and generalization in neural code intelligence models. It aims to provide insights on how memorization may impact the learning behavior of neural models in code intelligence systems. To observe the extent of memorization in models, we add random noise to the original training dataset and use various metrics to quantify the impact of noise on various aspects of training and testing. We evaluate several state-of-the-art neural code intelligence models and benchmarks based on Java, Python, and Ruby codebases. Our results highlight important risks: millions of trainable parameters allow the neural networks to memorize anything, including noisy data, and provide a false sense of generalization. We observed all models manifest some forms of memorization. This can be potentially troublesome in most code intelligence tasks where they rely on rather noise-prone and repetitive data sources, such as code from GitHub. To the best of our knowledge, we provide the first study to quantify memorization effects in the domain of software engineering and code intelligence systems. This work raises awareness and provides new insights into important issues of training neural models in code intelligence systems that are usually overlooked by software engineering researchers.


title: Observing symmetry-broken optimal paths of stationary Kardar-Parisi-Zhang interface via a large-deviation sampling of directed polymers in random media

abstract: Consider the short-time probability distribution $\mathcal{P}(H,t)$ of the one-point interface height difference $h(x=0,\tau=t)-h(x=0,\tau=0)=H$ of the stationary interface $h(x,\tau)$ described by the Kardar-Parisi-Zhang equation. It was previously shown that the optimal path -- the most probable history of the interface $h(x,\tau)$ which dominates the upper tail of $\mathcal{P}(H,t)$ -- is described by any of \emph{two} ramp-like structures of $h(x,\tau)$ traveling either to the left, or to the right. These two solutions emerge, at a critical value of $H$, via a spontaneous breaking of the mirror symmetry $x\leftrightarrow -x$ of the optimal path, and this symmetry breaking is responsible for a second-order dynamical phase transition in the system. We simulate the interface configurations numerically by employing a large-deviation Monte Carlo sampling algorithm in conjunction with the mapping between the KPZ interface and the directed polymer in a random potential at high temperature. This allows us to observe the optimal paths, which determine each of the two tails of $\mathcal{P}(H,t)$, down to probability densities as small as $10^{-500}$. At short times we observe mirror-symmetry-broken traveling optimal paths for the upper tail, and a single mirror-symmetric path for the lower tail, in good quantitative agreement with analytical predictions. At long times, even at moderate values of $H$, where the optimal fluctuation method is \emph{not} supposed to apply, we still observe two well-defined dominating paths. Each of them violates the mirror symmetry $x\leftrightarrow -x$ and is a mirror image of the other.


title: Silent Speech and Emotion Recognition from Vocal Tract Shape Dynamics in Real-Time MRI

abstract: Speech sounds of spoken language are obtained by varying configuration of the articulators surrounding the vocal tract. They contain abundant information that can be utilized to better understand the underlying mechanism of human speech production. We propose a novel deep neural network-based learning framework that understands acoustic information in the variable-length sequence of vocal tract shaping during speech production, captured by real-time magnetic resonance imaging (rtMRI), and translate it into text. The proposed framework comprises of spatiotemporal convolutions, a recurrent network, and the connectionist temporal classification loss, trained entirely end-to-end. On the USC-TIMIT corpus, the model achieved a 40.6% PER at sentence-level, much better compared to the existing models. To the best of our knowledge, this is the first study that demonstrates the recognition of entire spoken sentence based on an individual's articulatory motions captured by rtMRI video. We also performed an analysis of variations in the geometry of articulation in each sub-regions of the vocal tract (i.e., pharyngeal, velar and dorsal, hard palate, labial constriction region) with respect to different emotions and genders. Results suggest that each sub-regions distortion is affected by both emotion and gender.


title: Emergence of Sinai Physics in the stochastic motion of passive and active particles

abstract: A particle that is immersed in a uniform temperature bath performs Brownian diffusion, as discussed by Einstein. But Sinai has realized that in a "random environment" the diffusion is suppressed. Follow-up works have pointed out that in the presence of bias $f$ there are delocalization and sliding transitions, with threshold value $f_c$ that depends on the disorder strength. We discuss in a critical way the emergence of Sinai physics for both passive and active Brownian particles. Tight-binding and Fokker-Planck versions of the model are addressed on equal footing. We assume that the transition rates between sites are enhanced either due to a driving mechanism or due to self-propulsion mechanism that are induced by an irradiation source. Consequently, counter intuitively, the dynamics becomes sub-diffusive and the relaxation modes become over-damped. For a finite system, spontaneous delocalization may arise, due to residual bias that is induced by the irradiation.


title: The association between topic growth and citation impact of research publications

abstract: Citations are used for research evaluation, and it is therefore important to know which factors influence or associate with citation impact of articles. Several citation factors have been studied in the literature. In this study we propose a new factor, topic growth, that no previous study has studied empirically. The growth rate of topics may influence future citation counts because a high growth in a topic means there are more publications citing previous publications in that topic. We construct topics using community detection in a citation network and use a two-part regression model to study the association between topic growth and citation counts in eight broad disciplines. The first part of the model uses quantile regression to estimate the effect of growth ratio on citation counts for publications with more than three citations. The second part of the model uses logistic regression to model the influence of the explanatory variables on the probability of being lowly cited versus being modestly or highly cited. Both models control for three variables that may distort the association between the topic growth and citations: journal impact, number of references, and number of authors. The regression model clearly shows that publications in fast-growing topics have a citation advantage compared to publications in slow-growing or declining topics in all of the eight disciplines. Using citation indicators for research evaluation may give incentives for researchers to publish in fast-growing topics, but they may cause research to be less diversified. The results have also some implications for citation normalization.


title: Topology detection in cavity QED

abstract: We explore the physics of topological lattice models in c-QED architectures for arbitrary coupling strength, and the use of the cavity transmission as a topological marker. For this, we develop an approach combining the input-output formalism with an expansion in quantum fluctuations which allows to go beyond the small-coupling regime. We apply our formalism to a fermionic Su-Schrieffer-Heeger (SSH) chain coupled to a single-mode cavity, and find that the cavity can indeed act as a quantum sensor for topological phases, where the initial state preparation plays a crutial role. Additionally, we discuss the persistence of topological features as the coupling strength increases, in terms of an effective Hamiltonian, and calculate the entanglement entropy.


title: Mobile Augmented Reality: User Interfaces, Frameworks, and Intelligence

abstract: Mobile Augmented Reality (MAR) integrates computer-generated virtual objects with physical environments for mobile devices. MAR systems enable users to interact with MAR devices, such as smartphones and head-worn wearables, and performs seamless transitions from the physical world to a mixed world with digital entities. These MAR systems support user experiences by using MAR devices to provide universal accessibility to digital contents. Over the past 20 years, a number of MAR systems have been developed, however, the studies and design of MAR frameworks have not yet been systematically reviewed from the perspective of user-centric design. This article presents the first effort of surveying existing MAR frameworks (count: 37) and further discusses the latest studies on MAR through a top-down approach: 1) MAR applications; 2) MAR visualisation techniques adaptive to user mobility and contexts; 3) systematic evaluation of MAR frameworks including supported platforms and corresponding features such as tracking, feature extraction plus sensing capabilities; and 4) underlying machine learning approaches supporting intelligent operations within MAR systems. Finally, we summarise the development of emerging research fields, current state-of-the-art, and discuss the important open challenges and possible theoretical and technical directions. This survey aims to benefit both researchers and MAR system developers alike.


title: Operational detection of entanglement via quantum designs

abstract: From an operational point of view, we propose several new entanglement detection criteria using quantum designs. These criteria are constructed by considering the correlations defined with quantum designs. Counter-intuitively, the criteria with more settings are exactly equivalent to the corresponding ones with the minimal number of settings, namely the symmetric informationally complete positive operator-valued measures (SIC POVMs). Fundamentally, this observation highlights the potentially unique role played by SIC POVMs in quantum information processing. Experimentally, this provides the minimal number of settings that one should choose for detecting entanglement. Furthermore, we find that nonlinear criteria are not always better than linear ones for the task of entanglement detection.


title: Low-Rank Parity-Check Codes Over Finite Commutative Rings

abstract: Low-Rank Parity-Check (LRPC) codes are a class of rank metric codes that have many applications specifically in network coding and cryptography. Recently, LRPC codes have been extended to Galois rings which are a specific case of finite rings. In this paper, we first define LRPC codes over finite commutative local rings, which are bricks of finite rings, with an efficient decoder. We improve the theoretical bound of the failure probability of the decoder. Then, we extend the work to arbitrary finite commutative rings. Certain conditions are generally used to ensure the success of the decoder. Over finite fields, one of these conditions is to choose a prime number as the extension degree of the Galois field. We have shown that one can construct LRPC codes without this condition on the degree of Galois extension.


title: 2nd Place Solution for Waymo Open Dataset Challenge -- Real-time 2D Object Detection

abstract: In an autonomous driving system, it is essential to recognize vehicles, pedestrians and cyclists from images. Besides the high accuracy of the prediction, the requirement of real-time running brings new challenges for convolutional network models. In this report, we introduce a real-time method to detect the 2D objects from images. We aggregate several popular one-stage object detectors and train the models of variety input strategies independently, to yield better performance for accurate multi-scale detection of each category, especially for small objects. For model acceleration, we leverage TensorRT to optimize the inference time of our detection pipeline. As shown in the leaderboard, our proposed detection framework ranks the 2nd place with 75.00% L1 mAP and 69.72% L2 mAP in the real-time 2D detection track of the Waymo Open Dataset Challenges, while our framework achieves the latency of 45.8ms/frame on an Nvidia Tesla V100 GPU.


title: Numerical Stability of Tangents and Adjoints of Implicit Functions

abstract: We investigate errors in tangents and adjoints of implicit functions resulting from errors in the primal solution due to approximations computed by a numerical solver. Adjoints of systems of linear equations turn out to be unconditionally numerically stable. Tangents of systems of linear equations can become instable as well as both tangents and adjoints of systems of nonlinear equations, which extends to optima of convex unconstrained objectives. Sufficient conditions for numerical stability are derived.


title: Solution to Waves in Dissipative Media with Reciprocal Attenuation in Time and Space Domains

abstract: The study points out that the traditional solutions to wave equation of dissipative wave and motion equation of block for a multi-degree-of-freedom mass spring damper system are the possible solutions, which are not necessarily objective and conflict each other. The disturbance in discrete system like crystals vibration can be expressed in differential form. A new general solution to dissipative wave equation is proposed with the general Fourier transform. The solution reveals that the attenuation of the disturbance can simultaneously occur in time and space domains. Then the general solution is used in case studies to analyze the properties of dissipative waves. It is concluded that the properties of waves formulated with the same equation can be different because of the difference of attenuation mechanism.


title: W-translated Schubert divisors and transversal intersections

abstract: We study the toric degeneration of Weyl group translated Schubert divisors of a partial flag variety of Lie type A via Gelfand-Cetlin polytopes. We propose a conjecture that Schubert varieties of appropriate dimensions intersect transversally up to translation by Weyl group elements, and verify it in various cases, including complex Grassmannian Gr(2, n) and complete flag variety Fl_4.


title: Probabilistic DAG Search

abstract: Exciting contemporary machine learning problems have recently been phrased in the classic formalism of tree search -- most famously, the game of Go. Interestingly, the state-space underlying these sequential decision-making problems often posses a more general latent structure than can be captured by a tree. In this work, we develop a probabilistic framework to exploit a search space's latent structure and thereby share information across the search tree. The method is based on a combination of approximate inference in jointly Gaussian models for the explored part of the problem, and an abstraction for the unexplored part that imposes a reduction of complexity ad hoc. We empirically find our algorithm to compare favorably to existing non-probabilistic alternatives in Tic-Tac-Toe and a feature selection application.


title: Comment on "Scheme of the arrangement for attack on the protocol BB84"

abstract: In a recent paper (Scheme of the arrangement for attack on the protocol BB84, Optik 127(18):7083-7087, Sept 2016), a protocol was proposed for using weak measurement to attack BB84. This claimed the four basis states typically used could be perfectly discriminated, and so an interceptor could obtain all information carried. We show this attack fails when considered using standard quantum mechanics, as expected - such ``single-shot" quantum state discrimination is impossible, even using weak measurement.


title: On compactness of K\"ahler metrics with bounded entropy and bounded $L^{2n+1}$ scalar curvature

abstract: In their seminal work (\cite{CC}, \cite{CC2}), Chen and Cheng proved apriori estimates for the constant scalar curvature metrics on compact K\"ahler manifolds. They also proved $C^{3,\alpha}$ estimate for the potential of the \ka metrics under boundedness assumption on the scalar curvature and the entropy. The goal of this short note is to slightly relax the boundedness condition on the scalar curvature.


title: Predicting crop yields with little ground truth: A simple statistical model for in-season forecasting

abstract: We present a fully automated model for in-season crop yield prediction, designed to work where there is a dearth of sub-national "ground truth" information. Our approach relies primarily on satellite data and is characterized by careful feature engineering combined with a simple regression model. As such, it can work almost anywhere in the world. Applying it to 10 different crop-country pairs (5 cereals -- corn, wheat, sorghum, barley and millet, in 2 countries -- Ethiopia and Kenya), we achieve RMSEs of 5%-10% for predictions 9 months into the year, and 7%-14% for predictions 3 months into the year. The model outputs daily forecasts for the final yield of the current year. It is trained using approximately 4 million data points for each crop-country pair. These consist of: historical country-level annual yields, crop calendars, crop cover, NDVI, temperature, rainfall, and evapotransporation.


title: Entanglement cost of discriminating noisy Bell states by local operations and classical communication

abstract: Entangled states can help in quantum state discrimination by local operations and classical communication (LOCC). For example, a Bell state is necessary (and sufficient) to perfectly discriminate a set of either three or four Bell states by LOCC. In this paper, we consider the task of LOCC discrimination of the states of noisy Bell ensembles, where a given ensemble consists of the states obtained by mixing the Bell states with an arbitrary two-qubit state with nonzero probabilities. It is proved that a Bell state is required for optimal discrimination by LOCC, even though the ensembles do not contain, in general, any maximally entangled state, and in specific instances, any entangled state.


title: High order pulse-echo (HOPE) ultrasound

abstract: Multiple reflections between transducer and imaged object can naturally occur in ultrasound imaging and other acoustic sensing applications such as sonar. The repeated interaction of the emitted wavefront with the imaged object is traditionally regarded an undesired reverberation artifact, often misinterpreted as fictitious acoustic boundaries. Here we introduce high order reflection pulse-echo (HOPE)-ultrasound, a novel method that leverages high order reflections to improve on several aspects of conventional ultrasound imaging. HOPE is experimentally demonstrated to resolve sub-micrometer features by breaking through the Nyquist resolution limit. The major contrast enhancement of the high reflection orders allowed to reveal defects within materials invisible to conventional scanning acoustic microscopy. The technique is further shown to improve accuracy of frequency-dependent ultrasound attenuation measurements from biological tissues. HOPE ultrasound requires no additional hardware and is easy to implement, underscoring its potential to boost imaging performance in a broad range of biomedical imaging, nondestructive testing, and other acoustic sensing applications.


title: Coreference Augmentation for Multi-Domain Task-Oriented Dialogue State Tracking

abstract: Dialogue State Tracking (DST), which is the process of inferring user goals by estimating belief states given the dialogue history, plays a critical role in task-oriented dialogue systems. A coreference phenomenon observed in multi-turn conversations is not addressed by existing DST models, leading to sub-optimal performances. In this paper, we propose Coreference Dialogue State Tracker (CDST) that explicitly models the coreference feature. In particular, at each turn, the proposed model jointly predicts the coreferred domain-slot pair and extracts the coreference values from the dialogue context. Experimental results on MultiWOZ 2.1 dataset show that the proposed model achieves the state-of-the-art joint goal accuracy of 56.47%.


title: Rank-initial embeddings of non-standard models of set theory

abstract: A theoretical development is carried to establish fundamental results about rank-initial embeddings and automorphisms of countable non-standard models of set theory, with a keen eye for their sets of fixed points. These results are then combined into a "geometric technique" used to prove several results about countable non-standard models of set theory. In particular, back-and-forth constructions are carried out to establish various generalizations and refinements of Friedman's theorem on the existence of rank-initial embeddings between countable non-standard models of the fragment $\mathrm{KP}^\mathcal{P}$ + $\Sigma_1^\mathcal{P}$-Separation of $\mathrm{ZF}$; and Gaifman's technique of iterated ultrapowers is employed to show that any countable model of $\mathrm{GBC}$ + "$\mathrm{Ord}$ is weakly compact" can be elementarily rank-end-extended to models with well-behaved automorphisms whose sets of fixed points equal the original model. These theoretical developments are then utilized to prove various results relating self-embeddings, automorphisms, their sets of fixed points, strong rank-cuts, and set theories of different strengths. Two examples: The notion of "strong rank-cut" is characterized (i) in terms of the theory $\mathrm{GBC}$ + "$\mathrm{Ord}$ is weakly compact", and (ii) in terms of fixed-point sets of self-embeddings.


title: On the convex components of a set in $\mathbb{R}^n$

abstract: We prove a lower bound on the number of the convex components of a compact set with non-empty interior in $\mathbb{R}^n$ for all $n\ge2$. Our result generalizes and improves the inequalities previously obtained in M. Carozza, F. Giannetti, F. Leonetti and A. Passarelli di Napoli, "Convex components", in Communications in Contemporary Mathematics, Vol. 21, No. 06, 1850036 (2019) and in M. La Civita and F. Leonetti, "Convex components of a set and the measure of its boundary", Atti. Sem. Mat. Fis. Univ. Modena Reggio Emilia 56 (2008-2009) 71-78.


title: The spectrum and the Weyr characteristics of operator pencils and linear relations

abstract: The relation between the spectra of operator pencils with unbounded coefficients and of associated linear relations is investigated. It turns out that various types of spectrum coincide and the same is true for the Weyr characteristics. This characteristic describes how many independent Jordan chains up to a certain length exist. Furthermore, the change of this characteristic subject to one-dimensional perturbations is investigated.


title: AtrialGeneral: Domain Generalization for Left Atrial Segmentation of Multi-Center LGE MRIs

abstract: Left atrial (LA) segmentation from late gadolinium enhanced magnetic resonance imaging (LGE MRI) is a crucial step needed for planning the treatment of atrial fibrillation. However, automatic LA segmentation from LGE MRI is still challenging, due to the poor image quality, high variability in LA shapes, and unclear LA boundary. Though deep learning-based methods can provide promising LA segmentation results, they often generalize poorly to unseen domains, such as data from different scanners and/or sites. In this work, we collect 210 LGE MRIs from different centers with different levels of image quality. To evaluate the domain generalization ability of models on the LA segmentation task, we employ four commonly used semantic segmentation networks for the LA segmentation from multi-center LGE MRIs. Besides, we investigate three domain generalization strategies, i.e., histogram matching, mutual information based disentangled representation, and random style transfer, where a simple histogram matching is proved to be most effective.


title: Real phase structures on matroid fans and matroid orientations

abstract: We introduce the notion of real phase structure on rational polyhedral fans in Euclidean space. Such a structure consists of an assignment of affine spaces over $\mathbb{Z}/2\mathbb{Z}$ to each top dimensional face of the fan subject to two conditions. Given an oriented matroid we can construct a real phase structure on the fan of the underlying matroid. Conversely, we show that from a real phase structure on a matroid fan we can produce an orientation of the underlying matroid. Thus real phase structures are cryptomorphic to matroid orientations. The topes of the orientated matroid are recovered immediately from the real phase structure. We also provide a direct way to recover the signed circuits of the oriented matroid from the real phase structure.


title: Modeling and Accomplishing the BEREC Network Neutrality Policy

abstract: Network neutrality (NN) is a principle of equal treatment of data in network infrastructures with fairness and universality being the primary outcomes of the NN management practice. For networks, the accomplishment of NN management practice is essential to deal with heterogeneous user requirements and the ever-increasing data traffic. Current tools and methods address the NN problem by detecting network neutrality violations and detecting traffic differentiation. This paper proposes the NN-PCM (Network Neutrality Policy Conformance Module) that deploys the BEREC network neutrality policy using a bandwidth allocation model (BAM). The NN-PCM new approach allocates bandwidth to network users and accomplishes the BEREC NN policy concomitantly. Network neutrality is achieved by grouping users with similar traffic requirements in classes and leveraging the bandwidth allocation model's characteristics. The conceptual analysis and simulation results indicate that NN-PCM allocates bandwidth to users and accomplishes BEREC network neutrality conformance by design with transparent, non-discriminatory, exceptional, and proportional management practices.


title: Bilby-MCMC: An MCMC sampler for gravitational-wave inference

abstract: We introduce Bilby-MCMC, a Markov-Chain Monte-Carlo sampling algorithm tuned for the analysis of gravitational waves from merging compact objects. Bilby-MCMC provides a parallel-tempered ensemble Metropolis-Hastings sampler with access to a block-updating proposal library including problem-specific and machine learning proposals. We demonstrate that learning proposals can produce over a 10-fold improvement in efficiency by reducing the autocorrelation time. Using a variety of standard and problem-specific tests, we validate the ability of the Bilby-MCMC sampler to produce independent posterior samples and estimate the Bayesian evidence. Compared to the widely-used dynesty nested sampling algorithm, Bilby-MCMC is less efficient in producing independent posterior samples and less accurate in its estimation of the evidence. However, we find that posterior samples drawn from the Bilby-MCMC sampler are more robust: never failing to pass our validation tests. Meanwhile, the dynesty sampler fails the difficult-to-sample Rosenbrock likelihood test, over constraining the posterior. For CBC problems, this highlights the importance of cross-sampler comparisons to ensure results are robust to sampling error. Finally, Bilby-MCMC can be embarrassingly and asynchronously parallelised making it highly suitable for reducing the analysis wall-time using a High Throughput Computing environment. Bilby-MCMC may be a useful tool for the rapid and robust analysis of gravitational-wave signals during the advanced detector era and we expect it to have utility throughout astrophysics.


title: EVA: a quantum Exponential Value Approximation algorithm

abstract: VQE is currently one of the most widely used algorithms for optimizing problems using quantum computers. A necessary step in this algorithm is calculating the expectation value given a state, which is calculated by decomposing the Hamiltonian into Pauli operators and obtaining this value for each of them. In this work, we have designed an algorithm capable of figuring this value using a single circuit. A time cost study has been carried out, and it has been found that in certain more complex Hamiltonians, it is possible to obtain a good performance over the current methods.


title: AMA-GCN: Adaptive Multi-layer Aggregation Graph Convolutional Network for Disease Prediction

abstract: Recently, Graph Convolutional Networks (GCNs) have proven to be a powerful mean for Computer Aided Diagnosis (CADx). This approach requires building a population graph to aggregate structural information, where the graph adjacency matrix represents the relationship between nodes. Until now, this adjacency matrix is usually defined manually based on phenotypic information. In this paper, we propose an encoder that automatically selects the appropriate phenotypic measures according to their spatial distribution, and uses the text similarity awareness mechanism to calculate the edge weights between nodes. The encoder can automatically construct the population graph using phenotypic measures which have a positive impact on the final results, and further realizes the fusion of multimodal information. In addition, a novel graph convolution network architecture using multi-layer aggregation mechanism is proposed. The structure can obtain deep structure information while suppressing over-smooth, and increase the similarity between the same type of nodes. Experimental results on two databases show that our method can significantly improve the diagnostic accuracy for Autism spectrum disorder and breast cancer, indicating its universality in leveraging multimodal data for disease prediction.


title: Intertwined non-trivial band topology and giant Rashba spin splitting

abstract: Composite quantum compounds (CQCs) have become an important avenue for the investigation of inter-correlation between two distinct phenomenon in physics. Topological superconductors, axion insulators etc. are few such CQCs which have recently drawn tremendous attention in the community. Topological nontriviality and Rashba spin physics are two different quantum phenomena but can be intertwined within a CQC platform. In this letter, we present a general symmetry based mechanism, supported by \textit{ab-initio} calculations to achieve intertwined giant Rashba splitting and topological non-trivial states simultaneously in a single crystalline system. Such co-existent properties can further be tuned to achieve other rich phenomenon. We have achieved Rashba splitting energy ($\Delta E$) and Rashba coefficient ($\alpha$) values as large as 161 meV and 4.87 eV$\r{A}$ respectively in conjunction with Weyl semimetal phase in KSnSb$_{0.625}$Bi$_{0.375}$. Interestingly, these values are even larger than the values reported for widely studied topologically trivial Rashba semiconductor BiTeI. The advantage of our present analysis is that one can achieve various topological phases without compromising the Rashba parameters, within this CQC platform.


title: Accretion bursts in high-mass protostars: a new testbed for models of episodic accretion

abstract: It is well known that low mass young stellar objects (LMYSOs) gain a significant portion of their final mass through episodes of very rapid accretion, with mass accretion rates up to $\dot M_* \sim 10^{-4} M_{\odot}$~yr$^{-1}$. Recent observations of high mass young stellar objects (HMYSO) with masses $M_* \gtrsim 10 M_{\odot}$ uncovered outbursts with accretion rates exceeding $\dot M_*\sim 10^{-3}M_{\odot}$~yr$^{-1}$. Here we examine which scenarios proposed in the literature so far to explain accretion bursts of LMYSOs can apply to the episodic accretion in HMYSOs. We utilise a 1D time dependent models of protoplanetary discs around HMYSOs to study burst properties. We find that discs around HMYSOs are much hotter than those around their low mass cousins. As a result, much more extended regions of the disc are prone to the thermal hydrogen ionisation and MRI activation instabilities. The former in particular is found to be ubiquitous in a very wide range of accretion rates and disc viscosity parameters. The outbursts triggered by these instabilities, however, always have too low $\dot M_*$, and are one to several orders of magnitude too long compared to those observed from HMYSOs so far. On the other hand, bursts generated by tidal disruptions of gaseous giant planets formed by the gravitational instability of the protoplanetary discs yield properties commensurate with observations, provided that the clumps are in the post-collapse configuration with planet radius $R_{\rm p} \gtrsim 10 $ Jupiter radii. Furthermore, if observed bursts are caused by disc ionisation instabilities then they should be periodic phenomena with the duration of the quiescent phase comparable to that of the bursts. This may yield potentially observable burst periodicity signatures in the jets, the outer disc, or the surrounding diffuse material of massive HMYSOs. (abridged)


title: A generalization of a theorem of Nash-Williams

abstract: In 1972, Chvatal gave a well-known sufficient condition for a graphical sequence to be forcibly hamiltonian, and showed that in some sense his condition is best possible. Nash-Williams gave examples of forcibly hamiltonian n-sequences that do not satisfy Chvatla's condition for every n at least 5. In this note we generalize the Nash-Williams examples, and use this generalization to generate \Omega(2^n/n^.5) forcibly hamiltonian n-sequences that do not satisfy Chvatal's condition


title: Symplectic groups over noncommutative algebras

abstract: We introduce the symplectic group $\mathrm{Sp}_2(A,\sigma)$ over a noncommutative algebra $A$ with an anti-involution $\sigma$. We realize several classical Lie groups as $\mathrm{Sp}_2$ over various noncommutative algebras, which provides new insights into their structure theory. We construct several geometric spaces, on which the groups $\mathrm{Sp}_2(A,\sigma)$ act. We introduce the space of isotropic $A$-lines, which generalizes the projective line. We describe the action of $\mathrm{Sp}_2(A,\sigma)$ on isotropic $A$-lines, generalize the Kashiwara-Maslov index of triples and the cross ratio of quadruples of isotropic $A$-lines as invariants of this action. When the algebra $A$ is Hermitian or the complexification of a Hermitian algebra, we introduce the symmetric space $X_{\mathrm{Sp}_2(A,\sigma)}$, and construct different models of this space. Applying this to classical Hermitian Lie groups of tube type (realized as $\mathrm{Sp}_2(A,\sigma)$) and their complexifications, we obtain different models of the symmetric space as noncommutative generalizations of models of the hyperbolic plane and of the three-dimensional hyperbolic space. We also provide a partial classification of Hermitian algebras in Appendix A.


title: Benefits, Challenges and Contributors to Success for National eHealth Systems Implementation: A Scoping Review

abstract: Our scoping review aims to assess what legal, ethical, and socio-technical factors contribute or inhibit the success of national eHealth system implementations. In addition, our review seeks to describe the characteristics and benefits of eHealth systems. We conducted a scoping review of literature published in English between January 2000 and 2020 using a keyword search on five databases; PubMed, Scopus, Web of Science, IEEEXplore, and ProQuest. After removal of duplicates, abstract screening and full-text filtering, 86 articles were included from 8276 search results. We identified 17 stakeholder groups, 6 eHealth Systems areas, and 15 types of legal regimes and standards. In-depth textual analysis revealed challenges mainly in implementation, followed by ethico-legal and data related aspects. Key factors influencing success include promoting trust of the system, ensuring wider acceptance amongst users, reconciling the system with legal requirements and ensuring an adaptable technical platform. Results revealed support for decentralised implementations because they carry less implementation and engagement challenges than centralised ones. Simultaneously, due to decentralised systems interoperability issues, federated implementations (with a set of national standards) might be preferable. This study identifies the primary socio-technical, legal and ethical factors that challenge and contribute to the success of eHealth system implementations. This study also describes the complexities and characteristics of existing eHealth implementation programs, and surmises suggested guidance for resolving the identified challenges.


title: Probability of Resolution of MUSIC and g-MUSIC: An Asymptotic Approach

abstract: In this article, the outlier production mechanism of the conventional Multiple Signal Classification (MUSIC) and the g-MUSIC Direction-of-Arrival (DoA) estimation technique is investigated using tools from Random Matrix Theory (RMT). A general Central Limit Theorem (CLT) is derived that allows to analyze the asymptotic stochastic behavior of eigenvector-based cost functions in the asymptotic regime where the number of snapshots and the number of antennas increase without bound at the same rate. Furthermore, this CLT is used to provide an accurate prediction of the resolution capabilities of the MUSIC and the g-MUSIC DoA estimation method. The finite dimensional distribution of the MUSIC and the g-MUSIC cost function is shown to be asymptotically jointly Gaussian distributed in the asymptotic regime.


title: Cosmological particle production in quantum gravity

abstract: Quantum theory of a test field on a quantum cosmological spacetime may be viewed as a theory of the test field on an emergent classical background. In such a case, the resulting dressed metric for the field propagation is a function of the quantum fluctuations of the original geometry. When the backreaction is negligible, massive modes can experience an anisotropic Bianchi type I background. The field modes propagating on such a quantum-gravity-induced spacetime can then unveil interesting phenomenological consequences of the super-Planckian scales, such as gravitational particle production. The aim of this paper is to address the issue of gravitational particle production associated to the massive modes in such an anisotropic dressed spacetime. By imposing a suitable adiabatic condition on the vacuum state and computing the energy density of the created particles, the significance of the particle production on the dynamics of the universe in Planck era is discussed.


title: The DEWCAD Project: Pushing Back the Doubly Exponential Wall of Cylindrical Algebraic Decomposition

abstract: This abstract seeks to introduce the ISSAC community to the DEWCAD project, which is based at Coventry University and the University of Bath, in the United Kingdom. The project seeks to push back the Doubly Exponential Wall of Cylindrical Algebraic Decomposition, through the integration of SAT/SMT technology, the extension of Lazard projection theory, and the development of new algorithms based on CAD technology but without producing CADs themselves. The project also seeks to develop applications of CAD and will focus on applications in the domains of economics and bio-network analysis.


title: Enriching Source Style Transfer in Recognition-Synthesis based Non-Parallel Voice Conversion

abstract: Current voice conversion (VC) methods can successfully convert timbre of the audio. As modeling source audio's prosody effectively is a challenging task, there are still limitations of transferring source style to the converted speech. This study proposes a source style transfer method based on recognition-synthesis framework. Previously in speech generation task, prosody can be modeled explicitly with prosodic features or implicitly with a latent prosody extractor. In this paper, taking advantages of both, we model the prosody in a hybrid manner, which effectively combines explicit and implicit methods in a proposed prosody module. Specifically, prosodic features are used to explicit model prosody, while VAE and reference encoder are used to implicitly model prosody, which take Mel spectrum and bottleneck feature as input respectively. Furthermore, adversarial training is introduced to remove speaker-related information from the VAE outputs, avoiding leaking source speaker information while transferring style. Finally, we use a modified self-attention based encoder to extract sentential context from bottleneck features, which also implicitly aggregates the prosodic aspects of source speech from the layered representations. Experiments show that our approach is superior to the baseline and a competitive system in terms of style transfer; meanwhile, the speech quality and speaker similarity are well maintained.


title: Amenability and profinite completions of finitely generated groups

abstract: This article explores the interplay between the finite quotients of finitely generated residually finite groups and the concept of amenability. We construct a finitely generated, residually finite, amenable group $A$ and an uncountable family of finitely generated, residually finite non-amenable groups all of which are profinitely isomorphic to $A$. All of these groups are branch groups. Moreover, picking up Grothendieck's problem, the group $A$ embeds in these groups such that the inclusion induces an isomorphism of profinite completions. In addition, we review the concept of uniform amenability, a strengthening of amenability introduced in the 70's, and we prove that uniform amenability indeed is detectable from the profinite completion.


title: Electroweak monopoles with a non-linearly realized weak hypercharge

abstract: We present a finite-energy electroweak-monopole solution obtained by considering non-linear extensions of the hypercharge sector of the Electroweak Theory, based on logarithmic and exponential versions of electrodynamics. We find constraints for a class of non-linear extensions and also work out an estimate for the monopole mass in this scenario. We finally derive a lower bound for the energy of the monopole and discuss the simpler case of a Dirac magnetic charge.


title: Modal dynamics in multimode optical fibers: An attractor of high-order modes

abstract: Multimode fibers (MMFs) support abundant spatial modes and involve rich spatiotemporal dynamics, yielding many promising applications. Here, we investigate the influences of the number and initial energy of high-order modes (HOMs) on the energy flow from the intermediate modes (IMs) to the fundamental mode (FM) and HOMs. It is quite surprising that random distribution of high-order modes evolves to a stationary one, indicating the asymptotic behavior of orbits in the same attraction domain. By employing the Lyapunov exponent, we prove that the threshold of the HOMs-attractor is consistent with the transition point of the energy flow which indiactes the HOMs-attracotr acts as a "valve" in the modal energy flow. Our results provide a new perspective to explore the nonlinear phenomena in MMFs, such as Kerr self-cleaning, and may pave the way to some potential applications, such as secure communications in MMFs.


title: Analysis of an in-service rupture of the Inner First Wall of Tore Supra

abstract: The last experimental campaign of Tore Supra was also the last one with a set of plasma facing components mainly dating from the assembly of the machine in 1988. This campaign was interrupted a few days ahead of schedule because of the rupture of one coolant tube of the Inner First Wall (IFW). The rupture was observed by an abrupt increase of the pressure in the vessel. It was caused by a water leak which occurred two seconds after the end of the lower hybrid heating pulse during the current ramp-down. Investigations show that the accident is not related to the operation of the machine or a weaker element but rather to a localised heat flux exceeding the heat removal capability of the IFW.


title: Real-time Adversarial Perturbations against Deep Reinforcement Learning Policies: Attacks and Defenses

abstract: Deep reinforcement learning (DRL) is vulnerable to adversarial perturbations. Adversaries can mislead the policies of DRL agents by perturbing the state of the environment observed by the agents. Existing attacks are feasible in principle, but face challenges in practice, either by being too slow to fool DRL policies in real time or by modifying past observations stored in the agent's memory. We show that Universal Adversarial Perturbations (UAP), independent of the individual inputs to which they are applied, can fool DRL policies effectively and in real time. We introduce three attack variants leveraging UAP. Via an extensive evaluation using three Atari 2600 games, we show that our attacks are effective, as they fully degrade the performance of three different DRL agents (up to 100%, even when the $l_\infty$ bound on the perturbation is as small as 0.01). It is faster than the frame rate (60 Hz) of image capture and considerably faster than prior attacks ($\approx 1.8$ms). Our attack technique is also efficient, incurring an online computational cost of $\approx 0.027$ms. Using two tasks involving robotic movement, we confirm that our results generalize to complex DRL tasks. Furthermore, we demonstrate that the effectiveness of known defenses diminishes against universal perturbations. We introduce an effective technique that detects all known adversarial perturbations against DRL policies, including all universal perturbations presented in this paper.


title: Towards Optimally Weighted Physics-Informed Neural Networks in Ocean Modelling

abstract: The carbon pump of the world's ocean plays a vital role in the biosphere and climate of the earth, urging improved understanding of the functions and influences of the ocean for climate change analyses. State-of-the-art techniques are required to develop models that can capture the complexity of ocean currents and temperature flows. This work explores the benefits of using physics-informed neural networks (PINNs) for solving partial differential equations related to ocean modeling; such as the Burgers, wave, and advection-diffusion equations. We explore the trade-offs of using data vs. physical models in PINNs for solving partial differential equations. PINNs account for the deviation from physical laws in order to improve learning and generalization. We observed how the relative weight between the data and physical model in the loss function influence training results, where small data sets benefit more from the added physics information.


title: Input Invex Neural Network

abstract: Connected decision boundaries are useful in several tasks like image segmentation, clustering, alpha-shape or defining a region in nD-space. However, the machine learning literature lacks methods for generating connected decision boundaries using neural networks. Thresholding an invex function, a generalization of a convex function, generates such decision boundaries. This paper presents two methods for constructing invex functions using neural networks. The first approach is based on constraining a neural network with Gradient Clipped-Gradient Penality (GCGP), where we clip and penalise the gradients. In contrast, the second one is based on the relationship of the invex function to the composition of invertible and convex functions. We employ connectedness as a basic interpretation method and create connected region-based classifiers. We show that multiple connected set based classifiers can approximate any classification function. In the experiments section, we use our methods for classification tasks using an ensemble of 1-vs-all models as well as using a single multiclass model on larger-scale datasets. The experiments show that connected set-based classifiers do not pose any disadvantage over ordinary neural network classifiers, but rather, enhance their interpretability. We also did an extensive study on the properties of invex function and connected sets for interpretability and network morphism with experiments on simulated and real-world data sets. Our study suggests that invex function is fundamental to understanding and applying locality and connectedness of input space which is useful for various downstream tasks.


title: Learning to Disentangle GAN Fingerprint for Fake Image Attribution

abstract: Rapid pace of generative models has brought about new threats to visual forensics such as malicious personation and digital copyright infringement, which promotes works on fake image attribution. Existing works on fake image attribution mainly rely on a direct classification framework. Without additional supervision, the extracted features could include many content-relevant components and generalize poorly. Meanwhile, how to obtain an interpretable GAN fingerprint to explain the decision remains an open question. Adopting a multi-task framework, we propose a GAN Fingerprint Disentangling Network (GFD-Net) to simultaneously disentangle the fingerprint from GAN-generated images and produce a content-irrelevant representation for fake image attribution. A series of constraints are provided to guarantee the stability and discriminability of the fingerprint, which in turn helps content-irrelevant feature extraction. Further, we perform comprehensive analysis on GAN fingerprint, providing some clues about the properties of GAN fingerprint and which factors dominate the fingerprint in GAN architecture. Experiments show that our GFD-Net achieves superior fake image attribution performance in both closed-world and open-world testing. We also apply our method in binary fake image detection and exhibit a significant generalization ability on unseen generators.


title: Quasi-Bayesian Dual Instrumental Variable Regression

abstract: Recent years have witnessed an upsurge of interest in employing flexible machine learning models for instrumental variable (IV) regression, but the development of uncertainty quantification methodology is still lacking. In this work we present a novel quasi-Bayesian procedure for IV regression, building upon the recently developed kernelized IV models and the dual/minimax formulation of IV regression. We analyze the frequentist behavior of the proposed method, by establishing minimax optimal contraction rates in $L_2$ and Sobolev norms, and discussing the frequentist validity of credible balls. We further derive a scalable inference algorithm which can be extended to work with wide neural network models. Empirical evaluation shows that our method produces informative uncertainty estimates on complex high-dimensional problems.


title: Homological stability for the ribbon Higman--Thompson groups

abstract: We generalize the notion of asymptotic mapping class groups and allow them to surject to the Higman--Thompson groups, answering a question of Aramayona and Vlamis in the case of the Higman--Thompson groups. When the underlying surface is a disk, these new asymptotic mapping class groups can be identified with the ribbon and oriented ribbon Higman--Thompson groups. We use this model to prove that the ribbon Higman--Thompson groups satisfy homological stability, providing the first homological stability result for dense subgroups of big mapping class groups. Our result can also be treated as an extension of Szymik--Wahl's work on homological stability for the Higman--Thompson groups to the surface setting.


title: Unsupervised Domain Adaptation with Variational Approximation for Cardiac Segmentation

abstract: Unsupervised domain adaptation is useful in medical image segmentation. Particularly, when ground truths of the target images are not available, domain adaptation can train a target-specific model by utilizing the existing labeled images from other modalities. Most of the reported works mapped images of both the source and target domains into a common latent feature space, and then reduced their discrepancy either implicitly with adversarial training or explicitly by directly minimizing a discrepancy metric. In this work, we propose a new framework, where the latent features of both domains are driven towards a common and parameterized variational form, whose conditional distribution given the image is Gaussian. This is achieved by two networks based on variational auto-encoders (VAEs) and a regularization for this variational approximation. Both of the VAEs, each for one domain, contain a segmentation module, where the source segmentation is trained in a supervised manner, while the target one is trained unsupervisedly. We validated the proposed domain adaptation method using two cardiac segmentation tasks, i.e., the cross-modality (CT and MR) whole heart segmentation and the cross-sequence cardiac MR segmentation. Results show that the proposed method achieved better accuracies compared to two state-of-the-art approaches and demonstrated good potential for cardiac segmentation. Furthermore, the proposed explicit regularization was shown to be effective and efficient in narrowing down the distribution gap between domains, which is useful for unsupervised domain adaptation. Our code and data has been released via https://zmiclab.github.io/projects.html.


title: Domain Wall Fermions on the Brane

abstract: We study domain wall fermions and their condensation in the D3/probe D7 system. A spatially dependent mass term for the N=2 hypermultiplet can be arranged to isolate distinct two component fermions on two 2+1 dimensional domain walls. We argue that the system shows condensation/mass generation analogous to the D3/probe D5 anti-D5 system. The chiral condensate and pion mass can be directly computed on the domain wall. We provide evidence that these systems with the domains separated by a width w have a bare (current) quark mass that scales as 1/w when the spatial dependent mass is large. Adding a magnetic field does not induce chiral symmetry breaking between the separated domain wall fermions, but a similar phenomenological dilaton factor can be made strong enough to introduce spontaneous symmetry breaking. We show a Gell-Man-Oakes-Renner relation for the pions in that case and also for the case where the D7 probe is in a back-reacted dilaton flow geometry. The vacuum configurations can also be interpreted as having a spontaneously generated mass by a Nambu-Jona-Lasinio four fermion operator, depending on the choice of boundary conditions on fluctuations, according to Witten's multi-trace prescription.


title: Conformal Three-Dimensional Interphase of Li Metal Anode Revealed by Low Dose Cryo-Electron Microscopy

abstract: Using cryogenic transmission electron microscopy, we revealed three dimensional (3D) structural details of the electrochemically plated lithium (Li) flakes and their solid electrolyte interphase (SEI), including the composite SEI skin-layer and SEI fossil pieces buried inside the Li matrix. As the SEI skin-layer is largely comprised of nanocrystalline LiF and Li2O in amorphous polymeric matrix, when complete Li stripping occurs, the compromised SEI three-dimensional framework buckles, forming nanoscale bends and wrinkles. We showed that the flexibility and resilience of the SEI skin-layer plays a vital role in preserving an intact SEI 3D framework after Li stripping. The intact SEI network enables the nucleation and growth of the newly plated Li inside the previously formed SEI network in the subsequent cycles, preventing additional large amount of SEI formation between newly plated Li metal and the electrolyte. In addition, cells cycled under the accurately controlled uniaxial pressure can further enhance the repeated utilization of the SEI framework and improve the coulombic efficiency (CE) by up to 97%, demonstrating an effective strategy of reducing the formation of additional SEI and inactive dead Li. The identification of such flexible and porous 3D SEI framework clarifies the working mechanism of SEI in lithium metal anode for batteries. The insights provided in this work will inspire researchers to design more functional artificial 3D SEI on other metal anodes to improve rechargeable metal battery with long cycle life.


title: Mean Field Markov Decision Processes

abstract: We consider mean-field control problems in discrete time with discounted reward, infinite time horizon and compact state and action space. The existence of optimal policies is shown and the limiting mean-field problem is derived when the number of individuals tends to infinity. Moreover, we consider the average reward problem and show that the optimal policy in this mean-field limit is $\varepsilon$-optimal for the discounted problem if the number of individuals is large and the discount factor close to one. This result is very helpful, because it turns out that in the special case when the reward does only depend on the distribution of the individuals, we obtain a very interesting subclass of problems where an average reward optimal policy can be obtained by first computing an optimal measure from a static optimization problem and then achieving it with Markov Chain Monte Carlo methods. We give two applications: Avoiding congestion an a graph and optimal positioning on a market place which we solve explicitly.


title: Optimizing Data Augmentation Policy Through Random Unidimensional Search

abstract: It is no secret amongst deep learning researchers that finding the optimal data augmentation strategy during training can mean the difference between state-of-the-art performance and a run-of-the-mill result. To that end, the community has seen many efforts to automate the process of finding the perfect augmentation procedure for any task at hand. Unfortunately, even recent cutting-edge methods bring massive computational overhead, requiring as many as 100 full model trainings to settle on an ideal configuration. We show how to achieve equivalent performance using just 6 trainings with Random Unidimensional Augmentation. Source code is available at https://github.com/fastestimator/RUA/tree/v1.0


title: An operator model in the annulus

abstract: For an invertible linear operator $T$ on a Hilbert space $H$, put \[ \alpha(T^*,T) := -T^{*2}T^2 + (1+r^2) T^* T - r^2 I, \] where $I$ stands for the identity operator on $H$ and $r\in (0,1)$; this expression comes from applying Agler's hereditary functional calculus to the polynomial $\alpha(t)=(1-t) (t-r^2)$. We give a concrete unitarily equivalent functional model for operators satisfying $\alpha(T^*,T)\ge0$. In particular, we prove that the closed annulus $r\le |z|\le 1$ is a complete $K$-spectral set for $T$. We explain the relation of the model with the Sz.-Nagy--Foias one and with the observability gramian and discuss the relationship of this class with other operator classes related to the annulus.


title: A class of Lie algebras who contains a class of Kac-Moody algebras

abstract: The theory of standard pentads is the theory aims to construct a graded Lie algebra whose local part consists of a given Lie algebra and its representation. In other words, using standard pentads, we can embed given Lie algebra and its representation into a larger graded Lie algebra. As special cases of Lie algebras associated with standard pentads, we have the notion of PC Lie algebras. Our aim of this paper is to show that the class of PC Lie algebras contains the class of Kac-Moody algebras, that is, to show that the notion of PC Lie algebras is an extension of Kac-Moody algebras.


title: OpenSSLNTRU: Faster post-quantum TLS key exchange

abstract: Google's CECPQ1 experiment in 2016 integrated a post-quantum key-exchange algorithm, newhope1024, into TLS 1.2. The Google-Cloudflare CECPQ2 experiment in 2019 integrated a more efficient key-exchange algorithm, ntruhrss701, into TLS 1.3. This paper revisits the choices made in CECPQ2, and shows how to achieve higher performance for post-quantum key exchange in TLS 1.3 using a higher-security algorithm, sntrup761. Previous work had indicated that ntruhrss701 key generation was much faster than sntrup761 key generation, but this paper makes sntrup761 key generation much faster by generating a batch of keys at once. Batch key generation is invisible at the TLS protocol layer, but raises software-engineering questions regarding the difficulty of integrating batch key exchange into existing TLS libraries and applications. This paper shows that careful choices of software layers make it easy to integrate fast post-quantum software, including batch key exchange, into TLS with minor changes to TLS libraries and no changes to applications. As a demonstration of feasibility, this paper reports successful integration of its fast sntrup761 library, via a lightly patched OpenSSL, into an unmodified web browser and an unmodified TLS terminator. This paper also reports TLS 1.3 handshake benchmarks, achieving more TLS 1.3 handshakes per second than any software included in OpenSSL.


title: New Observations of the IR Emission Corona from the July 2, 2019 Eclipse Flight of the Airborne Infrared Spectrometer

abstract: The Airborne Infrared Spectrometer (AIR-Spec) was commissioned during the 2017 total solar eclipse, when it observed five infrared coronal emission lines from a Gulfstream V (GV) research jet owned by the National Science Foundation (NSF) and operated by the National Center for Atmospheric Research (NCAR). The second AIR-Spec research flight took place during the July 2, 2019 total solar eclipse across the South Pacific. The 2019 eclipse flight resulted in seven minutes of observations, during which the instrument measured all four of its target emission lines: S XI 1.393 $\mu$m, Si X 1.431 $\mu$m, S XI 1.921 $\mu$m, and Fe IX 2.853 $\mu$m. The 1.393 $\mu$m line was detected for the first time, and probable first detections were made of Si XI 1.934 $\mu$m and Fe X 1.947 $\mu$m. The 2017 AIR-Spec detection of Fe IX was confirmed and the first observations were made of the Fe IX line intensity as a function of solar radius. Telluric absorption features were used to calibrate the wavelength mapping, instrumental broadening, and throughput of the instrument. AIR-Spec underwent significant upgrades in preparation for the 2019 eclipse observation. The thermal background was reduced by a factor of 30, providing a 5.5x improvement in signal-to-noise ratio, and the post-processed pointing stability was improved by a factor of five to $<$10 arcsec rms. In addition, two imaging artifacts were identified and resolved, improving the spectral resolution and making the 2019 data easier to interpret.


title: Toward Affective XAI: Facial Affect Analysis for Understanding Explainable Human-AI Interactions

abstract: As machine learning approaches are increasingly used to augment human decision-making, eXplainable Artificial Intelligence (XAI) research has explored methods for communicating system behavior to humans. However, these approaches often fail to account for the emotional responses of humans as they interact with explanations. Facial affect analysis, which examines human facial expressions of emotions, is one promising lens for understanding how users engage with explanations. Therefore, in this work, we aim to (1) identify which facial affect features are pronounced when people interact with XAI interfaces, and (2) develop a multitask feature embedding for linking facial affect signals with participants' use of explanations. Our analyses and results show that the occurrence and values of facial AU1 and AU4, and Arousal are heightened when participants fail to use explanations effectively. This suggests that facial affect analysis should be incorporated into XAI to personalize explanations to individuals' interaction styles and to adapt explanations based on the difficulty of the task performed.


title: Shape from Blur: Recovering Textured 3D Shape and Motion of Fast Moving Objects

abstract: We address the novel task of jointly reconstructing the 3D shape, texture, and motion of an object from a single motion-blurred image. While previous approaches address the deblurring problem only in the 2D image domain, our proposed rigorous modeling of all object properties in the 3D domain enables the correct description of arbitrary object motion. This leads to significantly better image decomposition and sharper deblurring results. We model the observed appearance of a motion-blurred object as a combination of the background and a 3D object with constant translation and rotation. Our method minimizes a loss on reconstructing the input image via differentiable rendering with suitable regularizers. This enables estimating the textured 3D mesh of the blurred object with high fidelity. Our method substantially outperforms competing approaches on several benchmarks for fast moving objects deblurring. Qualitative results show that the reconstructed 3D mesh generates high-quality temporal super-resolution and novel views of the deblurred object.


title: Non-Hermitian arrangement for stable semiconductor laser arrays

abstract: We propose and explore a physical mechanism for the stabilization of the complex spatiotemporal dynamics in arrays (bars) of broad area laser diodes taking advantage of the symmetry breaking in non-Hermitian potentials. We show that such stabilization can be achieved by specific pump and index profiles leading to a PT-symmetric coupling between nearest neighboring lasers within the semiconductor bar. A numerical analysis is performed using a complete (2+1)-dimensional space-temporal model, including transverse and longitudinal spatial degrees of freedom and temporal evolution of the electric field and carriers. We show regimes of temporal stabilization and light emission spatial redistribution and enhancement. We also consider a simplified (1+1)-dimensional model for an array of lasers holding the proposed non-Hermitian coupling with a global axisymmetric geometry. We numerically demonstrate a two-fold benefit: the control over the temporal dynamics over the EELs bar and the field concentration on the central lasers leading to a brighter output beam, facilitating a direct coupling to an optical fiber.


title: Photodetachment and Test-Particle Simulation Constraints on Negative Ions in Solar System Plasmas

abstract: Negative ions have been detected in abundance in recent years by spacecraft across the solar system. These detections were, however, made by instruments not designed for this purpose and, as such, significant uncertainties remain regarding the prevalence of these unexpected plasma components. In this article, the phenomenon of photodetachment is examined and experimentally and theoretically derived cross-sections are used to calculate photodetachment rates for a range of atomic and molecular negative ions subjected to the solar photon spectrum. These rates are applied to negative ions outflowing from Europa, Enceladus, Titan, Dione and Rhea and their trajectories are traced to constrain source production rates and the extent to which negative ions are able to pervade the surrounding space environments. Predictions are also made for further negative ion populations in the outer solar system with Triton used as an illustrative example. This study demonstrates how, at increased heliocentric distances, negative ions can form stable ambient plasma populations and can be exploited by future missions to the outer solar system.

categories: physics.space-ph astro-ph.EP physics.ao-ph physics.geo-ph physics.plasm-ph


title: Random iron-nickel alloys: From first principles to dynamic spin fluctuation theory

abstract: We provide a systematic analysis of finite-temperature magnetic properties of random alloys Fe$_x$Ni$_{1-x}$ with the face-centered-cubic structure over a broad concentration range $x$. By means of the spin-polarized relativistic Korringa-Kohn-Rostoker method we calculate the electronic structure of disordered iron-nickel alloys and discuss how a composition change affects magnetic moments of Fe and Ni and the density of states. We investigate how the Curie temperature depends on Fe concentration using conventional approaches, such as mean-field approximation or Monte Carlo simulations, and dynamic spin-fluctuation theory. Being devised to account for spin fluctuations explicitly, the latter method shows the best fit to experimental results.


title: Measurement of the inclusive branching fraction for $\psi(3686)\rightarrow K_{S}^{0} + \text{anything}$

abstract: Using 5.9~pb$^{-1}$ of $e^+e^-$ annihilation data collected at center-of-mass energies from 3.640 to 3.701 GeV with the BESIII detector at the BEPCII Collider, we measure the observed cross sections of $e^+e^-\rightarrow K_{S}^{0} X$ (where $X= \text{anything}$). From a fit to these observed cross sections with the sum of continuum and $\psi(3686)$ and $J/\psi$ Breit-Wigner functions and considering initial state radiation and the BEPCII beam energy spread, we obtain for the first time the product of $\psi(3686)$ leptonic width and inclusive decay branching fraction $\Gamma^{ee}_{\psi(3686)}\mathcal B(\psi(3686)\rightarrow K_{S}^{0} X) = (373.8 \pm 6.7 \pm 20.0)$ eV, and assuming $\Gamma^{ee}_{\psi(3686)}$ is $(2.33 \pm 0.04)$ keV from PDG value, we measure $\mathcal B(\psi(3686)\rightarrow K_{S}^{0} X) = (16.04 \pm 0.29 \pm 0.90)\%$, where the first uncertainty is statistical and the second is systematic.


title: To Raise or Not To Raise: The Autonomous Learning Rate Question

abstract: There is a parameter ubiquitous throughout the deep learning world: learning rate. There is likewise a ubiquitous question: what should that learning rate be? The true answer to this question is often tedious and time consuming to obtain, and a great deal of arcane knowledge has accumulated in recent years over how to pick and modify learning rates to achieve optimal training performance. Moreover, the long hours spent carefully crafting the perfect learning rate can come to nothing the moment your network architecture, optimizer, dataset, or initial conditions change ever so slightly. But it need not be this way. We propose a new answer to the great learning rate question: the Autonomous Learning Rate Controller. Find it at https://github.com/fastestimator/ARC/tree/v2.0


title: Shape of atomic nuclei in heavy ion collisions

abstract: In the hydrodynamic model description of heavy ion collisions, the final-state anisotropic flow $v_n$ are linearly related to the strength of the multi-pole shape of the distribution of nucleons in the transverse plane $\varepsilon_n$, $v_n\propto \varepsilon_n$. The $\varepsilon_n$, for $n=1,2,3,4$, are sensitive to the shape of the colliding ions, characterized by the quadrupole $\beta_2$, octupole $\beta_3$ and hexadecapole $\beta_4$ deformations. This sensitivity is investigated analytically and also in a Monte Carlo Glauber model. One observes a robust linear relation, $\langle\varepsilon_n^2\rangle = a_n'+b_n'\beta_n^2$, for events in a fixed centrality. The $\langle\varepsilon_1^2\rangle$ has a contribution from $\beta_3$ and $\beta_4$, and $\langle\varepsilon_3^2\rangle$ from $\beta_4$. In the ultra-central collisions, there are little cross contributions between $\beta_2$ and $\varepsilon_3$ and between $\beta_3$ and $\varepsilon_2$, but clear cross contributions are present in non-central collisions. Additionally, $\langle\varepsilon_n^2\rangle$ are insensitive to non-axial shape parameters such as the triaxiality. This is good news because the measurements of $v_2$, $v_3$ and $v_4$ can be used to constrain simultaneously the $\beta_2$, $\beta_3$, and $\beta_4$ values. This is best done by comparing two colliding ions with similar mass numbers and therefore nearly identical $a_n'$, to obtain simple equation that relates the $\beta_n$ of the two species. This opens up the possibility to map the shape of the atomic nuclei at a timescale ($<10^{-24}$s) much shorter than probed by low-energy nuclear structure physics ($<10^{-21}$s), which ultimately may provide information complementary to those obtained in the nuclear structure experiments.


title: Knowledge-Adaptation Priors

abstract: Humans and animals have a natural ability to quickly adapt to their surroundings, but machine-learning models, when subjected to changes, often require a complete retraining from scratch. We present Knowledge-adaptation priors (K-priors) to reduce the cost of retraining by enabling quick and accurate adaptation for a wide-variety of tasks and models. This is made possible by a combination of weight and function-space priors to reconstruct the gradients of the past, which recovers and generalizes many existing, but seemingly-unrelated, adaptation strategies. Training with simple first-order gradient methods can often recover the exact retrained model to an arbitrary accuracy by choosing a sufficiently large memory of the past data. Empirical results show that adaptation with K-priors achieves performance similar to full retraining, but only requires training on a handful of past examples.


title: TSSuBERT: Tweet Stream Summarization Using BERT

abstract: The development of deep neural networks and the emergence of pre-trained language models such as BERT allow to increase performance on many NLP tasks. However, these models do not meet the same popularity for tweet summarization, which can probably be explained by the lack of existing collections for training and evaluation. Our contribution in this paper is twofold : (1) we introduce a large dataset for Twitter event summarization, and (2) we propose a neural model to automatically summarize huge tweet streams. This extractive model combines in an original way pre-trained language models and vocabulary frequency-based representations to predict tweet salience. An additional advantage of the model is that it automatically adapts the size of the output summary according to the input tweet stream. We conducted experiments using two different Twitter collections, and promising results are observed in comparison with state-of-the-art baselines.


title: Reinforcement Learning for Markovian Bandits: Is Posterior Sampling more Scalable than Optimism?

abstract: We study learning algorithms for the classical Markovian bandit problem with discount. We explain how to adapt PSRL [24] and UCRL2 [2] to exploit the problem structure. These variants are called MB-PSRL and MB-UCRL2. While the regret bound and runtime of vanilla implementations of PSRL and UCRL2 are exponential in the number of bandits, we show that the episodic regret of MB-PSRL and MB-UCRL2 is $\tilde{O}(S\sqrt{nK})$ where $K$ is the number of episodes, $n$ is the number of bandits and $S$ is the number of states of each bandit (the exact bound in S, n and K is given in the paper). Up to a factor $\sqrt S$, this matches the lower bound of $\Omega(\sqrt{SnK})$ that we also derive in the paper. MB-PSRL is also computationally efficient: its runtime is linear in the number of bandits. We further show that this linear runtime cannot be achieved by adapting classical non-Bayesian algorithms such as UCRL2 or UCBVI to Markovian bandit problems. Finally, we perform numerical experiments that confirm that MB-PSRL outperforms other existing algorithms in practice, both in terms of regret and of computation time.


title: Mildly Flavoring Domain Walls in Sp(N) SQCD

abstract: We consider supersymmetric domain walls of four-dimensional $\mathcal{N}\!=\!1$ $Sp(N)$ SQCD with $F\!=\!N+1$ and $F\!=\!N+2$ flavors. First, we study numerically the differential equations defining the walls, classifying the solutions. When $F\!=\!N+2$, in the special case of the parity-invariant walls, the naive analysis does not provide all the expected solutions. We show that an infinitesimal deformation of the differential equations sheds some light on this issue. Second, we discuss the $3d$ $\mathcal{N}\!=\!1$ Chern-Simons-matter theories that should describe the effective dynamics on the walls. These proposals pass various tests, including dualities and matching of the vacua of the massive $3d$ theory with the $4d$ analysis. However, for $F\!=\!N+2$, the semiclassical analysis of the vacua is only partially successful, suggesting that yet-to-be-understood strong coupling phenomena are into play in our $3d$ $\mathcal{N}\!=\!1$ gauge theories.


title: Persistent Excitation is Unnecessary for On-line Exponential Parameter Estimation: A New Algorithm that Overcomes this Obstacle

abstract: In this paper, we prove that it is possible to estimate online the parameters of a classical vector linear regression equation $ Y=\Omega \theta$, where $ Y \in \mathbb{R}^n,\;\Omega \in \mathbb{R}^{n \times q}$ are bounded, measurable signals and $\theta \in \mathbb{R}^q$ is a constant vector of unknown parameters, even when the regressor $\Omega$ is not persistently exciting. Moreover, the convergence of the new parameter estimator is global and exponential and is given for both continuous-time and discrete-time implementations. As an illustration example, we consider the problem of parameter estimation of a linear time-invariant system, when the input signal is not sufficiently exciting, which is known to be a necessary and sufficient condition for the solution of the problem with the standard gradient or least-squares adaptation algorithms.


title: Analysis and Optimisation of Bellman Residual Errors with Neural Function Approximation

abstract: Recent development of Deep Reinforcement Learning (DRL) has demonstrated superior performance of neural networks in solving challenging problems with large or even continuous state spaces. One specific approach is to deploy neural networks to approximate value functions by minimising the Mean Squared Bellman Error (MSBE) function. Despite great successes of DRL, development of reliable and efficient numerical algorithms to minimise the MSBE is still of great scientific interest and practical demand. Such a challenge is partially due to the underlying optimisation problem being highly non-convex or using incomplete gradient information as done in Semi-Gradient algorithms. In this work, we analyse the MSBE from a smooth optimisation perspective and develop an efficient Approximate Newton's algorithm. First, we conduct a critical point analysis of the error function and provide technical insights on optimisation and design choices for neural networks. When the existence of global minima is assumed and the objective fulfils certain conditions, suboptimal local minima can be avoided when using over-parametrised neural networks. We construct a Gauss Newton Residual Gradient algorithm based on the analysis in two variations. The first variation applies to discrete state spaces and exact learning. We confirm theoretical properties of this algorithm such as being locally quadratically convergent to a global minimum numerically. The second employs sampling and can be used in the continuous setting. We demonstrate feasibility and generalisation capabilities of the proposed algorithm empirically using continuous control problems and provide a numerical verification of our critical point analysis. We outline the difficulties of combining Semi-Gradient approaches with Hessian information. To benefit from second-order information complete derivatives of the MSBE must be considered during training.


title: Momentum-inspired Low-Rank Coordinate Descent for Diagonally Constrained SDPs

abstract: We present a novel, practical, and provable approach for solving diagonally constrained semi-definite programming (SDP) problems at scale using accelerated non-convex programming. Our algorithm non-trivially combines acceleration motions from convex optimization with coordinate power iteration and matrix factorization techniques. The algorithm is extremely simple to implement, and adds only a single extra hyperparameter -- momentum. We prove that our method admits local linear convergence in the neighborhood of the optimum and always converges to a first-order critical point. Experimentally, we showcase the merits of our method on three major application domains: MaxCut, MaxSAT, and MIMO signal detection. In all cases, our methodology provides significant speedups over non-convex and convex SDP solvers -- 5X faster than state-of-the-art non-convex solvers, and 9 to 10^3 X faster than convex SDP solvers -- with comparable or improved solution quality.

categories: math.OC cs.IT cs.LG cs.MS math.IT stat.ML


title: Combinatorial materials discovery strategy for high entropy alloy electrocatalysts using deposition source permutations

abstract: High entropy alloys offer a huge search space for new electrocatalysts. Searching for a global property maximum in one quinary system could require, depending on compositional resolution, the synthesis of up to 10E6 samples which is impossible using conventional approaches. Co-sputtered materials libraries address this challenge by synthesis of controlled composition gradients of each element. However, even such a materials library covers less than 1% of the composition space of a quinary system. We present a new strategy using deposition source permutations optimized for highest improvement of the covered new compositions. Using this approach, the composition space can be sampled in different subsections allowing identification of the contribution of individual elements and their combinations on electrochemical activity. Unsupervised machine learning reveals that electrochemical activity is governed by the complex interplay of chemical and structural factors. Out of 2394 measured compositions, a new highly active composition for the oxygen reduction reaction around Ru17Rh5Pd19Ir29Pt30 was identified.


title: Manifolds.jl: An Extensible Julia Framework for Data Analysis on Manifolds

abstract: We present the Julia package Manifolds.jl, providing a fast and easy-to-use library of Riemannian manifolds and Lie groups. This package enables working with data defined on a Riemannian manifold, such as the circle, the sphere, symmetric positive definite matrices, or one of the models for hyperbolic spaces. We introduce a common interface, available in ManifoldsBase.jl, with which new manifolds, applications, and algorithms can be implemented. We demonstrate the utility of Manifolds.jl using B\'ezier splines, an optimization task on manifolds, and principal component analysis on nonlinear data. In a benchmark, Manifolds.jl outperforms all comparable packages for low-dimensional manifolds in speed; over Python and Matlab packages, the improvement is often several orders of magnitude, while over C/C++ packages, the improvement is two-fold. For high-dimensional manifolds, it outperforms all packages except for Tensorflow-Riemopt, which is specifically tailored for high-dimensional manifolds.


title: An Information Filtering approach to stress testing: an application to FTSE markets

abstract: We present a novel methodology to quantify the "impact" of and "response" to market shocks. We apply shocks to a group of stocks in a part of the market, and we quantify the effects in terms of average losses on another part of the market using a sparse probabilistic elliptical model for the multivariate return distribution of the whole market. Sparsity is introduced with an $L_0$-norm regularization, which forces to zero some elements of the inverse covariance according to a dependency structure inferred from an information filtering network. Our study concerns the FTSE 100 and 250 markets and analyzes impact and response to shocks both applied to and received from individual stocks and group of stocks. We observe that the shock pattern is related to the structure of the network associated with the sparse structure of the inverse covariance of stock returns. Central sectors appear more likely to be affected by shocks, and stocks with a large level of underlying diversification have a larger impact on the rest of the market when experiencing shocks. By analyzing the system during times of crisis and comparative market calmness, we observe changes in the shock patterns with a convergent behavior in times of crisis.


title: Comparison of Outlier Detection Techniques for Structured Data

abstract: An outlier is an observation or a data point that is far from rest of the data points in a given dataset or we can be said that an outlier is away from the center of mass of observations. Presence of outliers can skew statistical measures and data distributions which can lead to misleading representation of the underlying data and relationships. It is seen that the removal of outliers from the training dataset before modeling can give better predictions. With the advancement of machine learning, the outlier detection models are also advancing at a good pace. The goal of this work is to highlight and compare some of the existing outlier detection techniques for the data scientists to use that information for outlier algorithm selection while building a machine learning model.


title: Information and evaluation models of complex hierarchical network systems

abstract: The problem of selection, storage, search and analysis of information about the state, functioning and interaction of elements of complex hierarchical network systems is considered. The principles of construction of information models of such systems and models of evaluation of their operation efficiency are proposed. These models are formed on the basis of results of regular planned studies of the system and continuous monitoring of the activities of its components at all levels of the hierarchy. The problem of novelty detection in the information model of system is investigated and it is shown how the application of evaluation theory methods allows to solve it. The proposed methods of complex analysis of the behavior of real complex systems and optimization of data processing makes it possible to significantly simplify and speed up the decision-making process for further action for such systems.