title: GMM Discriminant Analysis with Noisy Label for Each Class

abstract: Real world datasets often contain noisy labels, and learning from such datasets using standard classification approaches may not produce the desired performance. In this paper, we propose a Gaussian Mixture Discriminant Analysis (GMDA) with noisy label for each class. We introduce flipping probability and class probability and use EM algorithms to solve the discriminant problem with label noise. We also provide the detail proofs of convergence. Experimental results on synthetic and real-world datasets show that the proposed approach notably outperforms other four state-of-art methods.


title: BERTHA: Video Captioning Evaluation Via Transfer-Learned Human Assessment

abstract: Evaluating video captioning systems is a challenging task as there are multiple factors to consider; for instance: the fluency of the caption, multiple actions happening in a single scene, and the human bias of what is considered important. Most metrics try to measure how similar the system generated captions are to a single or a set of human-annotated captions. This paper presents a new method based on a deep learning model to evaluate these systems. The model is based on BERT, which is a language model that has been shown to work well in multiple NLP tasks. The aim is for the model to learn to perform an evaluation similar to that of a human. To do so, we use a dataset that contains human evaluations of system generated captions. The dataset consists of the human judgments of the captions produce by the system participating in various years of the TRECVid video to text task. These annotations will be made publicly available. BERTHA obtain favourable results, outperforming the commonly used metrics in some setups.


title: A radiative seesaw model in a supersymmetric modular $A_4$ group

abstract: We propose a supersymmetric radiative seesaw model with modular $A_4$ symmetry. Thanks to contributions of supersymmetric partners to one-loop diagrams generating neutrino masses, we successfully fit neutrino data and obtain predictions in case of normal hierarchy in a minimal framework that would not be realized in a non-supersymmetric model. We show a several predictive figures and demonstrate a best fit benchmark point through $\chi^2$


title: On Uniform Boundedness Properties of SGD and its Momentum Variants

abstract: A theoretical, and potentially also practical, problem with stochastic gradient descent is that trajectories may escape to infinity. In this note, we investigate uniform boundedness properties of iterates and function values along the trajectories of the stochastic gradient descent algorithm and its important momentum variant. Under smoothness and $R$-dissipativity of the loss function, we show that broad families of step-sizes, including the widely used step-decay and cosine with (or without) restart step-sizes, result in uniformly bounded iterates and function values. Several important applications that satisfy these assumptions, including phase retrieval problems, Gaussian mixture models, and some neural network classifiers, are discussed in detail. We further extend the uniform boundedness of SGD and its momentum variant under the generalized dissipativity for the functions whose tails grow slower than quadratic functions. This includes some interesting applications, for example, Bayesian logistic regression and logistic regression with $\ell_1$ regularization.


title: Topological Molecules and Topological Localization of a Rydberg Electron on a Classical Orbit

abstract: It is common knowledge that atoms can form molecules if they attract each other. Here, we show that it is possible to create molecules where bound states of the atoms are not the result of attractive interactions but have the topological origin. That is, the bound states of the atoms correspond to the topologically protected edge states of a topological model. Such topological molecules can be realized if the interaction strength between ultra-cold atoms is properly modulated in time. A similar mechanism allows one to realize topologically protected localization of an electron on a classical orbit if a Rydberg atom is perturbed by a properly modulated microwave field.


title: Identification of System Vulnerability under a Smart Sensor Attack via Attack Model Reduction

abstract: In this work, we investigate how to make use of model reduction techniques to identify the vulnerability of a closed-loop system, consisting of a plant and a supervisor, that might invite attacks. Here, the system vulnerability refers to the existence of key observation sequences that could be exploited by a specific smart sensor attack to cause damage infliction. We consider a nondeterministic smart attack, i.e., there might exist more than one attack choice over each received observation, and adopt our previously proposed modeling framework, where such an attack is captured by a standard finite-state automaton. For a given supervisor S and a smart sensor attack model A, another smart attack model A' is called attack equivalent to A with respect to S, if the resulting compromised supervisor, defined as the composition of the supervisor S and attack model A', is control equivalent to the original compromised supervisor, defined as the composition of S and A. Following the spirit of supervisor reduction that relies on the concept of control congruence, we will show that, this problem of synthesizing a reduced smart attack model A' that is attack equivalent to A with respect to S, can be transformed to a classical supervisor reduction problem, making all existing synthesis tools available for supervisor reduction directly applicable to our problem. A simplified and ideally minimum-state attack model can reveal all necessary observation sequences for the attacker to be successful, thus, reminds system designers to take necessary precautions in advance, which may improve system resilience significantly. An example is presented to show the effectiveness of our proposed attack model reduction technique to identify the system vulnerability.


title: HoneyTop90: A 90-line MATLAB code for topology optimization using honeycomb tessellation

abstract: This paper provides a simple, compact and efficient 90-line pedagogical MATLAB code for topology optimization using hexagonal elements (honeycomb tessellation). Hexagonal elements provide nonsingular connectivity between two juxtaposed elements and, thus, subdue checkerboard patterns and point connections inherently from the optimized designs. A novel approach to generate honeycomb tessellation is proposed. The element connectivity matrix and corresponding nodal coordinates array are determined in 5 (7) and 4 (6) lines, respectively. Two additional lines for the meshgrid generation are required for an even number of elements in the vertical direction. The code takes a fraction of a second to generate meshgrid information for the millions of hexagonal elements. Wachspress shape functions are employed for the finite element analysis, and compliance minimization is performed using the optimality criteria method. The provided Matlab code and its extensions are explained in detail. Options to run the optimization with and without filtering techniques are provided. Steps to include different boundary conditions, multiple load cases, active and passive regions, and a Heaviside projection filter are also discussed. The code is provided in Appendix~A, and it can also be downloaded along with supplementary materials from \url{https://github.com/PrabhatIn/HoneyTop90}.


title: Diversity in the Music Listening Experience: Insights from Focus Group Interviews

abstract: Music listening in today's digital spaces is highly characterized by the availability of huge music catalogues, accessible by people all over the world. In this scenario, recommender systems are designed to guide listeners in finding tracks and artists that best fit their requests, having therefore the power to influence the diversity of the music they listen to. Albeit several works have proposed new techniques for developing diversity-aware recommendations, little is known about how people perceive diversity while interacting with music recommendations. In this study, we interview several listeners about the role that diversity plays in their listening experience, trying to get a better understanding of how they interact with music recommendations. We recruit the listeners among the participants of a previous quantitative study, where they were confronted with the notion of diversity when asked to identify, from a series of electronic music lists, the most diverse ones according to their beliefs. As a follow-up, in this qualitative study we carry out semi-structured interviews to understand how listeners may assess the diversity of a music list and to investigate their experiences with music recommendation diversity. We report here our main findings on 1) what can influence the diversity assessment of tracks and artists' music lists, and 2) which factors can characterize listeners' interaction with music recommendation diversity.


title: Coded Caching in Networks with Heterogeneous User Activity

abstract: This work elevates coded caching networks from their purely information-theoretic framework to a stochastic setting, by exploring the effect of random user activity and by exploiting correlations in the activity patterns of different users. In particular, the work studies the $K$-user cache-aided broadcast channel with a limited number of cache states, and explores the effect of cache state association strategies in the presence of arbitrary user activity levels; a combination that strikes at the very core of the coded caching problem and its crippling subpacketization bottleneck. We first present a statistical analysis of the average worst-case delay performance of such subpacketization-constrained (state-constrained) coded caching networks, and provide computationally efficient performance bounds as well as scaling laws for any arbitrary probability distribution of the user-activity levels. The achieved performance is a result of a novel user-to-cache state association algorithm that leverages the knowledge of probabilistic user-activity levels. We then follow a data-driven approach that exploits the prior history on user-activity levels and correlations, in order to predict interference patterns, and thus better design the caching algorithm. This optimized strategy is based on the principle that users that overlap more, interfere more, and thus have higher priority to secure complementary cache states. This strategy is proven here to be within a small constant factor from the optimal. Finally, the above analysis is validated numerically using synthetic data following the Pareto principle. To the best of our understanding, this is the first work that seeks to exploit user-activity levels and correlations, in order to map future interference and design optimized coded caching algorithms that better handle this interference.


title: A Simple Proof of Bohr's Inequality

abstract: The classical inequality of Bohr concerning Taylor coeficients of bounded holomorphic functions on the unit disk, has proved to be of significance in answering in the negative the conjecture that if the non-unital von Neumann inequality held for a Banach algebra then it was necessarily an operator algebra. Here we provide a rather short and easy proof of the inequality.


title: DocEnTr: An End-to-End Document Image Enhancement Transformer

abstract: Document images can be affected by many degradation scenarios, which cause recognition and processing difficulties. In this age of digitization, it is important to denoise them for proper usage. To address this challenge, we present a new encoder-decoder architecture based on vision transformers to enhance both machine-printed and handwritten document images, in an end-to-end fashion. The encoder operates directly on the pixel patches with their positional information without the use of any convolutional layers, while the decoder reconstructs a clean image from the encoded patches. Conducted experiments show a superiority of the proposed model compared to the state-of the-art methods on several DIBCO benchmarks. Code and models will be publicly available at: \url{https://github.com/dali92002/DocEnTR}.


title: Timely Status Update: Should ARQ be Used in Two-Hop Networks?

abstract: This paper investigates the information freshness of two-hop networks. Age of information (AoI) is used as the metric to characterize the information freshness, defined as the time elapsed since the latest received status update was generated. In error-prone wireless networks, prior studies indicated that Automatic Repeat-reQuest (ARQ) does not help improve the average AoI performance of single-hop networks, because sending a new packet always carries the most up-to-date information (i.e., discarding the old packet). We believe that this observation does not apply to two-hop networks. For example, when a packet transmission fails in the second hop, although a new packet has more recent information, it may require more time to be delivered (i.e., the communication has to restart from the first hop), thus leading to a high AoI. This paper analyzes the theoretical average AoI of two-hop networks with and without ARQ. Specifically, we model the two schemes using Markov chains, from which we derive the average AoI. Our theoretical and simulation results confirm that, unlike single-hop networks, ARQ should be used in two-hop networks to achieve lower average AoI. In particular, when ARQ is used, the successful decoding probability of the second hop has a greater impact on the average AoI than that of the first hop. Overall, our findings provide insight into the ARQ design for two-hop timely status update systems.


title: How to be an extremist

abstract: We present a toy model of opinion spreading in a society which combines a self-reinforcing mechanism with diffusion. The relative strength of these two mechanisms - called the affectability of the system - is a free parameter of the model. The model is run on a scale-free network and its asymptotic behaviour is investigated. A surprising emergent effect is observed: If every individual becomes more attentive to the opinions of others, the society as a whole switches from a plurality of nuanced opinions into the state of an absolute consensus on an extreme opinion. This counter-intuitive emergent behaviour may help to explain certain paradoxes in human history.


title: Enhanced Global Optimization with Parallel Global and Local Structures

abstract: In practice, objective functions of real-time control systems can have multiple local minimums or can dramatically change over the function space, making them hard to optimize. To efficiently optimize such systems, in this paper, we develop a parallel global optimization framework that combines direct search methods with Bayesian parallel optimization. It consists of an iterative global and local search that searches broadly through the entire global space for promising regions and then efficiently exploits each local promising region. We prove the asymptotic convergence properties of the proposed framework and conduct an extensive numerical comparison to illustrate its empirical performance.


title: Quantitative coarse-graining of Markov chains

abstract: Coarse-graining techniques play a central role in reducing the complexity of stochastic models, and are typically characterised by a mapping which projects the full state of the system onto a smaller set of variables which captures the essential features of the system. Starting with a continuous-time Markov chain, in this work we propose and analyse an effective dynamics, which approximates the dynamical information in the coarse-grained chain. Without assuming explicit scale-separation, we provide sufficient conditions under which this effective dynamics stays close to the original system and provide quantitative bounds on the approximation error. We also compare the effective dynamics and corresponding error bounds to the averaging literature on Markov chains which involve explicit scale-separation. We demonstrate our findings on an illustrative test example.


title: PREVIS -- A Combined Machine Learning and Visual Interpolation Approach for Interactive Reverse Engineering in Assembly Quality Control

abstract: We present PREVIS, a visual analytics tool, enhancing machine learning performance analysis in engineering applications. The presented toolchain allows for a direct comparison of regression models. In addition, we provide a methodology to visualize the impact of regression errors on the underlying field of interest in the original domain, the part geometry, via exploiting standard interpolation methods. Further, we allow a real-time preview of user-driven parameter changes in the displacement field via visual interpolation. This allows for fast and accountable online change management. We demonstrate the effectiveness with an ex-ante optimization of an automotive engine hood.


title: Testing time evolution of the mass distribution of the black hole mergers

abstract: The detection of gravitational-wave events revealed that there are numerous populations of black hole (BH) binaries that can merge within the age of the Universe. Although several formation channels of such binaries are known, considerable theoretical uncertainties associated with each channel defeat the robust prediction of how much each channel contributes to the total merger rate density. Given that the time evolution of the merger rate density in some channels is (exactly or nearly) independent of BH masses, clarifying this feature from observational data will shed some light on the nature of BH binaries. On the basis of this motivation, we formulate a methodology to perform a statistical test of whether the mass distribution of BH mergers evolves over time by hypothesis testing. Our statistical test requires neither a priori specification of the mass distribution, which is largely uncertain, nor that of the time dependence of merger rate. We then apply it to mock data for some concrete shapes of the merger rate density and show that the proposed method rejects/(does not reject) the null hypothesis correctly for a large sample size. After this verification, the method is applied to a catalog of the gravitational-wave events obtained during the LIGO-Virgo's third observing run. We find that the selection bias degrades the effectiveness of our method for the O3 catalog owing to the reduction in the number of and the maximum redshifts of the merger events that we can explore. Within the range where the method can be applied, there is no indication of the time evolution of the mass distribution of merger rate density. This limitation will be eased in future observations containing more events, and our hypothesis testing will help determine whether the merger rate density evolves over time independently of BH masses.


title: t-Deletion-s-Insertion-Burst Correcting Codes

abstract: Motivated by applications in DNA-based storage and communication systems, we study deletion and insertion errors simultaneously in a burst. In particular, we study a type of error named $t$-deletion-$s$-insertion-burst ($(t,s)$-burst for short) which is a generalization of the $(2,1)$-burst error proposed by Schoeny {\it et. al}. Such an error deletes $t$ consecutive symbols and inserts an arbitrary sequence of length $s$ at the same coordinate. We provide a sphere-packing upper bound on the size of binary codes that can correct a $(t,s)$-burst error, showing that the redundancy of such codes is at least $\log n+t-1$. For $t\geq 2s$, an explicit construction of binary $(t,s)$-burst correcting codes with redundancy $\log n+(t-s-1)\log\log n+O(1)$ is given. In particular, we construct a binary $(3,1)$-burst correcting code with redundancy at most $\log n+9$, which is optimal up to a constant.


title: Scar States in Deconfined $\mathbb{Z}_2$ Lattice Gauge Theories

abstract: The weak ergodicity breaking induced by quantum many-body scars (QMBS) represents an intriguing concept that has received great attention in recent years due to its relation to unusual non-equilibrium behaviour. Here we reveal that this phenomenon can occur in a previously unexplored regime of a lattice gauge theory, where QMBS emerge due to the presence of an extensive number of local constraints. In particular, by analyzing the gauged Kitaev model, we provide an example where QMBS appear in a regime where charges are deconfined. By means of both numerical and analytical approaches, we find a variety of scarred states far away from the regime where the model is integrable. The presence of these states is revealed both by tracing them directly from the analytically reachable limit, as well as by quantum quenches showing persistent oscillations for specific initial states.


title: Multifractal Spin-Glass Chaos Projection and Interrelation of Multicultural Music and Brain Signals

abstract: A complexity classification scheme is developed from the fractal spectra of spin-glass chaos and demonstrated with multigeographic multicultural music and brain electroencephalogram signals. Systematic patterns are found to emerge. Chaos under scale change is the essence of spin-glass ordering and can be obtained, continuously tailor-made, from the exact renormalization-group solution of Ising models on frustrated hierarchical lattices. The music pieces are from Turkish music, namely Arabesque, Rap, Pop, Classical, and Western music, namely Blues, Jazz, Pop, Classical. A surprising group defection occurs.


title: Do Transformers Encode a Foundational Ontology? Probing Abstract Classes in Natural Language

abstract: With the methodological support of probing (or diagnostic classification), recent studies have demonstrated that Transformers encode syntactic and semantic information to some extent. Following this line of research, this paper aims at taking semantic probing to an abstraction extreme with the goal of answering the following research question: can contemporary Transformer-based models reflect an underlying Foundational Ontology? To this end, we present a systematic Foundational Ontology (FO) probing methodology to investigate whether Transformers-based models encode abstract semantic information. Following different pre-training and fine-tuning regimes, we present an extensive evaluation of a diverse set of large-scale language models over three distinct and complementary FO tagging experiments. Specifically, we present and discuss the following conclusions: (1) The probing results indicate that Transformer-based models incidentally encode information related to Foundational Ontologies during the pre-training pro-cess; (2) Robust FO taggers (accuracy of 90 percent)can be efficiently built leveraging on this knowledge.


title: Quantum Anomaly Detection with a Spin Processor in Diamond

abstract: In the processing of quantum computation, analyzing and learning the pattern of the quantum data are essential for many tasks. Quantum machine learning algorithms can not only deal with the quantum states generated in the preceding quantum procedures, but also the quantum registers encoding classical problems. In this work, we experimentally demonstrate the anomaly detection of quantum states encoding audio samples with a three-qubit quantum processor consisting of solid-state spins in diamond. By training the quantum machine with a few normal samples, the quantum machine can detect the anomaly samples with a minimum error rate of 15.4%. These results show the power of quantum anomaly detection in dealing with machine learning tasks and the potential to detect abnormal output of quantum devices.


title: Finite temperature corrections to black hole quasinormal modes from 2D CFT

abstract: We revisit the holographic calculation of the decay modes of the BTZ blackhole perturbed by a scalar probe. We carry out a finite temperature expansion of the torus two point function of large central charge $(c)$ CFTs in order to obtain the corrections to blackhole quasinormal modes. We take the contribution of the lightest primary above the vacuum, with dimension $\Delta_{\chi}$ and upper bound of $c/6$, in the torus two point function. We exploit the modular properties of 2D CFT on the torus to connect the expression of thermal two point function at high temperature with the same at low temperature. The correction term can be expressed as a four point function on the Riemann sphere. In the dual bulk theory the corrections are expected to arise due to the presence of a light matter field in the spacetime along with gravity. In the holographic limit the effects of this correction term is encoded in the change in blackhole temperature. This leads to new quasinormal modes and modification of thermalization time scale.


title: Polaron-enhanced polariton nonlinearity in lead halide perovskites

abstract: Exciton-polaritons offer a versatile platform for realization of all-optical integrated logic gates due to the strong effective optical nonlinearity resulting from the exciton-exciton interactions. In most of the current excitonic materials there exists a direct connection between the exciton robustness to thermal fluctuations and the strength of exciton-exciton interaction, making materials with highest levels of exciton nonlinearity applicable at cryogenic temperatures only. Here, we show that strong polaronic effects, characteristic for perovskite materials, allow to overcome this limitation. Namely, we demonstrate the record-high value of the nonlinear optical response in nanostructured organic-inorganic halide perovskite MAPbI$_3$, experimentally detected as 19.7 meV blueshift of the polariton branch under femtosecond laser irradiation. This is substantially higher than characteristic values for the samples based on conventional semiconductors and monolayers of transition metal dichalcogenides. The observed strong polaron-enhanced nonlinearity exists for both tetragonal and orthorombic phases of MAPbI$_3$, and remains stable at elevated temperatures.


title: Combining Commonsense Reasoning and Knowledge Acquisition to Guide Deep Learning in Robotics

abstract: Algorithms based on deep network models are being used for many pattern recognition and decision-making tasks in robotics and AI. Training these models requires a large labeled dataset and considerable computational resources, which are not readily available in many domains. Also, it is difficult to explore the internal representations and reasoning mechanisms of these models. As a step towards addressing the underlying knowledge representation, reasoning, and learning challenges, the architecture described in this paper draws inspiration from research in cognitive systems. As a motivating example, we consider an assistive robot trying to reduce clutter in any given scene by reasoning about the occlusion of objects and stability of object configurations in an image of the scene. In this context, our architecture incrementally learns and revises a grounding of the spatial relations between objects and uses this grounding to extract spatial information from input images. Non-monotonic logical reasoning with this information and incomplete commonsense domain knowledge is used to make decisions about stability and occlusion. For images that cannot be processed by such reasoning, regions relevant to the tasks at hand are automatically identified and used to train deep network models to make the desired decisions. Image regions used to train the deep networks are also used to incrementally acquire previously unknown state constraints that are merged with the existing knowledge for subsequent reasoning. Experimental evaluation performed using simulated and real-world images indicates that in comparison with baselines based just on deep networks, our architecture improves reliability of decision making and reduces the effort involved in training data-driven deep network models.


title: On the Translation of Automata to Linear Temporal Logic

abstract: While the complexity of translating future linear temporal logic (LTL) into automata on infinite words is well-understood, the size increase involved in turning automata back to LTL is not. In particular, there is no known elementary bound on the complexity of translating deterministic $\omega$-regular automata to LTL. Our first contribution consists of tight bounds for LTL over a unary alphabet: alternating, nondeterministic and deterministic automata can be exactly exponentially, quadratically and linearly more succinct, respectively, than any equivalent LTL formula. Our main contribution consists of a translation of general counter-free deterministic $\omega$-regular automata into LTL formulas of double exponential temporal-nesting depth and triple exponential length, using an intermediate Krohn-Rhodes cascade decomposition of the automaton. To our knowledge, this is the first elementary bound on this translation. Furthermore, our translation preserves the acceptance condition of the automaton in the sense that it turns a looping, weak, B\"uchi, coB\"uchi or Muller automaton into a formula that belongs to the matching class of the syntactic future hierarchy. In particular, it can be used to translate an LTL formula recognising a safety language to a formula belonging to the safety fragment of LTL (over both finite and infinite words).


title: Using Deep Reinforcement Learning for Zero Defect Smart Forging

abstract: Defects during production may lead to material waste, which is a significant challenge for many companies as it reduces revenue and negatively impacts sustainability and the environment. An essential reason for material waste is a low degree of automation, especially in industries that currently have a low degree of digitalization, such as steel forging. Those industries typically rely on heavy and old machinery such as large induction ovens that are mostly controlled manually or using well-known recipes created by experts. However, standard recipes may fail when unforeseen events happen, such as an unplanned stop in production, which may lead to overheating and thus material degradation during the forging process. In this paper, we develop a digital twin-based optimization strategy for the heating process for a forging line to automate the development of an optimal control policy that adjusts the power for the heating coils in an induction oven based on temperature data observed from pyrometers. We design a digital twin-based deep reinforcement learning (DTRL) framework and train two different deep reinforcement learning (DRL) models for the heating phase using a digital twin of the forging line. The twin is based on a simulator that contains a heating transfer and movement model, which is used as an environment for the DRL training. Our evaluation shows that both models significantly reduce the temperature unevenness and can help to automate the traditional heating process.


title: Probability estimation and structured output prediction for learning preferences in last mile delivery

abstract: We study the problem of learning the preferences of drivers and planners in the context of last mile delivery. Given a data set containing historical decisions and delivery locations, the goal is to capture the implicit preferences of the decision-makers. We consider two ways to use the historical data: one is through a probability estimation method that learns transition probabilities between stops (or zones). This is a fast and accurate method, recently studied in a VRP setting. Furthermore, we explore the use of machine learning to infer how to best balance multiple objectives such as distance, probability and penalties. Specifically, we cast the learning problem as a structured output prediction problem, where training is done by repeatedly calling the TSP solver. Another important aspect we consider is that for last-mile delivery, every address is a potential client and hence the data is very sparse. Hence, we propose a two-stage approach that first learns preferences at the zone level in order to compute a zone routing; after which a penalty-based TSP computes the stop routing. Results show that the zone transition probability estimation performs well, and that the structured output prediction learning can improve the results further. We hence showcase a successful combination of both probability estimation and machine learning, all the while using standard TSP solvers, both during learning and to compute the final solution; this means the methodology is applicable to other, real-life, TSP variants, or proprietary solvers.


title: Strange metallicity of moir\'e twisted bilayer graphene

abstract: Recent measurements in several different laboratories report the observation of an approximately linear-in-temperature resistivity with a large twist-angle-dependent slope (or temperature coefficient) in moir\'e twisted bilayer graphene (tBLG) down to a few K and sometimes to much lower temperatures. In this note, we theoretically discuss this `strange metal' linear-in-temperature transport behavior from the perspective of resistive scattering by acoustic phonons, emphasizing the aspects of the transport data, which are and which are not consistent with the phonon scattering mechanism. Extensive theoretical comparison with a new experiment [A. Jaoui et al., Nature Physics 18, 633 (2022)] is the central new aspect of this work.


title: Convolutional Xformers for Vision

abstract: Vision transformers (ViTs) have found only limited practical use in processing images, in spite of their state-of-the-art accuracy on certain benchmarks. The reason for their limited use include their need for larger training datasets and more computational resources compared to convolutional neural networks (CNNs), owing to the quadratic complexity of their self-attention mechanism. We propose a linear attention-convolution hybrid architecture -- Convolutional X-formers for Vision (CXV) -- to overcome these limitations. We replace the quadratic attention with linear attention mechanisms, such as Performer, Nystr\"omformer, and Linear Transformer, to reduce its GPU usage. Inductive prior for image data is provided by convolutional sub-layers, thereby eliminating the need for class token and positional embeddings used by the ViTs. We also propose a new training method where we use two different optimizers during different phases of training and show that it improves the top-1 image classification accuracy across different architectures. CXV outperforms other architectures, token mixers (e.g. ConvMixer, FNet and MLP Mixer), transformer models (e.g. ViT, CCT, CvT and hybrid Xformers), and ResNets for image classification in scenarios with limited data and GPU resources (cores, RAM, power).


title: Image Fragile Watermarking Algorithm Based on Deneighborhood Mapping

abstract: To address the security risk caused by fixed offset mapping and the limited recoverability of random mapping used in image watermarking, we propose an image self-embedding fragile watermarking algorithm based on deneighborhood mapping. First, the image is divided into several 2*2 blocks, and authentication watermark and recovery watermark are generated based on the average value of the image blocks. Then, the denighborhood mapping is implemented as, for each image block, its mapping block is randomly selected outside it's neighborhood whose size is specified by a parameter. Finally, the authentication watermark and the recovery watermark are embedded in the image block itself and its corresponding mapping block. Theoretical analysis indicates that in the case of continuous region tampering, the proposed watermarking method can achieve better the recovery rate of the tampered image block than the method based on the random mapping. The experimental results verify the rationality and effectiveness of the theoretical analysis. Moreover, compared with the existing embedding algorithms based on random mapping, chaos mapping and Arnold mapping, in the case of continuous region tampering, the average recovery rate of the tampered region achieved by the proposed algorithm is higher.


title: Time-Varying Parameters in Sequential Decision Making Problems

abstract: In this paper we address the class of Sequential Decision Making (SDM) problems that are characterized by time-varying parameters. These parameter dynamics are either pre-specified or manipulable. At any given time instant the decision policy -- that governs the sequential decisions -- along with all the parameter values determines the cumulative cost incurred by the underlying SDM. Thus, the objective is to determine the manipulable parameter dynamics as well as the time-varying decision policy such that the associated cost gets minimized at each time instant. To this end we develop a control-theoretic framework to design the unknown parameter dynamics such that it locates and tracks the optimal values of the parameters, and simultaneously determines the time-varying optimal sequential decision policy. Our methodology builds upon a Maximum Entropy Principle (MEP) based framework that addresses the static parameterized SDMs. More precisely, we utilize the resulting smooth approximation (from the above framework) of the cumulative cost as a control Lyapunov function. We show that under the resulting control law the parameters asymptotically track the local optimal, the proposed control law is Lipschitz continuous and bounded, as well as ensure that the decision policy of the SDM is optimal for a given set of parameter values. The simulations demonstrate the efficacy of our proposed methodology.


title: Multi-channel Attentive Graph Convolutional Network With Sentiment Fusion For Multimodal Sentiment Analysis

abstract: Nowadays, with the explosive growth of multimodal reviews on social media platforms, multimodal sentiment analysis has recently gained popularity because of its high relevance to these social media posts. Although most previous studies design various fusion frameworks for learning an interactive representation of multiple modalities, they fail to incorporate sentimental knowledge into inter-modality learning. This paper proposes a Multi-channel Attentive Graph Convolutional Network (MAGCN), consisting of two main components: cross-modality interactive learning and sentimental feature fusion. For cross-modality interactive learning, we exploit the self-attention mechanism combined with densely connected graph convolutional networks to learn inter-modality dynamics. For sentimental feature fusion, we utilize multi-head self-attention to merge sentimental knowledge into inter-modality feature representations. Extensive experiments are conducted on three widely-used datasets. The experimental results demonstrate that the proposed model achieves competitive performance on accuracy and F1 scores compared to several state-of-the-art approaches.


title: Aerospace Human System Integration Evolution over the Last 40 Years

abstract: This chapter focuses on the evolution of Human-Centered Design (HCD) in aerospace systems over the last forty years. Human Factors and Ergonomics first shifted from the study of physical and medical issues to cognitive issues circa the 1980s. The advent of computers brought with it the development of human-computer interaction (HCI), which then expanded into the field of digital interaction design and User Experience (UX). We ended up with the concept of interactive cockpits, not because pilots interacted with mechanical things, but because they interacted using pointing devices on computer displays. Since the early 2000s, complexity and organizational issues gained prominence to the point that complex systems design and management found itself center stage, with the spotlight on the role of the human element and organizational setups. Today, Human Systems Integration (HSI) is no longer only a single-agent problem, but a multi-agent research field. Systems are systems of systems, considered as representations of people and machines. They are made of statically and dynamically articulated structures and functions. When they are at work, they are living organisms that generate emerging functions and structures that need to be considered in evolution (i.e., in their constant redesign). This chapter will more specifically, focus on human factors such as human-centered systemic representations, life critical systems, organizational issues, complexity management, modeling and simulation, flexibility, tangibility and autonomy. The discussion will be based on several examples in civil aviation and air combat, as well as aerospace.


title: City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds

abstract: We present a fully automatic approach for reconstructing compact 3D building models from large-scale airborne point clouds. A major challenge of urban reconstruction from airborne LiDAR point clouds lies in that the vertical walls are typically missing. Based on the observation that urban buildings typically consist of planar roofs connected with vertical walls to the ground, we propose an approach to infer the vertical walls directly from the data. With the planar segments of both roofs and walls, we hypothesize the faces of the building surface, and the final model is obtained by using an extended hypothesis-and-selection-based polygonal surface reconstruction framework. Specifically, we introduce a new energy term to encourage roof preferences and two additional hard constraints into the optimization step to ensure correct topology and enhance detail recovery. Experiments on various large-scale airborne LiDAR point clouds have demonstrated that the method is superior to the state-of-the-art methods in terms of reconstruction accuracy and robustness. In addition, we have generated a new dataset with our method consisting of the point clouds and 3D models of 20k real-world buildings. We believe this dataset can stimulate research in urban reconstruction from airborne LiDAR point clouds and the use of 3D city models in urban applications.


title: Generation of travelling sine-Gordon breathers in noisy long Josephson junctions

abstract: The generation of travelling sine-Gordon breathers is achieved through the nonlinear supratransmission effect in a magnetically driven long Josephson junction, in the presence of losses, a current bias, and a thermal noise source. We demonstrate how to exclusively induce breather modes by means of controlled magnetic pulses. A nonmonotonic behavior of the breather-only generation probability is observed as a function of the noise intensity. An experimental protocol providing evidence of the Josephson breather's existence is proposed.


title: Two-dimensional MoSi2N4: An Excellent 2D Semiconductor for Transistors

abstract: We report the performance of field-effect transistors (FETs), comprised of mono-layer of recently synthesized layered two-dimensional MoSi2N_4 as channel material, using the first principles quantum transport simulations. The devices' performance is assessed as per the International Roadmap for Devices and Systems (IRDS) 2020 roadmap for the year 2034 and compared to advanced silicon-based FETs, carbon nanotube-based FETs, and other promising two-dimensional materials based FETs. Finally, we estimate the figure of merits of a combinational and a sequential logic circuit based on our double gate devices and benchmark against promising alternative logic technologies. The performance of our devices and circuits based on them are encouraging, and competitive to other logic alternatives.


title: Effect of Two-Stage Shattered Pellet Injection on Tokamak Disruptions

abstract: An effective disruption mitigation system in a tokamak reactor should limit the exposure of the wall to localized heat losses and to the impact of high current runaway electron beams, and avoid excessive forces on the structure. We evaluate with respect to these aspects a two-stage deuterium-neon shattered pellet injection in an ITER-like plasma, using simulations with the DREAM framework [M. Hoppe et al (2021) Comp. Phys. Commun. 268, 108098]. To minimize the obtained runaway currents an optimal range of injected deuterium quantities is found. This range is sensitive to the opacity of the plasma to Lyman radiation, which affects the ionization degree of deuterium, and thus avalanche runaway generation. The two-stage injection scheme, where dilution cooling is produced by deuterium before a radiative thermal quench caused by neon, reduces both the hot-tail seed and the localized transported heat load on the wall. However, during nuclear operation, additional runaway seed sources from the activated wall and tritium make it difficult to reach tolerably low runaway currents.


title: The Trusted Computing Base of the CompCert Verified Compiler

abstract: CompCert is the first realistic formally verified compiler: it provides a machine-checked mathematical proof that the code it generates matches the source code. Yet, there could be loopholes in this approach. We comprehensively analyze aspects of CompCert where errors could lead to incorrect code being generated. Possible issues range from the modeling of the source and the target languages to some techniques used to call external algorithms from within the compiler.


title: Latency Fairness Optimization on Wireless Networks through Deep Reinforcement Learning

abstract: In this paper, we propose a novel deep reinforcement learning framework to maximize user fairness in terms of delay. To this end, we devise a new version of the modified largest weighted delay first (M-LWDF) algorithm, which is called $\beta$-M-LWDF, aiming to fulfill an appropriate balance between user fairness and average delay. This balance is defined as a feasible region on the cumulative distribution function (CDF) of the user delay that allows identifying unfair states, feasible-fair states, and over-fair states. Simulation results reveal that our proposed framework outperforms traditional resource allocation techniques in terms of latency fairness and average delay


title: Multi-kink brane in Gauss-Bonnet gravity and its stability

abstract: Einstein-Gauss-Bonnet gravity in high dimensional spacetime is intriguing. Here, the properties of thick branes generated by a bulk scalar field in the five-dimensional Einstein-Gauss-Bonnet gravity were studied. With the help of the superpotential method, we obtain a series of multi-kink brane solutions. We also analyze the linear stability of the brane system under tensor perturbations and prove that they are stable. The massless graviton is shown to be localized near the brane and hence the four-dimensional Newtonian potential can be recovered. By comparing the properties of these thick branes under different superpotentials we find with some specific choice of superpotential the Gauss-Bonnet term can determine the scalar field are multi-kink or single kink.


title: SASV Challenge 2022: A Spoofing Aware Speaker Verification Challenge Evaluation Plan

abstract: ASV (automatic speaker verification) systems are intrinsically required to reject both non-target (e.g., voice uttered by different speaker) and spoofed (e.g., synthesised or converted) inputs. However, there is little consideration for how ASV systems themselves should be adapted when they are expected to encounter spoofing attacks, nor when they operate in tandem with CMs (spoofing countermeasures), much less how both systems should be jointly optimised. The goal of the first SASV (spoofing-aware speaker verification) challenge, a special sesscion in ISCA INTERSPEECH 2022, is to promote development of integrated systems that can perform ASV and CM simultaneously.


title: Twist automorphisms and Poisson structures

abstract: We introduce (quantum) twist automorphisms for upper cluster algebras and cluster Poisson algebras with coefficients. Our constructions generalize the twist automorphisms for quantum unipotent cells. We study their existence and their compatibility with Poisson structures and quantization. The twist automorphisms always permute well-behaved bases for cluster algebras. We explicitly construct (quantum) twist automorphisms of Donaldson-Thomas type and for principal coefficients.


title: Efficient Approximations of the Fisher Matrix in Neural Networks using Kronecker Product Singular Value Decomposition

abstract: Several studies have shown the ability of natural gradient descent to minimize the objective function more efficiently than ordinary gradient descent based methods. However, the bottleneck of this approach for training deep neural networks lies in the prohibitive cost of solving a large dense linear system corresponding to the Fisher Information Matrix (FIM) at each iteration. This has motivated various approximations of either the exact FIM or the empirical one. The most sophisticated of these is KFAC, which involves a Kronecker-factored block diagonal approximation of the FIM. With only a slight additional cost, a few improvements of KFAC from the standpoint of accuracy are proposed. The common feature of the four novel methods is that they rely on a direct minimization problem, the solution of which can be computed via the Kronecker product singular value decomposition technique. Experimental results on the three standard deep auto-encoder benchmarks showed that they provide more accurate approximations to the FIM. Furthermore, they outperform KFAC and state-of-the-art first-order methods in terms of optimization speed.


title: Symmetry-protected transport through a lattice with a local particle loss

abstract: We study particle transport through a chain of coupled sites connected to free-fermion reservoirs at both ends, subjected to a local particle loss. The transport is characterized by calculating the conductance and particle density in the steady state using the Keldysh formalism for open quantum systems. Besides a reduction of conductance, we find that transport can remain (almost) unaffected by the loss for certain values of the chemical potential in the lattice. We show that this "protected" transport results from the spatial symmetry of single-particle eigenstates. At a finite voltage, the density profile develops a drop at the lossy site, connected to the onset of non-ballistic transport.


title: Structured Handling of Scoped Effects: Extended Version

abstract: Algebraic effects offer a versatile framework that covers a wide variety of effects. However, the family of operations that delimit scopes are not algebraic and are usually modelled as handlers, thus preventing them from being used freely in conjunction with algebraic operations. Although proposals for scoped operations exist, they are either ad-hoc and unprincipled, or too inconvenient for practical programming. This paper provides the best of both worlds: a theoretically-founded model of scoped effects that is convenient for implementation and reasoning. Our new model is based on an adjunction between a locally finitely presentable category and a category of functorial algebras. Using comparison functors between adjunctions, we show that our new model, an existing indexed model, and a third approach that simulates scoped operations in terms of algebraic ones have equal expressivity for handling scoped operations. We consider our new model to be the sweet spot between ease of implementation and structuredness. Additionally, our approach automatically induces fusion laws of handlers of scoped effects, which are useful for reasoning and optimisation.


title: Linear stability of semiclassical theories of gravity

abstract: The linearization of semiclassical theories of gravity is investigated in a toy model, consisting of a quantum scalar field in interaction with a second classical scalar field which plays the role of a classical background. This toy model mimics also the evolution induced by semiclassical Einstein equations, such as the one which describes the early universe in the cosmological case. The equations governing the dynamics of linear perturbations around simple exact solutions of this toy model are analyzed by constructing the corresponding retarded fundamental solutions, and by discussing the corresponding initial value problem. It is shown that, if the quantum field which drives the back-reaction to the classical background is massive, then there are choices of the renormalization parameters for which the linear perturbations with compact spatial support decay polynomially in time for large times, thus indicating stability of the underlying semiclassical solution.


title: Chatbots and messaging platforms in the classroom: an analysis from the teacher's perspective

abstract: Introducing new technologies such as messaging platforms, and the chatbots attached to them, in higher education, is rapidly growing. This introduction entails a careful consideration of the potential opportunities and/or challenges of adopting these tools. Hence, a thorough examination of the teachers' experiences in this discipline can shed light on the effective ways of enhancing students' learning and boosting their progress. In this contribution, we have surveyed the opinions of tertiary education teachers based in Spain (mainly) and Spanish-speaking countries. The focus of these surveys is to collect teachers' feedback about their opinions regarding the introduction of the messaging platforms and chatbots in their classes, understand their needs and to gather information about the various educational use cases where these tools are valuable. In addition, an analysis of how and when teachers' opinions towards the use of these tools can vary across gender, experience, and their discipline of specialisation is presented. The key findings of this study highlight the factors that can contribute to the advancement of the adoption of messaging platforms and chatbots in higher education institutions to achieve the desired learning outcomes.


title: Characterizations and constructions of n-to-1 mappings over finite fields

abstract: $n$-to-$1$ mappings have wide applications in many areas, especially in cryptography, finite geometry, coding theory and combinatorial design. In this paper, many classes of $n$-to-$1$ mappings over finite fields are studied. First, we provide a characterization of general $n$-to-$1$ mappings over $\mathbb{F}_{p^m}$ by means of the Walsh transform. Then, we completely determine $3$-to-$1$ polynomials with degree no more than $4$ over $\mathbb{F}_{p^{m}}$. Furthermore, we obtain an AGW-like criterion for characterizing an equivalent relationship between the $n$-to-$1$ property of a mapping over finite set $A$ and that of another mapping over a subset of $A$. Finally, we apply the AGW-like criterion into several forms of polynomials and obtain some explicit $n$-to-$1$ mappings. Especially, three explicit constructions of the form $x^rh\left( x^s \right) $ from the cyclotomic perspective, and several classes of $n$-to-$1$ mappings of the form $ g\left( x^{q^k} -x +\delta \right) +cx$ are provided.


title: Rank-adaptive time integration of tree tensor networks

abstract: A rank-adaptive integrator for the approximate solution of high-order tensor differential equations by tree tensor networks is proposed and analyzed. In a recursion from the leaves to the root, the integrator updates bases and then evolves connection tensors by a Galerkin method in the augmented subspace spanned by the new and old bases. This is followed by rank truncation within a specified error tolerance. The memory requirements are linear in the order of the tensor and linear in the maximal mode dimension. The integrator is robust to small singular values of matricizations of the connection tensors. Up to the rank truncation error, which is controlled by the given error tolerance, the integrator preserves norm and energy for Schrodinger equations, and it dissipates the energy in gradient systems. Numerical experiments with a basic quantum spin system illustrate the behavior of the proposed algorithm.


title: Cluster algebras associated with open Richardson varieties: an algorithm to compute initial seeds

abstract: We present a new algorithm to compute initial seeds for cluster structures on categories associated with coordinate rings of open Richardson varieties. This allows us to explicitely determine seeds first considered in Leclerc's 2016 article.


title: Field representation of interatomic interactions: from relativistic dynamics to microscopic thermodynamics of both many-body and few-body systems

abstract: It is proved that the class of stable interatomic potentials admits an exact representation in the form of a finite or infinite superposition of Yukawa potentials. An auxiliary scalar field is introduced to describe the dynamics of a system of neutral particles (atoms) in the framework of classical field theory. In the case of atoms at rest, this field is equivalent to the interatomic potential, but in the dynamic case it describes the dynamics of a system of atoms interacting through a relativistic classical field. A relativistic Lagrangian for a system consisting of atoms and an auxiliary composite field through which the atoms interact is proposed. Equations are derived for the relativistic dynamics of a system consisting of atoms and an auxiliary field via which the atoms interact. A closed system of equations for the relativistic dynamics of a system consisting of atoms and an auxiliary field through which the atoms interact is derived. In the resulting system, an exact analytical exclusion of field variables is performed, and a closed kinetic equation is derived with respect to the probability-free microscopic atomic distribution function. Keywords: Classical relativistic dynamics; Causality principle; Stable interatomic interactions; Irreversibility phenomenon; Retarded interactions


title: S2MS: Self-Supervised Learning Driven Multi-Spectral CT Image Enhancement

abstract: Photon counting spectral CT (PCCT) can produce reconstructed attenuation maps in different energy channels, reflecting energy properties of the scanned object. Due to the limited photon numbers and the non-ideal detector response of each energy channel, the reconstructed images usually contain much noise. With the development of Deep Learning (DL) technique, different kinds of DL-based models have been proposed for noise reduction. However, most of the models require clean data set as the training labels, which are not always available in medical imaging field. Inspiring by the similarities of each channel's reconstructed image, we proposed a self-supervised learning based PCCT image enhancement framework via multi-spectral channels (S2MS). In S2MS framework, both the input and output labels are noisy images. Specifically, one single channel image was used as output while images of other single channels and channel-sum image were used as input to train the network, which can fully use the spectral data information without extra cost. The simulation results based on the AAPM Low-dose CT Challenge database showed that the proposed S2MS model can suppress the noise and preserve details more effectively in comparison with the traditional DL models, which has potential to improve the image quality of PCCT in clinical applications.


title: Post-Hoc Explanations Fail to Achieve their Purpose in Adversarial Contexts

abstract: Existing and planned legislation stipulates various obligations to provide information about machine learning algorithms and their functioning, often interpreted as obligations to "explain". Many researchers suggest using post-hoc explanation algorithms for this purpose. In this paper, we combine legal, philosophical and technical arguments to show that post-hoc explanation algorithms are unsuitable to achieve the law's objectives. Indeed, most situations where explanations are requested are adversarial, meaning that the explanation provider and receiver have opposing interests and incentives, so that the provider might manipulate the explanation for her own ends. We show that this fundamental conflict cannot be resolved because of the high degree of ambiguity of post-hoc explanations in realistic application scenarios. As a consequence, post-hoc explanation algorithms are unsuitable to achieve the transparency objectives inherent to the legal norms. Instead, there is a need to more explicitly discuss the objectives underlying "explainability" obligations as these can often be better achieved through other mechanisms. There is an urgent need for a more open and honest discussion regarding the potential and limitations of post-hoc explanations in adversarial contexts, in particular in light of the current negotiations of the European Union's draft Artificial Intelligence Act.


title: Quantum thermal field fluctuation induced corrections to the interaction between two ground-state atoms

abstract: We generalize the formalism proposed by Dalibard, Dupont-Roc, and Cohen-Tannoudji [the DDC formalism] in the fourth order for two atoms in interaction with scalar fields in vacuum to a thermal bath at finite temperature $T$, and then calculate the interatomic interaction energy of two ground-state atoms separately in terms of the contributions of thermal fluctuations and the radiation reaction of the atoms and analyze in detail the thermal corrections to the van der Waals and Casimir-Polder interactions. We discover a particular region, i.e., $\sqrt[4]{\lambda^3\beta}\ll L\ll \lambda$ with $L$, $\beta$ and $\lambda$ denoting the interatomic separation, the wavelength of thermal photons and the transition wavelength of the atoms respectively, where the thermal corrections remarkably render the van der Waals force, which is usually attractive, repulsive, leading to an interesting crossover phenomenon of the interatomic interaction from attractive to repulsive as the temperature increases. We also find that the thermal corrections cause significant changes to the Casimir-Polder force when the temperature is sufficiently high, resulting in an attractive force proportional to $TL^{-3}$ in the $\lambda\ll\beta\ll L$ region, and a force which can be either attractive or repulsive and even vanishing in the $ \beta\ll\lambda\ll L$ region depending on the interatomic separation.


title: RadiOrchestra: Proactive Management of Millimeter-wave Self-backhauled Small Cells via Joint Optimization of Beamforming, User Association, Rate Selection, and Admission Control

abstract: Millimeter-wave self-backhauled small cells are a key component of next-generation wireless networks. Their dense deployment will increase data rates, reduce latency, and enable efficient data transport between the access and backhaul networks, providing greater flexibility not previously possible with optical fiber. Despite their high potential, operating dense self-backhauled networks optimally is an open challenge, particularly for radio resource management (RRM). This paper presents, RadiOrchestra, a holistic RRM framework that models and optimizes beamforming, rate selection as well as user association and admission control for self-backhauled networks. The framework is designed to account for practical challenges such as hardware limitations of base stations (e.g., computational capacity, discrete rates), the need for adaptability of backhaul links, and the presence of interference. Our framework is formulated as a nonconvex mixed-integer nonlinear program, which is challenging to solve. To approach this problem, we propose three algorithms that provide a trade-off between complexity and optimality. Furthermore, we derive upper and lower bounds to characterize the performance limits of the system. We evaluate the developed strategies in various scenarios, showing the feasibility of deploying practical self-backhauling in future networks.


title: A Special Case of Schematic Syntactic Unification

abstract: We present a unification problem based on first-order syntactic unification which ask whether every problem in a schematically-defined sequence of unification problems is unifiable, so called loop unification. Alternatively, our problem may be formulated as a recursive procedure calling first-order syntactic unification on certain bindings occurring in the solved form resulting from unification. Loop unification is closely related to Narrowing as the schematic constructions can be seen as a rewrite rule applied during unification, and primal grammars, as we deal with recursive term constructions. However, loop unification relaxes the restrictions put on variables as fresh as well as used extra variables may be introduced by rewriting. In this work we consider an important special case, so called semiloop unification. We provide a sufficient condition for unifiability of the entire sequence based on the structure of a sufficiently long initial segment. It remains an open question whether this condition is also necessary for semiloop unification and how it may be extended to loop unification.


title: Approximation of rigid obstacle by highly viscous fluid

abstract: In this paper, we study the problem concerning the approximation of a rigid obstacle for flows governed by the stationary Navier-Stokes equations in the two-dimensional case. The idea is to consider a highly viscous fluid in the place of the obstacle. Formally, as the fluid viscosity goes to infinity inside the region occupied by the obstacle, we obtain the original problem in the limit. The main goal is to establish a better regularity of approximate solutions. In particular, the pointwise estimate for the gradient of the velocity is proved. We give numerical evidence that the penalized solution can reasonably approximate the problem, even for relatively small values of the penalty parameter.


title: The Inverse Problem for Controlled Differential Equations

abstract: We study the problem of constructing the control driving a controlled differential equation from discrete observations of the response. By restricting the control to the space of piecewise linear paths, we identify the assumptions that ensure uniqueness. The main contribution of this paper is the introduction of a novel numerical algorithm for the construction of the piecewise linear control, that converges uniformly in time. Uniform convergence is needed for many applications and it is achieved by approaching the problem through the signature representation of the paths, which allows us to work with the whole path simultaneously.


title: Ratio of kaon-to-pion production cross-sections in $Be Be$ collisions as a function of $\sqrt{s}$

abstract: The inclusive spectra of pions and kaons produced in $Be Be$ collisions as functions of their transverse momentum $p_t$ at mid-rapidity are calculated within the self-similarity approach. A satisfactory description of NA61/SHINE data on these spectra and the ratio of $K^\pm$ to $\pi^\pm$ meson production cross sections in $Be Be$ collisions as a function of $\sqrt{s}$ are presented. The similarity of these observables to the ones for $pp$ collisions at mid-rapidity and in the wide range of initial energies is illustrated.


title: An inverse Fra\"iss\'e limit for finite posets and duality for posets and lattices

abstract: We consider a category of all finite partial orderings with quotient maps as arrows and construct a Fra\"iss\'e sequence in this category. Then we use commonly known relations between partial orders and lattices to construct a sequence of lattices associated with it. Each of these two sequences has a limit object -- an inverse limit, which is an object of our interest as well. In the first chapter there are some preliminaries considering partial orders, lattices, topology, inverse limits, category theory and Fra\"iss\'e theory, which are used later. In the second chapter there are our results considering a Fra\"iss\'e sequence in category of finite posets with quotient maps and properties of inverse limit of this sequence. In the third chapter we investigate connections between posets and order ideals corresponding to them, getting an inductive sequence made of these ideals; then we study properties of the inverse limit of this sequence.


title: Improved normal-boundary intersection algorithm: a method for energy optimization strategy in smart buildings

abstract: With the widespread use of distributed energy sources, the advantages of smart buildings over traditional buildings are becoming increasingly obvious. Subsequently, its energy optimal scheduling and multi-objective optimization have become more and more complex and need to be solved urgently. This paper presents a novel method to optimize energy utilization in smart buildings. Firstly, multiple transfer-retention ratio (TRR) parameters are added to the evaluation of distributed renewable energy. Secondly, the normal-boundary intersection (NBI) algorithm is improved by the adaptive weight sum, the adjust uniform axes method, and Mahalanobis distance to form the improved normal-boundary intersection (INBI) algorithm. The multi-objective optimization problem in smart buildings is solved by the parameter TRR and INBI algorithm to improve the regulation efficiency. In response to the needs of decision-makers with evaluation indicators, the average deviation is reduced by 60% compared with the previous case. Numerical examples show that the proposed method is superior to the existing technologies in terms of three optimization objectives. The objectives include 8.2% reduction in equipment costs, 7.6% reduction in power supply costs, and 1.6% improvement in occupants' comfort.


title: Regime recovery using implied volatility in Markov modulated market model

abstract: In the regime switching extension of Black-Scholes-Merton model of asset price dynamics, one assumes that the volatility coefficient evolves as a hidden pure jump process. Under the assumption of Markov regime switching, we have considered the locally risk minimizing price of European vanilla options. By pretending these prices or their noisy versions as traded prices, we have first computed the implied volatility (IV) of the underlying asset. Then by performing several numerical experiments we have investigated the dependence of IV on the time to maturity (TTM) and strike price of the vanilla options. We have observed a clear dependence that is at par with the empirically observed stylized facts. Furthermore, we have experimentally validated that IV time series, obtained from contracts with moneyness and TTM varying in particular narrow ranges, can recover the transition instances of the hidden Markov chain. Such regime recovery has also been proved in a theoretical setting. Moreover, the novel scheme for computing option price is shown to be stable.


title: Mutual information neural estimation for unsupervised multi-modal registration of brain images

abstract: Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance compared to iterative methods in just a fraction of the time. Most of the learning-based methods have focused on mono-modal image registration. The extension to multi-modal registration depends on the use of an appropriate similarity function, such as the mutual information (MI). We propose guiding the training of a deep learning-based registration method with MI estimation between an image-pair in an end-to-end trainable network. Our results show that a small, 2-layer network produces competitive results in both mono- and multi-modal registration, with sub-second run-times. Comparisons to both iterative and deep learning-based methods show that our MI-based method produces topologically and qualitatively superior results with an extremely low rate of non-diffeomorphic transformations. Real-time clinical application will benefit from a better visual matching of anatomical structures and less registration failures/outliers.


title: In-situ synchrotron based high energy X-ray diffraction study of the deformation mechanism of {\delta}-hydride in a commercially pure titanium

abstract: We used by in-situ high energy X-ray diffraction to inestigate the deformation behavior of Grade 2 commercially pure titanium that was hydrogen charged to form hydrides. The results showed that the peak broadening in the diffraction patterns are due to the high internal and interphase stresses generated within and around hydrides due to the volume expansion induced by the phase transformation. The hydrides exhibit typical high strength but brittle secondary phase behavior, which undertakes more elastic strain than matrix and is the location where cracks are first generated. Interestingly, the {\delta}-hydrides sustain larger strains than the matrix, especially after the matrix yields. This study on the deformation mechanism of hydrides in pure titanium provides insight into the hydride deformation behavior and hydrogen embrittlement in both titanium and zirconium.


title: Unboxing the graph: Neural Relational Inference for Mobility Prediction

abstract: Predicting the supply and demand of transport systems is vital for efficient traffic management, control, optimization, and planning. For example, predicting where from/to and when people intend to travel by taxi can support fleet managers to distribute resources; better predicting traffic speeds/congestion allows for pro-active control measures or for users to better choose their paths. Making spatio-temporal predictions is known to be a hard task, but recently Graph Neural Networks (GNNs) have been widely applied on non-euclidean spatial data. However, most GNN models require a predefined graph, and so far, researchers rely on heuristics to generate this graph for the model to use. In this paper, we use Neural Relational Inference to learn the optimal graph for the model. Our approach has several advantages: 1) a Variational Auto Encoder structure allows for the graph to be dynamically determined by the data, potentially changing through time; 2) the encoder structure allows the use of external data in the generation of the graph; 3) it is possible to place Bayesian priors on the generated graphs to encode domain knowledge. We conduct experiments on two datasets, namely the NYC Yellow Taxi and the PEMS road traffic datasets. In both datasets, we outperform benchmarks and show performance comparable to state-of-the-art. Furthermore, we do an in-depth analysis of the learned graphs, providing insights on what kinds of connections GNNs use for spatio-temporal predictions in the transport domain.


title: Near horizon gravitational charges

abstract: In this paper, we study the near horizon symmetry and gravitational charges in the Newman-Penrose formalism. In particular we investigate the effect from topological terms. We find that the Pontryagin term and Gauss-Bonnet term have significant influence on the near horizon charges and bring interesting novel features. We show that the gravitational charge derived from a general class of topological terms including the Pontryagin term and Gauss-Bonnet term can be obtained from the ambiguities of the symplectic potential.


title: Tripartite entanglement in quantum memristors

abstract: We study the entanglement and memristive properties of three coupled quantum memristors. We consider quantum memristors based on superconducting asymmetric SQUID architectures which are coupled via inductors. The three quantum memristors are arranged in two different geometries: linear and triangular coupling configurations. We obtain a variety of correlation measures, including bipartite entanglement and tripartite negativity. We find that, for identical quantum memristors, entanglement and memristivity follow the same behavior for the triangular case and the opposite one in the linear case. Finally, we study the multipartite correlations with the tripartite negativity and entanglement monogamy relations, showing that our system has genuine tripartite entanglement. Our results show that quantum correlations in multipartite memristive systems have a non-trivial role and can be used to design quantum memristor arrays for quantum neural networks and neuromorphic quantum computing architectures.


title: Improving INTEGRAL/SPI data analysis of GRBs

abstract: INTEGRAL/SPI is a coded mask instrument observing since 2002 in the keV to MeV energy range, which covers the peak of the $\nu F\nu$ spectrum of most Gamma-Ray Bursts (GRBs). Since its launch in 2008, Fermi/GBM has been the primary instrument for analyzing GRBs in the energy range between $\approx$ 10 keV to $\approx$ 10 MeV. Herein, we show that SPI, covering a similar energy range, can give equivalently constraining results for some parameters if we use an advanced analysis method. Also, combining the data of both instruments reduces the allowed parameter space in spectral fits. The main advantage of SPI as compared to GBM is the energy resolution of $\approx$ 0.2\% at 1.3 MeV compared to $\approx$ 10\% for GBM. Therefore, SPI is an ideal instrument to precisely measure the curvature of the spectrum. This is important, as it has been shown in recent years that physical models rather than heuristic functions should be fit to GRB data to obtain better insights into their still unknown emission mechanism, and the curvature of the peak is unique to the different physical models. To fit physical models to SPI GRB data and get the maximal amount of information from the data, we developed a new open source analysis software {\tt PySPI}. We apply these new techniques to GRB 120711A in order to validate and showcase {\tt PySPI}'s capabilities. We show that {\tt PySPI} improves the analysis of SPI GRB data compared to the {\tt OSA} analysis. In addition, we demonstrate that the GBM and the SPI data of this GRB can be fitted well with a physical synchrotron model. This evinces that SPI can play an important role in GRB spectral model fitting.


title: Multi-purpose open-end monitoring procedures for multivariate observations based on the empirical distribution function

abstract: We propose nonparametric open-end sequential testing procedures that can detect all types of changes in the contemporary distribution function of possibly multivariate observations. Their asymptotic properties are theoretically investigated under stationarity and under alternatives to stationarity. Monte Carlo experiments reveal their good finite-sample behavior in the case of continuous univariate, bivariate and trivariate observations. A short data example concludes the work.


title: Dual-dispersion-regime dual-comb mode-locked laser

abstract: We report on the first solid-state dual-comb mode-locked laser simultaneously operating in different dispersion regimes. Due to the intrinsic polarization-multiplexing in a birefringent Yb:Ca$_3$NbGa$_3$Si$_2$O$_{14}$ (Yb:CNGS) gain medium, the laser emits two cross-polarized pulse trains with a repetition rate offset of ~4.8 kHz from a single cavity. We obtain dual pulse generation with 20-fold difference in the duration, by setting the net cavity group delay dispersion to cross zero across the emission band of the employed gain medium. While the duration of the soliton-like pulses experiencing anomalous dispersion amounts to 117 fs, the second laser output that is spectrally located in the normal dispersion region, is strongly chirped with a pulse duration of 2360 fs.


title: Optimal design of redundant structural systems: fundamentals

abstract: In spite of extended recent interest in System Reliability-Based Design Optimization (System RBDO) and life-cycle cost or Risk Optimization (RO), there is a lack of published studies on optimal design of redundant hyperstatic systems with objective consideration of (a) progressive collapse and (b) the impact of epistemic uncertainties. This paper investigates the fundamental aspects of the problem, by addressing the optimal design of simple two-bar active and passive redundant systems. Progressive collapse is objectively addressed, differentiating consequences of direct collapse of statically determinate structures, and progressive collapse of redundant, statically indeterminate structures. It is well known that reliability of a structural system also depends on nonstructural factors, or factors beyond structural design, such as unanticipated loading, manufacturing quality, quality of workmanship and human errors. These factors can be taken into account in an encompassing risk analysis, which accounts for physical and epistemic uncertainties, and which contributes a fixed latent failure probability to the structural optimization problem. Results presented herein show that the latent failure probability is the single most important parameter in determining optimal solutions, in System RBDO and in RO solutions. When the latent failure probability is smaller than target (System RBDO) or optimal (RO) failure probabilities, there is an equivalence between redundant and non-redundant (hyperstatic and isostatic) designs. However, when the latent reliability is smaller than target or optimal reliabilities, optimal designs become necessarily redundant (hyperstatic); as the only way to make system reliability larger than the latent reliability is by making structural systems redundant.


title: Entropic Analysis of Reservation Policy of Government of India

abstract: Analysis based on the Entropy estimates of the society is carried out on a mathematical model in this paper, to make an assessment of Reservation policy presently in operation in India. The Reservation Policy was provisioned in the constitution of India under the policy of affirmative action. The policy makers had identified some communities of India that were being discriminated socially. They identified them by noticing their dismal representation in positions of power and respect, within the society. It was argued that these communities are required to be treated differently to give them equal opportunity in the society. The policy makers had provisioned in the same policy that the effectiveness of this policy will be analyzed at regular intervals to decide its continuation or improvisation. An attempt is made here to scientifically analyze the effectiveness of this policy and suggest possible improvements in the same. As per the understanding of Entropy, a policy such as the Reservation Policy, that is intended to encourage equality must be associated with increase in the Entropy of the society. After a careful mathematical analysis, it is shown here that the policy, in its present form, is designed to increase the entropy of the society in the short-term scenario but is an iso-entropic policy in the long term. A way has been suggested to complement the policy to make the entropy increased effectively and permanently.


title: Comparison research on binary relations based on transitive degrees and cluster degrees

abstract: Interval-valued information systems are generalized models of single-valued information systems. By rough set approach, interval-valued information systems have been extensively studied. Authors could establish many binary relations from the same interval-valued information system. In this paper, we do some researches on comparing these binary relations so as to provide numerical scales for choosing suitable relations in dealing with interval-valued information systems. Firstly, based on similarity degrees, we compare the most common three binary relations induced from the same interval-valued information system. Secondly, we propose the concepts of transitive degree and cluster degree, and investigate their properties. Finally, we provide some methods to compare binary relations by means of the transitive degree and the cluster degree. Furthermore, we use these methods to analyze the most common three relations induced from Face Recognition Dataset, and obtain that $RF_{B} ^{\lambda}$ is a good choice when we deal with an interval-valued information system by means of rough set approach.


title: Niching-based Evolutionary Diversity Optimization for the Traveling Salesperson Problem

abstract: In this work, we consider the problem of finding a set of tours to a traveling salesperson problem (TSP) instance maximizing diversity, while satisfying a given cost constraint. This study aims to investigate the effectiveness of applying niching to maximize diversity rather than simply maintaining it. To this end, we introduce a 2-stage approach where a simple niching memetic algorithm (NMA), derived from a state-of-the-art for multi-solution TSP, is combined with a baseline diversifying algorithm. The most notable feature of the proposed NMA is the use of randomized improvement-first local search instead of 2-opt. Our experiment on TSPLIB instances shows that while the populations evolved by our NMA tend to contain clusters at tight quality constraints, they frequently occupy distant basins of attraction rather than close-by regions, improving on the baseline diversification in terms of sum-sum diversity. Compared to the original NMA, ours, despite its simplicity, finds more distant solutions of higher quality within less running time, by a large margin.


title: Generation of arbitrarily polarized muon pairs via polarized $e^-e^+$ collision

abstract: Generation of arbitrarily spin polarized muon pairs is investigated via polarized $e^-e^+$ collision. We calculate the fully spin-resolved cross section ${\rm d}\sigma_{e^-e^+\rightarrow \mu^-\mu^+}$ and utilize the Monte Carlo method of binary collision to describe the production and polarization processes of muon pairs. We find that, due to the dependence of mixed helicities on the scattering angle, arbitrarily polarized muon pairs with both of the longitudinal and transverse spin components can be produced. The collision of tightly collimated electron and positron beams with highly longitudinal polarization and nC charge can generate about $40\%$ muon pairs with longitudinal polarization and about $60\%$ muon pairs with transverse polarization. The compact high-flux $e^-e^+\rightarrow\mu^-\mu^+$ muon source could be implemented through the next-generation laser-plasma linear collider, and would be essential to facilitate the investigation of fundamental physics and the measurement technology in broad areas.


title: Manipulating non-Hermitian skin effect via electric fields

abstract: In non-Hermitian systems, the phenomenon that the bulk-band eigenstates are accumulated at the boundaries of the systems under open boundary conditions is called non-Hermitian skin effect (NHSE), which is one of the most iconic and important features of a non-Hermitian system. In this work, we investigate the fate of NHSE in the presence of electric fields by analytically calculating the dynamical evolution of an initial bulk state and numerically computing the spectral winding number, the distributions of eigenstates, as well as the dynamical evolutions. We show abundant manipulation effects of dc and ac fields on the NHSE, and that the physical mechanism behind these effects is the interplay between the Stark localization, dynamic localization and the NHSE. In addition, the finite size analysis of the non-Hermitian system with a pure dc field shows the phenomenon of size-dependent NHSE. We further propose a scheme to realize the discussed model based on an electronic circuit. The results will help to deepen the understanding of NHSE and its manipulation.


title: Two sides of the same coin: sterile neutrinos and dark radiation. Status and perspectives

abstract: The presence of light sterile neutrinos is one of the unanswered questions of particle physics. The cosmological counterpart is represented by dark radiation, i.e.\ any form of radiation present in the early Universe besides photons and standard (active) neutrinos. This short review provides a comprehensive overview of the two problems and of their connection. We review the status of neutrino oscillation anomalies, commenting on the most recent oscillation data and their mutual tensions, and we discuss the constraints from other terrestrial probes. We show the shortcomings of translating light sterile neutrinos in cosmology as additional thermalised relativistic species, produced by neutrino oscillations, and we detail alternative solutions, specifically focusing on neutrino non standard interactions, and on their link to the Hubble constant problem. The impact of a new force leading to dark radiation -- dark matter interactions is also discussed in the realm of new physics in the dark sector.


title: The Quantum Eraser from a Weak Values Perspective

abstract: The quantum eraser variant of the double-slit experiment, and its 'delayed choice' sub-variant, are considered from the perspective of weak value and weak measurement theory (which is briefly reintroduced here). The interference fringes that appear when measuring certain spin states, which can then be 'erased' when measuring other spin states, are shown to be anomalous weak values that depend on particular post-selection choices. By framing the choice of spin measurement as a weak value of a certain weak measurement, it is then made clear what physical claims can and cannot be made about what occurs in the quantum eraser experiment. Specifically, claims about the choice of spin-state `retrocausally' influencing the choice of slit(s) for the particles to travel through are discredited, and a simple framework is presented for understanding how the fringes arise and why they can be 'erased'.


title: Compositional Cubes: A New Concept for Multi-factorial Compositions

abstract: Compositional data are commonly known as multivariate observations carrying relative information. Even though the case of vector or even two-factorial compositional data (compositional tables) is already well described in the literature, there is still a need for a comprehensive approach to the analysis of multi-factorial relative-valued data. Therefore, this contribution builds around the current knowledge about compositional data a general theory of work with k-factorial compositional data. As a main finding it turns out that similar to the case of compositional tables also the multi-factorial structures can be orthogonally decomposed into an independent and several interactive parts and, moreover, a coordinate representation allowing for their separate analysis by standard analytical methods can be constructed. For the sake of simplicity, these features are explained in detail for the case of three-factorial compositions (compositional cubes), followed by an outline covering the general case. The three-dimensional structure is analysed in depth in two practical examples, dealing with systems of spatial and time dependent compositional cubes. The methodology is implemented in the R package robCompositions.


title: Using unsupervised machine learning to quantify physical activity from accelerometry in a diverse and rapidly changing population

abstract: Accelerometers are widely used to measure physical activity behaviour, including in children. The traditional method for processing acceleration data uses cut points to define physical activity intensity, relying on calibration studies that relate the magnitude of acceleration to energy expenditure. However, these relationships do not generalise across diverse populations and hence they must be parametrised for each subpopulation (e.g., age groups) which is costly and makes studies across diverse populations and over time difficult. A data driven approach that allows physical activity intensity states to emerge from the data, without relying on parameters derived from external populations, and offers a new perspective on this problem and potentially improved results. We applied an unsupervised machine learning approach, namely a hidden semi Markov model, to segment and cluster the accelerometer data recorded from 279 children (9 to 38 months old) with a diverse range of physical and social-cognitive abilities (measured using the Paediatric Evaluation of Disability Inventory). We benchmarked this analysis with the cut points approach calculated using the best available thresholds for the population. Time spent active as measured by this unsupervised approach correlated more strongly with measures of the childs mobility, social-cognitive capacity, independence, daily activity, and age than that measured using the cut points approach. Unsupervised machine learning offers the potential to provide a more sensitive, appropriate, and cost-effective approach to quantifying physical activity behaviour in diverse populations, compared to the current cut points approach. This, in turn, supports research that is more inclusive of diverse or rapidly changing populations.


title: Little Help Makes a Big Difference: Leveraging Active Learning to Improve Unsupervised Time Series Anomaly Detection

abstract: Key Performance Indicators (KPI), which are essentially time series data, have been widely used to indicate the performance of telecom networks. Based on the given KPIs, a large set of anomaly detection algorithms have been deployed for detecting the unexpected network incidents. Generally, unsupervised anomaly detection algorithms gain more popularity than the supervised ones, due to the fact that labeling KPIs is extremely time- and resource-consuming, and error-prone. However, those unsupervised anomaly detection algorithms often suffer from excessive false alarms, especially in the presence of concept drifts resulting from network re-configurations or maintenance. To tackle this challenge and improve the overall performance of unsupervised anomaly detection algorithms, we propose to use active learning to introduce and benefit from the feedback of operators, who can verify the alarms (both false and true ones) and label the corresponding KPIs with reasonable effort. Specifically, we develop three query strategies to select the most informative and representative samples to label. We also develop an efficient method to update the weights of Isolation Forest and optimally adjust the decision threshold, so as to eventually improve the performance of detection model. The experiments with one public dataset and one proprietary dataset demonstrate that our active learning empowered anomaly detection pipeline could achieve performance gain, in terms of F1-score, more than 50% over the baseline algorithm. It also outperforms the existing active learning based methods by approximately 6%-10%, with significantly reduced budget (the ratio of samples to be labeled).


title: Addressing the Intra-class Mode Collapse Problem using Adaptive Input Image Normalization in GAN-based X-ray Images

abstract: Biomedical image datasets can be imbalanced due to the rarity of targeted diseases. Generative Adversarial Networks play a key role in addressing this imbalance by enabling the generation of synthetic images to augment datasets. It is important to generate synthetic images that incorporate a diverse range of features to accurately represent the distribution of features present in the training imagery. Furthermore, the absence of diverse features in synthetic images can degrade the performance of machine learning classifiers. The mode collapse problem can impact a Generative Adversarial Network's capacity to generate diversified images. Mode collapse comes in two varieties: intra-class and inter-class. In this paper, the intra-class mode collapse problem is investigated, and its subsequent impact on the diversity of synthetic X-ray images is evaluated. This work contributes an empirical demonstration of the benefits of integrating the adaptive input-image normalization for the Deep Convolutional GAN to alleviate the intra-class mode collapse problem. Results demonstrate that the DCGAN with adaptive input-image normalization outperforms DCGAN with un-normalized X-ray images as evident by the superior diversity scores.


title: KCo$_2$As$_2$: A New Portal for the Physics of High-Purity Metals

abstract: High-quality single crystals of KCo$_2$As$_2$ with the body-centered tetragonal ThCr$_2$Si$_2$ structure were grown using KAs self flux. Structural, magnetic, thermal, and electrical transport were investigated. No clear evidence for any phase transitions was found in the temperature range 2 to 300 K. The in-plane electrical resistivity $\rho$ versus temperature $T$ is highly unusual, showing a $T^4$ behavior below 30 K and an anomalous positive curvature up to 300 K which is different from the linear behavior expected from the Bloch-Gr\"uneisen theory for electron scattering by acoustic phonons. This positive curvature has been previously observed in the in-plane resistivity of high-conductivity layered delafossites such as PdCoO$_2$ and PtCoO$_2$. The in-plane $\rho(T\to0) = 0.36~\mu\Omega$ cm of KCo$_2$As$_2$ is exceptionally small for this class of compounds. The material also exhibits a nearly linear magnetoresistance at low $T$ which attains a value of about 40% at $T=2$K and magnetic field $H= 80$ kOe. The magnetic susceptibility $\chi$ of KCo$_2$As$_2$ is isotropic and about an order of magnitude smaller than the values for the related compounds SrCo$_2$As$_2$ and BaCo$_2$As$_2$. The $\chi$ increases above 100 K which is found from our first-principles calculations to arise from a sharp peak in the electronic density of states just above the Fermi energy $E_{\rm F}$. Heat capacity $C_{\rm p}(T)$ data at low $T$ yield an electronic density of states $N(E_{\rm F})$ that is about 36% larger than predicted by the first-principles theory. The $C_{\rm p}(T)$ data near room temperature suggest the presence of excited optic vibration modes which may also be the source of the positive curvature in $\rho(T)$. Our results show that KCo$_2$As$_2$ provides a new avenue for investigating the physics of high-purity metals.


title: ShapeFormer: Transformer-based Shape Completion via Sparse Representation

abstract: We present ShapeFormer, a transformer-based network that produces a distribution of object completions, conditioned on incomplete, and possibly noisy, point clouds. The resultant distribution can then be sampled to generate likely completions, each exhibiting plausible shape details while being faithful to the input. To facilitate the use of transformers for 3D, we introduce a compact 3D representation, vector quantized deep implicit function, that utilizes spatial sparsity to represent a close approximation of a 3D shape by a short sequence of discrete variables. Experiments demonstrate that ShapeFormer outperforms prior art for shape completion from ambiguous partial inputs in terms of both completion quality and diversity. We also show that our approach effectively handles a variety of shape types, incomplete patterns, and real-world scans.