title: Towards Building A Group-based Unsupervised Representation Disentanglement Framework

abstract: Disentangled representation learning is one of the major goals of deep learning, and is a key step for achieving explainable and generalizable models. A well-defined theoretical guarantee still lacks for the VAE-based unsupervised methods, which are a set of popular methods to achieve unsupervised disentanglement. The Group Theory based definition of representation disentanglement mathematically connects the data transformations to the representations using the formalism of group. In this paper, built on the group-based definition and inspired by the n-th dihedral group, we first propose a theoretical framework towards achieving unsupervised representation disentanglement. We then propose a model, based on existing VAE-based methods, to tackle the unsupervised learning problem of the framework. In the theoretical framework, we prove three sufficient conditions on model, group structure, and data respectively in an effort to achieve, in an unsupervised way, disentangled representation per group-based definition. With the first two of the conditions satisfied and a necessary condition derived for the third one, we offer additional constraints, from the perspective of the group-based definition, for the existing VAE-based models. Experimentally, we train 1800 models covering the most prominent VAE-based methods on five datasets to verify the effectiveness of our theoretical framework. Compared to the original VAE-based methods, these Groupified VAEs consistently achieve better mean performance with smaller variances.


title: End-to-end neural network approach to 3D reservoir simulation and adaptation

abstract: Reservoir simulation and adaptation (also known as history matching) are typically considered as separate problems. While a set of models are aimed at the solution of the forward simulation problem assuming all initial geological parameters are known, the other set of models adjust geological parameters under the fixed forward simulation model to fit production data. This results in many difficulties for both reservoir engineers and developers of new efficient computation schemes. We present a unified approach to reservoir simulation and adaptation problems. A single neural network model allows a forward pass from initial geological parameters of the 3D reservoir model through dynamic state variables to well's production rates and backward gradient propagation to any model inputs and variables. The model fitting and geological parameters adaptation both become the optimization problem over specific parts of the same neural network model. Standard gradient-based optimization schemes can be used to find the optimal solution. Using real-world oilfield model and historical production rates we demonstrate that the suggested approach allows reservoir simulation and history matching with a benefit of several orders of magnitude simulation speed-up. Finally, to propagate this research we open-source a Python-based framework DeepField that allows standard processing of reservoir models and reproducing the approach presented in this paper.


title: Paraproducts for bilinear multipliers associated with convex sets

abstract: We prove bounds in the local $ L^2 $ range for exotic paraproducts motivated by bilinear multipliers associated with convex sets. One result assumes an exponential boundary curve. Another one assumes a higher order lacunarity condition.


title: Designation of Intra-layer and Intercalated High Entropy Quasi-2D Compounds

abstract: Here, we designed two promising schemes to realize the high-entropy structure in a series of quasi-two-dimensional compounds, transition metal dichalcogenides (TMDCs). In the intra-layer high-entropy plan, (HEM)X2 compounds with high-entropy structure in the MX2 slabs were obtained, here HEM means high-entropy metals, such as TiZrNbMoTa. And superconductivity with a Tc~7.4 K was found in a Mo-rich HEMX2. On the other hand, in the intercalation plan, we intercalated HEM-atoms (FeCoCrNiMn) into the gap between the sandwiched-MX2 slabs resulting in a series of (HEM)xMX2 compounds, x in the range of 0~0.5, in which HEM is mainly composed of 3d transition metal elements, such as FeCoCrNiMn. As the introduction of multi-component magnetic atoms, ferromagnetic spin-glass states with strong 2D characteristics ensued. Tuning the x content, three kinds of two in the high-entropy intercalated layer were observed including the 1*1 triangular lattice and two kinds of superlattices \sqrt3*\sqrt3 and \sqrt3*2 in x=0.333 and x>0.5, respectively. Meanwhile, the spin frustration in the two-dimensional high-entropy magnetic plane will be enhanced with the development of \sqrt3*\sqrt3 and will be reduced significantly when changing into the \sqrt3*2 phase. The high-entropy TMDCs and versatile two-dimensional high-entropy structures found by us possess great potentials to find new physics in low-dimensional high-entropy structures and future applications.


title: Large-width functional asymptotics for deep Gaussian neural networks

abstract: In this paper, we consider fully connected feed-forward deep neural networks where weights and biases are independent and identically distributed according to Gaussian distributions. Extending previous results (Matthews et al., 2018a;b; Yang, 2019) we adopt a function-space perspective, i.e. we look at neural networks as infinite-dimensional random elements on the input space $\mathbb{R}^I$. Under suitable assumptions on the activation function we show that: i) a network defines a continuous Gaussian process on the input space $\mathbb{R}^I$; ii) a network with re-scaled weights converges weakly to a continuous Gaussian process in the large-width limit; iii) the limiting Gaussian process has almost surely locally $\gamma$-H\"older continuous paths, for $0 < \gamma <1$. Our results contribute to recent theoretical studies on the interplay between infinitely wide deep neural networks and Gaussian processes by establishing weak convergence in function-space with respect to a stronger metric.


title: Strata-based Quantification of Distributional Uncertainty in Socio-Economic Indicators: A Comparative Study of Indian States

abstract: This paper reports a comprehensive study of distributional uncertainty in a few socio-economic indicators across the various states of India over the years 2001-2011. We show that the DGB distribution, a typical rank order distribution, provide excellent fits to the district-wise empirical data for the population size, literacy rate (LR) and work participation rate (WPR) within every states in India, through its two distributional parameters. Moreover, taking resort to the entropy formulation of the DGB distribution, a proposed uncertainty percentage (UP) unveils the dynamics of the uncertainty of LR and WPR in all states of India. We have also commented on the changes in the estimated parameters and the UP values from the years 2001 to 2011. Additionally, a gender based analysis of the distribution of these important socio-economic variables within different states of India has also been discussed. Interestingly, it has been observed that, although the distributions of the numbers of literate and working people has a direct (linear) correspondence with that of the population size, the literacy and work-participation rates are distributed independently of the population distributions.


title: An Inexact Semi-smooth Newton Method on Riemannian Manifolds with Application to Duality-based Total Variation Denoising

abstract: We propose a higher-order method for solving non-smooth optimization problems on manifolds. In order to obtain superlinear convergence, we apply a Riemannian Semi-smooth Newton method to a non-smooth non-linear primal-dual optimality system based on a recent extension of Fenchel duality theory to Riemannian manifolds. We also propose an inexact version of the Riemannian Semi-smooth Newton method and prove conditions for local linear and superlinear convergence that hold independent of the sign of the curvature. Numerical experiments on l2-TV-like problems with dual regularization confirm superlinear convergence on manifolds with positive and negative curvature.


title: Phase-field modeling on the diffusion-driven processes in metallic conductors and lithium-ion batteries

abstract: Diffusion-driven processes are important phenomena of materials science in the field of energy conversion and transmission. During the conversion from chemical energy to electrical energy, the species diffusion is generally linked to the rate of exchange, and hence to the performance of the conversion device. Alternatively, the transmission of the electric field diffuses the species when it passes through any medium. The consequences of this effect can be regulated to attune surface nano-patterns. Otherwise, uncontrolled morphologies may lead to permanent degradation of the metallic conductors. Therefore, the understanding of the material behavior, in the presence of the driving forces of the diffusional species, is of scientific interest. The presented dissertation proposes to investigate one example of species diffusion in each case, during energy conversion and transmission. Specifically, the objective of the study is to explore the lithium insertion into the cathode electrode of lithium-ion batteries and the morphological evolution of inclusions, while propagating under the electromigration in the metallic conductors. The presented dissertation demonstrates that the phase-field methods are able to elegantly capture the essential physics of the diffusion-driven phenomena discussed above.

categories: physics.app-ph cond-mat.mtrl-sci cs.CE nlin.PS


title: Near octave-spanning perfect soliton crystals in AlN microresonators

abstract: The perfect soliton crystal (PSC) was recently discovered as an extraordinary Kerr soliton state with regularly distributed soliton pulses and enhanced comb line power spaced by multiples of the cavity free spectral ranges (FSRs). The modulation of continuous-wave excitation in optical microresonators and the tunable repetition rate characteristic will significantly enhance and extend the application potential of soliton microcombs for self-referencing comb source, terahertz wave generation, and arbitrary waveform generation. However, the reported PSC spectrum is generally narrow. Here, we demonstrate the deterministic accessing of versatile perfect soliton crystals in the AlN microresonators (FSR ~374 GHz), featuring a broad spectral range up to 0.96 of an octave-span (1170-2300 nm) and terahertz repetition rates (up to ~1.87 THz). The measured 60-fs short pulses and low-noise characteristics confirms the high coherence of the PSCs


title: Bregman Finito/MISO for nonconvex regularized finite sum minimization without Lipschitz gradient continuity

abstract: We introduce two algorithms for nonconvex regularized finite sum minimization, where typical Lipschitz differentiability assumptions are relaxed to the notion of relative smoothness. The first one is a Bregman extension of Finito/MISO, studied for fully nonconvex problems when the sampling is randomized, or under convexity of the nonsmooth term when it is essentially cyclic. The second algorithm is a low-memory variant, in the spirit of SVRG and SARAH, that also allows for fully nonconvex formulations. Our analysis is made remarkably simple by employing a Bregman Moreau envelope as Lyapunov function. In the randomized case, linear convergence is established when the cost function is strongly convex, yet with no convexity requirements on the individual functions in the sum. For the essentially cyclic and low-memory variants, global and linear convergence results are established when the cost function satisfies the Kurdyka-\L ojasiewicz property.


title: Mesh Manifold based Riemannian Motion Planning for Omnidirectional Micro Aerial Vehicles

abstract: This paper presents a novel on-line path planning method that enables aerial robots to interact with surfaces. We present a solution to the problem of finding trajectories that drive a robot towards a surface and move along it. Triangular meshes are used as a surface map representation that is free of fixed discretization and allows for very large workspaces. We propose to leverage planar parametrization methods to obtain a lower-dimensional topologically equivalent representation of the original surface. Furthermore, we interpret the original surface and its lower-dimensional representation as manifold approximations that allow the use of Riemannian Motion Policies (RMPs), resulting in an efficient, versatile, and elegant motion generation framework. We compare against several Rapidly-exploring Random Tree (RRT) planners, a customized CHOMP variant, and the discrete geodesic algorithm. Using extensive simulations on real-world data we show that the proposed planner can reliably plan high-quality near-optimal trajectories at minimal computational cost. The accompanying multimedia attachment demonstrates feasibility on a real OMAV. The obtained paths show less than 10% deviation from the theoretical optimum while facilitating reactive re-planning at kHz refresh rates, enabling flying robots to perform motion planning for interaction with complex surfaces.


title: GMA: A Pareto Optimal Distributed Resource-Allocation Algorithm

abstract: To address the rising demand for strong packet delivery guarantees in networking, we study a novel way to perform graph resource allocation. We first introduce allocation graphs, in which nodes can independently set local resource limits based on physical constraints or policy decisions. In this scenario we formalize the distributed path-allocation (PAdist) problem, which consists in allocating resources to paths considering only local on-path information -- importantly, not knowing which other paths could have an allocation -- while at the same time achieving the global property of never exceeding available resources. Our core contribution, the global myopic allocation (GMA) algorithm, is a solution to this problem. We prove that GMA can compute unconditional allocations for all paths on a graph, while never over-allocating resources. Further, we prove that GMA is Pareto optimal with respect to the allocation size, and it has linear complexity in the input size. Finally, we show with simulations that this theoretical result could be indeed applied to practical scenarios, as the resulting path allocations are large enough to fit the requirements of practically relevant applications.


title: EXTRA: Explanation Ranking Datasets for Explainable Recommendation

abstract: Recently, research on explainable recommender systems has drawn much attention from both academia and industry, resulting in a variety of explainable models. As a consequence, their evaluation approaches vary from model to model, which makes it quite difficult to compare the explainability of different models. To achieve a standard way of evaluating recommendation explanations, we provide three benchmark datasets for EXplanaTion RAnking (denoted as EXTRA), on which explainability can be measured by ranking-oriented metrics. Constructing such datasets, however, poses great challenges. First, user-item-explanation triplet interactions are rare in existing recommender systems, so how to find alternatives becomes a challenge. Our solution is to identify nearly identical sentences from user reviews. This idea then leads to the second challenge, i.e., how to efficiently categorize the sentences in a dataset into different groups, since it has quadratic runtime complexity to estimate the similarity between any two sentences. To mitigate this issue, we provide a more efficient method based on Locality Sensitive Hashing (LSH) that can detect near-duplicates in sub-linear time for a given query. Moreover, we make our code publicly available to allow researchers in the community to create their own datasets.


title: Direct observation of layer-stacking and oriented wrinkles in multilayer hexagonal boron nitride

abstract: Hexagonal boron nitride (h-BN) has long been recognized as an ideal substrate for electronic devices due to its dangling-bond-free surface, insulating nature and thermal/chemical stability. Therefore, to analyse the lattice structure and orientation of h-BN crystals becomes important. Here, the stacking order and wrinkles of h-BN are investigated by transmission electron microscopy (TEM). It is experimentally confirmed that the layers in the h-BN flakes are arranged in the AA' stacking. The wrinkles in a form of threefold network throughout the h-BN crystal are oriented along the armchair direction, and their formation mechanism was further explored by molecular dynamics simulations. Our findings provide a deep insight about the microstructure of h-BN and shed light on the structural design/electronic modulations of two-dimensional crystals.


title: On guarding polygons with holes

abstract: There is an old conjecture by Shermer \cite{sher} that in a polygon with $n$ vertices and $h$ holes, $\lfloor \dfrac{n+h}{3} \rfloor$ vertex guards are sufficient to guard the entire polygon. The conjecture is proved for $h=1$ by Shermer \cite{sher} and Aggarwal \cite{aga} seperately. In this paper, we prove a theorem similar to the Shermer's conjecture for a special case where the goal is to guard the vertices of the polygon (not the entire polygon) which is equivalent to finding a dominating set for the visibility graph of the polygon. Our proof also guarantees that the selected vertex guards also cover the entire outer boundary (outer perimeter of the polygon) as well.


title: A new technique for solving Sobolev type fractional multi-order evolution equations

abstract: A strong inspiration for studying Sobolev type fractional evolution equations comes from the fact that have been verified to be useful tools in the modeling of many physical processes. We introduce a novel technique for solving Sobolev type fractional evolution equations with multi-orders in a Banach space. We propose a new Mittag-Leffler type function which is generated by linear bounded operators and investigate their properties which are productive for checking the candidate solutions for multi-term fractional differential equations. Furthermore, we propose an exact analytical representation of solutions for multi-dimensional fractional-order dynamical systems with nonpermutable and permutable matrices.


title: Stability and Resilience of Distributed Information Spreading in Aggregate Computing

abstract: Spreading information through a network of devices is a core activity for most distributed systems. As such, self-stabilizing algorithms implementing information spreading are one of the key building blocks enabling aggregate computing to provide resilient coordination in open complex distributed systems. This paper improves a general spreading block in the aggregate computing literature by making it resilient to network perturbations, establishes its global uniform asymptotic stability and proves that it is ultimately bounded under persistent disturbances. The ultimate bounds depend only on the magnitude of the largest perturbation and the network diameter, and three design parameters trade off competing aspects of performance. For example, as in many dynamical systems, values leading to greater resilience to network perturbations slow convergence and vice versa.


title: GenFloor: Interactive Generative Space Layout System via Encoded Tree Graphs

abstract: Automated floorplanning or space layout planning has been a long-standing NP-hard problem in the field of computer-aided design, with applications in integrated circuits, architecture, urbanism, and operational research. In this paper, we introduce GenFloor, an interactive design system that takes geometrical, topological, and performance goals and constraints as input and provides optimized spatial design solutions as output. As part of our work, we propose three novel permutation methods for existing space layout graph representations, namely O-Tree and B*-Tree representations. We implement our proposed floorplanning methods as a package for Dynamo, a visual programming tool, with a custom GUI and additional evaluation functionalities to facilitate designers in their generative design workflow. Furthermore, we illustrate the performance of GenFloor in two sets of case-study experiments for residential floorplanning tasks by (a) measuring the ability of the proposed system to find a known optimal solution, and (b) observing how the system can generate diverse floorplans while addressing given a constant residential design problem. Our results indicate convergence to the global optimum is achieved while offering a diverse set of solutions of a residential floorplan corresponding to the Pareto-optimums of the solution landscape.


title: Design of Ciphers based on the Geometric Structure of the M\"obius Plane

abstract: Till now geometric structures don't play a major role in cryptography. Gilbert, MacWilliams and Sloane introduced in 1974 an authentication scheme in the projective plane and showed its perfectness in the sense of the definition of Shannon. In this paper we will show that this authentication scheme also fulfills the requirement of completeness according to Kam and Davida and we will extend the application of geometric structures in cryptography by introducing an encryption scheme in the M\"obius plane. We will further examine its properties, showing that it also fulfills the requirement of completeness and Shannon's requirement of perfectness in first approximation. The results of this paper can be used to define similar encryption schemes in the circle geometries of Laguerre and Minkowski.


title: Learnable MFCCs for Speaker Verification

abstract: We propose a learnable mel-frequency cepstral coefficient (MFCC) frontend architecture for deep neural network (DNN) based automatic speaker verification. Our architecture retains the simplicity and interpretability of MFCC-based features while allowing the model to be adapted to data flexibly. In practice, we formulate data-driven versions of the four linear transforms of a standard MFCC extractor -- windowing, discrete Fourier transform (DFT), mel filterbank and discrete cosine transform (DCT). Results reported reach up to 6.7\% (VoxCeleb1) and 9.7\% (SITW) relative improvement in term of equal error rate (EER) from static MFCCs, without additional tuning effort.


title: Unavailable Transit Feed Specification: Making it Available with Recurrent Neural Networks

abstract: Studies on public transportation in Europe suggest that European inhabitants use buses in ca. 56% of all public transport travels. One of the critical factors affecting such a percentage and more, in general, the demand for public transport services, with an increasing reluctance to use them, is their quality. End-users can perceive quality from various perspectives, including the availability of information, i.e., the access to details about the transit and the provided services. The approach proposed in this paper, using innovative methodologies resorting on data mining and machine learning techniques, aims to make available the unavailable data about public transport. In particular, by mining GPS traces, we manage to reconstruct the complete transit graph of public transport. The approach has been successfully validated on a real dataset collected from the local bus system of the city of L'Aquila (Italy). The experimental results demonstrate that the proposed approach and implemented framework are both effective and efficient, thus being ready for deployment.


title: Necessary and sufficient graphical conditions for optimal adjustment sets in causal graphical models with hidden variables

abstract: The problem of selecting optimal backdoor adjustment sets to estimate causal effects in graphical models with hidden and conditioned variables is addressed. Previous work has defined optimality as achieving the smallest asymptotic estimation variance and derived an optimal set for the case without hidden variables. For the case with hidden variables there can be settings where no optimal set exists and currently only a sufficient graphical optimality criterion of limited applicability has been derived. In the present work optimality is characterized as maximizing a certain adjustment information which allows to derive a necessary and sufficient graphical criterion for the existence of an optimal adjustment set and a definition and algorithm to construct it. Further, the optimal set is valid if and only if a valid adjustment set exists and has higher (or equal) adjustment information than the Adjust-set proposed in Perkovi{\'c} et al. [Journal of Machine Learning Research, 18: 1--62, 2018] for any graph. The results translate to minimal asymptotic estimation variance for a class of estimators whose asymptotic variance follows a certain information-theoretic relation. Numerical experiments indicate that the asymptotic results also hold for relatively small sample sizes and that the optimal adjustment set or minimized variants thereof often yield better variance also beyond that estimator class. Surprisingly, among the randomly created setups more than 90\% fulfill the optimality conditions indicating that also in many real-world scenarios graphical optimality may hold. Code is available as part of the python package \url{https://github.com/jakobrunge/tigramite}.


title: Immediate renormalization of complex polynomials

abstract: A cubic polynomial $P$ with a non-repelling fixed point $b$ is said to be \emph{immediately renormalizable} if there exists a (connected) quadratic-like invariant filled Julia set $K^*$ such that $b\in K^*$. In that case exactly one critical point of $P$ does not belong to $K^*$. We show that if, in addition, the Julia set of $P$ has no (pre)periodic cutpoints then this critical point is recurrent.


title: Automated identification of transiting exoplanet candidates in NASA Transiting Exoplanets Survey Satellite (TESS) data with machine learning methods

abstract: A novel artificial intelligence (AI) technique that uses machine learning (ML) methodologies combines several algorithms, which were developed by ThetaRay, Inc., is applied to NASA's Transiting Exoplanets Survey Satellite (TESS) dataset to identify exoplanetary candidates. The AI/ML ThetaRay system is trained initially with Kepler exoplanetary data and validated with confirmed exoplanets before its application to TESS data. Existing and new features of the data, based on various observational parameters, are constructed and used in the AI/ML analysis by employing semi-supervised and unsupervised machine learning techniques. By the application of ThetaRay system to 10,803 light curves of threshold crossing events (TCEs) produced by the TESS mission, obtained from the Mikulski Archive for Space Telescopes, the algorithm yields about 50 targets for further analysis, and we uncover three new exoplanetary candidates by further manual vetting. This study demonstrates for the first time the successful application of the particular combined multiple AI/ML-based methodologies to a large astrophysical dataset for rapid automated classification of TCEs.


title: Graph Laplacian for image deblurring

abstract: Image deblurring is relevant in many fields of science and engineering. To solve this problem, many different approaches have been proposed and among the various methods, variational ones are extremely popular. These approaches are characterized by substituting the original problem with a minimization one where the functional is composed of two terms, a data fidelity term and a regularization term. In this paper we propose, in the classical $\ell^2-\ell^1$ minimization with the non-negativity constraint of the solution, the use of the graph Laplacian as regularization operator. Firstly, we describe how to construct the graph Laplacian from the observed noisy and blurred image. Once the graph Laplacian has been built, we solve efficiently the proposed minimization problem splitting the convolution operator and the graph Laplacian by the alternating direction method of multipliers (ADMM). Some selected numerical examples show the good performances of the proposed algorithm.


title: Partitioning permutations into monotone subsequences

abstract: A permutation is $k$-coverable if it can be partitioned into $k$ monotone subsequences. Barber conjectured that, for any given permutation, if every subsequence of length $k+2 \choose 2$ is $k$-coverable then the permutation itself is $k$-coverable. This conjecture, if true, would be best possible. Our aim in this paper is to disprove this conjecture for all $k \ge 3$. In fact, we show that for any $k$ there are permutations such that every subsequence of length at most $(k/6)^{2.46}$ is $k$-coverable while the permutation itself is not.


title: A branching process approach to level-$k$ phylogenetic networks

abstract: The mathematical analysis of random phylogenetic networks via analytic and algorithmic methods has received increasing attention in the past years. In the present work we introduce branching process methods to their study. This approach appears to be new in this context. Our main results focus on random level-$k$ networks with $n$ labelled leaves. Although the number of reticulation vertices in such networks is typically linear in $n$, we prove that their asymptotic global and local shape is tree-like in a well-defined sense. We show that the depth process of vertices in a large network converges towards a Brownian excursion after rescaling by $n^{-1/2}$. We also establish Benjamini--Schramm convergence of large random level-$k$ networks towards a novel random infinite network.


title: Decoupling Value and Policy for Generalization in Reinforcement Learning

abstract: Standard deep reinforcement learning algorithms use a shared representation for the policy and value function, especially when training directly from images. However, we argue that more information is needed to accurately estimate the value function than to learn the optimal policy. Consequently, the use of a shared representation for the policy and value function can lead to overfitting. To alleviate this problem, we propose two approaches which are combined to create IDAAC: Invariant Decoupled Advantage Actor-Critic. First, IDAAC decouples the optimization of the policy and value function, using separate networks to model them. Second, it introduces an auxiliary loss which encourages the representation to be invariant to task-irrelevant properties of the environment. IDAAC shows good generalization to unseen environments, achieving a new state-of-the-art on the Procgen benchmark and outperforming popular methods on DeepMind Control tasks with distractors. Our implementation is available at https://github.com/rraileanu/idaac.


title: Separating Stimulus-Induced and Background Components of Dynamic Functional Connectivity in Naturalistic fMRI

abstract: We consider the challenges in extracting stimulus-related neural dynamics from other intrinsic processes and noise in naturalistic functional magnetic resonance imaging (fMRI). Most studies rely on inter-subject correlations (ISC) of low-level regional activity and neglect varying responses in individuals. We propose a novel, data-driven approach based on low-rank plus sparse (L+S) decomposition to isolate stimulus-driven dynamic changes in brain functional connectivity (FC) from the background noise, by exploiting shared network structure among subjects receiving the same naturalistic stimuli. The time-resolved multi-subject FC matrices are modeled as a sum of a low-rank component of correlated FC patterns across subjects, and a sparse component of subject-specific, idiosyncratic background activities. To recover the shared low-rank subspace, we introduce a fused version of principal component pursuit (PCP) by adding a fusion-type penalty on the differences between the rows of the low-rank matrix. The method improves the detection of stimulus-induced group-level homogeneity in the FC profile while capturing inter-subject variability. We develop an efficient algorithm via a linearized alternating direction method of multipliers to solve the fused-PCP. Simulations show accurate recovery by the fused-PCP even when a large fraction of FC edges are severely corrupted. When applied to natural fMRI data, our method reveals FC changes that were time-locked to auditory processing during movie watching, with dynamic engagement of sensorimotor systems for speech-in-noise. It also provides a better mapping to auditory content in the movie than ISC.

categories: q-bio.NC cs.LG cs.SD eess.AS eess.IV eess.SP stat.AP


title: Low temperature pseudo-phase transition in an extended Hubbard diamond chain

abstract: We consider the extended Hubbard diamond chain with an arbitrary number of particles driven by chemical potential. The interaction between dimer diamond chain and nodal couplings is considered in the atomic limit (no hopping), while the dimer interaction includes the hopping term. We demonstrate that this model exhibits a pseudo-transition effect in the low-temperature regime. Here, we explore the pseudo-transition rigorously by analyzing several physical quantities. The internal energy and entropy depict sudden, although continuous, jumps which closely resembles discontinuous or first-order phase transition. At the same time, the correlation length and specific heat exhibit astonishing strong sharp peaks, quite similar to a second-order phase transition. We associate the ascending and descending part of the peak with power-law \textquotedbl pseudo-critical\textquotedbl exponents. We determine the pseudo-critical exponents in the temperature range where these peaks are developed, namely $\nu=1$ for the correlation length and $\alpha=3$ for the specific heat. We also study the behavior of the electron density and isothermal compressibility around the pseudo-critical temperature.


title: Provably Strict Generalisation Benefit for Equivariant Models

abstract: It is widely believed that engineering a model to be invariant/equivariant improves generalisation. Despite the growing popularity of this approach, a precise characterisation of the generalisation benefit is lacking. By considering the simplest case of linear models, this paper provides the first provably non-zero improvement in generalisation for invariant/equivariant models when the target distribution is invariant/equivariant with respect to a compact group. Moreover, our work reveals an interesting relationship between generalisation, the number of training examples and properties of the group action. Our results rest on an observation of the structure of function spaces under averaging operators which, along with its consequences for feature averaging, may be of independent interest.


title: Incident-angle dependence of deformation characteristics of aluminum surface under low-energy xenon-ion impact

abstract: Ion thruster is a revolution technology with potential applications in space mission but the thrusters operation lifetime is limited by the sputtering from thruster components. In this work, molecular dynamic simulations are performed to explore the dependence of deformation characteristics of an aluminum surface on incident angle and kinetic energy under low-energy xenon-ion impact. The fraction of non-12-coordinated atoms is used to quantitatively characterize the microstructural evolution and defect density levels. It is found that defect density level has a linear relation with incident energy, and there exists a critical incident angle around 20 degrees, at which the aluminum surface has the maximum defect density level. In addition, a collision model is developed to theoretically reveal the physical mechanisms behind the dependence. Our findings may helpful in developing long endurance electric propulsion devices for practical applications.


title: Exploring Knowledge Distillation of a Deep Neural Network for Multi-Script identification

abstract: Multi-lingual script identification is a difficult task consisting of different language with complex backgrounds in scene text images. According to the current research scenario, deep neural networks are employed as teacher models to train a smaller student network by utilizing the teacher model's predictions. This process is known as dark knowledge transfer. It has been quite successful in many domains where the final result obtained is unachievable through directly training the student network with a simple architecture. In this paper, we explore dark knowledge transfer approach using long short-term memory(LSTM) and CNN based assistant model and various deep neural networks as the teacher model, with a simple CNN based student network, in this domain of multi-script identification from natural scene text images. We explore the performance of different teacher models and their ability to transfer knowledge to a student network. Although the small student network's limited size, our approach obtains satisfactory results on a well-known script identification dataset CVSI-2015.


title: Physical Reasoning Using Dynamics-Aware Models

abstract: A common approach to solving physical reasoning tasks is to train a value learner on example tasks. A limitation of such an approach is that it requires learning about object dynamics solely from reward values assigned to the final state of a rollout of the environment. This study aims to address this limitation by augmenting the reward value with self-supervised signals about object dynamics. Specifically, we train the model to characterize the similarity of two environment rollouts, jointly with predicting the outcome of the reasoning task. This similarity can be defined as a distance measure between the trajectory of objects in the two rollouts, or learned directly from pixels using a contrastive formulation. Empirically, we find that this approach leads to substantial performance improvements on the PHYRE benchmark for physical reasoning (Bakhtin et al., 2019), establishing a new state-of-the-art.


title: Measurement of proton electromagnetic form factors in the time-like region using initial state radiation at BESIII

abstract: The electromagnetic process $e^{+}e^{-}\to p\bar{p}$ is studied with the initial-state-radiation technique using 7.5 fb$^{-1}$ of data collected by the BESIII experiment at seven energy points from 3.773 to 4.600 GeV. The Born cross section and the effective form factor of the proton are measured from the production threshold to 3.0 GeV/$c^{2}$ using the $p\bar{p}$ invariant-mass spectrum. The ratio of electric and magnetic form factors of the proton is determined from the analysis of the proton-helicity angular distribution.


title: SSFG: Stochastically Scaling Features and Gradients for Regularizing Graph Convolutional Networks

abstract: Graph convolutional networks have been successfully applied in various graph-based tasks. In a typical graph convolutional layer, node features are updated by aggregating neighborhood information. Repeatedly applying graph convolutions can cause the oversmoothing issue, i.e., node features at deep layers converge to similar values. Previous studies have suggested that oversmoothing is one of the major issues that restrict the performance of graph convolutional networks. In this paper, we propose a stochastic regularization method to tackle the oversmoothing problem. In the proposed method, we stochastically scale features and gradients (SSFG) by a factor sampled from a probability distribution in the training procedure. By explicitly applying a scaling factor to break feature convergence, the oversmoothing issue is alleviated. We show that applying stochastic scaling at the gradient level is complementary to that applied at the feature level to improve the overall performance. Our method does not increase the number of trainable parameters. When used together with ReLU, our SSFG can be seen as a stochastic ReLU activation function. We experimentally validate our SSFG regularization method on three commonly used types of graph networks. Extensive experimental results on seven benchmark datasets for four graph-based tasks demonstrate that our SSFG regularization is effective in improving the overall performance of the baseline graph networks.


title: The Hilbert cube contains a minimal subshift of full mean dimension

abstract: We construct a minimal dynamical system of mean dimension equal to $1$, which can be embedded in the shift action on the Hilbert cube $[0,1]^\mathbb{Z}$. This clarifies a seemingly plausible impression about embedding possibility in relation to mean dimension. Our result finally leads to a full understanding of a pair of exact ranges of all the possible values of mean dimension, within which there will always be a minimal dynamical system that can/cannot be embedded in the shift action on the Hilbert cube.


title: A Python Framework for Fast Modelling and Simulation of Cellular Nonlinear Networks and other Finite-difference Time-domain Systems

abstract: This paper introduces and evaluates a freely available cellular nonlinear network simulator optimized for the effective use of GPUs, to achieve fast modelling and simulations. Its relevance is demonstrated for several applications in nonlinear complex dynamical systems, such as slow-growth phenomena as well as for various image processing applications such as edge detection. The simulator is designed as a Jupyter notebook written in Python and functionally tested and optimized to run on the freely available cloud platform Google Collaboratory. Although the simulator, in its actual form, is designed to model the FitzHugh Nagumo Reaction-Diffusion cellular nonlinear network, it can be easily adapted for any other type of finite-difference time-domain model. Four implementation versions are considered, namely using the PyCUDA, NUMBA respectively CUPY libraries (all three supporting GPU computations) as well as a NUMPY-based implementation to be used when GPU is not available. The specificities and performances for each of the four implementations are analyzed concluding that the PyCUDA implementation ensures a very good performance being capable to run up to 14000 Mega cells per seconds (each cell referring to the basic nonlinear dynamic system composing the cellular nonlinear network).


title: Simulating complex networks in phase space: Gaussian boson sampling

abstract: We show how phase-space simulations of Gaussian quantum states in a photonic network permit verification of measurable correlations of Gaussian boson sampling (GBS) quantum computers. Our results agree with experiments for up to 100-th order correlations, provided decoherence is included. We extend this to more than 16,000 modes, and describe how to simulate genuine multipartite entanglement.


title: On a notion of independence proposed by Teddy Seidenfeld

abstract: Teddy Seidenfeld has been arguing for quite a long time that binary preference models are not powerful enough to deal with a number of crucial aspects of imprecision and indeterminacy in uncertain inference and decision making. It is at his insistence that we initiated our study of so-called sets of desirable option sets, which we have argued elsewhere provides an elegant and powerful approach to dealing with general, binary as well as non-binary, decision-making under uncertainty. We use this approach here to explore an interesting notion of irrelevance (and independence), first suggested by Seidenfeld in an example intended as a criticism of a number of specific decision methodologies based on (convex) binary preferences. We show that the consequences of making such an irrelevance or independence assessment are very strong, and might be used to argue for the use of so-called mixing choice functions, and E-admissibility as the resulting decision scheme.


title: Measuring the Transferability of $\ell_\infty$ Attacks by the $\ell_2$ Norm

abstract: Deep neural networks could be fooled by adversarial examples with trivial differences to original samples. To keep the difference imperceptible in human eyes, researchers bound the adversarial perturbations by the $\ell_\infty$ norm, which is now commonly served as the standard to align the strength of different attacks for a fair comparison. However, we propose that using the $\ell_\infty$ norm alone is not sufficient in measuring the attack strength, because even with a fixed $\ell_\infty$ distance, the $\ell_2$ distance also greatly affects the attack transferability between models. Through the discovery, we reach more in-depth understandings towards the attack mechanism, i.e., several existing methods attack black-box models better partly because they craft perturbations with 70% to 130% larger $\ell_2$ distances. Since larger perturbations naturally lead to better transferability, we thereby advocate that the strength of attacks should be simultaneously measured by both the $\ell_\infty$ and $\ell_2$ norm. Our proposal is firmly supported by extensive experiments on ImageNet dataset from 7 attacks, 4 white-box models, and 9 black-box models.


title: Inverse Design of Quantum Holograms in Three-Dimensional Nonlinear Photonic Crystals

abstract: We introduce a systematic approach for designing 3D nonlinear photonic crystals and pump beams for generating desired quantum correlations between structured photon-pairs. Our model is fully differentiable, allowing accurate and efficient learning and discovery of novel designs.


title: Model architectures to extrapolate emotional expressions in DNN-based text-to-speech

abstract: This paper proposes architectures that facilitate the extrapolation of emotional expressions in deep neural network (DNN)-based text-to-speech (TTS). In this study, the meaning of "extrapolate emotional expressions" is to borrow emotional expressions from others, and the collection of emotional speech uttered by target speakers is unnecessary. Although a DNN has potential power to construct DNN-based TTS with emotional expressions and some DNN-based TTS systems have demonstrated satisfactory performances in the expression of the diversity of human speech, it is necessary and troublesome to collect emotional speech uttered by target speakers. To solve this issue, we propose architectures to separately train the speaker feature and the emotional feature and to synthesize speech with any combined quality of speakers and emotions. The architectures are parallel model (PM), serial model (SM), auxiliary input model (AIM), and hybrid models (PM&AIM and SM&AIM). These models are trained through emotional speech uttered by few speakers and neutral speech uttered by many speakers. Objective evaluations demonstrate that the performances in the open-emotion test provide insufficient information. They make a comparison with those in the closed-emotion test, but each speaker has their own manner of expressing emotion. However, subjective evaluation results indicate that the proposed models could convey emotional information to some extent. Notably, the PM can correctly convey sad and joyful emotions at a rate of >60%.


title: Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance

abstract: Recent studies have provided both empirical and theoretical evidence illustrating that heavy tails can emerge in stochastic gradient descent (SGD) in various scenarios. Such heavy tails potentially result in iterates with diverging variance, which hinders the use of conventional convergence analysis techniques that rely on the existence of the second-order moments. In this paper, we provide convergence guarantees for SGD under a state-dependent and heavy-tailed noise with a potentially infinite variance, for a class of strongly convex objectives. In the case where the $p$-th moment of the noise exists for some $p\in [1,2)$, we first identify a condition on the Hessian, coined '$p$-positive (semi-)definiteness', that leads to an interesting interpolation between positive semi-definite matrices ($p=2$) and diagonally dominant matrices with non-negative diagonal entries ($p=1$). Under this condition, we then provide a convergence rate for the distance to the global optimum in $L^p$. Furthermore, we provide a generalized central limit theorem, which shows that the properly scaled Polyak-Ruppert averaging converges weakly to a multivariate $\alpha$-stable random vector. Our results indicate that even under heavy-tailed noise with infinite variance, SGD can converge to the global optimum without necessitating any modification neither to the loss function or to the algorithm itself, as typically required in robust statistics. We demonstrate the implications of our results to applications such as linear regression and generalized linear models subject to heavy-tailed data.


title: Mechanism Design Powered by Social Interactions

abstract: Mechanism design has traditionally assumed that the set of participants are fixed and known to the mechanism (the market owner) in advance. However, in practice, the market owner can only directly reach a small number of participants (her neighbours). Hence the owner often needs costly promotions to recruit more participants in order to get desirable outcomes such as social welfare or revenue maximization. In this paper, we propose to incentivize existing participants to invite their neighbours to attract more participants. However, they would not invite each other if they are competitors. We discuss how to utilize the conflict of interest between the participants to incentivize them to invite each other to form larger markets. We will highlight the early solutions and open the floor for discussing the fundamental open questions in the settings of auctions, coalitional games, matching and voting.


title: Safe and Uncertainty-Aware Robotic Motion Planning Techniques for Agile On-Orbit Assembly

abstract: As access to space and robotic autonomy capabilities move forward, there is simultaneously a growing interest in deploying large, complex space structures to provide new on-orbit capabilities. New space-borne observatories, large orbital outposts, and even futuristic on-orbit manufacturing will be enabled by robotic assembly of space structures using techniques like on-orbit additive manufacturing which can provide flexibility in constructing and even repairing complex hardware. However, the dynamics underlying the robotic assembler during manipulation may operate under inertial uncertainties. Thus, inertial estimation of the robot and the manipulated component system must be considered during structural assembly. The contribution of this work is to address both the motion planning and control for robotic assembly with consideration of the inertial estimation of the combined free-flying robotic assembler and additively manufactured component system. Specifically, the Linear Quadratic Regulator Rapidly-Exploring Randomized Trees (LQR-RRT*) and dynamically feasible path smoothing are used to obtain obstacle-free trajectories for the system. Further, model learning is incorporated explicitly into the planning stages via approximation of the continuous system and accompanying reward of performing safe, objective-oriented motion. Remaining uncertainty can then be dealt with using robust tube model predictive control. By obtaining controlled trajectories that consider both obstacle avoidance and learning of the inertial properties of the free-flyer and manipulated component system, the free-flyer rapidly considers and plans the construction of space structures with enhanced system knowledge. The approach naturally generalizes to repairing, refueling, and re-provisioning space structure components while providing optimal collision-free trajectories under e.g., inertial uncertainty.


title: Everything is Relative: Understanding Fairness with Optimal Transport

abstract: To study discrimination in automated decision-making systems, scholars have proposed several definitions of fairness, each expressing a different fair ideal. These definitions require practitioners to make complex decisions regarding which notion to employ and are often difficult to use in practice since they make a binary judgement a system is fair or unfair instead of explaining the structure of the detected unfairness. We present an optimal transport-based approach to fairness that offers an interpretable and quantifiable exploration of bias and its structure by comparing a pair of outcomes to one another. In this work, we use the optimal transport map to examine individual, subgroup, and group fairness. Our framework is able to recover well known examples of algorithmic discrimination, detect unfairness when other metrics fail, and explore recourse opportunities.


title: Nonclassical Light from Exciton Interactions in a Two-Dimensional Quantum Mirror

abstract: Excitons in a semiconductor monolayer form a collective resonance that can reflect resonant light with extraordinarily high efficiency. Here, we investigate the nonlinear optical properties of such atomistically thin mirrors and show that finite-range interactions between excitons can lead to the generation of highly non-classical light. We describe two scenarios, in which optical nonlinearities arise either from direct photon coupling to excitons in excited Rydberg states or from resonant two-photon excitation of Rydberg excitons with finite-range interactions. The latter case yields conditions of electromagnetically induced transparency and thereby provides an efficient mechanism for single-photon switching between high transmission and reflectance of the monolayer, with a tunable dynamical timescale of the emerging photon-photon interactions. Remarkably, it turns out that the resulting high degree of photon correlations remains virtually unaffected by Rydberg-state decoherence, in excess of non-radiative decoherence observed for ground-state excitons in two-dimensional semiconductors. This robustness to imperfections suggests a promising new approach to quantum photonics at the level of individual photons.


title: Nonlinear dimension reduction for surrogate modeling using gradient information

abstract: We introduce a method for the nonlinear dimension reduction of a high-dimensional function $u:\mathbb{R}^d\rightarrow\mathbb{R}$, $d\gg1$. Our objective is to identify a nonlinear feature map $g:\mathbb{R}^d\rightarrow\mathbb{R}^m$, with a prescribed intermediate dimension $m\ll d$, so that $u$ can be well approximated by $f\circ g$ for some profile function $f:\mathbb{R}^m\rightarrow\mathbb{R}$. We propose to build the feature map by aligning the Jacobian $\nabla g$ with the gradient $\nabla u$, and we theoretically analyze the properties of the resulting $g$. Once $g$ is built, we construct $f$ by solving a gradient-enhanced least squares problem. Our practical algorithm makes use of a sample $\{x^{(i)},u(x^{(i)}),\nabla u(x^{(i)})\}_{i=1}^N$ and builds both $g$ and $f$ on adaptive downward-closed polynomial spaces, using cross validation to avoid overfitting. We numerically evaluate the performance of our algorithm across different benchmarks, and explore the impact of the intermediate dimension $m$. We show that building a nonlinear feature map $g$ can permit more accurate approximation of $u$ than a linear $g$, for the same input data set.


title: Localization Game for Random Geometric Graphs

abstract: The localization game is a two player combinatorial game played on a graph $G=(V,E)$. The cops choose a set of vertices $S_1 \subseteq V$ with $|S_1|=k$. The robber then chooses a vertex $v \in V$ whose location is hidden from the cops, but the cops learn the graph distance between the current position of the robber and the vertices in $S_1$. If this information is sufficient to locate the robber, the cops win immediately; otherwise the cops choose another set of vertices $S_2 \subseteq V$ with $|S_2|=k$, and the robber may move to a neighbouring vertex. The new distances are presented to the robber, and if the cops can deduce the new location of the robber based on all information they accumulated thus far, then they win; otherwise, a new round begins. If the robber has a strategy to avoid being captured, then she wins. The localization number is defined to be the smallest integer $k$ so that the cops win the game. In this paper we determine the localization number (up to poly-logarithmic factors) of the random geometric graph $G \in \mathcal G(n,r)$ slightly above the connectivity threshold.


title: Dynamic Clock Reconfiguration for the Constrained IoT and its Application to Energy-efficient Networking

abstract: Clock configuration takes a key role in tuning constrained general-purpose microcontrollers for performance, timing accuracy, and energy efficiency. Configuring the underlying clock tree, however, involves a large parameter space with complex dependencies and dynamic constraints. We argue for clock configuration as a generic operating system module that bridges the gap between highly configurable but complex embedded hardware and easy application development. In this paper, we propose a method and a runtime subsystem for dynamic clock reconfiguration on constrained Internet of Things (IoT) devices named ScaleClock. ScaleClock derives measures to dynamically optimize clock configurations by abstracting the hardware-specific clock trees. The ScaleClock system service grants portable access to the optimization potential of dynamic clock scaling for applications. We implement the approach on the popular IoT operating system RIOT for two target platforms of different manufacturers and evaluate its performance in static and dynamic scenarios on real devices. We demonstrate the potential of ScaleClock by designing a platform-independent dynamic voltage and frequency scaling (DVFS) mechanism that enables RIOT to autonomously adapt the hardware performance to requirements of the software currently executed. In a use case study, we manage to boost energy efficiency of constrained network communication by reducing the MCU consumption by 40 % at negligible performance impact.


title: New binary self-dual codes of lengths 56, 58, 64, 80 and 92 from a modification of the four circulant construction

abstract: In this work, we give a new technique for constructing self-dual codes over commutative Frobenius rings using $\lambda$-circulant matrices. The new construction was derived as a modification of the well-known four circulant construction of self-dual codes. Applying this technique together with the building-up construction, we construct singly-even binary self-dual codes of lengths 56, 58, 64, 80 and 92 that were not known in the literature before. Singly-even self-dual codes of length 80 with $\beta\in\{2,4,5,6,8\}$ in their weight enumerators are constructed for the first time in the literature.


title: Interference of Quantum Trajectories

abstract: We extend quantum trajectory theory to encompass the evolution of a large class of open quantum systems interacting with an environment at {arbitrary coupling strength}. Specifically, we prove that general time-local quantum master equations admit an unraveling described by ordinary jump-stochastic differential equations. The sufficient condition is to weigh the state vector Monte Carlo averages by a probability pseudo-measure which we call the "influence martingale". The influence martingale satisfies a $ 1d $ stochastic differential equation enslaved to the ones governing the quantum trajectories. Our interpretation is that the influence martingale models interference effects between distinct realizations of quantum trajectories at strong system-environment coupling. Our result proves the existence of a Markovian quantum trajectory picture in the Hilbert space of the system for completely bounded divisible dynamical maps. Furthermore, our result provides a new avenue to numerically integrate systems with large numbers of degrees of freedom by naturally extending the existing theory.


title: On in-plane drill rotations for Cosserat surfaces

abstract: We show under some natural smoothness assumptions that pure in-plane drill rotations as deformation mappings of a $C^2$-smooth regular shell surface to another one parametrized over the same domain are impossible provided that the rotations are fixed at a portion of the boundary. Put otherwise, if the tangent vectors of the new surface are obtained locally by only rotating the given tangent vectors, and if these rotations have a rotation axis which coincides everywhere with the normal of the initial surface, then the two surfaces are equal provided they coincide at a portion of the boundary. In the language of differential geometry of surfaces we show that any isometry which leaves normals invariant and which coincides with the given surface at a portion of the boundary, is the identity mapping.


title: How To Train Your HERON

abstract: In this paper we apply Deep Reinforcement Learning (Deep RL) and Domain Randomization to solve a navigation task in a natural environment relying solely on a 2D laser scanner. We train a model-based RL agent in simulation to follow lake and river shores and apply it on a real Unmanned Surface Vehicle in a zero-shot setup. We demonstrate that even though the agent has not been trained in the real world, it can fulfill its task successfully and adapt to changes in the robot's environment and dynamics. Finally, we show that the RL agent is more robust, faster, and more accurate than a state-aware Model-Predictive-Controller.


title: Mean dimension of product spaces: a fundamental formula

abstract: Mean dimension is a topological invariant of dynamical systems, which originates with Mikhail Gromov in 1999 and which was studied with deep applications around 2000 by Elon Lindenstrauss and Benjamin Weiss within the framework of amenable group actions. Let a countable discrete amenable group $G$ act continuously on compact metrizable spaces $X$ and $Y$. Consider the product action of $G$ on the product space $X\times Y$. The product inequality for mean dimension is well known: $\mathrm{mdim}(X\times Y,G)\le\mathrm{mdim}(X,G)+\mathrm{mdim}(Y,G)$, while it was unknown for a long time if the product inequality could be an equality. In 2019, Masaki Tsukamoto constructed the first example of two different continuous actions of $G$ on compact metrizable spaces $X$ and $Y$, respectively, such that the product inequality becomes strict. However, there is still one longstanding problem which remains open in this direction, asking if there exists a continuous action of $G$ on some compact metrizable space $X$ such that $\mathrm{mdim}(X\times X,G)<2\cdot\mathrm{mdim}(X,G)$. We solve this problem. Somewhat surprisingly, we prove, in contrast to (topological) dimension theory, a rather satisfactory theorem: If an infinite (countable discrete) amenable group $G$ acts continuously on a compact metrizable space $X$, then we have $\mathrm{mdim}(X^n,G)=n\cdot\mathrm{mdim}(X,G)$, for any positive integer $n$. Our product formula for mean dimension, together with the example and inequality (stated previously), eventually allows mean dimension of product actions to be fully understood.


title: Regression Filtration with Resetting to Provide Exponential Convergence of MRAC for Plants with Jump Change of Unknown Parameters

abstract: This paper proposes a new method to provide the exponential convergence of both the parameter and tracking errors of the composite adaptive control system without the persistent excitation (PE) requirement. Instead, the derived composite adaptive law ensures the above-mentioned properties under the strictly weaker finite excitation (FE) condition. Unlike known solutions, in addition to the PE requirement relaxation, it provides better transient response under jump change of the plant uncertainty parameters. To derive such an adaptive law, a novel scheme of uncertainty filtration with resetting is proposed, which provides the required properties of the control system. A rigorous proof of all mentioned properties of the developed adaptive law is presented. Such law is compared with the known composite ones, which also relax the PE requirement, using the wing-rock problem to conduct numerical experiments. The obtained results fully support the theoretical analysis and demonstrate the advantages of the proposed method.


title: Gelfand problem and Hemisphere rigidity

abstract: We give an interpretation of the hemisphere rigidity theorem of Hang-Wang in the framework of Gelfand problem. More precisely, Hang-Wang showed that for a metric $g$ conformal to the standard metric $g_0$ on $S^{n}_{+}$ with $R\geq n(n-1)$ and whose boundary coincides with $g_0|_{\partial S^{n}_{+}}$, then $g=g_0$. This is related to the classical Gelfand problem, which investigates $-\Delta u=\lambda g(u)$ for certain nonlinearity $g$ in a bounded region $\Omega \subset \mathbb{R}^n$ subject to the Dirichlet boundary condition. It is well-known that there exists an extremal $\lambda^{*}$, such that for $\lambda>\lambda^{*}$, the above equation does not admit any solution. Interestingly, Hang-Wang's hemisphere rigidity theorem yields a precise value for $\lambda^{*}$ for $g(u)=e^{2u}$ when $n=2$ and $g(u)=(1+u)^{\frac{n+2}{n-2}}$ for $n\geq 3$. We attempt to generalize the hemisphere rigidity theorem under $Q$ curvature lower bound and fit this into the interpretation of fourth order Gelfand problem for bi-Laplacian with conformal nonlinearity.


title: Topological Classical Systems with Generalized Chiral Symmetry

abstract: The bulk band topology of symmetry invariant adiabatic systems in the thermodynamic limit are considered to be determined by the hopping energy. In this work, we present that in closed classical systems, due to generalized chiral symmetry broken, the on-site energy cannot always be regarded as identical and can crucially impact the topological properties of the systems. Based on a finite one-dimensional chain, we demonstrate that the non-equivalent on-site energy of bulk lattices affects the topological phases of the bands, and the on-site energy of end lattices affects the existence of the topological states. Along these lines, the correspondence with generalized chiral symmetry in acoustic system is rigorously proposed. Our work provides a new degree of freedom for topological classical systems, and can be generalized to higher-dimensions and non-Hermitian conditions.


title: Factored Policy Gradients: Leveraging Structure for Efficient Learning in MOMDPs

abstract: Policy gradient methods can solve complex tasks but often fail when the dimensionality of the action-space or objective multiplicity grow very large. This occurs, in part, because the variance on score-based gradient estimators scales quadratically. In this paper, we address this problem through a factor baseline which exploits independence structure encoded in a novel action-target influence network. Factored policy gradients (FPGs), which follow, provide a common framework for analysing key state-of-the-art algorithms, are shown to generalise traditional policy gradients, and yield a principled way of incorporating prior knowledge of a problem domain's generative processes. We provide an analysis of the proposed estimator and identify the conditions under which variance is reduced. The algorithmic aspects of FPGs are discussed, including optimal policy factorisation, as characterised by minimum biclique coverings, and the implications for the bias-variance trade-off of incorrectly specifying the network. Finally, we demonstrate the performance advantages of our algorithm on large-scale bandit and traffic intersection problems, providing a novel contribution to the latter in the form of a spatial approximation.


title: High resolution imaging with anomalous saturated excitation

abstract: The nonlinear fluorescence emission has been widely applied for the high spatial resolution optical imaging. Here, we studied the fluorescence anomalous saturating effect of the nitrogen vacancy defect in diamond. The fluorescence reduction was observed with high power laser excitation. It increased the nonlinearity of the fluorescence emission, and changed the spatial frequency distribution of the fluorescence image. We used a differential excitation protocol to extract the high spatial frequency information. By modulating the excitation laser's power, the spatial resolution of imaging was improved approximate 1.6 times in comparison with the confocal microscopy. Due to the simplicity of the experimental setup and data processing, we expect this method can be used for improving the spatial resolution of sensing and biological labeling with the defects in solids.


title: Infinitely many roots of unity are zeros of some Jones polynomials

abstract: Let $N=2n^2-1$ or $N=n^2+n-1$, for any $n\ge 2$. Let $M=\frac{N-1}{2}$. We construct families of prime knots with Jones polynomials $(-1)^M\sum_{k=-M}^{M} (-1)^kt^k$. Such polynomials have Mahler measure equal to $1$. If $N$ is prime, these are cyclotomic polynomials $\Phi_{2N}(t)$, up to some shift in the powers of $t$. Otherwise, they are products of such polynomials, including $\Phi_{2N}(t)$. In particular, all roots of unity $\zeta_{2N}$ occur as roots of Jones polynomials. We also show that some roots of unity cannot be zeros of Jones polynomials.


title: Analyzing Overfitting under Class Imbalance in Neural Networks for Image Segmentation

abstract: Class imbalance poses a challenge for developing unbiased, accurate predictive models. In particular, in image segmentation neural networks may overfit to the foreground samples from small structures, which are often heavily under-represented in the training set, leading to poor generalization. In this study, we provide new insights on the problem of overfitting under class imbalance by inspecting the network behavior. We find empirically that when training with limited data and strong class imbalance, at test time the distribution of logit activations may shift across the decision boundary, while samples of the well-represented class seem unaffected. This bias leads to a systematic under-segmentation of small structures. This phenomenon is consistently observed for different databases, tasks and network architectures. To tackle this problem, we introduce new asymmetric variants of popular loss functions and regularization techniques including a large margin loss, focal loss, adversarial training, mixup and data augmentation, which are explicitly designed to counter logit shift of the under-represented classes. Extensive experiments are conducted on several challenging segmentation tasks. Our results demonstrate that the proposed modifications to the objective function can lead to significantly improved segmentation accuracy compared to baselines and alternative approaches.


title: Deep Learning-based Power Control for Cell-Free Massive MIMO Networks

abstract: A deep learning (DL)-based power control algorithm that solves the max-min user fairness problem in a cell-free massive multiple-input multiple-output (MIMO) system is proposed. Max-min rate optimization problem in a cell-free massive MIMO uplink setup is formulated, where user power allocations are optimized in order to maximize the minimum user rate. Instead of modeling the problem using mathematical optimization theory, and solving it with iterative algorithms, our proposed solution approach is using DL. Specifically, we model a deep neural network (DNN) and train it in an unsupervised manner to learn the optimum user power allocations which maximize the minimum user rate. This novel unsupervised learning-based approach does not require optimal power allocations to be known during model training as in previously used supervised learning techniques, hence it has a simpler and flexible model training stage. Numerical results show that the proposed DNN achieves a performance-complexity trade-off with around 400 times faster implementation and comparable performance to the optimization-based algorithm. An online learning stage is also introduced, which results in near-optimal performance with 4-6 times faster processing.


title: A Combinatorial Approach to Root Multiplicities of a Special Type Rank 3 Kac-Moody Algebras

abstract: In this paper, we calculate the dimension of root spaces $\mathfrak{g}_{\lambda}$ of a special type rank $3$ Kac-Moody algebras $\mathfrak{g}$. We first introduce a special type of elements in $\mathfrak{g}$, which we call elements in standard form. Then, we prove that any root space is spanned by these elements. By calculating the number of linearly independent elements in standard form, we obtain a formula for the dimension of root spaces $\mathfrak{g}_{\lambda}$, which depends on the root $\lambda$.


title: Logics of Dependence and Independence: The Local Variants

abstract: Modern logics of dependence and independence are based on team semantics, which means that formulae are evaluated not on a single assignment of values to variables, but on a set of such assignments, called a team. This leads to high expressive power, on the level of existential second-order logic. As an alternative, Baltag and van Benthem have proposed a local variant of dependence logic, called logic of functional dependence (LFD). While its semantics is also based on a team, the formulae are evaluated locally on just one of its assignments, and the team just serves as the supply of the possible assignments that are taken into account in the evaluation process. This logic thus relies on the modal perspective of generalized assignments semantics, and can be seen as a fragment of first-order logic. For the variant of LFD without equality, the satisfiability problem is decidable. We extend the idea of localising logics of dependence and independence in a systematic way, taking into account local variants of standard atomic dependency properties: besides dependence and independence, also inclusion, exclusion, and anonymity. We study model-theoretic and algorithmic questions of the localised logics, and also resolve some of the questions that had been left open by Baltag and van Benthem. In particular, we study decidability issues of the local logics, and prove that satisfiability of LFD with equality is undecidable. Further, we establish characterisation theorems via appropriate notions of bisimulation and study the complexity of model checking problems for these logics.


title: WaNet -- Imperceptible Warping-based Backdoor Attack

abstract: With the thriving of deep learning and the widespread practice of using pre-trained networks, backdoor attacks have become an increasing security threat drawing many research interests in recent years. A third-party model can be poisoned in training to work well in normal conditions but behave maliciously when a trigger pattern appears. However, the existing backdoor attacks are all built on noise perturbation triggers, making them noticeable to humans. In this paper, we instead propose using warping-based triggers. The proposed backdoor outperforms the previous methods in a human inspection test by a wide margin, proving its stealthiness. To make such models undetectable by machine defenders, we propose a novel training mode, called the ``noise mode. The trained networks successfully attack and bypass the state-of-the-art defense methods on standard classification datasets, including MNIST, CIFAR-10, GTSRB, and CelebA. Behavior analyses show that our backdoors are transparent to network inspection, further proving this novel attack mechanism's efficiency.


title: EMDS-5: Environmental Microorganism Image Dataset Fifth Version for Multiple Image Analysis Tasks

abstract: Environmental Microorganism Data Set Fifth Version (EMDS-5) is a microscopic image dataset including original Environmental Microorganism (EM) images and two sets of Ground Truth (GT) images. The GT image sets include a single-object GT image set and a multi-object GT image set. The EMDS-5 dataset has 21 types of EMs, each of which contains 20 original EM images, 20 single-object GT images and 20 multi-object GT images. EMDS-5 can realize to evaluate image preprocessing, image segmentation, feature extraction, image classification and image retrieval functions. In order to prove the effectiveness of EMDS-5, for each function, we select the most representative algorithms and price indicators for testing and evaluation. The image preprocessing functions contain two parts: image denoising and image edge detection. Image denoising uses nine kinds of filters to denoise 13 kinds of noises, respectively. In the aspect of edge detection, six edge detection operators are used to detect the edges of the images, and two evaluation indicators, peak-signal to noise ratio and mean structural similarity, are used for evaluation. Image segmentation includes single-object image segmentation and multi-object image segmentation. Six methods are used for single-object image segmentation, while k-means and U-net are used for multi-object segmentation.We extract nine features from the images in EMDS-5 and use the Support Vector Machine classifier for testing. In terms of image classification, we select the VGG16 feature to test different classifiers. We test two types of retrieval approaches: texture feature retrieval and deep learning feature retrieval. We select the last layer of features of these two deep learning networks as feature vectors. We use mean average precision as the evaluation index for retrieval.


title: Denoising Higher-order Moments for Blind Digital Modulation Identification in Multiple-antenna Systems

abstract: The paper proposes a new technique that substantially improves blind digital modulation identification (DMI) algorithms that are based on higher-order statistics (HOS). The proposed technique takes advantage of noise power estimation to make an offset on higher-order moments (HOM), thus getting an estimate of noise-free HOM. When tested for multiple-antenna systems, the proposed method outperforms other DMI algorithms, in terms of identification accuracy, that are based only on cumulants or do not consider HOM denoising, even for a receiver with impairments. The improvement is achieved with the same order of complexity of the common HOS-based DMI algorithms in the same context.


title: Trapping of a run-and-tumble particle in an inhomogeneous domain: the weak noise limit

abstract: A one-dimensional run-and-tumble particle (RTP) switches randomly between a left and right moving state of constant speed $v$. This type of motion arises in a wide range of applications in cell biology, including the unbiased growth and shrinkage of microtubules or cytonemes, the bidirectional motion of molecular motors, and the "run-and-tumble" motion of bacteria such as {\em E. coli}. RTPs are also of more general interest within the non-equilibrium statistical physics community, both at the single particle level and at the interacting population level, where it provides a simple example of active matter. In this paper we use asymptotic methods to calculate the mean first passage time (MFPT) for a one-dimensional RTP to escape an effective trapping potential generated by space-dependent switching rates. Such methods are part of a more general framework for studying metastability in so-called piecewise deterministic Markov processes (PDMPs), which include the RTP as a special case.


title: Calmness of partial perturbation to composite rank constraint systems and its applications

abstract: This paper is concerned with the calmness of a partial perturbation to the composite rank constraint system, an intersection of the rank constraint set and a general closed set, which is shown to be equivalent to a local Lipschitz-type error bound and also a global Lipschitz-type error bound under a certain compactness. Based on its lifted formulation, we derive two criteria for identifying those closed sets such that the associated partial perturbation possesses the calmness, and provide a collection of examples to demonstrate that the criteria are satisfied by common nonnegative and positive semidefinite rank constraint sets. Then, we use the calmness of this perturbation to obtain several global exact penalties for rank constrained optimization problems, and a family of equivalent DC surrogates for rank regularized problems.


title: Reflectionless propagation of Manakov solitons on a line:A model based on the concept of transparent boundary conditions

abstract: We consider the problem of absence of backscattering in the transport of Manakov solitons on a line. The concept of transparent boundary conditions is used for modeling the reflectionless propagation of Manakov vector solitons in a one-dimensional domain. Artificial boundary conditions that ensure the absence of backscattering are derived and their numerical implementation is demonstrated.


title: Hybrid-driven Trajectory Prediction Based on Group Emotion

abstract: We present a hybrid-driven trajectory prediction method based on group emotion. The data driven and model driven methods are combined to make a compromise between the controllability, generality, and efficiency of the method on the basis of simulating more real crowd movements. A hybrid driven method is proposed to improve the reliability of the calculation results based on real crowd data, and ensure the controllability of the model. It reduces the dependence of our model on real data and realizes the complementary advantages of these two kinds of methods. In addition, we divide crowd into groups based on human relations in society. So our method can calculate the movements in different scales. We predict individual movement trajectories according to the trajectories of group and fully consider the influence of the group movement state on the individual movements. Besides we also propose a group emotion calculation method and our method also considers the effect of group emotion on crowd movements.


title: The Use of Voice Source Features for Sung Speech Recognition

abstract: In this paper, we ask whether vocal source features (pitch, shimmer, jitter, etc) can improve the performance of automatic sung speech recognition, arguing that conclusions previously drawn from spoken speech studies may not be valid in the sung speech domain. We first use a parallel singing/speaking corpus (NUS-48E) to illustrate differences in sung vs spoken voicing characteristics including pitch range, syllables duration, vibrato, jitter and shimmer. We then use this analysis to inform speech recognition experiments on the sung speech DSing corpus, using a state of the art acoustic model and augmenting conventional features with various voice source parameters. Experiments are run with three standard (increasingly large) training sets, DSing1 (15.1 hours), DSing3 (44.7 hours) and DSing30 (149.1 hours). Pitch combined with degree of voicing produces a significant decrease in WER from 38.1% to 36.7% when training with DSing1 however smaller decreases in WER observed when training with the larger more varied DSing3 and DSing30 sets were not seen to be statistically significant. Voicing quality characteristics did not improve recognition performance although analysis suggests that they do contribute to an improved discrimination between voiced/unvoiced phoneme pairs.


title: CellTrack R-CNN: A Novel End-To-End Deep Neural Network for Cell Segmentation and Tracking in Microscopy Images

abstract: Cell segmentation and tracking in microscopy images are of great significance to new discoveries in biology and medicine. In this study, we propose a novel approach to combine cell segmentation and cell tracking into a unified end-to-end deep learning based framework, where cell detection and segmentation are performed with a current instance segmentation pipeline and cell tracking is implemented by integrating Siamese Network with the pipeline. Besides, tracking performance is improved by incorporating spatial information into the network and fusing spatial and visual prediction. Our approach was evaluated on the DeepCell benchmark dataset. Despite being simple and efficient, our method outperforms state-of-the-art algorithms in terms of both cell segmentation and cell tracking accuracies.


title: Self-Supervised Learning via multi-Transformation Classification for Action Recognition

abstract: Self-supervised tasks have been utilized to build useful representations that can be used in downstream tasks when the annotation is unavailable. In this paper, we introduce a self-supervised video representation learning method based on the multi-transformation classification to efficiently classify human actions. Self-supervised learning on various transformations not only provides richer contextual information but also enables the visual representation more robust to the transforms. The spatio-temporal representation of the video is learned in a self-supervised manner by classifying seven different transformations i.e. rotation, clip inversion, permutation, split, join transformation, color switch, frame replacement, noise addition. First, seven different video transformations are applied to video clips. Then the 3D convolutional neural networks are utilized to extract features for clips and these features are processed to classify the pseudo-labels. We use the learned models in pretext tasks as the pre-trained models and fine-tune them to recognize human actions in the downstream task. We have conducted the experiments on UCF101 and HMDB51 datasets together with C3D and 3D Resnet-18 as backbone networks. The experimental results have shown that our proposed framework is outperformed other SOTA self-supervised action recognition approaches. The code will be made publicly available.


title: Elliptic problem driven by different types of nonlinearities

abstract: In this paper we establish the existence and multiplicity of nontrivial solutions to the following problem \begin{align*} \begin{split} (-\Delta)^{\frac{1}{2}}u+u+(\ln|\cdot|*|u|^2)&=f(u)+\mu|u|^{-\gamma-1}u,~\text{in}~\mathbb{R}, \end{split} \end{align*} where $\mu>0$, $(*)$ is the convolution operation between two functions, $0<\gamma<1$, $f$ is a function with a certain type of growth. We prove the existence of a nontrivial solution at a certain mountain pass level and another ground state solution when the nonlinearity $f$ is of exponential critical growth.


title: Elastic scattering of twisted neutrons by nuclei

abstract: We present a theoretical formalism for scattering of the twisted neutrons by nuclei in a kinematic regime where interference between Coulomb interaction and the strong interaction is essential. Twisted neutrons have definite quantized values of an angular momentum projection along the direction of propagation, and we show that it results in novel observable effects for the scattering cross section, spin asymmetries and polarization of the scattered neutrons. We demonstrate that additional capabilities provided by beam's orbital angular momentum enable new techniques for measuring both real and imaginary parts of the scattering amplitude. Several possible observables are considered, for which the targets may be either well-localized with respect to the spatial beam profile, or the scattering occurs incoherently on nuclei in a bulk target. The developed approach can be applied to other nuclear reactions with strongly interacting twisted particles.


title: Schauder type estimates for degenerate Kolmogorov equations with Dini continuous coefficients

abstract: We study the regularity properties of the second order linear operator in $\mathbb{R}^{N+1}$: \begin{equation*} \mathscr{L} u := \sum_{j,k= 1}^{m} a_{jk}\partial_{x_j x_k}^2 u + \sum_{j,k= 1}^{N} b_{jk}x_k \partial_{x_j} u - \partial_t u, \end{equation*} where $A = \left( a_{jk} \right)_{j,k= 1, \dots, m}, B= \left( b_{jk} \right)_{j,k= 1, \dots, N}$ are real valued matrices with constant coefficients, with $A$ symmetric and strictly positive. We prove that, if the operator $\mathscr{L}$ satisfies H\"ormander's hypoellipticity condition, and $f$ is a Dini continuous function, then the second order derivatives of the solution $u$ to the equation $\mathscr{L} u = f$ are Dini continuous functions as well. We also consider the case of Dini continuous coefficients $a_{jk}$'s. A key step in our proof is a Taylor formula for classical solutions to $\mathscr{L} u = f$ that we establish under minimal regularity assumptions on $u$.


title: Regulating Mobility-on-Demand Services: Tri-level Model and Bayesian Optimization Solution Approach

abstract: The goal of this paper is to develop a modeling framework that captures the inter-decision dynamics between mobility service providers (MSPs) and travelers that can be used to optimize and analyze policies/regulations related to MSPs. To meet this goal, the paper proposes a tri-level mathematical programming model with a public-sector decision maker (regulator) at the highest level, the MSP in the middle level, and travelers at the lowest level. The regulator aims to maximize social welfare via implementing regulations, policies, plans, transit service designs, etc. The MSP aims to maximize profit by adjusting its service designs. Travelers aim to maximize utility by changing their modes and routes. The travelers' decisions depend on the regulator and MSP's decisions while the MSP decisions themselves depend on the regulator's decisions. To solve the tri-level mathematical program, the study employs Bayesian optimization (BO) within a simulation-optimization solution approach. At the lowest level, the solution approach includes an agent-based transportation system simulation model to capture travelers' behavior subject to specific decisions made by the regulator and MSP. The agent-based transportation simulation model includes a mode choice model, a road network, a transit network, and an MSP providing automated mobility-on-demand (AMOD) service with shared rides. The modeling and solution approaches are applied to Munich, Germany in order to validate the model. The case study investigates the tolls and parking costs the city administration should set, as well as changes in the public transport budget and a limitation of the AMOD fleet size. Best policy settings are derived for two social welfare definitions, in both of which the AMOD fleet size is not regulated as the shared-ride AMOD service provides significant value to travelers in Munich.


title: Reconstruction along a geodesic from sphere data in Finsler geometry and anisotropic elasticity

abstract: Dix formulated the inverse problem of recovering an elastic body from the measurements of wave fronts of point scatterers. We geometrize this problem in the framework of linear elasticity, leading to the geometrical inverse problem of recovering a Finsler manifold from certain sphere data in a given open subset of the manifold. We solve this problem locally along any geodesic through the measurement set.


title: Effect of internal resonance on the dynamics of MoS2 resonator

abstract: Nonlinear modal interactions and associated internal resonance phenomena have recently been used to demonstrate improved oscillator performance and enhanced sensing capabilities. Here, we show tunable modal interaction in a MoS2 resonator. We achieve the tunability of coupling between these initially uncoupled modes by using electrostatic gate voltages. This tunable coupling enables us to make the modes commensurate and observe energy exchange between the modes. We attribute the strong energy exchange between the vibrational modes to 2:1 internal resonance. This interaction strongly affects the dynamics of the modal response of such resonators. We observe peak splitting, a signature of energy exchange between the modes even when the modal response is in the linear regime. We model our device to explain the observed effect of excitation, detuning of modal frequencies, and intermodal coupling strength on the resonator dynamics. MoS2 resonators explored in this work are ideal for understanding the rich dynamics offered through the intermodal coupling.


title: Cold atoms beyond atomic physics

abstract: In the last 25 years, much progress has been made producing and controlling Bose-Einstein condensates (BECs) and degenerate Fermi gases. The advances in trapping, cooling and tuning the interparticle interactions in these cold atom systems lead to an unprecedented amount of control that one can exert over them. This work aims to show that knowledge acquired studying cold atom systems can be applied to other fields that share similarities and analogies with them, provided that the differences are also known and taken into account. We focus on two specific fields, nuclear physics and statistical optics. The nuclear physics discussion occurs with the BCS-BEC crossover in mind, in which we compare cold Fermi gases with nuclear and neutron matter and nuclei. We connect BECs and atom lasers through both systems' matter-wave character for the analogy with statistical optics. Finally, we present some challenges that, if solved, would increase our understanding of cold atom systems and, thus, the related areas.


title: Accurate predictions of chaotic motion of a free fall disk

abstract: It is important to know the accurate trajectory of a free fall object in fluid (such as a spacecraft), whose motion might be chaotic in many cases. However, it is impossible to accurately predict its chaotic trajectory in a long enough duration by traditional numerical algorithms in double precision. In this paper, we give the accurate predictions of the same problem by a new strategy, namely the Clean Numerical Simulation (CNS). Without loss of generality, a free fall disk in water is considered, whose motion is governed by the Andersen-Pesavento-Wang model. We illustrate that convergent and reliable trajectories of a chaotic free fall disk in a long enough interval of time can be obtained by means of the CNS, but different traditional algorithms in double precision give disparate trajectories. Besides, unlike the traditional algorithms in double precision, the CNS can predict the accurate posture of the free fall disk near the vicinity of the bifurcation point of some physical parameters in a long duration. Therefore, the CNS can provide reliable prediction of chaotic systems in a long enough interval of time.


title: Towards Teachable Conversational Agents

abstract: The traditional process of building interactive machine learning systems can be viewed as a teacher-learner interaction scenario where the machine-learners are trained by one or more human-teachers. In this work, we explore the idea of using a conversational interface to investigate the interaction between human-teachers and interactive machine-learners. Specifically, we examine whether teachable AI agents can reliably learn from human-teachers through conversational interactions, and how this learning compare with traditional supervised learning algorithms. Results validate the concept of teachable conversational agents and highlight the factors relevant for the development of machine learning systems that intend to learn from conversational interactions.


title: Measuring the Stability of Learned Features

abstract: Many modern datasets don't fit neatly into $n \times p$ matrices, but most techniques for measuring statistical stability expect rectangular data. We study methods for stability assessment on non-rectangular data, using statistical learning algorithms to extract rectangular latent features. We design controlled simulations to characterize the power and practicality of competing approaches. This motivates new strategies for visualizing feature stability. Our stability curves supplement the direct analysis, providing information about the reliability of inferences based on learned features. Finally, we illustrate our approach using a spatial proteomics dataset, where machine learning tools can augment the scientist's workflow, but where guarantees of statistical reproducibility are still central. Our raw data, packaged code, and experimental outputs are publicly available.


title: On the Order Parameter of the Continuous Phase Transition in the Classical and Quantum Mechanical limits

abstract: The mean field theory is revisited in the classical and quantum mechanical limits. Taking into account the boundary conditions at the phase transition and the third law of the thermodynamics the physical properties of the ordered and disordered phases were reported. The equation for the order parameter predicts the occurrence of a saturation of $\Psi^2$ = 1 near $\Theta_S$, the temperature below the quantum mechanical ground state is reached. The theoretical predictions are also compared with high resolution thermal expansion data of SrTiO$_{\text{3}}$ monocrystalline samples and other some previous results. An excellent agreement has been found suggesting a universal behavior of the theoretical model to describe continuous structural phase transitions.


title: The Incubator Case Study for Digital Twin Engineering

abstract: To demystify the Digital Twin concept, we built a simple yet representative thermal incubator system. The incubator is an insulated box fitted with a heatbed, and complete with a software system for communication, a controller, and simulation models. We developed two simulation models to predict the temperature inside the incubator, one with two free parameters and one with four free parameters. Our experiments showed that the latter model was better at predicting the thermal inertia of the heatbed itself, which makes it more appropriate for further development of the digital twin. The hardware and software used in this case study are available open source, providing an accessible platform for those who want to develop and verify their own techniques for digital twins.