title: Effects of wave interaction on ignition and deflagration-to-detonation transition in ethylene/air mixtures behind a reflected shock

abstract: Dynamics of ethylene autoignition and Deflagration-to-Detonation Transition (DDT) in a one-dimensional shock tube are numerically investigated using a skeletal chemistry including 10 species and 10 reactions. Different combustion modes are investigated through considering various premixed gas equivalence ratios (0.2 to 2.0) and incident shock wave Mach numbers (1.8 to 3.2). Four ignition and DDT modes are observed from the studied cases, i.e., no ignition, deflagration combustion, detonation after reflected shock and deflagration behind the incident shock. For detonation development behind the reflected shock, three autoignition hot spots are formed. The first one occurs at the wall surface after the re-compression of the reflected shock and contact surface, which further develops to a reaction shock because of the explosion in the explosion regime. The other two are off the wall, respectively caused by the reflected shock rarefaction wave interaction and reaction induction in the compressed mixture. The last hot spot develops to a reaction wave and couples with the reflected shock after a DDT process, which eventually leads to detonation combustion. For deflagration development behind the reflected shock, the wave interactions, wall surface autoignition hot spot as well as its induction of reaction shock are qualitatively similar to the mode of detonation after incident shock reflection, before the reflected shock rarefaction wave collision point. However, only one hot spot is induced after the collision, which also develops to a reaction wave but cannot catch up with the reflected shock. For deflagration behind the incident shock, deflagration combustion is induced by the incident shock compression whereas detonation occurs after the shock reflection.


title: Backward diffusion-wave problem: stability, regularization and approximation

abstract: We aim at the development and analysis of the numerical schemes for approximately solving the backward diffusion-wave problem, which involves a fractional derivative in time with order $\alpha\in(1,2)$. From terminal observations at two time levels, i.e., $u(T_1)$ and $u(T_2)$, we simultaneously recover two initial data $u(0)$ and $u_t(0)$ and hence the solution $u(t)$ for all $t > 0$. First of all, existence, uniqueness and Lipschitz stability of the backward diffusion-wave problem were established under some conditions about $T_1$ and $T_2$. Moreover, for noisy data, we propose a quasi-boundary value scheme to regularize the "mildly" ill-posed problem, and show the convergence of the regularized solution. Next, to numerically solve the regularized problem, a fully discrete scheme is proposed by applying finite element method in space and convolution quadrature in time. We establish error bounds of the discrete solution in both cases of smooth and nonsmooth data. The error estimate is very useful in practice since it indicates the way to choose discretization parameters and regularization parameter, according to the noise level. The theoretical results are supported by numerical experiments.


title: Optimal Control of Velocity and Nonlocal Interactions in the Mean-Field Kuramoto Model

abstract: In this paper, we investigate how the self-synchronization property of a swarm of Kuramoto oscillators can be controlled and exploited to achieve target densities and target phase coherence. In the limit of an infinite number of oscillators, the collective dynamics of the agents' density is described by a mean-field model in the form of a nonlocal PDE, where the nonlocality arises from the synchronization mechanism. In this mean-field setting, we introduce two space-time dependent control inputs to affect the density of the oscillators: an angular velocity field that corresponds to a state feedback law for individual agents, and a control parameter that modulates the strength of agent interactions over space and time, i.e., a multiplicative control with respect to the integral nonlocal term. We frame the density tracking problem as a PDE-constrained optimization problem. The controlled synchronization and phase-locking are measured with classical polar order metrics. After establishing the mass conservation property of the mean-field model and bounds on its nonlocal term, a system of first-order necessary conditions for optimality is recovered using a Lagrangian method. The optimality system, comprising a nonlocal PDE for the state dynamics equation, the respective nonlocal adjoint dynamics, and the Euler equation, is solved iteratively following a standard Optimize-then-Discretize approach and an efficient numerical solver based on spectral methods. We demonstrate our approach for each of the two control inputs in simulation.


title: The Three and Fourfold Translative Tiles in Three-Dimensional Space

abstract: This paper proves the following statement: If a convex body can form a three or fourfold translative tiling in the three-dimensional space, it must be a parallelohedron. In other words, it must be a parallelotope, a hexagonal prism, a rhombic dodecahedron, an elongated dodecahedron, or a truncated octahedron.


title: Non-Asymptotic Analysis of Stochastic Approximation Algorithms for Streaming Data

abstract: We introduce a streaming framework for analyzing stochastic approximation/optimization problems. This streaming framework is analogous to solving optimization problems using time-varying mini-batches that arrive sequentially. We provide non-asymptotic convergence rates of various gradient-based algorithms; this includes the famous Stochastic Gradient (SG) descent (a.k.a. Robbins-Monro algorithm), mini-batch SG and time-varying mini-batch SG algorithms, as well as their iterated averages (a.k.a. Polyak-Ruppert averaging). We show i) how to accelerate convergence by choosing the learning rate according to the time-varying mini-batches, ii) that Polyak-Ruppert averaging achieves optimal convergence in terms of attaining the Cramer-Rao lower bound, and iii) how time-varying mini-batches together with Polyak-Ruppert averaging can provide variance reduction and accelerate convergence simultaneously, which is advantageous for many learning problems, such as online, sequential, and large-scale learning. We further demonstrate these favorable effects for various time-varying mini-batches.


title: Low-Resource Named Entity Recognition Based on Multi-hop Dependency Trigger

abstract: This paper presents a simple and effective approach in low-resource named entity recognition (NER) based on multi-hop dependency trigger. Dependency trigger refer to salient nodes relative to a entity in the dependency graph of a context sentence. Our main observation is that there often exists trigger which play an important role to recognize the location and type of entity in sentence. Previous research has used manual labelling of trigger. Our main contribution is to propose use a syntactic parser to automatically annotate trigger. Experiments on two English datasets (CONLL 2003 and BC5CDR) show that the proposed method is comparable to the previous trigger-based NER model.


title: Outer approximation algorithms for convex vector optimization problems

abstract: In this study, we present a general framework of outer approximation algorithms to solve convex vector optimization problems, in which the Pascoletti-Serafini (PS) scalarization is solved iteratively. This scalarization finds the minimum 'distance' from a reference point, which is usually taken as a vertex of the current outer approximation, to the upper image through a given direction. We propose efficient methods to select the parameters (the reference point and direction vector) of the PS scalarization and analyze the effects of these on the overall performance of the algorithm. Different from the existing vertex selection rules from the literature, the proposed methods do not require solving additional single-objective optimization problems. Using some test problems, we conduct an extensive computational study where three different measures are set as the stopping criteria: the approximation error, the runtime, and the cardinality of solution set. We observe that the proposed variants have satisfactory results especially in terms of runtime compared to the existing variants from the literature.


title: Infusing model predictive control into meta-reinforcement learning for mobile robots in dynamic environments

abstract: The successful operation of mobile robots requires them to adapt rapidly to environmental changes. To develop an adaptive decision-making tool for mobile robots, we propose a novel algorithm that combines meta-reinforcement learning (meta-RL) with model predictive control (MPC). Our method employs an off-policy meta-RL algorithm as a baseline to train a policy using transition samples generated by MPC when the robot detects certain events that can be effectively handled by MPC, with its explicit use of robot dynamics. The key idea of our method is to switch between the meta-learned policy and the MPC controller in a randomized and event-triggered fashion to make up for suboptimal MPC actions caused by the limited prediction horizon. During meta-testing, the MPC module is deactivated to significantly reduce computation time in motion control. We further propose an online adaptation scheme that enables the robot to infer and adapt to a new task within a single trajectory. The performance of our method has been demonstrated through simulations using a nonlinear car-like vehicle model with (i) synthetic movements of obstacles, and (ii) real-world pedestrian motion data. The simulation results indicate that our method outperforms other algorithms in terms of learning efficiency and navigation quality.


title: Enhancing Data-Driven Reachability Analysis using Temporal Logic Side Information

abstract: This paper presents algorithms for performing data-driven reachability analysis under temporal logic side information. In certain scenarios, the data-driven reachable sets of a robot can be prohibitively conservative due to the inherent noise in the robot's historical measurement data. In the same scenarios, we often have side information about the robot's expected motion (e.g., limits on how much a robot can move in a one-time step) that could be useful for further specifying the reachability analysis. In this work, we show that if we can model this side information using a signal temporal logic (STL) fragment, we can constrain the data-driven reachability analysis and safely limit the conservatism of the computed reachable sets. Moreover, we provide formal guarantees that, even after incorporating side information, the computed reachable sets still properly over-approximate the robot's future states. Lastly, we empirically validate the practicality of the over-approximation by computing constrained, data-driven reachable sets for the Small-Vehicles-for-Autonomy (SVEA) hardware platform in two driving scenarios.


title: Unraveling the Global Teleconnections of Indian Summer Monsoon Clouds: Expedition from CMIP5 to CMIP6

abstract: We have analyzed the teleconnection of total cloud fraction (TCF) with global sea surface temperature (SST) in multi-model ensembles (MME) of the fifth and sixth Coupled Model Intercomparison Projects (CMIP5 and CMIP6). CMIP6-MME has a more robust and realistic teleconnection (TCF and global SST) pattern over the extra-tropics (R ~0.43) and North Atlantic (R ~0.39) region, which in turn resulted in improvement of rainfall bias over the Asian summer monsoon (ASM) region. CMIP6-MME can better reproduce the mean TCF and have reduced dry (wet) rainfall bias on land (ocean) over the ASM region. CMIP6-MME has improved the biases of seasonal mean rainfall, TCF, and outgoing longwave radiation (OLR) over the Indian Summer Monsoon (ISM) region by ~40%, ~45%, and ~31%, respectively, than CMIP5-MME and demonstrates better spatial correlation with observation/reanalysis. Results establish the credibility of the CMIP6 models and provide a scientific basis for improving the seasonal prediction of ISM.


title: Phase retrieval for affine groups over prime fields

abstract: We study phase retrieval for group frames arising from permutation representations, focusing on the action of the affine group of a finite field. We investigate various versions of the phase retrieval problem, including conjugate phase retrieval, sign retrieval, and matrix recovery. Our main result establishes that the canonical irreducible representation of the affine group $\mathbb{Z}_p \rtimes \mathbb{Z}_p^\ast$ (with $p$ prime), acting on the vectors in $\mathbb{C}^{p}$ with zero-sum, has the strongest retrieval property, allowing to reconstruct matrices from scalar products with a group orbit consisting of rank-one projections. We explicitly characterize the generating vectors that ensure this property, provide a linear matrix recovery algorithm and explicit examples of vectors that allow matrix recovery. We also comment on more general permutation representations.


title: On certain supercuspidal representations of symplectic groups associated with tamely ramified extensions : the formal degree conjecture and the root number conjecture

abstract: The formal degree conjecture and the root number conjecture are verified with respect to supercuspidal representations of $Sp_{2n}(F)$ and $L$-parameters associated with tamely ramified extension $K/F$ of degree $2n$. The supercuspidal representation is constructed as a compact induction from an irreducible unitary representation of the hyper special compact group $Sp_{2n}(O_F)$, which is explicitly constructed, based upon the general theory developed by the author, by $K$ and certain character $\theta$ of the multiplicative group $K^{\times}$. $L$-parameter is constructed by the data $\{K,\theta\}$ by means of the local Langlands correspondence of tori and Langlands-Schelstad procedure.


title: Diagnosability of labeled $\mathfrak{D_p}$ automata

abstract: In this paper, we formulate a notion of diagnosability for labeled weighted automata over a class of dioids which admit both positive and negative numbers as well as vectors. The weights can represent diverse physical meanings such as time elapsing and position deviations. We also develop an original tool called concurrent composition to verify diagnosability for such automata. These results are fundamentally new compared with the existing ones in the literature.


title: Limit theorems for Hawkes processes including inhibition

abstract: In this paper we consider some non linear Hawkes processes with signed reproduction function (or memory kernel) thus exhibiting both self-excitation and inhibition. We provide a Law of Large Numbers, a Central Limit Theorem and large deviation results, as time growths to infinity. The proofs lie on a renewal structure for these processes introduced in Costa et al. (2020) which leads to a comparison with cumulative processes. Explicit computations are made on some examples. Similar results have been obtained in the literature for self-exciting Hawkes processes only.


title: A Survey on Data Cleaning Methods for Improved Machine Learning Model Performance

abstract: Data cleaning is the initial stage of any machine learning project and is one of the most critical processes in data analysis. It is a critical step in ensuring that the dataset is devoid of incorrect or erroneous data. It can be done manually with data wrangling tools, or it can be completed automatically with a computer program. Data cleaning entails a slew of procedures that, once done, make the data ready for analysis. Given its significance in numerous fields, there is a growing interest in the development of efficient and effective data cleaning frameworks. In this survey, some of the most recent advancements of data cleaning approaches are examined for their effectiveness and the future research directions are suggested to close the gap in each of the methods.


title: The interplay of different metrics for the construction of constant dimension codes

abstract: A basic problem for constant dimension codes is to determine the maximum possible size $A_q(n,d;k)$ of a set of $k$-dimensional subspaces in $\mathbb{F}_q^n$, called codewords, such that the subspace distance satisfies $d_S(U,W):=2k-2\dim(U\cap W)\ge d$ for all pairs of different codewords $U$, $W$. Constant dimension codes have applications in e.g.\ random linear network coding, cryptography, and distributed storage. Bounds for $A_q(n,d;k)$ are the topic of many recent research papers. Providing a general framework we survey many of the latest constructions and show up the potential for further improvements. As examples we give improved constructions for the cases $A_q(10,4;5)$, $A_q(11,4;4)$, $A_q(12,6;6)$, and $A_q(15,4;4)$. We also derive general upper bounds for subcodes arising in those constructions.


title: What Does The User Want? Information Gain for Hierarchical Dialogue Policy Optimisation

abstract: The dialogue management component of a task-oriented dialogue system is typically optimised via reinforcement learning (RL). Optimisation via RL is highly susceptible to sample inefficiency and instability. The hierarchical approach called Feudal Dialogue Management takes a step towards more efficient learning by decomposing the action space. However, it still suffers from instability due to the reward only being provided at the end of the dialogue. We propose the usage of an intrinsic reward based on information gain to address this issue. Our proposed reward favours actions that resolve uncertainty or query the user whenever necessary. It enables the policy to learn how to retrieve the users' needs efficiently, which is an integral aspect in every task-oriented conversation. Our algorithm, which we call FeudalGain, achieves state-of-the-art results in most environments of the PyDial framework, outperforming much more complex approaches. We confirm the sample efficiency and stability of our algorithm through experiments in simulation and a human trial.


title: Light baryonium spectrum

abstract: We evaluate the light baryonium spectrum, viz. the baryon-antibaryon states, in the framework of QCD sum rules. The nonperturbative contributions up to dimension 12 are taken into account. Numerical results indicate that there might exist eight possible light baryonium states, i.e. $p$-$\bar{p}$, $\Lambda$-$\bar{\Lambda}$, $\Sigma$-$\bar{\Sigma}$, and $\Xi$-$\bar{\Xi}$ with quantum numbers of $0^{-+}$ and $1^{--}$. For the $\Lambda$-$\bar{\Lambda}$, $\Sigma$-$\bar{\Sigma}$, and $\Xi$-$\bar{\Xi}$ states, their masses are found above the corresponding dibaryon thresholds, while the masses of $p$-$\bar{p}$ states are not. The possible baryonium decay modes are analyzed, which are hopefully measurable in BESIII, BELLEII, and LHCb experiments.


title: Inequality Constrained Trajectory Optimization with A Hybrid Multiple-shooting iLQR

abstract: Trajectory optimization has been used extensively in robotic systems. In particular, iterative Linear Quadratic Regulator (iLQR) has performed well as an off-line planner and online nonlinear model predictive control solver, with a lower computational cost. However, standard iLQR cannot handle any constraints or perform reasonable initialization of a state trajectory. In this paper, we propose a hybrid constrained iLQR variant with a multiple-shooting framework to incorporate general inequality constraints and infeasible states initialization. The main technical contributions are twofold: 1) In addition to inheriting the simplicity of the initialization in multiple-shooting settings, a two-stage framework is developed to deal with state and/or control constraints robustly without loss of the linear feedback term of iLQR. Such a hybrid strategy offers fast convergence of constraint satisfaction. 2) An improved globalization strategy is proposed to exploit the coupled effects between line-searching and regularization, which is able to enhance the numerical robustness of the constrained iLQR approaches. Our approach is tested on various constrained trajectory optimization problems and outperforms the commonly-used collocation and shooting methods.


title: Parallel Constraint-Driven Inductive Logic Programming

abstract: Multi-core machines are ubiquitous. However, most inductive logic programming (ILP) approaches use only a single core, which severely limits their scalability. To address this limitation, we introduce parallel techniques based on constraint-driven ILP where the goal is to accumulate constraints to restrict the hypothesis space. Our experiments on two domains (program synthesis and inductive general game playing) show that (i) parallelisation can substantially reduce learning times, and (ii) worker communication (i.e. sharing constraints) is important for good performance.


title: Combining Context Awareness and Planning to Learn Behavior Trees from Demonstration

abstract: Fast changing tasks in unpredictable, collaborative environments are typical for medium-small companies, where robotised applications are increasing. Thus, robot programs should be generated in short time with small effort, and the robot able to react dynamically to the environment. To address this we propose a method that combines context awareness and planning to learn Behavior Trees (BTs), a reactive policy representation that is becoming more popular in robotics and has been used successfully in many collaborative scenarios. Context awareness allows to infer from the demonstration the frames in which actions are executed and to capture relevant aspects of the task, while a planner is used to automatically generate the BT from the sequence of actions from the demonstration. The learned BT is shown to solve non-trivial manipulation tasks where learning the context is fundamental to achieve the goal. Moreover, we collected non-expert demonstrations to study the performances of the algorithm in industrial scenarios.


title: ROW-SLAM: Under-Canopy Cornfield Semantic SLAM

abstract: We study a semantic SLAM problem faced by a robot tasked with autonomous weeding under the corn canopy. The goal is to detect corn stalks and localize them in a global coordinate frame. This is a challenging setup for existing algorithms because there is very little space between the camera and the plants, and the camera motion is primarily restricted to be along the row. To overcome these challenges, we present a multi-camera system where a side camera (facing the plants) is used for detection whereas front and back cameras are used for motion estimation. Next, we show how semantic features in the environment (corn stalks, ground, and crop planes) can be used to develop a robust semantic SLAM solution and present results from field trials performed throughout the growing season across various cornfields.


title: Co-Embedding: Discovering Communities on Bipartite Graphs through Projection

abstract: Many datasets take the form of a bipartite graph where two types of nodes are connected by relationships, like the movies watched by a user or the tags associated with a file. The partitioning of the bipartite graph could be used to fasten recommender systems, or reduce the information retrieval system's index size, by identifying groups of items with similar properties. This type of graph is often processed by algorithms using the Vector Space Model representation, where a binary vector represents an item with 0 and 1. The main problem with this representation is the dimension relatedness, like words' synonymity, which is not considered. This article proposes a co-clustering algorithm using items projection, allowing the measurement of features similarity. We evaluated our algorithm on a cluster retrieval task. Over various datasets, our algorithm produced well balanced clusters with coherent items in, leading to high retrieval scores on this task..


title: T-model field equations: the general solution

abstract: We analyze the field equations for the perfect fluid solutions admitting a group G$_3$ of isometries acting on orbits S$_2$ whose curvature has a gradient that is tangent to the fluid flow (T-models). We propose several methods to integrate the field equations and we present the general solution without the need to calculate any integral.


title: Optimal Cycling of a Heterogenous Battery Bank via Reinforcement Learning

abstract: We consider the problem of optimal charging/discharging of a bank of heterogenous battery units, driven by stochastic electricity generation and demand processes. The batteries in the battery bank may differ with respect to their capacities, ramp constraints, losses, as well as cycling costs. The goal is to minimize the degradation costs associated with battery cycling in the long run; this is posed formally as a Markov decision process. We propose a linear function approximation based Q-learning algorithm for learning the optimal solution, using a specially designed class of kernel functions that approximate the structure of the value functions associated with the MDP. The proposed algorithm is validated via an extensive case study.


title: Patch-based Medical Image Segmentation using Matrix Product State Tensor Networks

abstract: Tensor networks are efficient factorisations of high-dimensional tensors into a network of lower-order tensors. They have been most commonly used to model entanglement in quantum many-body systems and more recently are witnessing increased applications in supervised machine learning. In this work, we formulate image segmentation in a supervised setting with tensor networks. The key idea is to first lift the pixels in image patches to exponentially high-dimensional feature spaces and using a linear decision hyper-plane to classify the input pixels into foreground and background classes. The high-dimensional linear model itself is approximated using the matrix product state (MPS) tensor network. The MPS is weight-shared between the non-overlapping image patches resulting in our strided tensor network model. The performance of the proposed model is evaluated on three 2D- and one 3D- biomedical imaging datasets. The performance of the proposed tensor network segmentation model is compared with relevant baseline methods. In the 2D experiments, the tensor network model yields competitive performance compared to the baseline methods while being more resource efficient.


title: Privacy amplification scheme based on composite coding

abstract: Privacy amplification is an indispensable step in the post-processing of quantum key distribution, which can be used to compress the redundancy of shared key and improve the security level of the key. The commonly used privacy amplification is based on the random selection of universal hash functions, which needs the help of an additional random source, while it does not exist in general. In this paper, we propose a privacy amplification scheme based on composite coding, which is an extension of quantum CSS codes to classical linear codes. Compared with the universal hashing function, the proposed scheme does not need other random sources, and the randomness can be completely provided by the qubit string. Furthermore, the information-theoretic bound for the extraction of the key is obvious in composite coding.


title: On the Universality of Deep Contextual Language Models

abstract: Deep Contextual Language Models (LMs) like ELMO, BERT, and their successors dominate the landscape of Natural Language Processing due to their ability to scale across multiple tasks rapidly by pre-training a single model, followed by task-specific fine-tuning. Furthermore, multilingual versions of such models like XLM-R and mBERT have given promising results in zero-shot cross-lingual transfer, potentially enabling NLP applications in many under-served and under-resourced languages. Due to this initial success, pre-trained models are being used as `Universal Language Models' as the starting point across diverse tasks, domains, and languages. This work explores the notion of `Universality' by identifying seven dimensions across which a universal model should be able to scale, that is, perform equally well or reasonably well, to be useful across diverse settings. We outline the current theoretical and empirical results that support model performance across these dimensions, along with extensions that may help address some of their current limitations. Through this survey, we lay the foundation for understanding the capabilities and limitations of massive contextual language models and help discern research gaps and directions for future work to make these LMs inclusive and fair to diverse applications, users, and linguistic phenomena.


title: Beyond Glass-Box Features: Uncertainty Quantification Enhanced Quality Estimation for Neural Machine Translation

abstract: Quality Estimation (QE) plays an essential role in applications of Machine Translation (MT). Traditionally, a QE system accepts the original source text and translation from a black-box MT system as input. Recently, a few studies indicate that as a by-product of translation, QE benefits from the model and training data's information of the MT system where the translations come from, and it is called the "glass-box QE". In this paper, we extend the definition of "glass-box QE" generally to uncertainty quantification with both "black-box" and "glass-box" approaches and design several features deduced from them to blaze a new trial in improving QE's performance. We propose a framework to fuse the feature engineering of uncertainty quantification into a pre-trained cross-lingual language model to predict the translation quality. Experiment results show that our method achieves state-of-the-art performances on the datasets of WMT 2020 QE shared task.


title: Universal Adversarial Attack on Deep Learning Based Prognostics

abstract: Deep learning-based time series models are being extensively utilized in engineering and manufacturing industries for process control and optimization, asset monitoring, diagnostic and predictive maintenance. These models have shown great improvement in the prediction of the remaining useful life (RUL) of industrial equipment but suffer from inherent vulnerability to adversarial attacks. These attacks can be easily exploited and can lead to catastrophic failure of critical industrial equipment. In general, different adversarial perturbations are computed for each instance of the input data. This is, however, difficult for the attacker to achieve in real time due to higher computational requirement and lack of uninterrupted access to the input data. Hence, we present the concept of universal adversarial perturbation, a special imperceptible noise to fool regression based RUL prediction models. Attackers can easily utilize universal adversarial perturbations for real-time attack since continuous access to input data and repetitive computation of adversarial perturbations are not a prerequisite for the same. We evaluate the effect of universal adversarial attacks using NASA turbofan engine dataset. We show that addition of universal adversarial perturbation to any instance of the input data increases error in the output predicted by the model. To the best of our knowledge, we are the first to study the effect of the universal adversarial perturbation on time series regression models. We further demonstrate the effect of varying the strength of perturbations on RUL prediction models and found that model accuracy decreases with the increase in perturbation strength of the universal adversarial attack. We also showcase that universal adversarial perturbation can be transferred across different models.


title: Spline-PINN: Approaching PDEs without Data using Fast, Physics-Informed Hermite-Spline CNNs

abstract: Partial Differential Equations (PDEs) are notoriously difficult to solve. In general, closed-form solutions are not available and numerical approximation schemes are computationally expensive. In this paper, we propose to approach the solution of PDEs based on a novel technique that combines the advantages of two recently emerging machine learning based approaches. First, physics-informed neural networks (PINNs) learn continuous solutions of PDEs and can be trained with little to no ground truth data. However, PINNs do not generalize well to unseen domains. Second, convolutional neural networks provide fast inference and generalize but either require large amounts of training data or a physics-constrained loss based on finite differences that can lead to inaccuracies and discretization artifacts. We leverage the advantages of both of these approaches by using Hermite spline kernels in order to continuously interpolate a grid-based state representation that can be handled by a CNN. This allows for training without any precomputed training data using a physics-informed loss function only and provides fast, continuous solutions that generalize to unseen domains. We demonstrate the potential of our method at the examples of the incompressible Navier-Stokes equation and the damped wave equation. Our models are able to learn several intriguing phenomena such as Karman vortex streets, the Magnus effect, Doppler effect, interference patterns and wave reflections. Our quantitative assessment and an interactive real-time demo show that we are narrowing the gap in accuracy of unsupervised ML based methods to industrial CFD solvers while being orders of magnitude faster.


title: Spin-Current Instability at a Magnetic Domain Wall in a Ferromagnetic Superfluid: a Generation Mechanism of Eccentric Fractional Skyrmions

abstract: Spinful superfluids of ultracold atoms are ideal for investigating the intrinsic properties of spin current and texture because they are realized in an isolated, nondissipative system free from impurities, dislocations, and thermal fluctuations. This study theoretically reveals the impact of spin current on a magnetic domain wall in spinful superfluids. An exact wall solution is obtained in the ferromagnetic phase of a spin-1 Bose--Einstein condensate with easy-axis anisotropy at zero temperature. The bosonic-quasiparticle mechanics analytically show that the spin current along the wall becomes unstable if the velocity exceeds the critical spin-current velocities, leading to complicated situations because of the competition between transverse magnons and ripplons. Our direct numerical simulation reveals that this system has a mechanism to generate an eccentric fractional skyrmion, which has a fractional topological charge, but its texture is not similar to that of a meron. This mechanism is in contrast to the generation of conventional skyrmions in easy-axis magnets. The theoretical findings can be examined in the same situation as in a recent experiment on ultracold atoms. In terms of the universality of spontaneous symmetry breaking, unexplored similar phenomena are expected in different physical systems with the same broken symmetry.

categories: cond-mat.quant-gas cond-mat.mes-hall cond-mat.other cond-mat.str-el


title: The NEVOD-EAS air-shower array

abstract: The Experimental complex NEVOD includes several different setups for studying various components of extensive air showers (EAS) in the energy range from 10^10 to 10^18 eV. The NEVOD-EAS array for detection of the EAS electron-photon component began its data taking in 2018. It is a distributed system of scintillation detectors installed over an area of about 10^4 m^2. A distinctive feature of this array is its cluster organization with different-altitude layout of the detecting elements. The main goal of the NEVOD-EAS array is to obtain an estimation of the primary particle energy for events measured by various detectors of the Experimental complex NEVOD. This paper describes the design, operation principles and data processing of the NEVOD-EAS array. The criteria for the event selection and the accuracy of the EAS parameters reconstruction obtained on the simulated events are discussed. The results of the preliminary analysis of experimental data obtained during a half-year operation are presented.


title: Stability of a cross-diffusion system and approximation by repulsive random walks: a duality approach

abstract: We consider conservative cross-diffusion systems for two species where individual motion rates depend linearly on the local density of the other species. We develop duality estimates and obtain stability and approximation results. We first control the time evolution of the gap between two bounded solutions by means of its initial value. As a by product, we obtain a uniqueness result for bounded solutions valid for any space dimension, under a non-perturbative smallness assumption. Using a discrete counterpart of our duality estimates, we prove the convergence of random walks with local repulsion in one dimensional discrete space to cross-diffusion systems. More precisely, we prove quantitative estimates for the gap between the stochastic process and the cross-diffusion system. We give first rough but general estimates; then we use the duality approach to obtain fine estimates under less general conditions.


title: Albanese map of special manifolds: A correction

abstract: We show that any fibration of a 'special' compact K{\"a}hler manifold X onto an Abelian variety has no multiple fibre in codimension one. This statement strengthens and extends previous results of Kawamata and Viehweg when $\kappa$(X) = 0. This also corrects the proof given in [2], 5.3 which was incomplete.


title: Semantics of European poetry is shaped by conservative forces: The relationship between poetic meter and meaning in accentual-syllabic verse

abstract: Recent advances in cultural analytics and large-scale computational studies of art, literature and film often show that long-term change in the features of artistic works happens gradually. These findings suggest that conservative forces that shape creative domains might be underestimated. To this end, we provide the first large-scale formal evidence of the persistent association between poetic meter and semantics in 18-19th European literatures, using Czech, German and Russian collections with additional data from English poetry and early modern Dutch songs. Our study traces this association through a series of clustering experiments using the abstracted semantic features of 150,000 poems. With the aid of topic modeling we infer semantic features for individual poems. Texts were also lexically simplified across collections to increase generalizability and decrease the sparseness of word frequency distributions. Topics alone enable recognition of the meters in each observed language, as may be seen from highly robust clustering of same-meter samples (median Adjusted Rand Index between 0.48 and 1). In addition, this study shows that the strength of the association between form and meaning tends to decrease over time. This may reflect a shift in aesthetic conventions between the 18th and 19th centuries as individual innovation was increasingly favored in literature. Despite this decline, it remains possible to recognize semantics of the meters from past or future, which suggests the continuity of semantic traditions while also revealing the historical variability of conditions across languages. This paper argues that distinct metrical forms, which are often copied in a language over centuries, also maintain long-term semantic inertia in poetry. Our findings, thus, highlight the role of the formal features of cultural items in influencing the pace and shape of cultural evolution.


title: Fusion with Hierarchical Graphs for Mulitmodal Emotion Recognition

abstract: Automatic emotion recognition (AER) based on enriched multimodal inputs, including text, speech, and visual clues, is crucial in the development of emotionally intelligent machines. Although complex modality relationships have been proven effective for AER, they are still largely underexplored because previous works predominantly relied on various fusion mechanisms with simply concatenated features to learn multimodal representations for emotion classification. This paper proposes a novel hierarchical fusion graph convolutional network (HFGCN) model that learns more informative multimodal representations by considering the modality dependencies during the feature fusion procedure. Specifically, the proposed model fuses multimodality inputs using a two-stage graph construction approach and encodes the modality dependencies into the conversation representation. We verified the interpretable capabilities of the proposed method by projecting the emotional states to a 2D valence-arousal (VA) subspace. Extensive experiments showed the effectiveness of our proposed model for more accurate AER, which yielded state-of-the-art results on two public datasets, IEMOCAP and MELD.


title: Reconstructing occluded Elevation Information in Terrain Maps with Self-supervised Learning

abstract: Accurate and complete terrain maps enhance the awareness of autonomous robots and enable safe and optimal path planning. Rocks and topography often create occlusions and lead to missing elevation information in the Digital Elevation Map (DEM). Currently, these occluded areas are either fully avoided during motion planning or the missing values in the elevation map are filled-in using traditional interpolation, diffusion or patch-matching techniques. These methods cannot leverage the high-level terrain characteristics and the geometric constraints of line of sight we humans use intuitively to predict occluded areas. We introduce a self-supervised learning approach capable of training on real-world data without a need for ground-truth information to reconstruct the occluded areas in the DEMs. We accomplish this by adding artificial occlusion to the incomplete elevation maps constructed on a real robot by performing ray casting. We first evaluate a supervised learning approach on synthetic data for which we have the full ground-truth available and subsequently move to several real-world datasets. These real-world datasets were recorded during exploration of both structured and unstructured terrain with a legged robot, and additionally in a planetary scenario on Lunar analogue terrain. We state a significant improvement compared to the baseline methods both on synthetic terrain and for the real-world datasets. Our neural network is able to run in real-time on both CPU and GPU with suitable sampling rates for autonomous ground robots. We motivate the applicability of reconstructing occlusion in elevation maps with preliminary motion planning experiments.


title: A measurement of the mean electronic excitation energy of liquid xenon

abstract: Detectors using liquid xenon as target are widely deployed in rare event searches. Conclusions on the interacting particle rely on a precise reconstruction of the deposited energy which requires calibrations of the energy scale of the detector by means of radioactive sources. However, a microscopic calibration, i.e. the translation from the number of excitation quanta into deposited energy, also necessitates good knowledge of the energy required to produce single scintillation photons or ionisation electrons in liquid xenon. The sum of these excitation quanta is directly proportional to the deposited energy in the target. The proportionality constant is the mean excitation energy and is commonly known as $W$-value. Here we present a measurement of the $W$-value with electronic recoil interactions in a small dual-phase xenon time projection chamber with a hybrid (photomultiplier tube and silicon photomultipliers) photosensor configuration. Our result is based on calibrations at $\mathcal{O}(1-10 \, \mathrm{keV})$ with internal $^{37}$Ar and $^{83\text{m}}$Kr sources and single electron events. We obtain a value of $W=11.5 \, ^{+0.2}_{-0.3} \, \mathrm{(syst.)} \, \mathrm{eV}$, with negligible statistical uncertainty, which is lower than previously measured at these energies. If further confirmed, our result will be relevant for modelling the absolute response of liquid xenon detectors to particle interactions.


title: Incorporating Residual and Normalization Layers into Analysis of Masked Language Models

abstract: Transformer architecture has become ubiquitous in the natural language processing field. To interpret the Transformer-based models, their attention patterns have been extensively analyzed. However, the Transformer architecture is not only composed of the multi-head attention; other components can also contribute to Transformers' progressive performance. In this study, we extended the scope of the analysis of Transformers from solely the attention patterns to the whole attention block, i.e., multi-head attention, residual connection, and layer normalization. Our analysis of Transformer-based masked language models shows that the token-to-token interaction performed via attention has less impact on the intermediate representations than previously assumed. These results provide new intuitive explanations of existing reports; for example, discarding the learned attention patterns tends not to adversely affect the performance. The codes of our experiments are publicly available.


title: Refined fundamental parameters of Canopus from combined near-IR interferometry and spectral energy distribution

abstract: Canopus, the brightest and closest yellow supergiant to our Solar System, offers a unique laboratory for understanding the physics of evolved massive stars. The accurate and precise PIONIER data allowed us to simultaneously measure the angular diameter and the limb darkening (LD) profile using different analytical laws. We found that the power-law LD, being also in agreement with predictions from stellar atmosphere models, reproduces the interferometric data well. For this model we measured an angular diameter of $7.184 \pm 0.0017 \pm 0.029$ mas and an LD coefficient of $0.1438 \pm 0.0015$, which are respectively $\gtrsim 5$ and $\sim15-25$ more precise than in our previous A\&A paper on Canopus from 2008. From a dedicated analysis of the interferometric data, we also provide new constraints on the putative presence of weak surface inhomogeneities. Additionally, we analyzed the SED in a innovative way by simultaneously fitting the reddening-related parameters and the stellar effective temperature and gravity. We find that a model based on two effective temperatures is much better at reproducing the whole SED, from which we derived several parameters, including a new bolometric flux estimate. The Canopus angular diameter and LD measured in this work with PIONIER are the most precise to date, with a direct impact on several related fundamental parameters. Moreover, thanks to our joint analysis, we were able to determine a set of fundamental parameters that simultaneously reproduces both high-precision interferometric data and a good quality SED and, at the same time, agrees with stellar evolution models.


title: Can Language Models be Biomedical Knowledge Bases?

abstract: Pre-trained language models (LMs) have become ubiquitous in solving various natural language processing (NLP) tasks. There has been increasing interest in what knowledge these LMs contain and how we can extract that knowledge, treating LMs as knowledge bases (KBs). While there has been much work on probing LMs in the general domain, there has been little attention to whether these powerful LMs can be used as domain-specific KBs. To this end, we create the BioLAMA benchmark, which is comprised of 49K biomedical factual knowledge triples for probing biomedical LMs. We find that biomedical LMs with recently proposed probing methods can achieve up to 18.51% Acc@5 on retrieving biomedical knowledge. Although this seems promising given the task difficulty, our detailed analyses reveal that most predictions are highly correlated with prompt templates without any subjects, hence producing similar results on each relation and hindering their capabilities to be used as domain-specific KBs. We hope that BioLAMA can serve as a challenging benchmark for biomedical factual probing.


title: Null test searches for BSM physics with rare charm decays

abstract: Semileptonic Flavor Changing Neutral Current decays of charmed hadrons uniquely probe the up-sector of the Standard Model. Clean null test observables, such as CP-asymmetries, lepton-universality ratios, missing energy modes, lepton flavor violating modes and angular observables can be studied in a variety of charmed meson and baryon modes. An overview of null test opportunities with rare charm decays is presented and similarities and complementarities of different modes are worked out.


title: Galactic Scaling Rules in a Modified Dynamical Model

abstract: Schulz (2017) galactic scaling rules, which include baryonic Tully-Fisher relation, have been surveyed in this work within the context of a modified dynamical model. These scaling relations are derived by employing the virial theorem and applying equilibrium and stability conditions. The scaling rules are also obtained by dimensional analysis of an integral relation between surface density and circular velocity of disk galaxies. To check the validity of the scaling relations based on observational data, we have defined, based on the properties of the model, the proper equilibrium size $R_{eq}$ and equilibrium velocity $V_{eq}$ of systems. By employing these measures of length and velocity, SPARC data ( Lelli et al. 2016a ) is used to analyze the results. The viability of the scaling relations is tested and it is shown that, compared to some other measures of length and velocity, $R_{eq}$ and $V_{eq}$ provide the closest fits to the theoretical predictions. We have compared our results with prior works and have concluded that the set of baryonic Tully-Fisher relation plus mass-size relation ( or mass-velocity ) provides an appropriate description of the general characteristics of the systems. Lastly, it is shown that these scaling relations predict a certain evolution of galactic properties with redshift. This behavior provides a chance to examine the cosmic evolution of the present modified dynamical model in future works.


title: Learning to Match Job Candidates Using Multilingual Bi-Encoder BERT

abstract: In this talk, we will show how we used Randstad history of candidate placements to generate labeled CV-vacancy pairs dataset. Afterwards we fine-tune a multilingual BERT with bi encoder structure over this dataset, by adding a cosine similarity log loss layer. We will explain how using the mentioned structure helps us overcome most of the challenges described above, and how it enables us to build a maintainable and scalable pipeline to match CVs and vacancies. In addition, we show how we gain a better semantic understanding, and learn to bridge the vocabulary gap. Finally, we highlight how multilingual transformers help us handle cross language barrier and might reduce discrimination.


title: Which One is Better: Assessing Objective Metrics for Point Cloud Compression

abstract: Point cloud compression (PCC) has made remarkable achievement in recent years. In the mean time, point cloud quality assessment (PCQA) also realize gratifying development. Some recently emerged metrics present robust performance on public point cloud assessment databases. However, these metrics have not been evaluated specifically for PCC to verify whether they exhibit consistent performance with the subjective perception. In this paper, we establish a new dataset for compression evaluation first, which contains 175 compressed point clouds in total, deriving from 7 compression algorithms with 5 compression levels. Then leveraging the proposed dataset, we evaluate the performance of the existing PCQA metrics in terms of different compression types. The results demonstrate some deficiencies of existing metrics in compression evaluation.


title: Note on the bundle geometry of field space, variational connections, the dressing field method, & presymplectic structures of gauge theories over bounded regions

abstract: In this note, we consider how the bundle geometry of field space interplays with the covariant phase space methods so as to allow to write results of some generality on the presymplectic structure of invariant gauge theories coupled to matter. We obtain in particular the generic form of Noether charges associated with field-independent and field-dependent gauge parameters, as well as their Poisson bracket. We also provide the general field-dependent gauge transformations of the presymplectic potential and 2-form, which clearly highlight the problem posed by boundaries in generic situations. We then conduct a comparative analysis of two strategies recently considered to evade the boundary problem and associate a modified symplectic structure to a gauge theory over a bounded regions: namely the use of edge modes on the one hand, and of variational connections on the other. To do so, we first try to give the clearest geometric account of both, showing in particular that edge modes are a special case of differential geometric tool of gauge symmetry reduction known as the "dressing field method". Applications to Yang-Mills theory and General Relativity reproduce or generalise several results of the recent literature.


title: An alternative for minimal group actions on totally regular curves

abstract: Let $G$ be a countable group and $X$ be a totally regular curve. Suppose that $\phi:G\rightarrow {\rm Homeo}(X)$ is a minimal action. Then we show an alternative: either the action is topologically conjugate to isometries on the circle $\mathbb S^1$ (this implies that $\phi(G)$ contains an abelian subgroup of index at most 2), or has a quasi-Schottky subgroup (this implies that $G$ contains the free nonabelian group $\mathbb Z*\mathbb Z$). In order to prove the alternative, we get a new characterization of totally regular curves by means of the notion of measure; and prove an escaping lemma holding for any minimal group action on infinite compact metric spaces, which improves a trick in Margulis' proof of the alternative in the case that $X=\mathbb S^1$.


title: Resolution-robust Large Mask Inpainting with Fourier Convolutions

abstract: Modern image inpainting systems, despite the significant progress, often struggle with large missing areas, complex geometric structures, and high-resolution images. We find that one of the main reasons for that is the lack of an effective receptive field in both the inpainting network and the loss function. To alleviate this issue, we propose a new method called large mask inpainting (LaMa). LaMa is based on i) a new inpainting network architecture that uses fast Fourier convolutions (FFCs), which have the image-wide receptive field; ii) a high receptive field perceptual loss; iii) large training masks, which unlocks the potential of the first two components. Our inpainting network improves the state-of-the-art across a range of datasets and achieves excellent performance even in challenging scenarios, e.g. completion of periodic structures. Our model generalizes surprisingly well to resolutions that are higher than those seen at train time, and achieves this at lower parameter&time costs than the competitive baselines. The code is available at \url{https://github.com/saic-mdal/lama}.


title: MISSFormer: An Effective Medical Image Segmentation Transformer

abstract: The CNN-based methods have achieved impressive results in medical image segmentation, but they failed to capture the long-range dependencies due to the inherent locality of the convolution operation. Transformer-based methods are recently popular in vision tasks because of their capacity for long-range dependencies and promising performance. However, it lacks in modeling local context. In this paper, taking medical image segmentation as an example, we present MISSFormer, an effective and powerful Medical Image Segmentation tranSFormer. MISSFormer is a hierarchical encoder-decoder network with two appealing designs: 1) A feed-forward network is redesigned with the proposed Enhanced Transformer Block, which enhances the long-range dependencies and supplements the local context, making the feature more discriminative. 2) We proposed Enhanced Transformer Context Bridge, different from previous methods of modeling only global information, the proposed context bridge with the enhanced transformer block extracts the long-range dependencies and local context of multi-scale features generated by our hierarchical transformer encoder. Driven by these two designs, the MISSFormer shows a solid capacity to capture more discriminative dependencies and context in medical image segmentation. The experiments on multi-organ and cardiac segmentation tasks demonstrate the superiority, effectiveness and robustness of our MISSFormer, the experimental results of MISSFormer trained from scratch even outperform state-of-the-art methods pre-trained on ImageNet. The core designs can be generalized to other visual segmentation tasks. The code has been released on Github: https://github.com/ZhifangDeng/MISSFormer


title: Compensation of differential dispersion: application to multiband stellar interferometry

abstract: With the aim of pushing the limiting magnitude of interferometric instruments, the need for wide-band detection channels and for a coordinated operation of different instruments has considerably grown in the field of long-baseline interferometry. For this reason, the Center for High Angular Resolution Astronomy (CHARA), an array of six telescopes, requires a new configuration of longitudinal dispersion compensators to keep the fringe contrast above 95 per cent simultaneously in all spectral bands, while preserving the transmission above 85 per cent. In this paper, we propose a new method for defining the longitudinal dispersion compensators (LDC) suited for multiband observations. A literal approximation of the contrast loss resulting from the dispersion residues enables us to define a general criterion for fringe contrast maximization on several bands simultaneously. The optimization of this criterion leads to a simple solution with only two LDC stages per arm and existing differential delay lines, to the glass choice and a simple linear formula for thickness control of all these media. A refined criterion can also take into account glass transmission. After presenting this criterion, we give the optimal solution (medium, configuration) and its expected performance for the planned observing modes on CHARA.


title: Patient-specific solution of the electrocorticography forward problem in deforming brain

abstract: Invasive intracranial electroencephalography (iEEG) or electrocorticography (ECoG) measures electric potential directly on the surface of the brain and can be used to inform treatment planning for epilepsy surgery. Combined with numerical modeling they can further improve accuracy of epilepsy surgery planning. Accurate solution of the iEEG or ECoG forward problem, which is a crucial prerequisite for solving the inverse problem in epilepsy seizure onset zone localization, requires accurate representation of the patient's brain geometry and tissue electrical conductivity after implantation of electrodes. However, implantation of subdural grid electrodes causes the brain to deform, which invalidates preoperatively acquired image data. Moreover, postoperative magnetic resonance imaging (MRI) is incompatible with implanted electrodes and computed tomography (CT) has insufficient range of soft tissue contrast, which precludes both MRI and CT from being used to obtain the deformed postoperative geometry. In this paper, we present a biomechanics-based image warping procedure using preoperative MRI for tissue classification and postoperative CT for locating implanted electrodes to perform non-rigid registration of the preoperative image data to the postoperative configuration. We solve the iEEG forward problem on the predicted postoperative geometry using the finite element method (FEM) which accounts for patient-specific inhomogeneity and anisotropy of tissue conductivity. Results for the simulation of a current source in the brain show large differences in electric potential predicted by the models based on the original images and the deformed images corresponding to the brain geometry deformed by placement of invasive electrodes. Computation of the lead field matrix (useful for solution of the iEEG inverse problem) also showed significant differences between the different models.


title: 3D Annotation Of Arbitrary Objects In The Wild

abstract: Recent years have produced a variety of learning based methods in the context of computer vision and robotics. Most of the recently proposed methods are based on deep learning, which require very large amounts of data compared to traditional methods. The performance of the deep learning methods are largely dependent on the data distribution they were trained on, and it is important to use data from the robot's actual operating domain during training. Therefore, it is not possible to rely on pre-built, generic datasets when deploying robots in real environments, creating a need for efficient data collection and annotation in the specific operating conditions the robots will operate in. The challenge is then: how do we reduce the cost of obtaining such datasets to a point where we can easily deploy our robots in new conditions, environments and to support new sensors? As an answer to this question, we propose a data annotation pipeline based on SLAM, 3D reconstruction, and 3D-to-2D geometry. The pipeline allows creating 3D and 2D bounding boxes, along with per-pixel annotations of arbitrary objects without needing accurate 3D models of the objects prior to data collection and annotation. Our results showcase almost 90% Intersection-over-Union (IoU) agreement on both semantic segmentation and 2D bounding box detection across a variety of objects and scenes, while speeding up the annotation process by several orders of magnitude compared to traditional manual annotation.


title: Bayesian testing of linear versus nonlinear effects using Gaussian process priors

abstract: A Bayes factor is proposed for testing whether the effect of a key predictor variable on the dependent variable is linear or nonlinear, possibly while controlling for certain covariates. The test can be used (i) when one is interested in quantifying the relative evidence in the data of a linear versus a nonlinear relationship and (ii) to quantify the evidence in the data in favor of a linear relationship (useful when building linear models based on transformed variables). Under the nonlinear model, a Gaussian process prior is employed using a parameterization similar to Zellner's $g$ prior resulting in a scale-invariant test. Moreover a Bayes factor is proposed for one-sided testing of whether the nonlinear effect is consistently positive, consistently negative, or neither. Applications are provides from various fields including social network research and education.


title: Superconductivity in In-doped AgSnBiTe3 with possible band inversion

abstract: We investigated the chemical pressure effects on structural and electronic properties of SnTe-based material using partial substitution of Sn by Ag0.5Bi0.5, which results in lattice shrinkage. For Sn1-2x(AgBi)xTe, single-phase polycrystalline samples were obtained with a wide range of x. On the basis of band calculations, we confirmed that the Sn1-2x(AgBi)xTe system is basically possessing band inversion and topologically preserved electronic states. To explore new superconducting phases related to the topological electronic states, we investigated the In-doping effects on structural and superconducting properties for x = 0.33 (AgSnBiTe3). For (AgSnBi)(1-y)/3InyTe, single-phase polycrystalline samples were obtained for y = 0-0.5 by high-pressure synthesis. Superconductivity was observed for y = 0.2-0.5. For y = 0.4, the transition temperature estimated from zero-resistivity state was 2.4 K, and the specific heat investigation confirmed the emergence of bulk superconductivity. Because the presence of band inversion was theoretically predicted, and the parameters obtained from specific heat analyses were comparable to In-doped SnTe, we expect that the (AgSnBi)(1-y)/3InyTe and other (Ag,In,Sn,Bi)Te phases are candidate systems for studying topological superconductivity.


title: UV lines as a tracers for the XUV-fluxes of stars and the PLATOspec project

abstract: Observations in the UV-regime are very important for exoplanet research, because many diagnostically important lines for studying stellar activity are in this regime. Studying stellar activity is not only important because of its negative effects on the determination planetary parameters, but also because the XUV-radiation from the host stars affects the photochemistry and the erosion of planetary atmospheres . Unfortunately, the XUV-region is only accessible from space. However, since the XUV-radiation is correlated with the CaII,HK-lines, we can use these lines to study the XUV radiation indirectly. The CaIIHK lines for relatively bright stars can be observed with PLATOspec, a new high-resolution echelle spectrograph in development for the ESO 1.5m telescope at La Silla. One advantage compared to instruments on larger telescopes will be that large programs can be carried out. There will be two modes for obtaining precise RV-measurements. In the future, the CUBES instrument on the VLT will be able to study the same lines to probe the XUV-radiation in much fainter targets.


title: Disentangling Generative Factors in Natural Language with Discrete Variational Autoencoders

abstract: The ability of learning disentangled representations represents a major step for interpretable NLP systems as it allows latent linguistic features to be controlled. Most approaches to disentanglement rely on continuous variables, both for images and text. We argue that despite being suitable for image datasets, continuous variables may not be ideal to model features of textual data, due to the fact that most generative factors in text are discrete. We propose a Variational Autoencoder based method which models language features as discrete variables and encourages independence between variables for learning disentangled representations. The proposed model outperforms continuous and discrete baselines on several qualitative and quantitative benchmarks for disentanglement as well as on a text style transfer downstream application.


title: Powered Hawkes-Dirichlet Process: Challenging Textual Clustering using a Flexible Temporal Prior

abstract: The textual content of a document and its publication date are intertwined. For example, the publication of a news article on a topic is influenced by previous publications on similar issues, according to underlying temporal dynamics. However, it can be challenging to retrieve meaningful information when textual information conveys little information or when temporal dynamics are hard to unveil. Furthermore, the textual content of a document is not always linked to its temporal dynamics. We develop a flexible method to create clusters of textual documents according to both their content and publication time, the Powered Dirichlet-Hawkes process (PDHP). We show PDHP yields significantly better results than state-of-the-art models when temporal information or textual content is weakly informative. The PDHP also alleviates the hypothesis that textual content and temporal dynamics are always perfectly correlated. PDHP allows retrieving textual clusters, temporal clusters, or a mixture of both with high accuracy when they are not. We demonstrate that PDHP generalizes previous work --such as the Dirichlet-Hawkes process (DHP) and Uniform process (UP). Finally, we illustrate the changes induced by PDHP over DHP and UP in a real-world application using Reddit data.


title: Balancing detectability and performance of attacks on the control channel of Markov Decision Processes

abstract: We investigate the problem of designing optimal stealthy poisoning attacks on the control channel of Markov decision processes (MDPs). This research is motivated by the recent interest of the research community for adversarial and poisoning attacks applied to MDPs, and reinforcement learning (RL) methods. The policies resulting from these methods have been shown to be vulnerable to attacks perturbing the observations of the decision-maker. In such an attack, drawing inspiration from adversarial examples used in supervised learning, the amplitude of the adversarial perturbation is limited according to some norm, with the hope that this constraint will make the attack imperceptible. However, such constraints do not grant any level of undetectability and do not take into account the dynamic nature of the underlying Markov process. In this paper, we propose a new attack formulation, based on information-theoretical quantities, that considers the objective of minimizing the detectability of the attack as well as the performance of the controlled process. We analyze the trade-off between the efficiency of the attack and its detectability. We conclude with examples and numerical simulations illustrating this trade-off.


title: Categorical Extension of Dualities: From Stone to de Vries and Beyond, II

abstract: Under a general categorical procedure for the extension of dual equivalences as presented in this paper's predecessor, a new algebraically defined category is established that is dually equivalent to the category $\bf LKHaus$ of locally compact Hausdorff spaces and continuous maps, with the dual equivalence extending a Stone-type duality for the category of extremally disconnected locally compact Hausdorff spaces and continuous maps. The new category is then shown to be isomorphic to the category $\bf CLCA$ of complete local contact algebras and suitable morphisms. Thereby, a new proof is presented for the equivalence ${\bf LKHaus}\simeq{\bf CLCA}^{\rm op}$ that was obtained by the first author more than a decade ago. Unlike the morphisms of $\bf CLCA$, the morphisms of the new category and their composition law are very natural and easy to handle.


title: A Comparison of Code Embeddings and Beyond

abstract: Program representation learning is a fundamental task in software engineering applications. With the availability of "big code" and the development of deep learning techniques, various program representation learning models have been proposed to understand the semantic properties of programs and applied on different software engineering tasks. However, no previous study has comprehensively assessed the generalizability of these deep models on different tasks, so that the pros and cons of the models are unclear. In this experience paper, we try to bridge this gap by systemically evaluating the performance of eight program representation learning models on three common tasks, where six models are based on abstract syntax trees and two models are based on plain text of source code. We kindly explain the criteria for selecting the models and tasks, as well as the method for enabling end-to-end learning in each task. The results of performance evaluation show that they perform diversely in each task and the performance of the AST-based models is generally unstable over different tasks. In order to further explain the results, we apply a prediction attribution technique to find what elements are captured by the models and responsible for the predictions in each task. Based on the findings, we discuss some general principles for better capturing the information in the source code, and hope to inspire researchers to improve program representation learning methods for software engineering tasks.


title: An Extended Primal-Dual Algorithm Framework for Nonconvex Problems with Application to Nonlinear Imaging

abstract: We propose an extended primal-dual algorithm framework for solving a general nonconvex optimization model. This work is motivated by image reconstruction problems in a class of nonlinear imaging, where the forward operator can be formulated as a nonlinear convex function with respect to the reconstructed image. Using the proposed framework, we put forward six specific iterative schemes, and present their detailed mathematical explanation. We also establish the relationship to existing algorithms. Moreover, under proper assumptions, we analyze the convergence of the schemes for the general model when the optimal dual variable regarding the nonlinear operator is non-vanishing. As a representative, the image reconstruction for spectral computed tomography is used to demonstrate the effectiveness of the proposed algorithm framework. By special properties of the concrete problem, we further prove the convergence of these customized schemes when the optimal dual variable regarding the nonlinear operator is vanishing. Finally, the numerical experiments show that the proposed algorithm has good performance on image reconstruction for various data with non-standard scanning configuration.


title: Circumneutral concentrated ammonium acetate solution as water-in-salt electrolyte

abstract: The exponentially growing market of electrochemical energy storage devices requires substitution of flammable, volatile, and toxic electrolytes. The use of Water in salt solutions (WiSE) regarded as green electrolyte might be of interest thanks to an association of key features such as high safety, low cost, wide electrochemical stability, and high ionic conductivity. Here, we report comprehensive chemical-physical study of circumneutral WiSE based on ammonium acetate so as to investigate application in electrochemical energy storage systems, with focus on the effect of pH, density, viscosity, conductivity, and the ESW with salt concentration ranging from 1 to 30 mol/kg . Data are reported and discussed with respect to the structure of the solutions investigated by complemental IR and molecular dynamic study. The study is addressed through the showcase of an asymmetric supercapacitor based on Argan shell-derived carbon electrodes tested at temperatures ranging from -10 to 80 {\deg}C.


title: Theory Closing Talk

abstract: In this talk I make some remarks about the search for the origin of the electroweak scale.


title: Adversarial Mixing Policy for Relaxing Locally Linear Constraints in Mixup

abstract: Mixup is a recent regularizer for current deep classification networks. Through training a neural network on convex combinations of pairs of examples and their labels, it imposes locally linear constraints on the model's input space. However, such strict linear constraints often lead to under-fitting which degrades the effects of regularization. Noticeably, this issue is getting more serious when the resource is extremely limited. To address these issues, we propose the Adversarial Mixing Policy (AMP), organized in a min-max-rand formulation, to relax the Locally Linear Constraints in Mixup. Specifically, AMP adds a small adversarial perturbation to the mixing coefficients rather than the examples. Thus, slight non-linearity is injected in-between the synthetic examples and synthetic labels. By training on these data, the deep networks are further regularized, and thus achieve a lower predictive error rate. Experiments on five text classification benchmarks and five backbone models have empirically shown that our methods reduce the error rate over Mixup variants in a significant margin (up to 31.3%), especially in low-resource conditions (up to 17.5%).


title: Systematic study of two-proton radioactivity half-lives within the two-potential approach with Skyrme-Hartree-Fock

abstract: In this work, we systematically study the two-proton($2p$) radioactivity half-lives using the two-potential approach while the nuclear potential is obtained by using Skyrme-Hartree-Fock approach with the Skyrme effective interaction of {SLy8}. For true $2p$ radioactivity($Q_{2p}$ $>$ 0 and $Q_p$ $< $0, where the $Q_p$ and $Q_{2p}$ are the released energy of the one-proton and two-proton radioactivity), the standard deviation between the experimental half-lives and our theoretical calculations is {0.701}. In addition, we extend this model to predict the half-lives of 15 possible $2p$ radioactivity candidates with $Q_{2p}$ $>$ 0 taken from the evaluated atomic mass table AME2016. The calculated results indicate that a clear linear relationship between the logarithmic $2p$ radioactivity half-lives $\rm{log}_{10}T_{1/2}$ and coulomb parameters [ ($Z_{d}^{0.8}$+$l^{0.25}$)$Q_{2p}^{-1/2}$] considered the effect of orbital angular momentum proposed by Liu $et$ $al$ [Chin. Phys. C \textbf{45}, 024108 (2021)] is also existed. For comparison, the generalized liquid drop model(GLDM), the effective liquid drop model(ELDM) and Gamow-like model are also used. Our predicted results are consistent with the ones obtained by the other models.


title: Continuous-wave stability and multi-pulse structures in a universal Complex Ginzburg-Landau model for passively mode-locked lasers with saturable absorber

abstract: The dynamics and stability of continuous-wave and multi-pulse structures are studied theoretically, for a generalized model of passively mode-locked fiber laser with an arbitrary nonlinearity. The model is characterized by a complex Ginzburg-Landau equation with saturable nonlinearity of a general form ($I^m/(1+\Gamma I)^n$), where $I$ is the field intensity, $m$ and $n$ are two positive real numbers and $\Gamma$ is the optical field saturation power. The analysis of fixed-point solutions of the governing equations, reveals an interesting loci of singular points in the amplitude-frequency plane consisting of zero, one or two fixed points depending upon the values of $m$ and $n$. The stability of continuous waves is analyzed within the framework of the modulational-instability theory, results demonstrate a bifurcation in the continuous-wave amplitude growth rate and propagation constant characteristic of multi-periodic wave structures. In the full nonlinear regime these multi-periodic wave structures turn out to be multi-pulse trains, unveiled via numerical simulations of the model nonlinear equation the rich variety of which is highlighted by considering different combinations of values for the pair ($m$,$n$). Results are consistent with previous analyses of the dynamics of multi-pulse structures in several contexts of passively mode-locked lasers with saturable absorber, as well as with predictions about the existence of multi-pulse structures and bound-state solitons in optical fibers with strong optical nonlinearity such as cubic-quintic and saturable nonlinearities.


title: Back to Basics: Deep Reinforcement Learning in Traffic Signal Control

abstract: In this paper we revisit some of the fundamental premises for a reinforcement learning (RL) approach to self-learning traffic lights. We propose RLight, a combination of choices that offers robust performance and good generalization to unseen traffic flows. In particular, our main contributions are threefold: our lightweight and cluster-aware state representation leads to improved performance; we reformulate the Markov Decision Process (MDP) such that it skips redundant timesteps of yellow light, speeding up learning by 30%; and we investigate the action space and provide insight into the difference in performance between acyclic and cyclic phase transitions. Additionally, we provide insights into the generalisation of the methods to unseen traffic. Evaluations using the real-world Hangzhou traffic dataset show that RLight outperforms state-of-the-art rule-based and deep reinforcement learning algorithms, demonstrating the potential of RL-based methods to improve urban traffic flows.


title: {\alpha}-Indirect Control in Onion-like Networks

abstract: Tens of thousands of parent companies control millions of subsidiaries through long chains of intermediary entities in global corporate networks. Conversely, tens of millions of entities are directly held by sole owners. We propose an algorithm for identification of ultimate controlling entities in such networks that unifies direct and indirect control and allows for continuous interpolation between the two concepts via a factor damping long paths. By exploiting onion-like properties of ownership networks the algorithm scales linearly with the network size and handles circular ownership by design. We apply it to the universe of 4.2 mln UK companies and 4 mln of their holders to understand the distribution of control in the country. Furthermore, we provide the first independent evaluation of the control identification results. We reveal that the proposed $\alpha$-ICON algorithm identifies more than 96% of beneficiary entities from the evaluation set and supersedes the existing approaches reported in the literature. We refer the superiority of $\alpha$-ICON algorithm to its ability to correctly identify the parents long away from their subsidiaries in the network.


title: The disconnectedness of certain sets defined after uni-variate polynomials

abstract: We consider the set of monic real univariate polynomials of a given degree $d$ with non-vanishing coefficients, with given signs of the coefficients and with given quantities $pos$ of their positive and $neg$ of their negative roots (all roots are distinct). For $d=6$ and for signs of the coefficients $(+,-,+,+,+,-,+)$, we prove that the set of such polynomials having two positive, two negative and two complex conjugate roots, is not connected. For $pos+neg\leq 3$ and for any $d$, we give the exhaustive answer to the question for which signs of the coefficients there exist polynomials with such values of $pos$ and $neg$.


title: Residual viscosity stabilized RBF-FD methods for solving nonlinear conservation laws

abstract: In this paper, we solve nonlinear conservation laws using the radial basis function generated finite difference (RBF-FD) method. Nonlinear conservation laws have solutions that entail strong discontinuities and shocks, which give rise to numerical instabilities when the solution is approximated by a numerical method. We introduce a residual-based artificial viscosity (RV) stabilization framework adjusted to the RBF-FD method, where the residual of the conservation law adaptively locates discontinuities and shocks. The RV stabilization framework is applied to the collocation RBF-FD method and the oversampled RBF-FD method. Computational tests confirm that the stabilized methods are reliable and accurate in solving scalar conservation laws and conservation law systems such as compressible Euler equations.


title: Unbounded $M$-weakly and unbounded $L$-weakly compact operators

abstract: We introduce the class of unbounded $M$-weakly operators and the class of unbounded $L$-weakly compact operators. We investigate some properties for these new classification of operators and we study relation between them and $M$-weakly compact and $L$-weakly compact operators. We also present an operator characterization of Banach lattices with order continuous norm. \keywords{unbounded $M$-weakly compact \and unbounded $L$-weakly compact \and unbounded norm convergence \and $M$-weakly compact \and $L$-weakly compact


title: Transformer-based Language Models for Factoid Question Answering at BioASQ9b

abstract: In this work, we describe our experiments and participating systems in the BioASQ Task 9b Phase B challenge of biomedical question answering. We have focused on finding the ideal answers and investigated multi-task fine-tuning and gradual unfreezing techniques on transformer-based language models. For factoid questions, our ALBERT-based systems ranked first in test batch 1 and fourth in test batch 2. Our DistilBERT systems outperformed the ALBERT variants in test batches 4 and 5 despite having 81% fewer parameters than ALBERT. However, we observed that gradual unfreezing had no significant impact on the model's accuracy compared to standard fine-tuning.


title: Cyclic hyperbolicity in CAT(0) cube complexes

abstract: It is known that a cocompact special group $G$ does not contain $\mathbb{Z} \times \mathbb{Z}$ if and only if it is hyperbolic; and it does not contain $\mathbb{F}_2 \times \mathbb{Z}$ if and only if it is toric relatively hyperbolic. Pursuing in this direction, we show that $G$ does not contain $\mathbb{F}_2 \times \mathbb{F}_2$ if and only if it is weakly hyperbolic relative to cyclic subgroups, or cyclically hyperbolic for short. This observation motivates the study of cyclically hyperbolic groups, which we initiate in the class of groups acting geometrically on CAT(0) cube complexes. Given such a group $G$, we first prove a structure theorem: $G$ virtually splits as the direct sum of a free abelian group and an acylindrically hyperbolic cubulable group. Next, we prove a strong Tits alternative: every subgroup $H \leq G$ either is virtually abelian or it admits a series $H=H_0 \rhd H_1 \rhd \cdots \rhd H_k$ where $H_k$ is acylindrically hyperbolic and where $H_i/H_{i+1}$ is finite or free abelian. As a consequence, $G$ is SQ-universal and it cannot contain subgroups such that products of free groups and virtually simple groups.


title: Thermodynamics and transport of holographic nodal line semimetals

abstract: We study various thermodynamic and transport properties of a holographic model of a nodal line semimetal (NLSM) at finite temperature, including the quantum phase transition to a topologically trivial phase, with Dirac semimetal-like conductivity. At zero temperature, composite fermion spectral functions obtained from holography are known to exhibit multiple Fermi surfaces. Similarly, for the holographic NLSM we observe multiple nodal lines instead of just one. We show, however, that as the temperature is raised these nodal lines broaden and disappear into the continuum one by one, so there is a finite range of temperatures for which there is only a single nodal line visible in the spectrum. We compute several transport coefficients in the holographic NLSM as a function of temperature, namely the charge and thermal conductivities, and the shear viscosities. By adding a new non-linear coupling to the model we are able to control the low frequency limit of the electrical conductivity in the direction orthogonal to the plane of the nodal line, allowing us to better match the conductivity of real NLSMs. The boundary quantum field theory is anisotropic and therefore has explicitly broken Lorentz invariance, which leads to a stress tensor that is not symmetric. This has important consequences for the energy and momentum transport: the thermal conductivity at vanishing charge density is not simply fixed by a Ward identity, and there are a much larger number of independent shear viscosities than in a Lorentz-invariant system.


title: Exceeding the limits of algorithmic self-calibration in super-resolution imaging

abstract: Fourier ptychographic microscopy is a computational imaging technique that provides quantitative phase information and high resolution over a large field-of-view. Although the technique presents numerous advantages over conventional microscopy, model mismatch due to unknown optical aberrations can significantly limit reconstruction quality. Many attempts to address this issue rely on embedding pupil recovery into the reconstruction algorithm. In this paper we demonstrate the limitations of a purely algorithmic approach and evaluate the merits of implementing a simple, dedicated calibration procedure. In simulations, we find that for a target sample reconstruction error, we can image without any aberration corrections up to a maximum aberration magnitude of $\lambda$/40. When we use algorithmic self-calibration, we can increase the aberration magnitude up to $\lambda$/10, and with our in situ speckle calibration technique, this working range is extended further to a maximum aberration magnitude of $\lambda$/3. Hence, one can trade-off complexity for accuracy by using a separate calibration process, which is particularly useful for larger aberrations.


title: On Characterization of Finite Geometric Distributive Lattices

abstract: A Lattice is a partially ordered set where both least upper bound and greatest lower bound of any pair of elements are unique and exist within the set. K\"{o}tter and Kschischang proved that codes in the linear lattice can be used for error and erasure-correction in random networks. Codes in the linear lattice have previously been shown to be special cases of codes in modular lattices. Two well known classifications of semimodular lattices are geometric and distributive lattices. Most of the frequently used coding spaces are examples of either or both. We have identified the unique criterion which makes a geometric lattice distributive, thus characterizing all finite geometric distributive lattices. Our characterization helps to prove a conjecture regarding the maximum size of a distributive sublattice of a finite geometric lattice and identify the maximal case. The Whitney numbers of the class of geometric distributive lattices are also calculated. We present a few other applications of this unique characterization to derive certain results regarding linearity and complements in the linear lattice.


title: A novel hotspot of gelsolin instability and aggregation propensity triggers a new mechanism of amyloidosis

abstract: The multidomain protein gelsolin (GSN) is composed of six homologous modules, sequentially named G1 to G6. Single point substitutions in this protein are responsible for AGel amyloidosis, a hereditary disease characterized by progressive corneal lattice dystrophy, cutis laxa, and polyneuropathy. Several different amyloidogenic variants of GSN have been identified over the years, but only the most common D187N/Y mutants, in G2, have been thoroughly characterized, and the underlying functional mechanistic link between mutation, altered protein structure, susceptibility to aberrant furin cleavage and aggregative potential resolved. Little is known about the recently identified mutations A551P, E553K and M517R hosted at the interface between G4 and G5, whose aggregation process likely follows an alternative pathway. We demonstrate that these three substitutions impair temperature and pressure stability of GSN but do not increase its susceptibility to furin cleavage, the first event of the canonical aggregation pathway. The variants are also characterized by a higher tendency to aggregate in the unproteolysed forms and show a higher proteotoxicity in a C. elegans-based assay. Structural studies point to a destabilization of the interface between G4 and G5 due to three different structural determinants: beta-strand breaking, steric hindrance and/or charge repulsion, all implying the impairment of interdomain contacts. All available evidence suggests that the rearrangement of the protein global architecture triggers a furin-independent aggregation of the protein, supporting the existence of a non-canonical pathway of gelsolin amyloidosis pathogenesis.


title: Particles Multiplicity Based on Rapidity in Landau and Artificial Neural Network(ANN) Models

abstract: ANN model is used to estimate the multiplicity per rapidity for charged pions and kaons observed in various high-energy experiments from central Au+Au collisions with energies ranging from 2-200 GeV, and then compared to available experimental data, including RHIC-BRAHMS, and the future facilities at NICA and FAIR. We also used Landau hydrodynamical approach, which has a better describtion for the evolution of hot and dense matter produced in ultra-relativistic heavy-ion collisions. The approach is fitted to both results estimated from experiment and ANN simulation. We noticed that the Landau model accurately reproduces the entire range of multiplicity per rapidity for all created particles at all energies. Also ANN model can reproduce the multiplicity per rapidity very well for all considered particles.


title: Fundamental modes of a trapped probe photon in optical fibers conveying periodic pulse trains

abstract: Wave modes induced by cross-phase reshaping of a probe photon in the guiding structure of a periodic train of temporal pulses are investigated theoretically with emphasis on exact solutions to the wave equation for the probe. The study has direct connection with recent advances on the issue of light control by light, the focus being on the trapping of a low-power probe by a temporal sequence of periodically matched high-power pulses of a dispersion-managed optical fiber. The problem is formulated in terms of the nonlinear optical fiber equation with averaged dispersion, coupled to a linear equation for the probe including a cross-phase modulation term. Shape-preserving modes which are robust against the dispersion are shown to be induced in the probe, they form a family of mutually orthogonal solitons the characteristic features of which are determined by the competition between the self-phase and cross-phase effects. Considering a specific context of this competition, the theory predicts two degenerate modes representing a train of bright signals and one mode which describes a train of dark signals. When the walk-off between the pump and probe is taken into consideration, these modes have finite-momentum envelopes and none of them is totally transparent vis-\`a-vis the optical pump soliton.


title: FCA: Learning a 3D Full-coverage Vehicle Camouflage for Multi-view Physical Adversarial Attack

abstract: Physical adversarial attacks in object detection have attracted increasing attention. However, most previous works focus on hiding the objects from the detector by generating an individual adversarial patch, which only covers the planar part of the vehicle's surface and fails to attack the detector in physical scenarios for multi-view, long-distance and partially occluded objects. To bridge the gap between digital attacks and physical attacks, we exploit the full 3D vehicle surface to propose a robust Full-coverage Camouflage Attack (FCA) to fool detectors. Specifically, we first try rendering the nonplanar camouflage texture over the full vehicle surface. To mimic the real-world environment conditions, we then introduce a transformation function to transfer the rendered camouflaged vehicle into a photo realistic scenario. Finally, we design an efficient loss function to optimize the camouflage texture. Experiments show that the full-coverage camouflage attack can not only outperform state-of-the-art methods under various test cases but also generalize to different environments, vehicles, and object detectors. The code of FCA will be available at: https://idrl-lab.github.io/Full-coverage-camouflage-adversarial-attack/.


title: Multiagent Multimodal Categorization for Symbol Emergence: Emergent Communication via Interpersonal Cross-modal Inference

abstract: This paper describes a computational model of multiagent multimodal categorization that realizes emergent communication. We clarify whether the computational model can reproduce the following functions in a symbol emergence system, comprising two agents with different sensory modalities playing a naming game. (1) Function for forming a shared lexical system that comprises perceptual categories and corresponding signs, formed by agents through individual learning and semiotic communication between agents. (2) Function to improve the categorization accuracy in an agent via semiotic communication with another agent, even when some sensory modalities of each agent are missing. (3) Function that an agent infers unobserved sensory information based on a sign sampled from another agent in the same manner as cross-modal inference. We propose an interpersonal multimodal Dirichlet mixture (Inter-MDM), which is derived by dividing an integrative probabilistic generative model, which is obtained by integrating two Dirichlet mixtures (DMs). The Markov chain Monte Carlo algorithm realizes emergent communication. The experimental results demonstrated that Inter-MDM enables agents to form multimodal categories and appropriately share signs between agents. It is shown that emergent communication improves categorization accuracy, even when some sensory modalities are missing. Inter-MDM enables an agent to predict unobserved information based on a shared sign.


title: Target Languages (vs. Inductive Biases) for Learning to Act and Plan

abstract: Recent breakthroughs in AI have shown the remarkable power of deep learning and deep reinforcement learning. These developments, however, have been tied to specific tasks, and progress in out-of-distribution generalization has been limited. While it is assumed that these limitations can be overcome by incorporating suitable inductive biases, the notion of inductive biases itself is often left vague and does not provide meaningful guidance. In the paper, I articulate a different learning approach where representations do not emerge from biases in a neural architecture but are learned over a given target language with a known semantics. The basic ideas are implicit in mainstream AI where representations have been encoded in languages ranging from fragments of first-order logic to probabilistic structural causal models. The challenge is to learn from data the representations that have traditionally been crafted by hand. Generalization is then a result of the semantics of the language. The goals of this paper are to make these ideas explicit, to place them in a broader context where the design of the target language is crucial, and to illustrate them in the context of learning to act and plan. For this, after a general discussion, I consider learning representations of actions, general policies, and subgoals ("intrinsic rewards"). In these cases, learning is formulated as a combinatorial problem but nothing prevents the use of deep learning techniques instead. Indeed, learning representations over languages with a known semantics provides an account of what is to be learned, while learning representations with neural nets provides a complementary account of how representations can be learned. The challenge and the opportunity is to bring the two together.