title: Multi-Level Visual Similarity Based Personalized Tourist Attraction Recommendation Using Geo-Tagged Photos

abstract: Geo-tagged photo based tourist attraction recommendation can discover users' travel preferences from their taken photos, so as to recommend suitable tourist attractions to them. However, existing visual content based methods cannot fully exploit the user and tourist attraction information of photos to extract visual features, and do not differentiate the significances of different photos. In this paper, we propose multi-level visual similarity based personalized tourist attraction recommendation using geo-tagged photos (MEAL). MEAL utilizes the visual contents of photos and interaction behavior data to obtain the final embeddings of users and tourist attractions, which are then used to predict the visit probabilities. Specifically, by crossing the user and tourist attraction information of photos, we define four visual similarity levels and introduce a corresponding quintuplet loss to embed the visual contents of photos. In addition, to capture the significances of different photos, we exploit the self-attention mechanism to obtain the visual representations of users and tourist attractions. We conducted experiments on a dataset crawled from Flickr, and the experimental results proved the advantage of this method.


title: Magnetically supramassive neutron stars

abstract: It is commonly believed that neutron stars exceeding the maximum mass limit for stability could be formed in the aftermath of binary neutron star mergers, enjoying a short life of metastability before losing centrifugal support and collapsing to a black hole. It is suggested here that a similar scenario could take place when the remnant's excess mass is supported by an ultra-strong $(\gtrsim 10^{17}\,\mbox{G})$ magnetic field that could be generated during, and shortly after, coalescence. We show that such 'magnetically supramassive' neutron stars could stave off collapse and survive for a few years before their magnetic energy is sufficiently dissipated due to ambipolar diffusion. In addition, we speculate on multi-messenger signatures of such objects and discuss the robustness of our results against limitations placed by neutron superfluidity and magneto-thermal evolution.


title: The topology of $SLE_{\kappa}$ is random for $\kappa >4$

abstract: We study the topology of $SLE$ curves for $\kappa > 4$. More precisely, we show that, a.s., there is no homeomorphism $\Phi: \overline{\mathbb{H}} \rightarrow \overline{\mathbb{H}}$, taking the range of one independent $SLE$ curve to another for $\kappa \in (4,8)$. Furthermore, we extend the result to $\kappa \geq 8$ by showing that there is no homeomorphism taking one $SLE$ curve to another, when viewed as curves modulo parametrization.


title: A Note on Occur-Check

abstract: Most known results on avoiding the occur-check are based on the notion of "not subject to occur-check" (NSTO). It means that unification is performed only on such pairs of atoms for which the occur-check never succeeds in any run of a nondeterministic unification algorithm. Here we show that this requirement is too strong. We show how to weaken it, and present some related sufficient conditions under which the occur-check may be safely omitted. We show examples for which the proposed approach provides more general results than the approaches based on well-moded and nicely moded programs (this includes cases to which the latter approaches are inapplicable).


title: Automata Techniques for Temporal Answer Set Programming

abstract: Temporal and dynamic extensions of Answer Set Programming (ASP) have played an important role in addressing dynamic problems, as they allow the use of temporal operators to reason with dynamic scenarios in a very effective way. In my Ph.D. research, I intend to exploit the relationship between automata theory and dynamic logic to add automata-based techniques to the ASP solver CLINGO helping us to deal with theses type of problems.


title: Gaussian discrepancy: a probabilistic relaxation of vector balancing

abstract: We introduce a novel relaxation of combinatorial discrepancy called Gaussian discrepancy, whereby binary signings are replaced with correlated standard Gaussian random variables. This relaxation effectively reformulates an optimization problem over the Boolean hypercube into one over the space of correlation matrices. We show that Gaussian discrepancy is a tighter relaxation than the previously studied vector and spherical discrepancy problems, and we construct a fast online algorithm that achieves a version of the Banaszczyk bound for Gaussian discrepancy. This work also raises new questions such as the Koml\'{o}s conjecture for Gaussian discrepancy, which may shed light on classical discrepancy problems.


title: Quantitative and Stream Extensions of Answer Set Programming

abstract: Answer Set Programming has separately been extended with constraints, to the streaming domain, and with capabilities to reason over the quantities associated with answer sets. We propose the introduction and analysis of a general framework that incorporates all three directions of extension by exploiting the strengths of Here-and-There Logic and Weighted Logic.


title: AdaLoss: A computationally-efficient and provably convergent adaptive gradient method

abstract: We propose a computationally-friendly adaptive learning rate schedule, "AdaLoss", which directly uses the information of the loss function to adjust the stepsize in gradient descent methods. We prove that this schedule enjoys linear convergence in linear regression. Moreover, we provide a linear convergence guarantee over the non-convex regime, in the context of two-layer over-parameterized neural networks. If the width of the first-hidden layer in the two-layer networks is sufficiently large (polynomially), then AdaLoss converges robustly \emph{to the global minimum} in polynomial time. We numerically verify the theoretical results and extend the scope of the numerical experiments by considering applications in LSTM models for text clarification and policy gradients for control problems.


title: Syntactic Requirements for Well-defined Hybrid Probabilistic Logic Programs

abstract: Hybrid probabilistic logic programs can represent several scenarios thanks to the expressivity of Logic Programming extended with facts representing discrete and continuous distributions. The semantics for this type of programs is crucial since it ensures that a probability can be assigned to every query. Here, following one recent semantics proposal, we illustrate a concrete syntax, and we analyse the syntactic requirements needed to preserve the well-definedness.


title: How to Split a Logic Program

abstract: Answer Set Programming (ASP) is a successful method for solving a range of real-world applications. Despite the availability of fast ASP solvers, computing answer sets demands a very large computational power, since the problem tackled is in the second level of the polynomial hierarchy. A speed-up in answer set computation may be attained, if the program can be split into two disjoint parts, bottom and top. Thus, the bottom part is evaluated independently of the top part, and the results of the bottom part evaluation are used to simplify the top part. Lifschitz and Turner have introduced the concept of a splitting set, i.e., a set of atoms that defines the splitting. In this paper, We show that the problem of computing a splitting set with some desirable properties can be reduced to a classic Search Problem and solved in polynomial time. This allows us to conduct experiments on the size of the splitting set in various programs and lead to an interesting discovery of a source of complication in stable model computation. We also show that for Head-Cycle-Free programs, the definition of splitting sets can be adjusted to allow splitting of a broader class of programs.


title: Fixpoint Semantics for Recursive SHACL

abstract: SHACL is a W3C-proposed language for expressing structural constraints on RDF graphs. The recommendation only specifies semantics for non-recursive SHACL; recently, some efforts have been made to allow recursive SHACL schemas. In this paper, we argue that for defining and studying semantics of recursive SHACL, lessons can be learned from years of research in non-monotonic reasoning. We show that from a SHACL schema, a three-valued semantic operator can directly be obtained. Building on Approximation Fixpoint Theory (AFT), this operator immediately induces a wide variety of semantics, including a supported, stable, and well-founded semantics, related in the expected ways. By building on AFT, a rich body of theoretical results becomes directly available for SHACL. As such, the main contribution of this short paper is providing theoretical foundations for the study of recursive SHACL, which can later enable an informed decision for an extension of the W3C recommendation.


title: Weighted Conditional EL{^}bot Knowledge Bases with Integer Weights: an ASP Approach

abstract: Weighted knowledge bases for description logics with typicality have been recently considered under a "concept-wise" multipreference semantics (in both the two-valued and fuzzy case), as the basis of a logical semantics of Multilayer Perceptrons. In this paper we consider weighted conditional EL^bot knowledge bases in the two-valued case, and exploit ASP and asprin for encoding concept-wise multipreference entailment for weighted KBs with integer weights.


title: APIA: An Architecture for Policy-Aware Intentional Agents

abstract: This paper introduces the APIA architecture for policy-aware intentional agents. These agents, acting in changing environments, are driven by intentions and yet abide by domain-relevant policies. This work leverages the AIA architecture for intention-driven intelligent agents by Blount, Gelfond, and Balduccini. It expands AIA with notions of policy compliance for authorization and obligation policies specified in the language AOPL by Gelfond and Lobo. APIA introduces various agent behavior modes, corresponding to different levels of adherence to policies. APIA reasoning tasks are reduced to computing answer sets using the Clingo solver and its Python API.


title: DMAPF: A Decentralized and Distributed Solver for Multi-Agent Path Finding Problem with Obstacles

abstract: Multi-Agent Path Finding (MAPF) is a problem of finding a sequence of movements for agents to reach their assigned location without collision. Centralized algorithms usually give optimal solutions, but have difficulties to scale without employing various techniques - usually with a sacrifice of optimality; but solving MAPF problems with the number of agents greater than a thousand remains a challenge nevertheless. To tackle the scalability issue, we present DMAPF - a decentralized and distributed MAPF solver, which is a continuation of our recently published work, ros-dmapf. We address the issues of ros-dmapf where it (i) only works in maps without obstacles; and (ii) has a low success rate with dense maps. Given a MAPF problem, both ros-dmapf and DMAPF divide the map spatially into subproblems, but the latter further divides each subproblem into disconnected regions called areas. Each subproblem is assigned to a distributed solver, which then individually creates an abstract plan - a sequence of areas that an agent needs to visit - for each agent in it, and interleaves agent migration with movement planning. Answer Set Programming, which is known for its performance in small but complex problems, is used in many parts including problem division, abstract planning, border assignment for the migration, and movement planning. Robot Operating System is used to facilitate communication between the solvers and to enable the opportunity to integrate with robotic systems. DMAPF introduces a new interaction protocol between the solvers, and mechanisms that together result in a higher success rate and better solution quality without sacrificing much of the performance. We implement and experimentally validate DMAPF by comparing it with other state-of-the-art MAPF solvers and the results show that our system achieves better scalability.


title: Refining the Semantics of Epistemic Specifications

abstract: Answer set programming (ASP) is an efficient problem-solving approach, which has been strongly supported both scientifically and technologically by several solvers, ongoing active research, and implementations in many different fields. However, although researchers acknowledged long ago the necessity of epistemic operators in the language of ASP for better introspective reasoning, this research venue did not attract much attention until recently. Moreover, the existing epistemic extensions of ASP in the literature are not widely approved either, due to the fact that some propose unintended results even for some simple acyclic epistemic programs, new unexpected results may possibly be found, and more importantly, researchers have different reasonings for some critical programs. To that end, Cabalar et al. have recently identified some structural properties of epistemic programs to formally support a possible semantics proposal of such programs and standardise their results. Nonetheless, the soundness of these properties is still under debate, and they are not widely accepted either by the ASP community. Thus, it seems that there is still time to really understand the paradigm, have a mature formalism, and determine the principles providing formal justification of their understandable models. In this paper, we mainly focus on the existing semantics approaches, the criteria that a satisfactory semantics is supposed to satisfy, and the ways to improve them. We also extend some well-known propositions of here-and-there logic (HT) into epistemic HT so as to reveal the real behaviour of programs. Finally, we propose a slightly novel semantics for epistemic ASP, which can be considered as a reflexive extension of Cabalar et al.'s recent formalism called autoepistemic ASP.


title: Generating Explainable Rule Sets from Tree-Ensemble Learning Methods by Answer Set Programming

abstract: We propose a method for generating explainable rule sets from tree-ensemble learners using Answer Set Programming (ASP). To this end, we adopt a decompositional approach where the split structures of the base decision trees are exploited in the construction of rules, which in turn are assessed using pattern mining methods encoded in ASP to extract interesting rules. We show how user-defined constraints and preferences can be represented declaratively in ASP to allow for transparent and flexible rule set generation, and how rules can be used as explanations to help the user better understand the models. Experimental evaluation with real-world datasets and popular tree-ensemble algorithms demonstrates that our approach is applicable to a wide range of classification tasks.


title: Natlog: a Lightweight Logic Programming Language with a Neuro-symbolic Touch

abstract: We introduce Natlog, a lightweight Logic Programming language, sharing Prolog's unification-driven execution model, but with a simplified syntax and semantics. Our proof-of-concept Natlog implementation is tightly embedded in the Python-based deep-learning ecosystem with focus on content-driven indexing of ground term datasets. As an overriding of our symbolic indexing algorithm, the same function can be delegated to a neural network, serving ground facts to Natlog's resolution engine. Our open-source implementation is available as a Python package at https://pypi.org/project/natlog/ .


title: exp(ASPc) : Explaining ASP Programs with Choice Atoms and Constraint Rules

abstract: We present an enhancement of exp(ASP), a system that generates explanation graphs for a literal l - an atom a or its default negation ~a - given an answer set A of a normal logic program P, which explain why l is true (or false) given A and P. The new system, exp(ASPc), differs from exp(ASP) in that it supports choice rules and utilizes constraint rules to provide explanation graphs that include information about choices and constraints.


title: Modeling and Solving Graph Synthesis Problems Using SAT-Encoded Reachability Constraints in Picat

abstract: Many constraint satisfaction problems involve synthesizing subgraphs that satisfy certain reachability constraints. This paper presents programs in Picat for four problems selected from the recent LP/CP programming competitions. The programs demonstrate the modeling capabilities of the Picat language and the solving efficiency of the cutting-edge SAT solvers empowered with effective encodings.


title: A Logic-based Multi-agent System for Ethical Monitoring and Evaluation of Dialogues

abstract: Dialogue Systems are tools designed for various practical purposes concerning human-machine interaction. These systems should be built on ethical foundations because their behavior may heavily influence a user (think especially about children). The primary objective of this paper is to present the architecture and prototype implementation of a Multi Agent System (MAS) designed for ethical monitoring and evaluation of a dialogue system. A prototype application, for monitoring and evaluation of chatting agents' (human/artificial) ethical behavior in an online customer service chat point w.r.t their institution/company's codes of ethics and conduct, is developed and presented. Future work and open issues with this research are discussed.


title: Geolog: Scalable Logic Programming on Spatial Data

abstract: Spatial data is ubiquitous in our data-driven society. The Logic Programming community has been investigating the use of spatial data in different settings. Despite the success of this research, the Geographic Information System (GIS) community has rarely made use of these new approaches. This has mainly two reasons. First, there is a lack of tools that tightly integrate logical reasoning into state-of-the-art GIS software. Second, the scalability of solutions has often not been tested and hence, some solutions might work on toy examples but do not scale well to real-world settings. The two main contributions of this paper are (1) the Relation Based Programming paradigm, expressing rules on relations instead of individual entities, and (2) Geolog, a tool for spatio-logical reasoning that can be installed on top of ArcMap, which is an industry standard GIS. We evaluate our new Relation Based Programming paradigm in four real-world scenarios and show that up to two orders of magnitude in performance gain can be achieved compared to the prevalent Entity Based Programming paradigm.


title: In-plane quasi-single-domain BaTiO$_3$ via interfacial symmetry engineering

abstract: The control of the in-plane domain evolution in ferroelectric thin films is not only critical to understanding ferroelectric phenomena but also to enabling functional device fabrication. However, in-plane polarized ferroelectric thin films typically exhibit complicated multi-domain states, not desirable for optoelectronic device performance. Here we report a strategy combining interfacial symmetry engineering and anisotropic strain to design single-domain, in-plane polarized ferroelectric BaTiO$_3$ thin films. Theoretical calculations predict the key role of the BaTiO$_3$ / PrScO$_3$ (110)$_O$ substrate interfacial environment, where anisotropic strain, monoclinic distortions, and interfacial electrostatic potential stabilize a single-variant spontaneous polarization. A combination of scanning transmission electron microscopy, piezoresponse force microscopy, ferroelectric hysteresis loop measurements, and second harmonic generation measurements directly reveals the stabilization of the in-plane quasi-single-domain polarization state. This work offers design principles for engineering in-plane domains of ferroelectric oxide thin films, which is a prerequisite for high performance optoelectronic devices.


title: DiscASP: A Graph-based ASP System for Finding Relevant Consistent Concepts with Applications to Conversational Socialbots

abstract: We consider the problem of finding relevant consistent concepts in a conversational AI system, particularly, for realizing a conversational socialbot. Commonsense knowledge about various topics can be represented as an answer set program. However, to advance the conversation, we need to solve the problem of finding relevant consistent concepts, i.e., find consistent knowledge in the "neighborhood" of the current topic being discussed that can be used to advance the conversation. Traditional ASP solvers will generate the whole answer set which is stripped of all the associations between the various atoms (concepts) and thus cannot be used to find relevant consistent concepts. Similarly, goal-directed implementations of ASP will only find concepts directly relevant to a query. We present the DiscASP system that will find the partial consistent model that is relevant to a given topic in a manner similar to how a human will find it. DiscASP is based on a novel graph-based algorithm for finding stable models of an answer set program. We present the DiscASP algorithm, its implementation, and its application to developing a conversational socialbot.


title: Generating Concurrent Programs From Sequential Data Structure Knowledge Using Answer Set Programming

abstract: We tackle the problem of automatically designing concurrent data structure operations given a sequential data structure specification and knowledge about concurrent behavior. Designing concurrent code is a non-trivial task even in simplest of cases. Humans often design concurrent data structure operations by transforming sequential versions into their respective concurrent versions. This requires an understanding of the data structure, its sequential behavior, thread interactions during concurrent execution and shared memory synchronization primitives. We mechanize this design process using automated commonsense reasoning. We assume that the data structure description is provided as axioms alongside the sequential code of its algebraic operations. This information is used to automatically derive concurrent code for that data structure, such as dictionary operations for linked lists and binary search trees. Knowledge in our case is expressed using Answer Set Programming (ASP), and we employ deduction and abduction -- just as humans do -- in the reasoning involved. ASP allows for succinct modeling of first order theories of pointer data structures, run-time thread interactions and shared memory synchronization. Our reasoner can systematically make the same judgments as a human reasoner, while constructing provably safe concurrent code. We present several reasoning challenges involved in transforming the sequential data structure into its equivalent concurrent version. All the reasoning tasks are encoded in ASP and our reasoner can make sound judgments to transform sequential code into concurrent code. To the best of our knowledge, our work is the first one to use commonsense reasoning to automatically transform sequential programs into concurrent code. We also have developed a tool that we describe that relies on state-of-the-art ASP solvers and performs the reasoning tasks involved to generate concurrent code.


title: Flexible and Explainable Solutions for Multi-Agent Path Finding Problems

abstract: The multi-agent path finding (MAPF) problem is a combinatorial search problem that aims at finding paths for multiple agents (e.g., robots) in an environment (e.g., an autonomous warehouse) such that no two agents collide with each other, and subject to some constraints on the lengths of paths. The real-world applications of MAPF require flexibility (e.g., solving variations of MAPF) as well as explainability. In this study, both of these challenges are addressed and some flexible and explainable solutions for MAPF and its variants are introduced.


title: Prediction of shear-thickening of particle suspensions in viscoelastic fluids by direct numerical simulation

abstract: To elucidate the key factor for the quantitative prediction of the shear-thickening in suspensions in viscoelastic fluids, direct numerical simulations of many-particle suspensions in a multi-mode Oldroyd-B fluid are performed using the smoothed profile method. Suspension flow under simple shear flow is solved under periodic boundary conditions by using Lees--Edwards boundary conditions for particle dynamics and a time-dependent oblique coordinate system that evolves with mean shear flow for fluid dynamics. Semi-dilute many-particle suspensions up to a particle volume fraction of 0.1 are investigated. The presented numerical results regarding the bulk rheological properties of the shear-thickening behavior agree quantitatively with recent experimental results of semi-dilute suspensions in a Boger fluid. The presented result clarifies that an accurate estimation of the first normal stress difference of the matrix in the shear-rate range where the shear-thickening starts to occur is crucial for the quantitative prediction of the suspension shear-thickening in a Boger fluid matrix at around the Weissenberg number $\rm{Wi}=1$ by an Oldroyd-B model. Additionally, the effect of suspension microstructures on the suspension viscosity is examined. The paper concludes with a discussion on how the flow pattern and the elastic stress development change with the volume fraction and Weissenberg number.


title: Comprehensive Multi-Agent Epistemic Planning

abstract: Over the last few years, the concept of Artificial Intelligence has become central in different tasks concerning both our daily life and several working scenarios. Among these tasks automated planning has always been central in the AI research community. In particular, this manuscript is focused on a specialized kind of planning known as Multi-agent Epistemic Planning (MEP). Epistemic Planning (EP) refers to an automated planning setting where the agent reasons in the space of knowledge/beliefs states and tries to find a plan to reach a desirable state from a starting one. Its general form, the MEP problem, involves multiple agents who need to reason about both the state of the world and the information flows between agents. To tackle the MEP problem several tools have been developed and, while the diversity of approaches has led to a deeper understanding of the problem space, each proposed tool lacks some abilities and does not allow for a comprehensive investigation of the information flows. That is why, the objective of our work is to formalize an environment where a complete characterization of the agents' knowledge/beliefs interaction and update is possible. In particular, we aim to achieve such goal by defining a new action-based language for multi-agent epistemic planning and to implement an epistemic planner based on it. This solver should provide a tool flexible enough to reason on different domains, e.g., economy, security, justice and politics, where considering others' knowledge/beliefs could lead to winning strategies.


title: Rack-Aware MSR Codes with Multiple Erasure Tolerance

abstract: The minimum storage rack-aware regenerating (MSRR) code is a variation of regenerating codes that achieves the optimal repair bandwidth for a single node failure in the rack-aware model. The authors in~\cite{Chen-Barg2019} and~\cite{Zhou-Zhang2021} provided explicit constructions of MSRR codes for all parameters to repair a single failed node. This paper generalizes the results in~\cite{Chen-Barg2019} to the case of multiple node failures. We propose a class of MDS array codes and scalar Reed-Solomon (RS) codes, and show that these codes have optimal repair bandwidth and error resilient capability for multiple node failures in the rack-aware storage model. Besides, our codes keep the same access level as the low-access constructions in~\cite{Chen-Barg2019} and~\cite{Zhou-Zhang2021}.


title: Compilation of Aggregates in ASP

abstract: Answer Set Programming (ASP) is a well-known problem-solving formalism in computational logic. Nowadays, ASP is used in many real world scenarios thanks to ASP solvers. Standard evaluation of ASP programs suffers from an intrinsic limitation, knows as Grounding Bottleneck, due to the grounding of some rules that could fit all the available memory. As a result, there exist instances of real world problems that are untractable using the standard Ground and Solve approach. In order to tackle this problem, different strategies have been proposed. Among them we focus on a recent approach based on compilation of problematic constraints as propagators, which revealed to be very promising but is currently limited to constraints without aggregates. Since aggregates are widely used in ASP, in this paper we extend such an approach also to constraints containing aggregates. Good results, that proof the effectiveness of the proposed approach, have been reached.


title: Product Configuration in Answer Set Programming

abstract: This is a preliminary work on configuration knowledge representation which serves as a foundation for building interactive configuration systems in Answer Set programming (ASP). The major concepts of the product configuration problem are identified and discussed with a bike configuration example. A fact format is developed for expressing product knowledge that is domain-specific and can be mapped from other systems. Finally, a domain-independent ASP encoding is provided that represents the concepts in the configuration problem.


title: Formalisation of Action with Durations in Answer Set Programming

abstract: In this paper, I will discuss the work I am currently doing as a Ph.D. student at the University of Potsdam, under the tutoring of T. Schaub. I'm currently looking into action description in ASP. More precisely, my goal is to explore how to represent actions with durations in ASP, in different contexts. Right now, I'm focused on Multi-Agent Path Finding (MAPF), looking at how to represent speeds for different agents and contexts. Before tackling duration, I wanted to explore and compare different representations of action taking in ASP. For this, I started comparing different simple encodings tackling the MAPF problem. Even in simple code, choices and assumptions have been made in their creations. The objective of my work is to present the consequences of those design decisions in terms of performance and knowledge representation. As far as I know, there is no current research on this topic. Besides that, I'm also exploring different ways to represent duration and to solve related problems. I planed to compare them the same way I described before. I also want this to help me find innovative and effective ways to solve problems with duration.


title: SentiPrompt: Sentiment Knowledge Enhanced Prompt-Tuning for Aspect-Based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) is an emerging fine-grained sentiment analysis task that aims to extract aspects, classify corresponding sentiment polarities and find opinions as the causes of sentiment. The latest research tends to solve the ABSA task in a unified way with end-to-end frameworks. Yet, these frameworks get fine-tuned from downstream tasks without any task-adaptive modification. Specifically, they do not use task-related knowledge well or explicitly model relations between aspect and opinion terms, hindering them from better performance. In this paper, we propose SentiPrompt to use sentiment knowledge enhanced prompts to tune the language model in the unified framework. We inject sentiment knowledge regarding aspects, opinions, and polarities into prompt and explicitly model term relations via constructing consistency and polarity judgment templates from the ground truth triplets. Experimental results demonstrate that our approach can outperform strong baselines on Triplet Extraction, Pair Extraction, and Aspect Term Extraction with Sentiment Classification by a notable margin.


title: Sinoledge: A Knowledge Engine based on Logical Reasoning and Distributed Micro Services

abstract: We propose a knowledge engine called Sinoledge mainly for doctors, physicians, and researchers in medical field to organize thoughts, manage reasoning process, test and deploy to production environments effortlessly. Our proposal can be related to rule engine usually used in business or medical fields. More importantly, our proposal provides a user-friendly interface, an easy-maintain way of organizing knowledge, an understandable testing functionality and a highly available and efficient back-end architecture.


title: Adaptive Ridge-Penalized Functional Local Linear Regression

abstract: We introduce an original method of multidimensional ridge penalization in functional local linear regressions. The nonparametric regression of functional data is extended from its multivariate counterpart, and is known to be sensitive to the choice of $J$, where $J$ is the dimension of the projection subspace of the data. Under multivariate setting, a roughness penalty is helpful for variance reduction. However, among the limited works covering roughness penalty under the functional setting, most only use a single scalar for tuning. Our new approach proposes a class of data-adaptive ridge penalties, meaning that the model automatically adjusts the structure of the penalty according to the data sets. This structure has $J$ free parameters and enables a quadratic programming search for optimal tuning parameters that minimize the estimated mean squared error (MSE) of prediction, and is capable of applying different roughness penalty levels to each of the $J$ basis. The strength of the method in prediction accuracy and variance reduction with finite data is demonstrated through multiple simulation scenarios and two real-data examples. Its asymptotic performance is proved and compared to the unpenalized functional local linear regressions.


title: On the Convexity of a Fragment of Pure Set Theory with Applications within a Nelson-Oppen Framework

abstract: The Satisfiability Modulo Theories (SMT) issue concerns the satisfiability of formulae from multiple background theories, usually expressed in the language of first-order predicate logic with equality. SMT solvers are often based on variants of the Nelson-Oppen combination method, a solver for the quantifier-free fragment of the combination of theories with disjoint signatures, via cooperation among their decision procedures. When each of the theories to be combined by the Nelson-Oppen method is convex (that is, any conjunction of its literals can imply a disjunction of equalities only when it implies at least one of the equalities) and decidable in polynomial time, the running time of the combination procedure is guaranteed to be polynomial in the size of the input formula. In this paper, we prove the convexity of a fragment of Zermelo-Fraenkel set theory, called Multi-Level Syllogistic, most of whose polynomially decidable fragments we have recently characterized.


title: On the size of disjunctive formulas in the $\mu$-calculus

abstract: A key result in the theory of the modal mu-calculus is the disjunctive normal form theorem by Janin & Walukiewicz, stating that every mu-calculus formula is semantically equivalent to a so-called disjunctive formula. These disjunctive formulas have good computational properties and play a pivotal role in the theory of the modal mu-calculus. It is therefore an interesting question what the best normalisation procedure is for rewriting a formula into an equivalent disjunctive formula of minimal size. The best constructions that are known from the literature are automata-theoretic in nature and consist of a guarded transformation, i.e., the constructing of an equivalent guarded alternating automaton from a mu-calculus formula, followed by a Simulation Theorem stating that any such alternating automaton can be transformed into an equivalent non-deterministic one. Both of these transformations are exponential constructions, making the best normalisation procedure doubly exponential. Our key contribution presented here shows that the two parts of the normalisation procedure can be integrated, leading to a procedure that is single-exponential in the closure size of the formula.


title: Adaptive Hierarchical Dual Consistency for Semi-Supervised Left Atrium Segmentation on Cross-Domain Data

abstract: Semi-supervised learning provides great significance in left atrium (LA) segmentation model learning with insufficient labelled data. Generalising semi-supervised learning to cross-domain data is of high importance to further improve model robustness. However, the widely existing distribution difference and sample mismatch between different data domains hinder the generalisation of semi-supervised learning. In this study, we alleviate these problems by proposing an Adaptive Hierarchical Dual Consistency (AHDC) for the semi-supervised LA segmentation on cross-domain data. The AHDC mainly consists of a Bidirectional Adversarial Inference module (BAI) and a Hierarchical Dual Consistency learning module (HDC). The BAI overcomes the difference of distributions and the sample mismatch between two different domains. It mainly learns two mapping networks adversarially to obtain two matched domains through mutual adaptation. The HDC investigates a hierarchical dual learning paradigm for cross-domain semi-supervised segmentation based on the obtained matched domains. It mainly builds two dual-modelling networks for mining the complementary information in both intra-domain and inter-domain. For the intra-domain learning, a consistency constraint is applied to the dual-modelling targets to exploit the complementary modelling information. For the inter-domain learning, a consistency constraint is applied to the LAs modelled by two dual-modelling networks to exploit the complementary knowledge among different data domains. We demonstrated the performance of our proposed AHDC on four 3D late gadolinium enhancement cardiac MR (LGE-CMR) datasets from different centres and a 3D CT dataset. Compared to other state-of-the-art methods, our proposed AHDC achieved higher segmentation accuracy, which indicated its capability in the cross-domain semi-supervised LA segmentation.


title: Fast DAQ system with image rejection for axion dark matter searches

abstract: A fast data acquisition (DAQ) system for axion dark matter searches utilizing a microwave resonant cavity, also known as axion haloscope searches, has been developed with a two-channel digitizer that can sample 16-bit amplitudes at rates up to 180 MSamples/s. First, we realized a practical DAQ efficiency of greater than 99% for a single DAQ channel, where the DAQ process includes the online fast Fourier transforms (FFTs). Using an IQ mixer and two parallel DAQ channels, we then also implemented a software-based image rejection without losing the DAQ efficiency. This work extends our continuing effort to improve the figure of merit in axion haloscope searches, the scanning rate.


title: Finite Model Property and Bisimulation for LFD

abstract: Recently, Baltag and van Benthem introduced a decidable logic of functional dependence (LFD) that extends the logic of Cylindrical Relativized Set Algebras (CRS) with atomic local dependence statements. Its semantics can be given in terms of generalised assignment models or their modal counterparts, hence the logic is both a first-order and a modal logic. We show that LFD has the finite model property (FMP) using Herwig's theorem on extending partial isomorphisms, and prove a bisimulation invariance theorem characterizing LFD as a fragment of first-order logic.


title: Superresolution microscopy of optical fields using tweezer-trapped single atoms

abstract: We realize a scanning probe microscope using single trapped $^{87}$Rb atoms to measure optical fields with subwavelength spatial resolution. Our microscope operates by detecting fluorescence from a single atom driven by near-resonant light and determining the ac Stark shift of an atomic transition from other local optical fields via the change in the fluorescence rate. We benchmark the microscope by measuring two standing-wave Gaussian modes of a Fabry-P\'{e}rot resonator with optical wavelengths of 1560 nm and 781 nm. We attain a spatial resolution of 300 nm, which is superresolving compared to the limit set by the 780 nm wavelength of the detected light. Sensitivity to short length scale features is enhanced by adapting the sensor to characterize an optical field via the force it exerts on the atom.


title: Reconfigurable Broadcast Networks and Asynchronous Shared-Memory Systems are Equivalent

abstract: We show the equivalence of two distributed computing models, namely reconfigurable broadcast networks (RBN) and asynchronous shared-memory systems (ASMS), that were introduced independently. Both RBN and ASMS are systems in which a collection of anonymous, finite-state processes run the same protocol. In RBN, the processes communicate by selective broadcast: a process can broadcast a message which is received by all of its neighbors, and the set of neighbors of a process can change arbitrarily over time. In ASMS, the processes communicate by shared memory: a process can either write to or read from a shared register. Our main result is that RBN and ASMS can simulate each other, i.e. they are equivalent with respect to parameterized reachability, where we are given two (possibly infinite) sets of configurations C and C' defined by upper and lower bounds on the number of processes in each state and we would like to decide if some configuration in C can reach some configuration in C'. Using this simulation equivalence, we transfer results of RBN to ASMS and vice versa. Finally, we show that RBN and ASMS can simulate a third distributed model called immediate observation (IO) nets. Moreover, for a slightly stronger notion of simulation (which is satisfied by all the simulations given in this paper), we show that IO nets cannot simulate RBN.


title: Adapting to the Behavior of Environments with Bounded Memory

abstract: We study the problem of synthesizing implementations from temporal logic specifications that need to work correctly in all environments that can be represented as transducers with a limited number of states. This problem was originally defined and studied by Kupferman, Lustig, Vardi, and Yannakakis. They provide NP and 2-EXPTIME lower and upper bounds (respectively) for the complexity of this problem, in the size of the transducer. We tighten the gap by providing a PSPACE lower bound, thereby showing that algorithms for solving this problem are unlikely to scale to large environment sizes. This result is somewhat unfortunate as solving this problem enables tackling some high-level control problems in which an agent has to infer the environment behavior from observations. To address this observation, we study a modified synthesis problem in which the synthesized controller must gather information about the environment's behavior safely. We show that the problem of determining whether the behavior of such an environment can be safely learned is only co-NP-complete. Furthermore, in such scenarios, the behavior of the environment can be learned using a Turing machine that requires at most polynomial space in the size of the environment's transducer.


title: Stochastic Games with Disjunctions of Multiple Objectives

abstract: Stochastic games combine controllable and adversarial non-determinism with stochastic behavior and are a common tool in control, verification and synthesis of reactive systems facing uncertainty. Multi-objective stochastic games are natural in situations where several - possibly conflicting - performance criteria like time and energy consumption are relevant. Such conjunctive combinations are the most studied multi-objective setting in the literature. In this paper, we consider the dual disjunctive problem. More concretely, we study turn-based stochastic two-player games on graphs where the winning condition is to guarantee at least one reachability or safety objective from a given set of alternatives. We present a fine-grained overview of strategy and computational complexity of such disjunctive queries (DQs) and provide new lower and upper bounds for several variants of the problem, significantly extending previous works. We also propose a novel value iteration-style algorithm for approximating the set of Pareto optimal thresholds for a given DQ.


title: The Optimal Way to Play the Most Difficult Repeated Coordination Games

abstract: This paper investigates repeated win-lose coordination games (WLC-games). We analyse which protocols are optimal for these games, covering both the worst case and average case scenarios, i,e., optimizing the guaranteed and expected coordination times. We begin by analysing Choice Matching Games (CM-games) which are a simple yet fundamental type of WLC-games, where the goal of the players is to pick the same choice from a finite set of initially indistinguishable choices. We give a fully complete classification of optimal expected and guaranteed coordination times in two-player CM-games and show that the corresponding optimal protocols are unique in every case - except in the CM-game with four choices, which we analyse separately. Our results on CM-games are essential for proving a more general result on the difficulty of all WLC-games: we provide a complete analysis of least upper bounds for optimal expected coordination times in all two-player WLC-games as a function of game size. We also show that CM-games can be seen as the most difficult games among all two-player WLC-games, as they turn out to have the greatest optimal expected coordination times.


title: Expressiveness of Extended Bounded Response LTL

abstract: Extended Bounded Response LTL with Past (LTLEBR+P) is a safety fragment of Linear Temporal Logic with Past (LTL+P) that has been recently introduced in the context of reactive synthesis. The strength of LTLEBR+P is a fully symbolic compilation of formulas into symbolic deterministic automata. Its syntax is organized in four levels. The first three levels feature (a particular combination of) future temporal modalities, the last one admits only past temporal operators. At the base of such a structuring there are algorithmic motivations: each level corresponds to a step of the algorithm for the automaton construction. The complex syntax of LTLEBR+P made it difficult to precisely characterize its expressive power, and to compare it with other LTL+P safety fragments. In this paper, we first prove that LTLEBR+P is expressively complete with respect to the safety fragment of LTL+P, that is, any safety language definable in LTL+P can be formalized in LTLEBR+P, and vice versa. From this, it follows that LTLEBR+P and Safety-LTL are expressively equivalent. Then, we show that past modalities play an essential role in LTLEBR+P: we prove that the future fragment of LTLEBR+P is strictly less expressive than full LTLEBR+P.


title: Adding the Relation Meets to the Temporal Logic of Prefixes and Infixes makes it EXPSPACE-Complete

abstract: The choice of the right trade-off between expressiveness and complexity is the main issue in interval temporal logic. In their seminal paper, Halpern and Shoham showed that the satisfiability problem for HS (the temporal logic of Allen's relations) is highly undecidable over any reasonable class of linear orders. In order to recover decidability, one can restrict the set of temporal modalities and/or the class of models. In the following, we focus on the satisfiability problem for HS fragments under the homogeneity assumption, according to which any proposition letter holds over an interval if only if it holds at all its points. The problem for full HS with homogeneity has been shown to be non-elementarily decidable, but its only known lower bound is EXPSPACE (in fact, EXPSPACE-hardness has been shown for the logic of prefixes and suffixes BE, which is a very small fragment of it. The logic of prefixes and infixes BD has been recently shown to be PSPACE-complete. In this paper, we prove that the addition of the Allen relation Meets to BD makes it EXPSPACE-complete.


title: Filtration and canonical completeness for continuous modal mu-calculi

abstract: The continuous modal mu-calculus is a fragment of the modal mu-calculus, where the application of fixpoint operators is restricted to formulas whose functional interpretation is Scott-continuous, rather than merely monotone. By game-theoretic means, we show that this relatively expressive fragment still allows two important techniques of basic modal logic, which notoriously fail for the full modal mu-calculus: filtration and canonical models. In particular, we show that the Filtration Theorem holds for formulas in the language of the continuous modal mu-calculus. As a consequence we obtain the finite model property over a wide range of model classes. Moreover, we show that if a basic modal logic L is canonical and the class of L-frames admits filtration, then the logic obtained by adding continuous fixpoint operators to L is sound and complete with respect to the class of L-frames. This generalises recent results on a strictly weaker fragment of the modal mu-calculus, viz. PDL.


title: New Algorithms for Combinations of Objectives using Separating Automata

abstract: The notion of separating automata was introduced by Bojanczyk and Czerwinski for understanding the first quasipolynomial time algorithm for parity games. In this paper we show that separating automata is a powerful tool for constructing algorithms solving games with combinations of objectives. We construct two new algorithms: the first for disjunctions of parity and mean payoff objectives, matching the best known complexity, and the second for disjunctions of mean payoff objectives, improving on the state of the art. In both cases the algorithms are obtained through the construction of small separating automata, using as black boxes the existing constructions for parity objectives and for mean payoff objectives.


title: A Nivat Theorem for Weighted Alternating Automata over Commutative Semirings

abstract: In this paper, we give a Nivat-like characterization for weighted alternating automata over commutative semirings (WAFA). To this purpose we prove that weighted alternating can be characterized as the concatenation of weighted finite tree automata (WFTA) and a specific class of tree homomorphism. We show that the class of series recognized by weighted alternating automata is closed under inverses of homomorphisms, but not under homomorphisms. We give a logical characterization of weighted alternating automata, which uses weighted MSO logic for trees. Finally we investigate the strong connection between weighted alternating automata and polynomial automata. Using the corresponding result for polynomial automata, we are able to prove that the ZERONESS problem for weighted alternating automata with the rational numbers as weights is decidable.


title: Games for Succinctness of Regular Expressions

abstract: We present a version of so called formula size games for regular expressions. These games characterize the equivalence of languages up to expressions of a given size. We use the regular expression size game to give a simple proof of a known non-elementary succinctness gap between first-order logic and regular expressions. We also use the game to only count the number of stars in an expression instead of the overall size. For regular expressions this measure trivially gives a hierarchy in terms of expressive power. We obtain such a hierarchy also for what we call RE over star-free expressions, where star-free expressions, that is ones with complement but no stars, are combined using the operations of regular expressions.


title: Decision Tree Learning with Spatial Modal Logics

abstract: Symbolic learning represents the most straightforward approach to interpretable modeling, but its applications have been hampered by a single structural design choice: the adoption of propositional logic as the underlying language. Recently, more-than-propositional symbolic learning methods have started to appear, in particular for time-dependent data. These methods exploit the expressive power of modal temporal logics in powerful learning algorithms, such as temporal decision trees, whose classification capabilities are comparable with the best non-symbolic ones, while producing models with explicit knowledge representation. With the intent of following the same approach in the case of spatial data, in this paper we: i) present a theory of spatial decision tree learning; ii) describe a prototypical implementation of a spatial decision tree learning algorithm based, and strictly extending, the classical C4.5 algorithm; and iii) perform a series of experiments in which we compare the predicting power of spatial decision trees with that of classical propositional decision trees in several versions, for a multi-class image classification problem, on publicly available datasets. Our results are encouraging, showing clear improvements in the performances from the propositional to the spatial models, which in turn show higher levels of interpretability.


title: Witnessing Subsystems for Probabilistic Systems with Low Tree Width

abstract: A standard way of justifying that a certain probabilistic property holds in a system is to provide a witnessing subsystem (also called critical subsystem) for the property. Computing minimal witnessing subsystems is NP-hard already for acyclic Markov chains, but can be done in polynomial time for Markov chains whose underlying graph is a tree. This paper considers the problem for probabilistic systems that are similar to trees or paths. It introduces the parameters directed tree-partition width (dtpw) and directed path-partition width (dppw) and shows that computing minimal witnesses remains NP-hard for Markov chains with bounded dppw (and hence also for Markov chains with bounded dtpw). By observing that graphs of bounded dtpw have bounded width with respect to all known tree similarity measures for directed graphs, the hardness result carries over to these other tree similarity measures. Technically, the reduction proceeds via the conceptually simpler matrix-pair chain problem, which is introduced and shown to be NP-complete for nonnegative matrices of fixed dimension. Furthermore, an algorithm which aims to utilise a given directed tree partition of the system to compute a minimal witnessing subsystem is described. It enumerates partial subsystems for the blocks of the partition along the tree order, and keeps only necessary ones. A preliminary experimental analysis shows that it outperforms other approaches on certain benchmarks which have directed tree partitions of small width.


title: Semiring Provenance for B\"uchi Games: Strategy Analysis with Absorptive Polynomials

abstract: This paper presents a case study for the application of semiring semantics for fixed-point formulae to the analysis of strategies in B\"uchi games. Semiring semantics generalizes the classical Boolean semantics by permitting multiple truth values from certain semirings. Evaluating the fixed-point formula that defines the winning region in a given game in an appropriate semiring of polynomials provides not only the Boolean information on who wins, but also tells us how they win and which strategies they might use. This is well-understood for reachability games, where the winning region is definable as a least fixed point. The case of B\"chi games is of special interest, not only due to their practical importance, but also because it is the simplest case where the fixed-point definition involves a genuine alternation of a greatest and a least fixed point. We show that, in a precise sense, semiring semantics provide information about all absorption-dominant strategies - strategies that win with minimal effort, and we discuss how these relate to positional and the more general persistent strategies. This information enables applications such as game synthesis or determining minimal modifications to the game needed to change its outcome.


title: Cranked Skyrme-Hartree-Fock-Bogoliubov approach for a mean-field description of nuclear rotations near the drip line

abstract: To describe the yrast states in weakly bound nuclei, I directly solve the coordinate-space cranked Skyrme-Hartree-Fock-Bogoliubov equation on a three-dimensional lattice with the continuum states discretized in a box. After the numerical demonstration for the ground-state band in a medium-mass nucleus, I apply the newly-developed method to neutron-rich even-$N$ Mg isotopes. I find that the appearance of the significantly low $I^\pi=2^+$ state in $^{40}$Mg is mainly due to the suppression of pairing. The calculation predicts that the $2^+$ state in $^{42}$Mg appears as high in energy as in $^{34\text{-}38}$Mg whereas the triaxial deformation is enhanced in non-zero spin states. The present numerical framework offers a practical approach for investigating the near yrast states systematically and revealing structures unique in drip-line nuclei.


title: Cross-layer Visualization and Profiling of Network and I/O Communication for HPC Clusters

abstract: Understanding and visualizing the full-stack performance trade-offs and interplay between HPC applications, MPI libraries, the communication fabric, and the file system is a challenging endeavor. Designing a holistic profiling and visualization method for HPC communication networks is challenging since different levels of communication coexist and interact with each other on the communication fabric. A breakdown of traffic is essential to understand the interplay of different layers along with the application's communication behavior without losing a general view of network traffic. Unfortunately, existing profiling tools are disjoint and either focus on only profiling and visualizing a few levels of the HPC stack, which limits the insights they can provide, or they provide extremely detailed information which necessitates a steep learning curve to understand. We target our profiling tool visualization to provide holistic and real-time insights into HPC communication stacks. In this paper, we propose and implement our visualization methods to enable holistic insight for representing the cross-stack metrics. Moreover, we propose and implement a low-overhead I/O profiling inside the communication library, collect and store the profiling information, and then study the correlation and evaluation of I/O traffic with MPI communication using a cross-stack approach by INAM. Through experimental evaluations and use cases, we demonstrate novel benefits of our cross-stack communication analysis in real-time to detect bottlenecks and understand communication performance.


title: Mass Segmentation in Automated 3-D Breast Ultrasound Using Dual-Path U-net

abstract: Automated 3-D breast ultrasound (ABUS) is a newfound system for breast screening that has been proposed as a supplementary modality to mammography for breast cancer detection. While ABUS has better performance in dense breasts, reading ABUS images is exhausting and time-consuming. So, a computer-aided detection system is necessary for interpretation of these images. Mass segmentation plays a vital role in the computer-aided detection systems and it affects the overall performance. Mass segmentation is a challenging task because of the large variety in size, shape, and texture of masses. Moreover, an imbalanced dataset makes segmentation harder. A novel mass segmentation approach based on deep learning is introduced in this paper. The deep network that is used in this study for image segmentation is inspired by U-net, which has been used broadly for dense segmentation in recent years. The system's performance was determined using a dataset of 50 masses including 38 malign and 12 benign lesions. The proposed segmentation method attained a mean Dice of 0.82 which outperformed a two-stage supervised edge-based method with a mean Dice of 0.74 and an adaptive region growing method with a mean Dice of 0.65.


title: Accelerating Offline Reinforcement Learning Application in Real-Time Bidding and Recommendation: Potential Use of Simulation

abstract: In recommender systems (RecSys) and real-time bidding (RTB) for online advertisements, we often try to optimize sequential decision making using bandit and reinforcement learning (RL) techniques. In these applications, offline reinforcement learning (offline RL) and off-policy evaluation (OPE) are beneficial because they enable safe policy optimization using only logged data without any risky online interaction. In this position paper, we explore the potential of using simulation to accelerate practical research of offline RL and OPE, particularly in RecSys and RTB. Specifically, we discuss how simulation can help us conduct empirical research of offline RL and OPE. We take a position to argue that we should effectively use simulations in the empirical research of offline RL and OPE. To refute the counterclaim that experiments using only real-world data are preferable, we first point out the underlying risks and reproducibility issue in real-world experiments. Then, we describe how these issues can be addressed by using simulations. Moreover, we show how to incorporate the benefits of both real-world and simulation-based experiments to defend our position. Finally, we also present an open challenge to further facilitate practical research of offline RL and OPE in RecSys and RTB, with respect to public simulation platforms. As a possible solution for the issue, we show our ongoing open source project and its potential use case. We believe that building and utilizing simulation-based evaluation platforms for offline RL and OPE will be of great interest and relevance for the RecSys and RTB community.


title: Cell-Level State of Charge Estimation for Battery Packs Under Minimal Sensing

abstract: This manuscript presents an algorithm for individual Lithium-ion (Li-ion) battery cell state of charge (SOC) estimation in a large-scale battery pack under minimal sensing, where only pack-level voltage and current are measured. For battery packs consisting of up to thousands of cells in electric vehicle or stationary energy storage applications, it is desirable to estimate individual cell SOCs without cell local measurements in order to reduce sensing costs. Mathematically, pure series connected cells yield dynamics given by ordinary differential equations under classical full voltage sensing. In contrast, parallel--series connected battery packs are evidently more challenging because the dynamics are governed by a nonlinear differential--algebraic equations (DAE) system. The majority of the conventional studies on SOC estimation for battery packs benefit from idealizing the pack as a lumped single cell which ultimately lose track of cell-level conditions and are blind to potential risks of cell-level over-charge and over-discharge. This work explicitly models a battery pack with high fidelity cell-by-cell resolution based on the interconnection of single cell models, and examines the observability of cell-level state with only pack-level measurements. A DAE-based state observer with linear output error injection is formulated, where the individual cell SOC and current can be reconstructed from minimal number of pack sensing. The mathematically guaranteed asymptotic convergence of differential and algebraic state estimates is established by considering local Lipschitz continuity property of system nonlinearities. Simulation results for Graphite/NMC cells illustrate convergence for cell SOCs, currents, and voltages.


title: A Multimodal Sentiment Dataset for Video Recommendation

abstract: Recently, multimodal sentiment analysis has seen remarkable advance and a lot of datasets are proposed for its development. In general, current multimodal sentiment analysis datasets usually follow the traditional system of sentiment/emotion, such as positive, negative and so on. However, when applied in the scenario of video recommendation, the traditional sentiment/emotion system is hard to be leveraged to represent different contents of videos in the perspective of visual senses and language understanding. Based on this, we propose a multimodal sentiment analysis dataset, named baiDu Video Sentiment dataset (DuVideoSenti), and introduce a new sentiment system which is designed to describe the sentimental style of a video on recommendation scenery. Specifically, DuVideoSenti consists of 5,630 videos which displayed on Baidu, each video is manually annotated with a sentimental style label which describes the user's real feeling of a video. Furthermore, we propose UNIMO as our baseline for DuVideoSenti. Experimental results show that DuVideoSenti brings new challenges to multimodal sentiment analysis, and could be used as a new benchmark for evaluating approaches designed for video understanding and multimodal fusion. We also expect our proposed DuVideoSenti could further improve the development of multimodal sentiment analysis and its application to video recommendations.


title: Observation of non-Hermitian many-body skin effects in Hilbert space

abstract: Non-Hermiticity greatly expands existing physical laws beyond the Hermitian framework, revealing various novel phenomena with unique properties. Up to now, most exotic nonHermitian effects, such as exceptional points and non-Hermitian skin effects, are discovered in single-particle systems. The interplay between non-Hermitian and manybody correlation is expected to be a more fascinating but much less explored area. Due to the complexity of the problem, current researches in this field mainly stay at the theoretical level. The experimental observation of predicted non-Hermitian manybody phases is still a great challenging. Here, we report the first experimental simulation of strongly correlated non-Hermitian many-body system, and reveal a new type of nonHermitian many-body skin states toward effective boundaries in Hilbert space. Such an interaction-induced non-Hermitian many-body skin effect represents the aggregation of bosonic clusters with non-identical occupations in the periodic lattice. In particular, by mapping eigen-states of three correlated bosons to modes of the designed threedimensional electric circuit, non-Hermitian many-body skin effects in Hilbert space is verified by measuring the spatial impedance response. Our finding not only discloses a new physical effect in the non-Hermitian many-body system, but also suggests a flexible platform to further investigate other non-Hermitian correlated phases in experiments.


title: Conductive homogeneity of compact metric spaces and construction of p-energy

abstract: In the ordinary theory of Sobolev spaces on domains of $R^n$, the $p$-energy is defined as the integral of $|\nabla{f}|^p$. In this paper, we try to construct $p$-energy on compact metric spaces as a scaling limit of discrete $p$-energies on a series of graphs approximating the original space. In conclusion, we propose a notion called conductive homogeneity under which one can construct a reasonable $p$-energy if $p$ is greater than the Ahlfors regular conformal dimension of the space. In particular, if $p = 2$, then we construct a local regular Dirichlet form and show that the heat kernel associated with the Dirichlet form satisfies upper and lower sub-Gaussian type heat kernel estimates. As examples of conductively homogeneous spaces, we present a new class of square-based self-similar sets and rationally ramified Sierpinski cross, where no diffusion was constructed before.


title: LoGG3D-Net: Locally Guided Global Descriptor Learning for 3D Place Recognition

abstract: Retrieval-based place recognition is an efficient and effective solution for re-localization within a pre-built map, or global data association for Simultaneous Localization and Mapping (SLAM). The accuracy of such an approach is heavily dependent on the quality of the extracted scene-level representation. While end-to-end solutions - which learn a global descriptor from input point clouds - have demonstrated promising results, such approaches are limited in their ability to enforce desirable properties at the local feature level. In this paper, we introduce a local consistency loss to guide the network towards learning local features which are consistent across revisits, hence leading to more repeatable global descriptors resulting in an overall improvement in 3D place recognition performance. We formulate our approach in an end-to-end trainable architecture called LoGG3D-Net. Experiments on two large-scale public benchmarks (KITTI and MulRan) show that our method achieves mean $F1_{max}$ scores of $0.939$ and $0.968$ on KITTI and MulRan respectively, achieving state-of-the-art performance while operating in near real-time. The open-source implementation is available at: https://github.com/csiro-robotics/LoGG3D-Net.


title: Widely tunable and narrow linewidth chip-scale lasers from deep visible to near-IR

abstract: Widely-tunable and narrow-linewidth integrated lasers across all visible wavelengths are necessary to enable on-chip technologies such as quantum photonics, optical trapping, and biophotonics. However, such lasers have not been realized due to the strong wavelength sensitivity and high loss of integrated optical devices at short wavelengths. Here we overcome these challenges and demonstrate a chip-scale visible lasers platform by using tightly-confined, micrometer-scale silicon nitride resonators and commercial Fabry-Perot laser diodes. We achieve tunable and narrow-linewidth lasing in the deep blue (450 nm), blue (488 nm), green (520 nm), red (660 nm) and near-IR (785 nm) with coarse tuning up to 12 nm, fine tuning up to 33.9 GHz, linewidth down to sub-kHz, side-mode suppression ratio > 35 dB, and fiber-coupled power up to 10 mW. These specifications of our chip-scale lasers are comparable to those of state-of-the-art commercial laser systems, making them stand out as powerful tools for the next generation of visible-light technologies.


title: The global sections of chiral de Rham complexes on compact Ricci-flat K\"ahler manifolds II

abstract: We give a complete description of the vertex algebra of global sections of the chiral de Rham complex of an arbitrary compact Ricci-flat K\"ahler manifold.


title: The Stackelberg Equilibrium for One-sided Zero-sum Partially Observable Stochastic Games

abstract: Formulating cyber-security problems with attackers and defenders as a partially observable stochastic game has become a trend recently. Among them, the one-sided two-player zero-sum partially observable stochastic game (OTZ-POSG) has emerged as a popular model because it allows players to compete for multiple stages based on partial knowledge of the system. All existing work on OTZ-POSG has focused on the simultaneous move scenario and assumed that one player's actions are private in the execution process. However, this assumption may become questionable since one player's action may be detected by the opponent through deploying action detection strategies. Hence, in this paper, we propose a turn-based OTZ-POSG with the assumption of public actions and investigate the existence and properties of a Stackelberg equilibrium for this game. We first prove the existence of the Stackelberg equilibrium for the one-stage case and show that the one-stage game can be converted into a linear-fractional programming problem and therefore solved by linear programming. For multiple stages, the main challenge is the information leakage issue as the public run-time action reveals certain private information to the opponent and allows the opponent to achieve more rewards in the future. To deal with this issue, we adopt the concept of $\epsilon$-Stackelberg equilibrium and prove that this equilibrium can be achieved for finite-horizon OTZ-POSGs. We propose a space partition approach to solve the game iteratively and show that the value function of the leader is piece-wise linear and the value function of the follower is piece-wise constant for multiple stages. Finally, examples are given to illustrate the space partition approach and show that value functions are piece-wise linear and piece-wise constant.


title: On the H-property for step-graphons and edge polytopes

abstract: Graphons $W$ can be used as stochastic models to sample graphs $G_n$ on $n$ nodes for $n$ arbitrarily large. A graphon $W$ is said to have the $H$-property if $G_n$ admits a decomposition into disjoint cycles with probability one as $n$ goes to infinity. Such a decomposition is known as a Hamiltonian decomposition. In this paper, we provide necessary conditions for the $H$-property to hold. The proof builds upon a hereby established connection between the so-called edge polytope of a finite undirected graph associated with $W$ and the $H$-property. Building on its properties, we provide a purely geometric solution to a random graph problem. More precisely, we assign two natural objects to $W$, which we term concentration vector and skeleton graph, denoted by $x^*$ and $S$ respectively. We then establish two necessary conditions for the $H$-property to hold: (1) the edge-polytope of $S$, denoted by $\mathcal{X}(S)$, is of full rank, and (2) $x^* \in \mathcal{X}(S)$.


title: THyMe+: Temporal Hypergraph Motifs and Fast Algorithms for Exact Counting

abstract: Group interactions arise in our daily lives (email communications, on-demand ride sharing, comment interactions on online communities, to name a few), and they together form hypergraphs that evolve over time. Given such temporal hypergraphs, how can we describe their underlying design principles? If their sizes and time spans are considerably different, how can we compare their structural and temporal characteristics? In this work, we define 96 temporal hypergraph motifs (TH-motifs), and propose the relative occurrences of their instances as an answer to the above questions. TH-motifs categorize the relational and temporal dynamics among three connected hyperedges that appear within a short time. For scalable analysis, we develop THyMe+, a fast and exact algorithm for counting the instances of TH-motifs in massive hypergraphs, and show that THyMe+ is at most 2,163X faster while requiring less space than baseline. Using it, we investigate 11 real-world temporal hypergraphs from various domains. We demonstrate that TH-motifs provide important information useful for downstream tasks and reveal interesting patterns, including the striking similarity between temporal hypergraphs from the same domain.


title: Dropout's Dream Land: Generalization from Learned Simulators to Reality

abstract: A World Model is a generative model used to simulate an environment. World Models have proven capable of learning spatial and temporal representations of Reinforcement Learning environments. In some cases, a World Model offers an agent the opportunity to learn entirely inside of its own dream environment. In this work we explore improving the generalization capabilities from dream environments to real environments (Dream2Real). We present a general approach to improve a controller's ability to transfer from a neural network dream environment to reality at little additional cost. These improvements are gained by drawing on inspiration from Domain Randomization, where the basic idea is to randomize as much of a simulator as possible without fundamentally changing the task at hand. Generally, Domain Randomization assumes access to a pre-built simulator with configurable parameters but oftentimes this is not available. By training the World Model using dropout, the dream environment is capable of creating a nearly infinite number of different dream environments. Previous use cases of dropout either do not use dropout at inference time or averages the predictions generated by multiple sampled masks (Monte-Carlo Dropout). Dropout's Dream Land leverages each unique mask to create a diverse set of dream environments. Our experimental results show that Dropout's Dream Land is an effective technique to bridge the reality gap between dream environments and reality. Furthermore, we additionally perform an extensive set of ablation studies.


title: Acila: Attaching Identities of Workloads for Efficient Packet Classification in a Cloud Data Center Network

abstract: IP addresses and port numbers (network based identifiers hereafter) in packets are two major identifiers for network devices to identify systems and roles of hosts sending and receiving packets for access control lists, priority control, etc. However, in modern system design on cloud, such as microservices architecture, network based identifiers are inefficient for network devices to identify systems and roles of hosts. This is because, due to autoscaling and automatic deployment of new software, many VMs and containers consisting of the system (workload hereafter) are frequently created and deleted on servers whose resources are available, and network based identifiers are assigned based on servers where containers and VMs are running. In this paper, we propose a new system, Acila, to classify packets based on the identity of a workload at network devices, by marking packets with the necessary information extracted from the identity that usually stored in orchestrators or controllers. We then implement Acila and show that packet filtering and priority control can be implemented with Acila, and entries for them with Acila is more efficient than conventional network based identifiers approach, with little overhead on performance


title: Achieving Model Fairness in Vertical Federated Learning

abstract: Vertical federated learning (VFL) has attracted greater and greater interest since it enables multiple parties possessing non-overlapping features to strengthen their machine learning models without disclosing their private data and model parameters. Similar to other machine learning algorithms, VFL faces demands and challenges of fairness, i.e., the learned model may be unfairly discriminatory over some groups with sensitive attributes. To tackle this problem, we propose a fair VFL framework in this work. First, we systematically formulate the problem of training fair models in VFL, where the learning task is modelled as a constrained optimization problem. To solve it in a federated and privacy-preserving manner, we consider the equivalent dual form of the problem and develop an asynchronous gradient coordinate-descent ascent algorithm, where some active data parties perform multiple parallelized local updates per communication round to effectively reduce the number of communication rounds. The messages that the server sends to passive parties are deliberately designed such that the information necessary for local updates is released without intruding on the privacy of data and sensitive attributes. We rigorously study the convergence of the algorithm when applied to general nonconvex-concave min-max problems. We prove that the algorithm finds a $\delta$-stationary point of the dual objective in $\mathcal{O}(\delta^{-4})$ communication rounds under mild conditions. Finally, the extensive experiments on three benchmark datasets demonstrate the superior performance of our method in training fair models.


title: Learning Enhanced Optimisation for Routing Problems

abstract: Deep learning approaches have shown promising results in solving routing problems. However, there is still a substantial gap in solution quality between machine learning and operations research algorithms. Recently, another line of research has been introduced that fuses the strengths of machine learning and operational research algorithms. In particular, search perturbation operators have been used to improve the solution. Nevertheless, using the perturbation may not guarantee a quality solution. This paper presents "Learning to Guide Local Search" (L2GLS), a learning-based approach for routing problems that uses a penalty term and reinforcement learning to adaptively adjust search efforts. L2GLS combines local search (LS) operators' strengths with penalty terms to escape local optimals. Routing problems have many practical applications, often presetting larger instances that are still challenging for many existing algorithms introduced in the learning to optimise field. We show that L2GLS achieves the new state-of-the-art results on larger TSP and CVRP over other machine learning methods.


title: Comfetch: Federated Learning of Large Networks on Constrained Clients via Sketching

abstract: Federated learning (FL) is a popular paradigm for private and collaborative model training on the edge. In centralized FL, the parameters of a global architecture (such as a deep neural network) are maintained and distributed by a central server/controller to clients who transmit model updates (gradients) back to the server based on local optimization. While many efforts have focused on reducing the communication complexity of gradient transmission, the vast majority of compression-based algorithms assume that each participating client is able to download and train the current and full set of parameters, which may not be a practical assumption depending on the resource constraints of smaller clients such as mobile devices. In this work, we propose a simple yet effective novel algorithm, Comfetch, which allows clients to train large networks using reduced representations of the global architecture via the count sketch, which reduces local computational and memory costs along with bi-directional communication complexity. We provide a nonconvex convergence guarantee and experimentally demonstrate that it is possible to learn large models, such as a deep convolutional network, through federated training on their sketched counterparts. The resulting global models exhibit competitive test accuracy over CIFAR10/100 classification when compared against un-compressed model training.


title: Experimental observation of anomalous supralinear response of single-photon detectors

abstract: We demonstrate a direct single-source measurement of absolute nonlinearity of single-photon detectors with unprecedented accuracy. We discover a surprising supralinear behavior of single-photon avalanche diodes and show that it cannot be explained using known theoretical models. We also fully characterize sub- and supra-linear operation regimes of superconducting nanowire single-photon detectors and uncover the supralinearity under faint continuous illumination. The results identify new detector anomalies that supersede existing knowledge of nonlinear effects at the single-photon level.


title: Stacking effect and Coulomb correlation in layered charge density wave phase of 1T-NbS2

abstract: Based on first-principles calculations, we explored the interplay between stacking effect and electron-electron correlation in the layered vdW material of bulk 1T-NbS2 with a 2D charge density wave (CDW) order. Without considering the Coulomb correlation, two energetically favorable out-of-plane stacking configurations are identified: one is a metallic phase with a single-layer stacking pattern, another is a band insulator with a paired-bilayer stacking configuration. Even though the Coulomb correlation is taken into account, the two energetic favorable stacking orders are still far more stable than other stacking orders. Furthermore, increasing the Coulomb interaction, the paired-bilayer stacking configuration transforms from nonmagnetic band insulator to antiferromagnetic insulator, while the single-layer stacking undergoes a Slater-Mott metal-insulator transition, which indicates the non-negligible role of electron-electron correlation interactions. In addition, the electronic structure and magnetic ground state change drastically among different stacking configurations, providing a platform to tune the electronic structures and interlayer magnetic interactions by altering the stacking order. In contrast to the widely accepted scenario of Mott localization as the driving force behind the gap formation in the CDW phase of layered transition metal dichalcogenides, our results not only highlight the crucial role of stacking order in the electronic structures of 1T-NbS2, but also shed fresh light on the distinct effects of Coulomb interaction in different stacking arrangements.


title: Proposal to detect a moving triangle singularity in $\psi(2S) \to \pi^+ \pi^- K^+ K^-$ process

abstract: In this work, we propose that there exists a moving triangle singularity in the $\psi(2S) \to \pi^+ \pi^- K^+ K^-$ process, whose position can vary from 1.158 to 1.181 GeV in the invariant mass spectrum of $K^+K^-$. After a precise analysis on this process, it turns out that after doing some cuts on $m_{\pi^+\pi^-}$, experiments do have the opportunity to observe this triangle singularity. In addition, when changing the cuts on $m_{\pi^+\pi^-}$, the movement of the predicted triangle singularity can also be observed. Thus, we suggest future experiments, especially Super Tau-Charm Facility (STCF), to do an anlysis on the $\psi(2S) \to \pi^+ \pi^- K^+ K^-$ process to verify our prediction.


title: Modelling control strategies against Classical Swine Fever: influence of traders and markets using static and temporal networks in Ecuador

abstract: Classical swine fever (CSF) in Ecuador is prevalent since 1940, pig farming represents an important economic and cultural sector. Recently, the National Veterinary Service (NVS) has implemented individual identification of pigs, movement control and mandatory vaccination against CSF, looking for a future eradication. Our aim was to characterise the pig premises according to risk criteria, analyse the effect of random and targeted strategies to control CSF and consider the temporal development of the network. We used social network analysis (SNA), SIRS (susceptible, infected, recovered, susceptible) network modelling and temporal network analysis. The data set contained 751,003 shipments and 6 million pigs from 2017 to 2019. 165,593 premises were involved: 144,118 farms, 138 industrials, 21,337 traders, and 51 markets. On annual average, 124,976 premises (75%) received or sent one movement with 1.5 pigs, in contrast, 166 (0.01%) with 1,372 movements and 11,607 pigs. Simulations resulted in CSF mean prevalence of 29.93%; Targeted selection strategy reduced the prevalence to 3.3%, while 24% with random selection. Selection of high-risk premises in every province was the best strategy using available surveillance infrastructure. Notably, selecting 10 traders/markets reduced the CSF prevalence to 4%, evidencing their prime influence over the network. Temporal analysis showed an overestimation of 38% (causal fidelity) in the number of transmission paths; The steps to cross the network were 4.3 (average path length), but take approximately 233 days. In conclusion, surveillance strategies applied by the NVS could be more efficient to find cases, reduce the spread of diseases and enable the implementation of risk-based surveillance. To focus the efforts on target selection of high-risk premises, special attention should be given to markets/traders which proved similar disease spread potential.


title: Regression Discontinuity Design with Potentially Many Covariates

abstract: This paper studies the case of possibly high-dimensional covariates in the regression discontinuity design (RDD) analysis. In particular, we propose estimation and inference methods for the RDD models with covariate selection which perform stably regardless of the number of covariates. The proposed methods combine the local approach using kernel weights with $\ell_{1}$-penalization to handle high-dimensional covariates. We provide theoretical and numerical results which illustrate the usefulness of the proposed methods. Theoretically, we present risk and coverage properties for our point estimation and inference methods, respectively. Under certain special case, the proposed estimator becomes more efficient than the conventional covariate adjusted estimator at the cost of an additional sparsity condition. Numerically, our simulation experiments and empirical example show the robust behaviors of the proposed methods to the number of covariates in terms of bias and variance for point estimation and coverage probability and interval length for inference.


title: Asymptotically almost periodic solutions to parabolic equations on the real hyperbolic manifold

abstract: In this work we study the existence and the asymptotic behaviour of the asymptotically almost periodic mild solutions of the vectorial parabolic equations on the real hyperbolic manifold $\mathbb{H}^d(\mathbb{R})$ ($d \geqslant 2$). We will consider the vectorial laplace operator in the sense of Ebin-Marsden's laplace operator. Our method is based on certain dispertive and smoothing estimates of the semigroup generated by the linearized vectorial heat equation and the fixed point argument. First, we prove the existence and the uniqueness of the asymptotically almost periodic mild solution for the linearized equations. Next, using the fixed point argument, we can pass from linearized equations to semilinear equations to prove the existence, uniqueness, exponential decay and stability of the solutions. Our abstract results will be applied to the incompressible Navier-Stokes equation and the semilinear vectorial heat equation.


title: Observation of coherent perfect absorption at an exceptional point

abstract: The past few years have witnessed growing interests in exceptional points (EPs) in various domains, including photonics, acoustics and electronics. However, EPs have mainly been realized based on the degeneracy of resonances of physical systems; distinct degeneracies occur relating to the absorption properties of waves, with distinct physical manifestations. Here we demonstrate this physically different kind of exceptional point, by engineering degeneracies in the absorption spectrum of optical microcavities with dissipation. We experimentally distinguish the conditions to realize a resonant EP and an absorbing EP. Furthermore, when the optical loss is optimized to achieve perfect absorption at such an EP, we observe an anomalously broadened lineshape in the absorption spectra, as predicted by theory. The distinct scattering properties enabled by this type of EP creates new opportunities for both the fundamental study and applications of non-Hermitian singularities.

categories: physics.optics cs.SY eess.SY physics.app-ph quant-ph


title: Task-adaptive Pre-training of Language Models with Word Embedding Regularization

abstract: Pre-trained language models (PTLMs) acquire domain-independent linguistic knowledge through pre-training with massive textual resources. Additional pre-training is effective in adapting PTLMs to domains that are not well covered by the pre-training corpora. Here, we focus on the static word embeddings of PTLMs for domain adaptation to teach PTLMs domain-specific meanings of words. We propose a novel fine-tuning process: task-adaptive pre-training with word embedding regularization (TAPTER). TAPTER runs additional pre-training by making the static word embeddings of a PTLM close to the word embeddings obtained in the target domain with fastText. TAPTER requires no additional corpus except for the training data of the downstream task. We confirmed that TAPTER improves the performance of the standard fine-tuning and the task-adaptive pre-training on BioASQ (question answering in the biomedical domain) and on SQuAD (the Wikipedia domain) when their pre-training corpora were not dominated by in-domain data.


title: Challenges of Driver Drowsiness Prediction: The Remaining Steps to Implementation

abstract: Driver drowsiness has caused a large number of serious injuries and deaths on public roads and incurred billions of taxpayer dollars in costs. Hence, monitoring of drowsiness is critical to reduce this burden on society. This paper surveys the broad range of solutions proposed to address the challenges of driver drowsiness, and identifies the key steps required for successful implementation. Although some commercial products already exist, with vehicle-based methods most commonly implemented by automotive manufacturers, these systems may not have the level of accuracy required to properly predict and monitor drowsiness. State-of-the-art models use physiological, behavioural and vehicle-based methods to detect drowsiness, with hybrid methods emerging as a superior approach. Current setbacks to implementing these methods include late detection, intrusiveness and subject diversity. In particular, physiological monitoring methods such as Electroencephalography (EEG) are intrusive to drivers; while behavioural monitoring is least robust, affected by external factors such as lighting, as well as being subject to privacy concerns. Drowsiness detection models are often developed and validated based on subjective measures, with the Karolinska Sleepiness Scale being the most popular. Subjective and incoherent labelling of drowsiness, lack of on road data and inconsistent protocols for data collection are among other challenges to be addressed to progress drowsiness detection for reliable on-road use.


title: Accurate, Interpretable, and Fast Animation: An Iterative, Sparse, and Nonconvex Approach

abstract: Digital human animation relies on high-quality 3D models of the human face: rigs. A face rig must be accurate and, at the same time, fast to compute. One of the most common rigging models is the blendshape model. We propose a novel algorithm for solving the nonconvex inverse rig problem in facial animation. Our approach is model-based, but in contrast with previous model-based approaches, we use a quadratic instead of the linear approximation to the higher order rig model. This increases the accuracy of the solution by 8 percent on average and, confirmed by the empirical results, increases the sparsity of the resulting parameter vector -- an important feature for interpretability by animation artists. The proposed solution is based on a Levenberg-Marquardt (LM) algorithm, applied to a nonconvex constrained problem with sparsity regularization. In order to reduce the complexity of the iterates, a paradigm of Majorization Minimization (MM) is further invoked, which leads to an easy to solve problem that is separable in the parameters at each algorithm iteration. The algorithm is evaluated on a number of animation datasets, proprietary and open-source, and the results indicate the superiority of our method compared to the standard approach based on the linear rig approximation. Although our algorithm targets the specific problem, it might have additional signal processing applications.


title: Dynamic Spatiotemporal Graph Convolutional Neural Networks for Traffic Data Imputation with Complex Missing Patterns

abstract: Missing data is an inevitable and ubiquitous problem for traffic data collection in intelligent transportation systems. Despite extensive research regarding traffic data imputation, there still exist two limitations to be addressed: first, existing approaches fail to capture the complex spatiotemporal dependencies in traffic data, especially the dynamic spatial dependencies evolving with time; second, prior studies mainly focus on randomly missing patterns while other more complex missing scenarios are less discussed. To fill these research gaps, we propose a novel deep learning framework called Dynamic Spatiotemporal Graph Convolutional Neural Networks (DSTGCN) to impute missing traffic data. The model combines the recurrent architecture with graph-based convolutions to model the spatiotemporal dependencies. Moreover, we introduce a graph structure estimation technique to model the dynamic spatial dependencies from real-time traffic information and road network structure. Extensive experiments based on two public traffic speed datasets are conducted to compare our proposed model with state-of-the-art deep learning approaches in four types of missing patterns. The results show that our proposed model outperforms existing deep learning models in all kinds of missing scenarios and the graph structure estimation technique contributes to the model performance. We further compare our proposed model with a tensor factorization model and find distinct behaviors across different model families under different training schemes and data availability.


title: Security Analysis of Distributed Ledgers and Blockchains through Agent-based Simulation

abstract: In this paper we describe LUNES-Blockchain, an agent-based simulator of blockchains that relies on Parallel and Distributed Simulation (PADS) techniques to obtain high scalability. The software is organized as a multi-level simulator that permits to simulate a virtual environment, made of many nodes running the protocol of a specific Distributed Ledger Technology (DLT), such as the Bitcoin or the Ethereum blockchains. This virtual environment is executed on top of a lower-level Peer-to-Peer (P2P) network overlay, which can be structured based on different topologies and with a given number of nodes and edges. Functionalities at different levels of abstraction are managed separately, by different software modules and with different time granularity. This allows for accurate simulations, where (and when) it is needed, and enhances the simulation performance. Using LUNES-Blockchain, it is possible to simulate different types of attacks on the DLT. In this paper, we specifically focus on the P2P layer, considering the selfish mining, the 51% attack and the Sybil attack. For which concerns selfish mining and the 51% attack, our aim is to understand how much the hash-rate (i.e. a general measure of the processing power in the blockchain network) of the attacker can influence the outcome of the misbehaviour. On the other hand, in the filtering denial of service (i.e. Sybil Attack), we investigate which dissemination protocol in the underlying P2P network makes the system more resilient to a varying number of nodes that drop the messages. The results confirm the viability of the simulation-based techniques for the investigation of security aspects of DLTs.