title: Genetic programming approaches to learning fair classifiers

abstract: Society has come to rely on algorithms like classifiers for important decision making, giving rise to the need for ethical guarantees such as fairness. Fairness is typically defined by asking that some statistic of a classifier be approximately equal over protected groups within a population. In this paper, current approaches to fairness are discussed and used to motivate algorithmic proposals that incorporate fairness into genetic programming for classification. We propose two ideas. The first is to incorporate a fairness objective into multi-objective optimization. The second is to adapt lexicase selection to define cases dynamically over intersections of protected groups. We describe why lexicase selection is well suited to pressure models to perform well across the potentially infinitely many subgroups over which fairness is desired. We use a recent genetic programming approach to construct models on four datasets for which fairness constraints are necessary, and empirically compare performance to prior methods utilizing game-theoretic solutions. Methods are assessed based on their ability to generate trade-offs of subgroup fairness and accuracy that are Pareto optimal. The result show that genetic programming methods in general, and random search in particular, are well suited to this task.


title: Various Ways to Quantify BDMPs

abstract: A Boolean logic driven Markov process (BDMP) is a dependability analysis model that defines a continuous-time Markov chain (CTMC). This formalism has high expressive power, yet it remains readable because its graphical representation stays close to standard fault trees. The size of a BDMP is roughly speaking proportional to the size of the system it models, whereas the size of the CTMC specified by this BDMP suffers from exponential growth. Thus quantifying large BDMPs can be a challenging task. The most general method to quantify them is Monte Carlo simulation, but this may be intractable for highly reliable systems. On the other hand, some subcategories of BDMPs can be processed with much more efficient methods. For example, BDMPs without repairs can be translated into dynamic fault trees, a formalism accepted as an input of the STORM model checker, that performs numerical calculations on sparse matrices, or they can be processed with the tool FIGSEQ that explores paths going to a failure state and calculates their probabilities. BDMPs with repairs can be quantified by FIGSEQ (BDMPs capturing quickly and completely repairable behaviors are solved by a different algorithm), and by the I&AB (Initiator and All Barriers) method, recently published and implemented in a prototype version of RISKSPECTRUM PSA. This tool, based exclusively on Boolean representations looks for and quantifies minimal cut sets of the system, i.e., minimal combinations of component failures that induce the loss of the system. This allows a quick quantification of large models with repairable components, standby redundancies and some other types of dependencies between omponents. All these quantification methods have been tried on a benchmark whose definition was published at the MARS 2017 workshop: the model of emergency power supplies of a nuclear power plant. In this paper, after a recall of the theoretical principles of the various quantification methods, we compare their performances on that benchmark.


title: Modeling the Raft Distributed Consensus Protocol in LNT

abstract: Consensus protocols are crucial for reliable distributed systems as they let them cope with network and server failures. For decades, most consensus protocols have been designed as variations of the seminal Paxos, yet in 2014 Raft was presented as a new, "understandable" protocol, meant to be easier to implement than the notoriously subtle Paxos family. Raft has since been used in various industrial projects, e.g. Hashicorp's Consul or etcd (used by Google's Kubernetes). The correctness of Raft is established via a manual proof, based on a TLA+ specification of the protocol. This paper reports our experience in modeling Raft in the LNT process algebra. We found a couple of issues with the original TLA+ specification of Raft, which has been corrected since. More generally, this exercise offers a great opportunity to discuss how to best use the features of the LNT formal language and the associated CADP verification toolbox to model distributed protocols, including network and server failures.


title: Formalising the Optimised Link State Routing Protocol

abstract: Routing protocol specifications are traditionally written in plain English. Often this yields ambiguities, inaccuracies or even contradictions. Formal methods techniques, such as process algebras, avoid these problems, thus leading to more precise and verifiable descriptions of protocols. In this paper we use the timed process algebra T-AWN for modelling the Optimised Link State Routing protocol (OLSR) version 2.


title: Formal Models of the OSPF Routing Protocol

abstract: We present three formal models of the OSPF routing protocol. The first two are formalised in the timed process algebra T-AWN, which is not only tailored to routing protocols, but also specifies protocols in pseudo-code that is easily readable. The difference between the two models lies in the level of detail (level of abstraction). From the more abstract model we then generate the third model. It is based on networks of timed automata and can be executed in the model checker Uppaal.


title: Iterative Variable Reordering: Taming Huge System Families

abstract: For the verification of systems using model-checking techniques, symbolic representations based on binary decision diagrams (BDDs) often help to tackle the well-known state-space explosion problem. Symbolic BDD-based representations have been also shown to be successful for the analysis of families of systems that arise, e.g., through configurable parameters or following the feature-oriented modeling approach. The state space of such system families face an additional exponential blowup in the number of parameters or features. It is well known that the order of variables in ordered BDDs is crucial for the size of the model representation. Especially for automatically generated models from real-world systems, family models might even be not constructible due to bad variable orders. In this paper we describe a technique, called iterative variable reordering, that can enable the construction of large-scale family models. We exemplify feasibility of our approach by means of an aircraft velocity control system with redundancy mechanisms modeled in the input language of the probabilistic model checker PRISM. We show that standard reordering and dynamic reordering techniques fail to construct the family model due to memory and time constraints, respectively, while the new iterative approach succeeds to generate a symbolic family model.


title: Estimating End-to-End Latencies in Automotive Cyber-physical Systems

abstract: Controller networks in today's automotive systems consist of more than 100 ECUs connected by various bus protocols. Seamless operation of the entire system requires a well-orchestrated interaction of these ECUs. Consequently, to ensure safety and comfort, a performance analysis is an inherent part of the engineering process. Conducting such an analysis manually is expensive, slow, and error prone. Tool support is therefore crucial, and a number of approaches have been presented. However, most work is limited to either network latencies or software latencies which results in an analysis gap at the transition between different layers of the communication stack. The work presented here introduces an approach to close this gap. Furthermore, we discuss the integration of different methods to obtain an end-to-end latency analysis.


title: Modeling an Asynchronous Circuit Dedicated to the Protection Against Physical Attacks

abstract: Asynchronous circuits have several advantages for security applications, in particular their good resistance to attacks. In this paper, we report on experiments with modeling, at various abstraction levels, a patented asynchronous circuit for detecting physical attacks, such as cutting wires or producing short-circuits.


title: Simulation-based Safety Assessment of High-level Reliability Models

abstract: Systems engineering approaches use high-level models to capture the architecture and behavior of the system. However, when safety engineers conduct safety and reliability analysis, they have to create formal models, such as fault-trees, according to the behavior described by the high-level engineering models and environmental/fault assumptions. Instead of creating low-level analysis models, our approach builds on engineering models in safety analysis by exploiting the simulation capabilities of recent probabilistic programming and simulation advancements. Thus, it could be applied in accordance with standards and best practices for the analysis of a critical automotive system as part of an industrial collaboration, while leveraging high-level block diagrams and statechart models created by engineers. We demonstrate the applicability of our approach in a case study adapted from the automotive system from the collaboration.


title: Evaluating the Rainbow DQN Agent in Hanabi with Unseen Partners

abstract: Hanabi is a cooperative game that challenges exist-ing AI techniques due to its focus on modeling the mental states ofother players to interpret and predict their behavior. While thereare agents that can achieve near-perfect scores in the game byagreeing on some shared strategy, comparatively little progresshas been made in ad-hoc cooperation settings, where partnersand strategies are not known in advance. In this paper, we showthat agents trained through self-play using the popular RainbowDQN architecture fail to cooperate well with simple rule-basedagents that were not seen during training and, conversely, whenthese agents are trained to play with any individual rule-basedagent, or even a mix of these agents, they fail to achieve goodself-play scores.


title: Synthesizing Strategies for Needle Steering in Gelatin Phantoms

abstract: In medicine, needles are frequently used to deliver treatments to subsurface targets or to take tissue samples from the inside of an organ. Current clinical practice is to insert needles under image guidance or haptic feedback, although that may involve reinsertions and adjustments since the needle and its interaction with the tissue during insertion cannot be completely controlled. (Automated) needle steering could in theory improve the accuracy with which a target is reached and thus reduce surgical traumata especially for minimally invasive procedures, e.g., brachytherapy or biopsy. Yet, flexible needles and needle-tissue interaction are both complex and expensive to model and can often be computed approximatively only. In this paper we propose to employ timed games to navigate flexible needles with a bevel tip to reach a fixed target in tissue. We use a simple non-holonomic model of needle-tissue interaction, which abstracts in particular from the various physical forces involved and appears to be simplistic compared to related models from medical robotics. Based on the model, we synthesize strategies from which we can derive sufficiently precise motion plans to steer the needle in soft tissue. However, applying those strategies in practice, one is faced with the problem of an unpredictable behavior of the needle at the initial insertion point. Our proposal is to implement a preprocessing step to initialize the model based on data from the real system, once the needle is inserted. Taking into account the actual needle tip angle and position, we generate strategies to reach the desired target. We have implemented the model in Uppaal Stratego and evaluated it on steering a flexible needle in gelatin phantoms; gelatin phantoms are commonly used in medical technology to simulate the behavior of soft tissue. The experiments show that strategies can be synthesized for both generated and measured needle motions with a maximum deviation of 1.84mm.


title: Epione: Lightweight Contact Tracing with Strong Privacy

abstract: Contact tracing is an essential tool in containing infectious diseases such as COVID-19. Many countries and research groups have launched or announced mobile apps to facilitate contact tracing by recording contacts between users with some privacy considerations. Most of the focus has been on using random tokens, which are exchanged during encounters and stored locally on users' phones. Prior systems allow users to search over released tokens in order to learn if they have recently been in the proximity of a user that has since been diagnosed with the disease. However, prior approaches do not provide end-to-end privacy in the collection and querying of tokens. In particular, these approaches are vulnerable to either linkage attacks by users using token metadata, linkage attacks by the server, or false reporting by users. In this work, we introduce Epione, a lightweight system for contact tracing with strong privacy protections. Epione alerts users directly if any of their contacts have been diagnosed with the disease, while protecting the privacy of users' contacts from both central services and other users, and provides protection against false reporting. As a key building block, we present a new cryptographic tool for secure two-party private set intersection cardinality (PSI-CA), which allows two parties, each holding a set of items, to learn the intersection size of two private sets without revealing intersection items. We specifically tailor it to the case of large-scale contact tracing where clients have small input sets and the server's database of tokens is much larger.


title: A deep learning-based framework for segmenting invisible clinical target volumes with estimated uncertainties for post-operative prostate cancer radiotherapy

abstract: In post-operative radiotherapy for prostate cancer, the cancerous prostate gland has been surgically removed, so the clinical target volume (CTV) to be irradiated encompasses the microscopic spread of tumor cells, which cannot be visualized in typical clinical images such as computed tomography or magnetic resonance imaging. In current clinical practice, physicians segment CTVs manually based on their relationship with nearby organs and other clinical information, per clinical guidelines. Automating post-operative prostate CTV segmentation with traditional image segmentation methods has been a major challenge. Here, we propose a deep learning model to overcome this problem by segmenting nearby organs first, then using their relationship with the CTV to assist CTV segmentation. The model proposed is trained using labels clinically approved and used for patient treatment, which are subject to relatively large inter-physician variations due to the absence of a visual ground truth. The model achieves an average Dice similarity coefficient (DSC) of 0.87 on a holdout dataset of 50 patients, much better than established methods, such as atlas-based methods (DSC<0.7). The uncertainties associated with automatically segmented CTV contours are also estimated to help physicians inspect and revise the contours, especially in areas with large inter-physician variations. We also use a 4-point grading system to show that the clinical quality of the automatically segmented CTV contours is equal to that of approved clinical contours manually drawn by physicians.


title: A continuous time formulation of stochastic dual control to avoid the curse of dimensionality

abstract: Dual control denotes a class of control problems where the parameters governing the system are imperfectly known. The challenge is to find the optimal balance between probing, i.e. exciting the system to understand it more, and caution, i.e. selecting conservative controls based on current knowledge to achieve the control objective. Dynamic programming techniques can achieve this optimal trade-off. However, while dynamic programming performs well with discrete state and time, it is not well-suited to problems with continuous time-frames or continuous or unbounded state spaces. Another limitation is that multidimensional states often cause the dynamic programming approaches to be intractable. In this paper, we investigate whether continuous-time optimal control tools could help circumvent these caveats whilst still achieving the probing-caution balance. We introduce a stylized problem where the state is governed by one of two differential equations. It is initially unknown which differential equation governs the system, so we must simultaneously determine the true differential equation and control the system to the desired state. We show how this problem can be transformed to apply optimal control tools, and compare the performance of this approach to a dynamic programming approach. Our results suggest that the optimal control algorithm rivals dynamic programming on small problems, achieving the right balance between aggressive and smoothly varying controls. In contrast to dynamic programming, the optimal control approach remains tractable when several states are to be controlled simultaneously.


title: Observation of primary scintillations in the visible range in liquid argon doped with methane

abstract: Neutron veto detector based on liquid scintillator containing hydrogen atoms is an integral part of any underground experiment for dark matter search. So far, a flammable mixture of liquid hydrocarbons was used as a liquid scintillator in such detectors. A safe alternative might be a liquid scintillator based on liquid argon doped with methane. In this work, we have studied the primary scintillations in pure liquid argon and its mixtures with methane, the CH4 content varying from 100 ppm to 5%. The primary scintillations have for the first time been observed in liquid argon doped with methane, in the visible and near infrared range, and their relative light yields have been measured as a function of the CH4 content.


title: Neural Hair Rendering

abstract: In this paper, we propose a generic neural-based hair rendering pipeline that can synthesize photo-realistic images from virtual 3D hair models. Unlike existing supervised translation methods that require model-level similarity to preserve consistent structure representation for both real images and fake renderings, our method adopts an unsupervised solution to work on arbitrary hair models. The key component of our method is a shared latent space to encode appearance-invariant structure information of both domains, which generates realistic renderings conditioned by extra appearance inputs. This is achieved by domain-specific pre-disentangled structure representation, partially shared domain encoder layers and a structure discriminator. We also propose a simple yet effective temporal conditioning method to enforce consistency for video sequence generation. We demonstrate the superiority of our method by testing it on a large number of portraits and comparing it with alternative baselines and state-of-the-art unsupervised image translation methods.


title: Self-trapped dynamics of a hollow Gaussian beam in metamaterials

abstract: We present a systematic investigation on the dynamics of a hollow Gaussian beam (HGB) in metamaterials. We predict self-trapped propagation of HGBs and evolution of the beam is highly influenced by dimensionless dispersion coefficient (k), which determines the strength of dispersion over diffraction. The evolutions of HGBs such as disappearance of single ringed intensity pattern and appearance of patterns with a central bright spot are achievable with less propagation distance in metamaterials with higher values of k. On the other hand, metamaterials with low values of k can preserve single ring intensity distribution over a long propagation distance without focusing. When the strength of dispersion over diffraction increases, it significantly influences the evolution of the beam and may lead to the formation of tightly focussed beam with high peak intensity at the center. The phenomenon of tight focussing is found to have some applications in trapping of nanosized particles.


title: Solar Flares Forecasting Using Time Series and Extreme Gradient Boosting Ensembles

abstract: Space weather events may cause damage to several fields, including aviation, satellites, oil and gas industries, and electrical systems, leading to economic and commercial losses. Solar flares are one of the most significant events, and refer to sudden radiation releases that can affect the Earth's atmosphere within a few hours or minutes. Therefore, it is worth designing high-performance systems for forecasting such events. Although in the literature there are many approaches for flare forecasting, there is still a lack of consensus concerning the techniques used for designing these systems. Seeking to establish some standardization while designing flare predictors, in this study we propose a novel methodology for designing such predictors, further validated with extreme gradient boosting tree classifiers and time series. This methodology relies on the following well-defined machine learning based pipeline: (i) univariate feature selection; (ii) randomized hyper-parameter optimization; (iii) imbalanced data treatment; (iv) adjustment of cut-off point of classifiers; and (v) evaluation under operational settings. To verify our methodology effectiveness, we designed and evaluated three proof-of-concept models for forecasting $\geq C$ class flares up to 72 hours ahead. Compared to baseline models, those models were able to significantly increase their scores of true skill statistics (TSS) under operational forecasting scenarios by 0.37 (predicting flares in the next 24 hours), 0.13 (predicting flares within 24-48 hours), and 0.36 (predicting flares within 48-72 hours). Besides increasing TSS, the methodology also led to significant increases in the area under the ROC curve, corroborating that we improved the positive and negative recalls of classifiers while decreasing the number of false alarms.


title: Interface Junctions in QCD${}_4$

abstract: We study 3+1 dimensional $SU(N)$ Quantum Chromodynamics (QCD) with $N_f$ degenerate quarks that have a spatially varying complex mass. It leads to a network of interfaces connected by interface junctions. We use anomaly inflow to constrain these defects. Based on the chiral Lagrangian and the conjectures on the interfaces, characterized by a spatially varying $\theta$-parameter, we propose a low-energy description of such networks of interfaces. Interestingly, we observe that the operators in the effective field theories on the junctions can carry baryon charges, and their spin and isospin representations coincide with baryons. We also study defects, characterized by spatially varying coupling constants, in 2+1 dimensional Chern-Simons-matter theories and in a 3+1 dimensional real scalar theory.


title: Learned Garbage Collection

abstract: Several programming languages use garbage collectors (GCs) to automatically manage memory for the programmer. Such collectors must decide when to look for unreachable objects to free, which can have a large performance impact on some applications. In this preliminary work, we propose a design for a learned garbage collector that autonomously learns over time when to perform collections. By using reinforcement learning, our design can incorporate user-defined reward functions, allowing an autonomous garbage collector to learn to optimize the exact metric the user desires (e.g., request latency or queries per second). We conduct an initial experimental study on a prototype, demonstrating that an approach based on tabular Q learning may be promising.


title: Tree-depth and the Formula Complexity of Subgraph Isomorphism

abstract: For a fixed "pattern" graph $G$, the $\textit{colored $G$-subgraph isomorphism problem}$ (denoted $\mathrm{SUB}(G)$) asks, given an $n$-vertex graph $H$ and a coloring $V(H) \to V(G)$, whether $H$ contains a properly colored copy of $G$. The complexity of this problem is tied to parameterized versions of $\mathit{P}$ ${=}?$ $\mathit{NP}$ and $\mathit{L}$ ${=}?$ $\mathit{NL}$, among other questions. An overarching goal is to understand the complexity of $\mathrm{SUB}(G)$, under different computational models, in terms of natural invariants of the pattern graph $G$. In this paper, we establish a close relationship between the $\textit{formula complexity}$ of $\mathrm{SUB}$ and an invariant known as $\textit{tree-depth}$ (denoted $\mathrm{td}(G)$). $\mathrm{SUB}(G)$ is known to be solvable by monotone $\mathit{AC^0}$ formulas of size $O(n^{\mathrm{td}(G)})$. Our main result is an $n^{\tilde\Omega(\mathrm{td}(G)^{1/3})}$ lower bound for formulas that are monotone $\textit{or}$ have sub-logarithmic depth. This complements a lower bound of Li, Razborov and Rossman (SICOMP 2017) relating tree-width and $\mathit{AC^0}$ circuit size. As a corollary, it implies a stronger homomorphism preservation theorem for first-order logic on finite structures (Rossman, ITCS 2017). The technical core of this result is an $n^{\Omega(k)}$ lower bound in the special case where $G$ is a complete binary tree of height $k$, which we establish using the $\textit{pathset framework}$ introduced in (Rossman, SICOMP 2018). (The lower bound for general patterns follows via a recent excluded-minor characterization of tree-depth (Czerwi\'nski et al, arXiv:1904.13077).) Additional results of this paper extend the pathset framework and improve upon both, the best known upper and lower bounds on the average-case formula size of $\mathrm{SUB}(G)$ when $G$ is a path.


title: Heterogeneous Representation Learning: A Review

abstract: The real-world data usually exhibits heterogeneous properties such as modalities, views, or resources, which brings some unique challenges wherein the key is Heterogeneous Representation Learning (HRL) termed in this paper. This brief survey covers the topic of HRL, centered around several major learning settings and real-world applications. First of all, from the mathematical perspective, we present a unified learning framework which is able to model most existing learning settings with the heterogeneous inputs. After that, we conduct a comprehensive discussion on the HRL framework by reviewing some selected learning problems along with the mathematics perspectives, including multi-view learning, heterogeneous transfer learning, Learning using privileged information and heterogeneous multi-task learning. For each learning task, we also discuss some applications under these learning problems and instantiates the terms in the mathematical framework. Finally, we highlight the challenges that are less-touched in HRL and present future research directions. To the best of our knowledge, there is no such framework to unify these heterogeneous problems, and this survey would benefit the community.


title: Learning to Learn Morphological Inflection for Resource-Poor Languages

abstract: We propose to cast the task of morphological inflection - mapping a lemma to an indicated inflected form - for resource-poor languages as a meta-learning problem. Treating each language as a separate task, we use data from high-resource source languages to learn a set of model parameters that can serve as a strong initialization point for fine-tuning on a resource-poor target language. Experiments with two model architectures on 29 target languages from 3 families show that our suggested approach outperforms all baselines. In particular, it obtains a 31.7% higher absolute accuracy than a previously proposed cross-lingual transfer model and outperforms the previous state of the art by 1.7% absolute accuracy on average over languages.


title: Weakly Supervised POS Taggers Perform Poorly on Truly Low-Resource Languages

abstract: Part-of-speech (POS) taggers for low-resource languages which are exclusively based on various forms of weak supervision - e.g., cross-lingual transfer, type-level supervision, or a combination thereof - have been reported to perform almost as well as supervised ones. However, weakly supervised POS taggers are commonly only evaluated on languages that are very different from truly low-resource languages, and the taggers use sources of information, like high-coverage and almost error-free dictionaries, which are likely not available for resource-poor languages. We train and evaluate state-of-the-art weakly supervised POS taggers for a typologically diverse set of 15 truly low-resource languages. On these languages, given a realistic amount of resources, even our best model gets only less than half of the words right. Our results highlight the need for new and different approaches to POS tagging for truly low-resource languages.


title: Ground state and nodal solutions for a class of double phase problems

abstract: We consider a double phase problem driven by the sum of the $p$-Laplace operator and a weighted $q$-Laplacian ($q<p$), with a weight function which is not bounded away from zero. The reaction term is $(p-1)$-superlinear. Employing the Nehari method, we show that the equation has a ground state solution of constant sign and a nodal (sign-changing) solution.


title: Insight-HXMT insight into switch of the accretion mode: the case of the X-ray pulsar 4U 1901+03

abstract: We use the In data collected during the 2019 outburst from X-ray pulsar 4U 1901+03 to complement the orbital parameters reported by Fermi/GBM. Using the Insight-HXMT, we examine the correlation between the derivative of the intrinsic spin frequency and bolometric flux based on accretion torque models. It was found that the pulse profiles significantly evolve during the outburst. The existence of two types of the profile's pattern discovered in the Insight-HXMT data indicates that this source experienced transition between a super-critical and a sub-critical accretion regime during its 2019 outburst. Based on the evolution of the pulse profiles and the torque model, we derive the distance to 4U 1901+03 as 12.4+-0.2 kpc.


title: Photon directional profile from stimulated decay of axion clouds with arbitrary axion spatial distributions

abstract: We model clusters of axions with spherically symmetric momentum but arbitrary spatial distributions and study the directional profile of photos produced in their evolution through spontaneous and stimulated decay of axions via the process $a \rightarrow \gamma + \gamma$. Several specific examples are presented.


title: Ultrafast 1 MHz vacuum-ultraviolet source via highly cascaded harmonic generation in negative-curvature hollow-core fibers

abstract: Vacuum ultraviolet (VUV) light is critical for the study of molecules and materials, but the generation of femtosecond pulses in the VUV region at high repetition rates has proven difficult. Here, we demonstrate the efficient generation of VUV light at MHz repetition rates using highly cascaded four-wave mixing processes in a negative-curvature hollow-core fiber. Both even and odd order harmonics are generated up to the 15th harmonic (69 nm, 18.0 eV), with high energy resolution of ~40 meV. In contrast to direct high harmonic generation, this highly cascaded harmonic generation process requires lower peak intensity and therefore can operate at higher repetition rates, driven by a robust ~10 W fiber-laser system in a compact setup. Additionally, we present numerical simulations that explore the fundamental capabilities and spatiotemporal dynamics of highly cascaded harmonic generation. This VUV source can enhance the capabilities of spectroscopies of molecular and quantum materials, such as photoionization mass spectrometry and time , angle , and spin-resolved photoemission.


title: Self-Attention with Cross-Lingual Position Representation

abstract: Position encoding (PE), an essential part of self-attention networks (SANs), is used to preserve the word order information for natural language processing tasks, generating fixed position indices for input sequences. However, in cross-lingual scenarios, e.g. machine translation, the PEs of source and target sentences are modeled independently. Due to word order divergences in different languages, modeling the cross-lingual positional relationships might help SANs tackle this problem. In this paper, we augment SANs with \emph{cross-lingual position representations} to model the bilingually aware latent structure for the input sentence. Specifically, we utilize bracketing transduction grammar (BTG)-based reordering information to encourage SANs to learn bilingual diagonal alignments. Experimental results on WMT'14 English$\Rightarrow$German, WAT'17 Japanese$\Rightarrow$English, and WMT'17 Chinese$\Leftrightarrow$English translation tasks demonstrate that our approach significantly and consistently improves translation quality over strong baselines. Extensive analyses confirm that the performance gains come from the cross-lingual information.


title: Corrigendum to the paper "The optimal range of the Calderon operator and its applications." [J. Funct. Anal. 277 (2019), no. 10, 3513--3559, arXiv:1908.09548]

abstract: We fix a gap in the proof of a result in our earlier paper arXiv:1908.09548


title: Certifying Certainty and Uncertainty in Approximate Membership Query Structures -- Extended Version

abstract: Approximate Membership Query structures (AMQs) rely on randomisation for time- and space-efficiency, while introducing a possibility of false positive and false negative answers. Correctness proofs of such structures involve subtle reasoning about bounds on probabilities of getting certain outcomes. Because of these subtleties, a number of unsound arguments in such proofs have been made over the years. In this work, we address the challenge of building rigorous and reusable computer-assisted proofs about probabilistic specifications of AMQs. We describe the framework for systematic decomposition of AMQs and their properties into a series of interfaces and reusable components. We implement our framework as a library in the Coq proof assistant and showcase it by encoding in it a number of non-trivial AMQs, such as Bloom filters, counting filters, quotient filters and blocked constructions, and mechanising the proofs of their probabilistic specifications. We demonstrate how AMQs encoded in our framework guarantee the absence of false negatives by construction. We also show how the proofs about probabilities of false positives for complex AMQs can be obtained by means of verified reduction to the implementations of their simpler counterparts. Finally, we provide a library of domain-specific theorems and tactics that allow a high degree of automation in probabilistic proofs.


title: Modularized Transfomer-based Ranking Framework

abstract: Recent innovations in Transformer-based ranking models have advanced the state-of-the-art in information retrieval. However, these Transformers are computationally expensive, and their opaque hidden states make it hard to understand the ranking process. In this work, we modularize the Transformer ranker into separate modules for text representation and interaction. We show how this design enables substantially faster ranking using offline pre-computed representations and light-weight online interactions. The modular design is also easier to interpret and sheds light on the ranking process in Transformer rankers.


title: Deep Machine Learning Approach to Develop a New Asphalt Pavement Condition Index

abstract: Automated pavement distress detection via road images is still a challenging issue among pavement researchers and computer-vision community. In recent years, advancement in deep learning has enabled researchers to develop robust tools for analyzing pavement images at unprecedented accuracies. Nevertheless, deep learning models necessitate a big ground truth dataset, which is often not readily accessible for pavement field. In this study, we reviewed our previous study, which a labeled pavement dataset was presented as the first step towards a more robust, easy-to-deploy pavement condition assessment system. In total, 7237 google street-view images were extracted, manually annotated for classification (nine categories of distress classes). Afterward, YOLO (you look only once) deep learning framework was implemented to train the model using the labeled dataset. In the current study, a U-net based model is developed to quantify the severity of the distresses, and finally, a hybrid model is developed by integrating the YOLO and U-net model to classify the distresses and quantify their severity simultaneously. Various pavement condition indices are developed by implementing various machine learning algorithms using the YOLO deep learning framework for distress classification and U-net for segmentation and distress densification. The output of the distress classification and segmentation models are used to develop a comprehensive pavement condition tool which rates each pavement image according to the type and severity of distress extracted.


title: Surface-like boundaries of hyperbolic groups

abstract: We classify the boundaries of hyperbolic groups that have enough quasiconvex codimension-1 surface subgroups with trivial or cyclic intersections.


title: SCRDet++: Detecting Small, Cluttered and Rotated Objects via Instance-Level Feature Denoising and Rotation Loss Smoothing

abstract: Small and cluttered objects are common in real-world which are challenging for detection. The difficulty is further pronounced when the objects are rotated, as traditional detectors often routinely locate the objects in horizontal bounding box such that the region of interest is contaminated with background or nearby interleaved objects. In this paper, we first innovatively introduce the idea of denoising to object detection. Instance-level denoising on the feature map is performed to enhance the detection to small and cluttered objects. To handle the rotation variation, we also add a novel IoU constant factor to the smooth L1 loss to address the long standing boundary problem, which to our analysis, is mainly caused by the periodicity of angular (PoA) and exchangeability of edges (EoE). By combing these two features, our proposed detector is termed as SCRDet++. Extensive experiments are performed on large aerial images public datasets DOTA, DIOR, UCAS-AOD as well as natural image dataset COCO, scene text dataset ICDAR2015, small traffic light dataset BSTLD and our released S$^2$TLD by this paper. The results show the effectiveness of our approach. The released dataset S2TLD is made public available, which contains 5,786 images with 14,130 traffic light instances across five categories.


title: Let's be Humorous: Knowledge Enhanced Humor Generation

abstract: The generation of humor is an under-explored and challenging problem. Previous works mainly utilize templates or replace phrases to generate humor. However, few works focus on freer forms and the background knowledge of humor. The linguistic theory of humor defines the structure of a humor sentence as set-up and punchline. In this paper, we explore how to generate a punchline given the set-up with the relevant knowledge. We propose a framework that can fuse the knowledge to end-to-end models. To our knowledge, this is the first attempt to generate punchlines with knowledge enhanced model. Furthermore, we create the first humor-knowledge dataset. The experimental results demonstrate that our method can make use of knowledge to generate fluent, funny punchlines, which outperforms several baselines.


title: Hybrid Active/Passive Wireless Network Aided by Intelligent Reflecting Surface: System Modeling and Performance Analysis

abstract: Intelligent reflecting surface (IRS) is a new and promising paradigm to substantially improve the spectral and energy efficiency of wireless networks, by constructing favorable communication channels via tuning massive low-cost passive reflecting elements. Despite recent advances in the link-level performance optimization for various IRS-aided wireless systems, it still remains an open problem whether the large-scale deployment of IRSs in wireless networks can be a cost-effective solution to achieve their sustainable capacity growth in the future. To address this problem, we study in this paper a new hybrid wireless network comprising both active base stations (BSs) and passive IRSs, and characterize its achievable spatial throughput in the downlink as well as other pertinent key performance metrics averaged over both channel fading and random locations of the deployed BSs/IRSs therein based on stochastic geometry. Compared to prior works on characterizing the performance of wireless networks with active BSs only, our analysis needs to derive the power distributions of both the signal and interference reflected by distributed IRSs in the network under spatially correlated channels, which exhibit channel hardening effects when the number of IRS elements becomes large. Extensive numerical results are presented to validate our analysis and demonstrate the effectiveness of deploying distributed IRSs in enhancing the hybrid network throughput against the conventional network without IRS, which significantly boosts the signal power but results in only marginally increased interference in the network. Moreover, it is unveiled that there exists an optimal IRS/BS density ratio that maximizes the hybrid network throughput subject to a total deployment cost given their individual costs, while the conventional network without IRS is generally suboptimal in terms of throughput per unit cost.


title: The giant component and 2-core in sparse random outerplanar graphs

abstract: Let $A(n,m)$ be a graph chosen uniformly at random from the class of all vertex-labelled outerplanar graphs with $n$ vertices and $m$ edges. We consider $A(n,m)$ in the sparse regime when $m=n/2+s$ for $s=o(n)$. We show that with high probability the giant component in $A(n,m)$ emerges at $m=n/2+O\left(n^{2/3}\right)$ and determine the typical order of the 2-core. In addition, we prove that if $s=\omega\left(n^{2/3}\right)$, with high probability every edge in $A(n,m)$ belongs to at most one cycle.


title: Run-Time Accuracy Reconfigurable Stochastic Computing for Dynamic Reliability and Power Management

abstract: In this paper, we propose a novel accuracy-reconfigurable stochastic computing (ARSC) framework for dynamic reliability and power management. Different than the existing stochastic computing works, where the accuracy versus power/energy trade-off is carried out in the design time, the new ARSC design can change accuracy or bit-width of the data in the run-time so that it can accommodate the long-term aging effects by slowing the system clock frequency at the cost of accuracy while maintaining the throughput of the computing. We validate the ARSC concept on a discrete cosine transformation (DCT) and inverse DCT designs for image compressing/decompressing applications, which are implemented on Xilinx Spartan-6 family XC6SLX45 platform. Experimental results shows that the new design can easily mitigate the long-term aging induced effects by accuracy trade-off while maintaining the throughput of the whole computing process using simple frequency scaling. We further show that one-bit precision loss for input data, which translated to 3.44dB of the accuracy loss in term of Peak Signal to Noise Ratio for images, we can sufficiently compensate the NBTI induced aging effects in 10 years while maintaining the pre-aging computing throughput of 7.19 frames per second. At the same time, we can save 74\% power consumption by 10.67dB of accuracy loss. The proposed ARSC computing framework also allows much aggressive frequency scaling, which can lead to order of magnitude power savings compared to the traditional dynamic voltage and frequency scaling (DVFS) techniques.


title: Machine Learning Methods for Brain Network Classification: Application to Autism Diagnosis using Cortical Morphological Networks

abstract: Autism spectrum disorder (ASD) affects the brain connectivity at different levels. Nonetheless, non-invasively distinguishing such effects using magnetic resonance imaging (MRI) remains very challenging to machine learning diagnostic frameworks due to ASD heterogeneity. So far, existing network neuroscience works mainly focused on functional (derived from functional MRI) and structural (derived from diffusion MRI) brain connectivity, which might not capture relational morphological changes between brain regions. Indeed, machine learning (ML) studies for ASD diagnosis using morphological brain networks derived from conventional T1-weighted MRI are very scarce. To fill this gap, we leverage crowdsourcing by organizing a Kaggle competition to build a pool of machine learning pipelines for neurological disorder diagnosis with application to ASD diagnosis using cortical morphological networks derived from T1-weighted MRI. During the competition, participants were provided with a training dataset and only allowed to check their performance on a public test data. The final evaluation was performed on both public and hidden test datasets based on accuracy, sensitivity, and specificity metrics. Teams were ranked using each performance metric separately and the final ranking was determined based on the mean of all rankings. The first-ranked team achieved 70% accuracy, 72.5% sensitivity, and 67.5% specificity, while the second-ranked team achieved 63.8%, 62.5%, 65% respectively. Leveraging participants to design ML diagnostic methods within a competitive machine learning setting has allowed the exploration and benchmarking of wide spectrum of ML methods for ASD diagnosis using cortical morphological networks.


title: On an extension of operator transforms

abstract: We introduce the $\lambda$-mean transform $M_{\lambda}(T)$ of a Hilbert space operator $T$ as an extension of some operator transforms based on the Duggal transform $T^D$ by $M_{\lambda}(T) := \lambda T + (1-\lambda)T^D$, and present some of its essentially properties. Among other things, we obtain estimates for the operator norm and numerical radius of the $\lambda$-mean transform $M_{\lambda}(T)$ in terms of the original operator $T$.


title: The non-relativistic limit of the Vlasov-Maxwell system with uniform macroscopic bounds

abstract: We study in this paper the non-relativistic limit from Vlasov-Maxwell to Vlasov-Poisson, which corresponds to the regime where the speed of light is large compared to the typical velocities of particles. In contrast with \cite{Asano-Ukai-86-SMA}, \cite{Degond-86-MMAS}, \cite{Schaeffer-86-CMP} which handle the case of classical solutions, we consider measure-valued solutions, whose moments and electromagnetic fields are assumed to satisfy some uniform bounds. To this end, we use a functional inspired by the one introduced by Loeper in his proof of uniqueness for the Vlasov-Poisson system \cite{Loeper-2006}. We also build a special class of measure-valued solutions, that enjoy no higher regularity with respect to the momentum variable, but whose moments and electromagnetic fields satisfy all required conditions to enter our framework.


title: Learning Feature Descriptors using Camera Pose Supervision

abstract: Recent research on learned visual descriptors has shown promising improvements in correspondence estimation, a key component of many 3D vision tasks. However, existing descriptor learning frameworks typically require ground-truth correspondences between feature points for training, which are challenging to acquire at scale. In this paper we propose a novel weakly-supervised framework that can learn feature descriptors solely from relative camera poses between images. To do so, we devise both a new loss function that exploits the epipolar constraint given by camera poses, and a new model architecture that makes the whole pipeline differentiable and efficient. Because we no longer need pixel-level ground-truth correspondences, our framework opens up the possibility of training on much larger and more diverse datasets for better and unbiased descriptors. We call the resulting descriptors CAmera Pose Supervised, or CAPS, descriptors. Though trained with weak supervision, CAPS descriptors outperform even prior fully-supervised descriptors and achieve state-of-the-art performance on a variety of geometric tasks. Project Page: https://qianqianwang68.github.io/CAPS/


title: Lone octupole and bulk magnetism in osmate 5d2 double perovskites

abstract: Cubic double perovskites that host heavy ions with total angular momentum J = 2 can exhibit a singular magnetic state epitomized by a lone octupole and bulk ferro-type magnetism. It exists in the Chen - Balents Hamiltonian with a quadrupole interaction and competing exchange forces between the ions. Our symmetry inspired analysis mirrors the Dzyaloshinskii - Man'ko theory of latent antiferromagnetic ordering, and a 3-k collinear structure. Experimental tests of the singular state include neutron and x-ray Bragg diffraction.


title: Topological phase transition and phonon-space Dirac topology surfaces in ZrTe$_5$

abstract: We use first-principles methods to reveal that in ZrTe$_5$, a layered van der Waals material like graphite, atomic displacements corresponding to five of the six zone-center A$_g$ (symmetry-preserving) phonon modes can drive a topological phase transition from strong to weak topological insulator with a Dirac semimetal state emerging at the transition, giving rise to a Dirac topology surface in the multi-dimensional space formed by the A$_g$ phonon modes. This implies that the topological phase transition in ZrTe$_5$ can be realized with many different settings of external stimuli that are capable of penetrating through the phonon-space Dirac surface without breaking the crystallographic symmetry. Furthermore, we predict that domains with effective mass of opposite signs can be created by laser pumping and will host Weyl modes of opposite chirality propagating along the domain boundaries. Studying phonon-space topology surfaces provides a new route to understanding and utilizing the exotic physical properties of ZrTe$_5$ and related quantum materials.


title: Hole or grain? A Section Pursuit Index for Finding Hidden Structure in Multiple Dimensions

abstract: Multivariate data is often visualized using linear projections, produced by techniques such as principal component analysis, linear discriminant analysis, and projection pursuit. A problem with projections is that they obscure low and high density regions near the center of the distribution. Sections, or slices, can help to reveal them. This paper develops a section pursuit method, building on the extensive work in projection pursuit, to search for interesting slices of the data. Linear projections are used to define sections of the parameter space, and to calculate interestingness by comparing the distribution of observations, inside and outside a section. By optimizing this index, it is possible to reveal features such as holes (low density) or grains (high density). The optimization is incorporated into a guided tour so that the search for structure can be dynamic. The approach can be useful for problems when data distributions depart from uniform or normal, as in visually exploring nonlinear manifolds, and functions in multivariate space. Two applications of section pursuit are shown: exploring decision boundaries from classification models, and exploring subspaces induced by complex inequality conditions from multiple parameter model. The new methods are available in R, in the tourr package.


title: Privacy Guidelines for Contact Tracing Applications

abstract: Contact tracing is a very powerful method to implement and enforce social distancing to avoid spreading of infectious diseases. The traditional approach of contact tracing is time consuming, manpower intensive, dangerous and prone to error due to fatigue or lack of skill. Due to this there is an emergence of mobile based applications for contact tracing. These applications primarily utilize a combination of GPS based absolute location and Bluetooth based relative location remitted from user's smartphone to infer various insights. These applications have eased the task of contact tracing; however, they also have severe implication on user's privacy, for example, mass surveillance, personal information leakage and additionally revealing the behavioral patterns of the user. This impact on user's privacy leads to trust deficit in these applications, and hence defeats their purpose. In this work we discuss the various scenarios which a contact tracing application should be able to handle. We highlight the privacy handling of some of the prominent contact tracing applications. Additionally, we describe the various threat actors who can disrupt its working, or misuse end user's data, or hamper its mass adoption. Finally, we present privacy guidelines for contact tracing applications from different stakeholder's perspective. To best of our knowledge, this is the first generic work which provides privacy guidelines for contact tracing applications.


title: Kink-antikink collision in a Lorentz-violating $\phi^4$ model

abstract: In this work, kink-antikink collision in a two-dimensional Lorentz-violating $\phi^4$ model is considered. It is shown that the Lorentz-violating term in the proposed model does not affect the structure of the linear perturbation spectrum of the standard $\phi^4$ model, and thus there exists only one vibrational mode. The Lorentz-violating term impacts, however, the frequency and spatial wave function of the vibrational mode. As a consequence, the well-known results on $\phi^4$ kink-antikink collision will also change. Collisions of kink-antikink pairs with different values of initial velocities and Lorentz-violating parameters are simulated using the Fourier spectral method. Our results indicate that models with larger Lorentz-violating parameters would have smaller critical velocities $v_c$ and smaller widths of bounce windows. Interesting fractal structures existing in the curves of maximal energy densities of the scalar field are also found.


title: Expansive Open Fermi Arcs and Connectivity Changes Induced by Infrared Phonons in ZrTe5

abstract: Expansive open Fermi arcs covering most of the surface Brillouin zone (SBZ) are desirable for detection and control of many topological phenomena, but so far has been only reported for Kramers-Weyl points, or unconventional chiral fermions, pinned at time-reversal invariant momentum in chiral materials. Here using first-principles band structure calculations, we show that for conventional Weyl points in ZrTe5 with the chirality of +1/-1 near the BZ center at general momentum induced by one of the infrared phonons, the second lowest B1u mode for breaking inversion symmetry, they can also form expansive open Fermi arcs across the SBZ boundary to occupy most of the SBZ when projected on (001) surface. We reveal that such expansive open Fermi arcs are evolved from the topological surface states that connect multiple surface Dirac points on the (001) surface of the topological insulator phases without lattice distortion in ZrTe5. Furthermore, we find that the connectivity of the induced open Fermi arcs can be changed by the magnitude of the lattice distortion of this infrared phonon mode. Thus, we propose that using coherent optical phonon to modulate lattice parameters can offer ways to induce novel topological features including expansive open Fermi arcs and dynamically control Fermi arcs connectivity in ZrTe5.


title: Leveraging Spatial Uncertainty for Online Error Compensation in EMT

abstract: Purpose: Electromagnetic Tracking (EMT) can potentially complement fluoroscopic navigation, reducing radiation exposure in a hybrid setting. Due to the susceptibility to external distortions, systematic error in EMT needs to be compensated algorithmically. Compensation algorithms for EMT in guidewire procedures are only practical in an online setting. Methods: We collect positional data and train a symmetric Artificial Neural Network (ANN) architecture for compensating navigation error. The results are evaluated in both online and offline scenarios and are compared to polynomial fits. We assess spatial uncertainty of the compensation proposed by the ANN. Simulations based on real data show how this uncertainty measure can be utilized to improve accuracy and limit radiation exposure in hybrid navigation. Results: ANNs compensate unseen distortions by more than 70%, outperforming polynomial regression. Working on known distortions, ANNs outperform polynomials as well. We empirically demonstrate a linear relationship between tracking accuracy and model uncertainty. The effectiveness of hybrid tracking is shown in a simulation experiment. Conclusion: ANNs are suitable for EMT error compensation and can generalize across unseen distortions. Model uncertainty needs to be assessed when spatial error compensation algorithms are developed, so that training data collection can be optimized. Finally, we find that error compensation in EMT reduces the need for x-ray images in hybrid navigation.


title: The AI Economist: Improving Equality and Productivity with AI-Driven Tax Policies

abstract: Tackling real-world socio-economic challenges requires designing and testing economic policies. However, this is hard in practice, due to a lack of appropriate (micro-level) economic data and limited opportunity to experiment. In this work, we train social planners that discover tax policies in dynamic economies that can effectively trade-off economic equality and productivity. We propose a two-level deep reinforcement learning approach to learn dynamic tax policies, based on economic simulations in which both agents and a government learn and adapt. Our data-driven approach does not make use of economic modeling assumptions, and learns from observational data alone. We make four main contributions. First, we present an economic simulation environment that features competitive pressures and market dynamics. We validate the simulation by showing that baseline tax systems perform in a way that is consistent with economic theory, including in regard to learned agent behaviors and specializations. Second, we show that AI-driven tax policies improve the trade-off between equality and productivity by 16% over baseline policies, including the prominent Saez tax framework. Third, we showcase several emergent features: AI-driven tax policies are qualitatively different from baselines, setting a higher top tax rate and higher net subsidies for low incomes. Moreover, AI-driven tax policies perform strongly in the face of emergent tax-gaming strategies learned by AI agents. Lastly, AI-driven tax policies are also effective when used in experiments with human participants. In experiments conducted on MTurk, an AI tax policy provides an equality-productivity trade-off that is similar to that provided by the Saez framework along with higher inverse-income weighted social welfare.


title: From a stochastic maximal inequality to infinite-dimensional martingales

abstract: As an alternative to the well-known methods of "chaining" and "bracketing" that have been developed in the study of random fields, a new method, which is based on a stochastic maximal inequality derived by using the Taylor expansion, is presented. The inequality dealing with finite-dimensional discrete-time martingales is pulled up to infinite-dimensional ones by using the monotone convergence arguments. The main results are some weak convergence theorems for sequences of separable random fields of discrete-time martingales under the uniform topology with the help also of entropy methods. As special cases, some new results for i.i.d. random sequences, including a new Donsker theorem and a moment bound for suprema of empirical processes indexed by classes of sets or functions, are obtained.


title: Implementation of a 12-Million Hodgkin-Huxley Neuron Network on a Single Chip

abstract: Understanding the human brain is the biggest challenge for scientists in the twenty-first century. The Hodgkin-Huxley (HH) model is one of the most successful mathematical models for bio-realistic simulations of the brain. However, the simulation of HH neurons involves complex computation, which makes the implementation of large-scale brain networks difficult. In this paper, we propose a hardware architecture that efficiently computes a large-scale network of HH neurons. This architecture is based on the neuron machine hardware architecture, which has the limitation of speed as it has only one computation node. The proposed architecture is essentially a non-Von Neumann synchronous system with multiple computation nodes, called hardware neurons, to achieve linear speedup. In this paper, the design of a digital circuit that computes large-scale networks of HH neurons is presented as an example to provide a detailed description of the proposed architecture. This design supports axonal conduction delay of spikes and short- and long-term plasticity synapses, along with floating-point precision HH neurons. The design is implemented on a field-programmable gate array (FPGA) chip and computes a network of one million HH neurons in near real time. The implemented system can compute a network with up to 12 million HH neurons and 600 million synapses. The proposed design method can facilitate the design of systems supporting complex neuron models and their flexible implementation on reconfigurable FPGA chips.


title: A Doubly Regularized Linear Discriminant Analysis Classifier with Automatic Parameter Selection

abstract: Linear discriminant analysis (LDA) based classifiers tend to falter in many practical settings where the training data size is smaller than, or comparable to, the number of features. As a remedy, different regularized LDA (RLDA) methods have been proposed. These methods may still perform poorly depending on the size and quality of the available training data. In particular, the test data deviation from the training data model, for example, due to noise contamination, can cause severe performance degradation. Moreover, these methods commit further to the Gaussian assumption (upon which LDA is established) to tune their regularization parameters, which may compromise accuracy when dealing with real data. To address these issues, we propose a doubly regularized LDA classifier that we denote as R2LDA. In the proposed R2LDA approach, the RLDA score function is converted into an inner product of two vectors. By substituting the expressions of the regularized estimators of these vectors, we obtain the R2LDA score function that involves two regularization parameters. To set the values of these parameters, we adopt three existing regularization techniques; the constrained perturbation regularization approach (COPRA), the bounded perturbation regularization (BPR) algorithm, and the generalized cross-validation (GCV) method. These methods are used to tune the regularization parameters based on linear estimation models, with the sample covariance matrix's square root being the linear operator. Results obtained from both synthetic and real data demonstrate the consistency and effectiveness of the proposed R2LDA approach, especially in scenarios involving test data contaminated with noise that is not observed during the training phase.


title: Automatic Cross-Replica Sharding of Weight Update in Data-Parallel Training

abstract: In data-parallel synchronous training of deep neural networks, different devices (replicas) run the same program with different partitions of the training batch, but weight update computation is repeated on all replicas, because the weights do not have a batch dimension to partition. This can be a bottleneck for performance and scalability in typical language models with large weights, and models with small per-replica batch size which is typical in large-scale training. This paper presents an approach to automatically shard the weight update computation across replicas with efficient communication primitives and data formatting, using static analysis and transformations on the training computation graph. We show this technique achieves substantial speedups on typical image and language models on Cloud TPUs, requiring no change to model code. This technique helps close the gap between traditionally expensive (ADAM) and cheap (SGD) optimizers, as they will only take a small part of training step time and have similar peak memory usage. It helped us to achieve state-of-the-art training performance in Google's MLPerf 0.6 submission.


title: Investigating the dynamics of COVID-19 pandemic in India under lockdown

abstract: In this paper, we investigate the ongoing dynamics of COVID-19 in India after its emergence in Wuhan, China in December 2019. We discuss the effect of nationwide lockdown implemented in India on March 25, 2020 to prevent the spread of COVID-19. Susceptible-Exposed-Infectious-Recovered (SEIR) model is used to forecast active COVID-19 cases in India considering the effect of nationwide lockdown and possible inflation in the active cases after its removal on May 3, 2020. Our model predicts that with the ongoing lockdown, the peak of active infected cases around 43,000 will occur in the mid of May, 2020. We also predict a 7$\%$ to 21$\%$ increase in the peak value of active infected cases for a variety of hypothetical scenarios reflecting a relative relaxation in the control strategies implemented by the government in the post-lockdown period. For India, it is an important decision to come up with a non-pharmaceutical control strategy such as nationwide lockdown for 40 days to prolong the higher phases of COVID-19 and to avoid severe load on its public health-care system. As the ongoing COVID-19 outbreak remains a global threat, it is a challenge for all the countries to come up with effective public health and administrative strategies to battle against COVID-19 and sustain their economies.


title: Semantics-Aware Inferential Network for Natural Language Understanding

abstract: For natural language understanding tasks, either machine reading comprehension or natural language inference, both semantics-aware and inference are favorable features of the concerned modeling for better understanding performance. Thus we propose a Semantics-Aware Inferential Network (SAIN) to meet such a motivation. Taking explicit contextualized semantics as a complementary input, the inferential module of SAIN enables a series of reasoning steps over semantic clues through an attention mechanism. By stringing these steps, the inferential network effectively learns to perform iterative reasoning which incorporates both explicit semantics and contextualized representations. In terms of well pre-trained language models as front-end encoder, our model achieves significant improvement on 11 tasks including machine reading comprehension and natural language inference.


title: On the stability of time-discrete dynamic multiple network poroelasticity systems arising from second-order implicit time-stepping schemes

abstract: The classical Biot's theory provides the foundation of a fully dynamic poroelasticity model describing the propagation of elastic waves in fluid-saturated media. Multiple network poroelastic theory (MPET) takes into account that the elastic matrix (solid) can be permeated by one or several ($n\ge1$) superimposed interacting single fluid networks of possibly different characteristics; hence the single network (classical Biot) model can be considered as a special case of the MPET model. We analyze the stability properties of the time-discrete systems arising from second-order implicit time stepping schemes applied to the variational formulation of the MPET model and prove an inf-sup condition with a constant that is independent of all model parameters. Moreover, we show that the fully discrete models obtained for a family of strongly conservative space discretizations are also uniformly stable with respect to the spatial discretization parameter. The norms in which these results hold are the basis for parameter-robust preconditioners.


title: Field emission characteristics of InSb patterned nanowires

abstract: InSb nanowire arrays with different geometrical parameters, diameter and pitch, are fabricated by top-down etching process on Si(100) substrates. Field emission properties of InSb nanowires are investigated by using a nano-manipulated tungsten probe-tip as anode inside the vacuum chamber of a scanning electron microscope. Stable field emission current is reported, with a maximum intensity extracted from a single nanowire of about 1$\mu A$, corresponding to a current density as high as 10$^4$ A/cm$^2$. Stability and robustness of nanowire is probed by monitoring field emission current for about three hours. By tuning the cathode-anode separation distance in the range 500nm - 1300nm, the field enhancement factor and the turn-on field exhibit a non-monotonic dependence, with a maximum enhancement $\beta \simeq $ 78 and a minimum turn-on field $E_{ON} \simeq$ 0.033 V/nm for a separation d =900nm. The reduction of spatial separation between nanowires and the increase of diameter cause the reduction of the field emission performance, with reduced field enhancement ($\beta <$ 60) and increased turn-on field ($E_{ON} \simeq $ 0.050 V/nm). Finally, finite element simulation of the electric field distribution in the system demonstrates that emission is limited to an effective area near the border of the nanowire top surface, with annular shape and maximum width of 10 nm.


title: The anomalous Hall Effect in a Magnetically Extended Topological Insulator Heterostructure

abstract: Constructing heterostructures of a topological insulator (TI) with an undoped magnetic insulator (MI) is a clean and versatile approach to break the time-reversible symmetry in the TI surface states. Despite a lot of efforts, the strength of interfacial magnetic proximity effect (MPE) is still too weak to achieve the quantum anomalous Hall effect and many other topological quantum phenomena. Recently, a new approach based on intercalation of atomic layers of MI, referred to as magnetic extension, was proposed to realize strong MPE [2D Mater. 4, 025082(2017)]. Motivated by this proposal, here, we study a magnetic extension system prepared by molecular beam epitaxy growth of MnSe thin films on topological insulator (Bi,Sb)2Te3. Direct evidence is obtained for intercalation of MnSe atomic layer into a few quintuple layers of (Bi,Sb)2Te3, forming either a double magnetic septuple layer (SL) or an isolated single SL at the interface, where one SL denotes a van der Waals building block consisting of B-A-B-Mn-B-A-B (A=Bi1-xSbx, B= Te1-ySey). The two types of interfaces (namely TI/mono-SL and TI/bi-SL) have different MPE, which is manifested as distinctively different transport behaviors. Specifically, the mono-SL induces a spinflip transition with a sharp change at small magnetic field in the anomalous Hall effect of TI layers, while the bi-SL induces a spin-flop transition with a slow change at large field. Our work demonstrates a useful platform to realize the full potential of the magnetic extension approach for pursuing novel topological physics and related device applications.


title: Scheduled DropHead: A Regularization Method for Transformer Models

abstract: In this paper, we introduce DropHead, a structured dropout method specifically designed for regularizing the multi-head attention mechanism, which is a key component of transformer, a state-of-the-art model for various NLP tasks. In contrast to the conventional dropout mechanisms which randomly drop units or connections, the proposed DropHead is a structured dropout method. It drops entire attention-heads during training and It prevents the multi-head attention model from being dominated by a small portion of attention heads while also reduces the risk of overfitting the training data, thus making use of the multi-head attention mechanism more efficiently. Motivated by recent studies about the learning dynamic of the multi-head attention mechanism, we propose a specific dropout rate schedule to adaptively adjust the dropout rate of DropHead and achieve better regularization effect. Experimental results on both machine translation and text classification benchmark datasets demonstrate the effectiveness of the proposed approach.


title: Complex-order Derivative and Integral Filters and its Applications

abstract: In this paper, complex-order derivative and integral filters are proposed, which are consistent with the filters with fractional derivative and integral orders. Compared with the filters designed only with real orders, complex order filters can reveal more details of input signals, and this can benefit a large number of tasks. The tremendous effect of the proposed complex-order filters, has been verified by several image processing examples. Especially, for the challenging problem indicating the diseased regions in prostate TRUS images, the proposed complex order filters look very promising. It is very astonishing that, indicating the diseased regions is fulfilled by complex-order integral, not by derivative. This is completely against the traditional views that using derivative operators to achieve the goal.


title: Robust Generative Adversarial Network

abstract: Generative adversarial networks (GANs) are powerful generative models, but usually suffer from instability and generalization problem which may lead to poor generations. Most existing works focus on stabilizing the training of the discriminator while ignoring the generalization properties. In this work, we aim to improve the generalization capability of GANs by promoting the local robustness within the small neighborhood of the training samples. We also prove that the robustness in small neighborhood of training sets can lead to better generalization. Particularly, we design a robust optimization framework where the generator and discriminator compete with each other in a \textit{worst-case} setting within a small Wasserstein ball. The generator tries to map \textit{the worst input distribution} (rather than a Gaussian distribution used in most GANs) to the real data distribution, while the discriminator attempts to distinguish the real and fake distribution \textit{with the worst perturbation}. We have proved that our robust method can obtain a tighter generalization upper bound than traditional GANs under mild assumptions, ensuring a theoretical superiority of RGAN over GANs. A series of experiments on CIFAR-10, STL-10 and CelebA datasets indicate that our proposed robust framework can improve on five baseline GAN models substantially and consistently.


title: Magnetisation dynamics of granular HAMR media by means of a multiscale model

abstract: Heat assisted magnetic recording (HAMR) technology represents the most promising candidate to replace the current perpendicular recording paradigm to achieve higher storage densities. To better understand HAMR dynamics in granular media we need to describe accurately the magnetisation dynamics up to temperatures close to the Curie point. To this end we propose a multiscale approach based on the micromagnetic Landau-Lifshitz-Bloch (LLB) equation of motion parametrised using atomistic calculations. The LLB formalism describes the magnetisation dynamics at finite temperature and allows to efficiently simulate large system sizes and long time scales. Atomistic simulations provide the required temperature dependent input quantities for the LLB equation, such as the equilibrium magnetisation and the anisotropy, and can be used to capture the detailed magnetisation dynamics. The multiscale approach makes possible to overcome the computational limitations of atomistic models in dealing with large systems, such as a recording track, while incorporating the basic physics of the HAMR process. We investigate the magnetisation dynamics of a single FePt grain as function of the properties of the temperature profile and applied field and test the micromagnetic results against atomistic calculations. Our results prove the appropriateness and potential of the approach proposed here where the granular model is able to reproduce the atomistic simulations and capture the main properties of a HAMR medium.


title: Two-point functions at arbitrary genus and its resurgence structure in a matrix model for 2D type IIA superstrings

abstract: In the previous papers, it is pointed out that a supersymmetric double-well matrix model corresponds to a two-dimensional type IIA superstring theory on a Ramond-Ramond background at the level of correlation functions. This was confirmed by agreement between their planar correlation functions. The supersymmetry in the matrix model corresponds to the target space supersymmetry and it is shown to be spontaneously broken by nonperturbative effect. Furthermore, in the matrix model we computed one-point functions of single-trace operators to all order of genus expansion in its double scaling limit. We found that this expansion is stringy and not Borel summable and hence there arises an ambiguity in applying the Borel resummation technique. We confirmed that resurgence works here, namely this ambiguity in perturbative series in a zero-instanton sector is exactly canceled by another ambiguity in a one-instanton sector obtained by instanton calculation. In this paper we extend this analysis and study resurgence structure of the two-point functions of the single trace operators. By using results in the random matrix theory, we derive two-point functions at arbitrary genus and see that the perturbative series in the zero-instanton sector again has an ambiguity. We find that the two-point functions inevitably have logarithmic singularity even at higher genus. In this derivation we obtain a new result of the two-point function expressed by the one-point function at the leading order in the soft-edge scaling limit of the random matrix theory. We also compute an ambiguity in the one-instanton sector by using the Airy kernel, and confirm that ambiguities in both sectors cancel each other at the leading order in the double scaling limit. We thus clarify resurgence structure of the two-point functions in the supersymmetric double-well matrix model.


abstract: The problem of finding the optimal portfolio for investors is called the portfolio optimization problem. Such problem mainly concerns the expectation and variability of return (i.e., mean and variance). Although the variance would be the most fundamental risk measure to be minimized, it has several drawbacks. Conditional Value-at-Risk (CVaR) is a relatively new risk measure that addresses some of the shortcomings of well-known variance-related risk measures, and because of its computational efficiencies, it has gained popularity. CVaR is defined as the expected value of the loss that occurs beyond a certain probability level ($\beta$). However, portfolio optimization problems that use CVaR as a risk measure are formulated with a single $\beta$ and may output significantly different portfolios depending on how the $\beta$ is selected. We confirm even small changes in $\beta$ can result in huge changes in the whole portfolio structure. In order to improve this problem, we propose RM-CVaR: Regularized Multiple $\beta$-CVaR Portfolio. We perform experiments on well-known benchmarks to evaluate the proposed portfolio. Compared with various portfolios, RM-CVaR demonstrates a superior performance of having both higher risk-adjusted returns and lower maximum drawdown.


title: A numerical multiscale method for fiber networks

abstract: Fiber network modeling can be used for studying mechanical properties of paper. The individual fibers and the bonds in-between constitute a detailed representation of the material. However, detailed microscale fiber network models must be resolved with efficient numerical methods. In this work, a numerical multiscale method for discrete network models is proposed that is based on the localized orthogonal decomposition method [arXiv:1810.05059]. The method is ideal for these network problems, because it reduces the maximum size of the problem, it is suitable for parallelization, and it can effectively solve fracture propagation. The problem analyzed in this work is the nodal displacement of a fiber network given an applied load. This problem is formulated as a linear system that is solved by using the aforementioned multiscale method. To solve the linear system, the multiscale method constructs a low-dimensional solution space with good approximation properties. The method is observed to work well for unstructured fiber networks, with optimal rates of convergence obtainable for highly localized configurations of the method.


title: Coordinate Interleaved Orthogonal Design with Media-Based Modulation

abstract: In this work, we propose a new multiple-input multiple-output (MIMO) concept, which is called coordinate interleaved orthogonal design with media-based modulation (CIOD-MBM). The proposed two novel CIOD-MBM schemes provide improved data rates as well as diversity gain while enabling hardware simplicity using a single radio frequency (RF) chain. Moreover, using the equivalent channel model, a reduced complexity can be obtained for maximum likelihood (ML) detection of the proposed system. Using computer simulations, it is shown that CIOD-MBM schemes provide remarkably better performance against the conventional MBM and CIOD systems.


title: A Route to High-Toughness Battery Electrodes

abstract: There is increasing interest in materials that combine energy-storing functions with augmented mechanical properties, ranging from flexibility in bending to stretchability to structural properties. In the case of lithium-ion batteries, these mechanical functions could enable their integration in emerging technologies such as wearable, free-form electronics and ultimately as structural elements, for example, in transport applications. This work presents a method to produce flexible LiFePO4 LFP electrodes with an extraordinary combination of electrochemical and mechanical performance. Such electrodes exhibit an exceptionally high specific toughness, combined with superior rate capability and energy density, with respect to reference electrodes with typical metallic current collectors. These properties are a result of the strong adhesion of the active material particles to the high surface area carbon nanotube fiber fabric, used as a lightweight, tough, and highly conducting current collector. This strong adherence minimizes electrical resistance, mitigates interfacial failure, and increases ductility through heterogeneous strain after cohesive failure of the inorganic phase. As a result, these electrodes can withstand large deformations before fracture, and, even after fracture, they retain excellent electrochemical performance, approximately double that of unstretched, Al-supported LFP electrodes with equivalent loading.


title: Communication-Efficient Edge AI Inference Over Wireless Networks

abstract: Given the fast growth of intelligent devices, it is expected that a large number of high-stake artificial intelligence (AI) applications, e.g., drones, autonomous cars, tactile robots, will be deployed at the edge of wireless networks in the near future. As such, the intelligent communication networks will be designed to leverage advanced wireless techniques and edge computing technologies to support AI-enabled applications at various end devices with limited communication, computation, hardware and energy resources. In this article, we shall present the principles of efficient deployment of model inference at network edge to provide low-latency and energy-efficient AI services. This includes the wireless distributed computing framework for low-latency device distributed model inference as well as the wireless cooperative transmission strategy for energy-efficient edge cooperative model inference. The communication efficiency of edge inference systems is further improved by building up a smart radio propagation environment via intelligent reflecting surface.


title: A Perspective on High-performance CNT fibres for Structural Composites

abstract: This review summarizes progress on structural composites with carbon nanotube fibres. It starts by analyzing their development towards a macroscopic ensemble of elongated and aligned crystalline domains, alongside the evolution of the structure of traditional high-performance fibres. Literature on tensile properties suggests that there are two emerging grades: highly aligned fibres spun from liquid crystalline solutions, with high modulus and strength, and spun from aerogels of ultra long-nanotubes, combining high strength and fracture energy. The fabrication of large unidirectional fabrics with similar properties as the fibres is presently a challenge, which CNT alignment remaining a key factor. A promising approach is to produce fabrics directly from aerogel filaments without having to densify and handle individual CNT fibres. Structural composites of CNT fibres have reached high longitudinal properties, however, on relatively small samples. In general, there is need to demonstrate fabrication of large CNT fibre laminate composites using standard fabrication routes and to study longitudinal and transverse mechanical properties in tension and compression. Complementary areas of development are interlaminar reinforcement with CNT fabric interleaves, and multifunctional structural composites with energy storage or harvesting functions.


title: Metastability for systems of interacting neurons

abstract: We study a stochastic system of interacting neurons and its metastable properties. The system consists of $N$ neurons, each spiking randomly with rate depending on its membrane potential. At its spiking time, the neuron potential is reset to $0$ and all other neurons receive an additional amount $h/N$ of potential. In between successive spike times, each neuron looses potential at exponential speed. We study this system in the supercritical regime, that is, for sufficiently high values of the synaptic weight $h.$ Under very mild conditions on the spiking rate function, is has been shown in Duarte and Ost \cite{do} that the only invariant distribution of the finite system is the trivial measure $ \delta_{\bf 0}$ corresponding to extinction of the process. Under minimal conditions on the behavior of the spiking rate function in the vicinity of $0$, we prove that the extinction time arrives at exponentially late times in $ N$, and discuss the stability of the equilibrium $\delta_{\bf 0}$ for the non-linear mean-field limit process depending on the parameters of the dynamics. We then specify our study to the case of saturating spiking rates and show that, under suitable conditions on the parameters of the model, 1) the non-linear mean-field limit admits a unique and globally attracting equilibrium and 2) the rescaled exit times for the mean spiking rate of a finite system from a neighbourhood of the non-linear equilibrium rate converge in law to an exponential distribution, as the system size diverges. In other words, the system exhibits a metastable behavior.


title: SGX-SSD: A Policy-based Versioning SSD with Intel SGX

abstract: This paper demonstrates that SSDs, which perform device-level versioning, can be exposed to data tampering attacks when the retention time of data is less than the malware's dwell time. To deal with that threat, we propose SGX-SSD, a SGX-based versioning SSD which selectively preserves file history based on the given policy. The proposed system adopts Intel SGX to implement the version policy management system that is safe from high-privileged malware. Based on the policy, only the necessary data is selectively preserved in SSD that prevents files with less priority from wasting space and also ensures the integrity of important files.


title: Observation of unusual slow components in electroluminescence signal of two-phase argon detector

abstract: Proportional electroluminescence (EL) in noble gases is used in two-phase detectors for dark matter search to record ionization signals in the gas phase induced by particle scattering in the liquid phase (S2 signals). In this work, the EL pulse-shapes in a two-phase argon detector have for the first time been studied systematically in a wide range of reduced electric field, varying from 3 to 9 Td. The pulse-shapes were studied at different readout configurations and spectral ranges: using cryogenic PMTs and SiPMs, with and without a wavelength shifter (WLS), in the VUV and visible range. We observed the fast component and two unusual slow components, with time constants of about 5 $\mu$s and 40 $\mu$s. The unusual characteristic property of slow components was that their contribution and time constants increased with electric field.


title: Proximal Gradient methods with Adaptive Subspace Sampling

abstract: Many applications in machine learning or signal processing involve nonsmooth optimization problems. This nonsmoothness brings a low-dimensional structure to the optimal solutions. In this paper, we propose a randomized proximal gradient method harnessing this underlying structure. We introduce two key components: i) a random subspace proximal gradient algorithm; ii) an identification-based sampling of the subspaces. Their interplay brings a significant performance improvement on typical learning problems in terms of dimensions explored.


title: A new 3D model for magnetic particle imaging using realistic magnetic field topologies for algebraic reconstruction

abstract: We derive a new 3D model for magnetic particle imaging (MPI) that is able to incorporate realistic magnetic fields in the reconstruction process. In real MPI scanners, the generated magnetic fields have distortions that lead to deformed magnetic low-field volumes (LFV) with the shapes of ellipsoids or bananas instead of ideal field-free points (FFP) or lines (FFL), respectively. Most of the common model-based reconstruction schemes in MPI use however the idealized assumption of an ideal FFP or FFL topology and, thus, generate artifacts in the reconstruction. Our model-based approach is able to deal with these distortions and can generally be applied to dynamic magnetic fields that are approximately parallel to their velocity field. We show how this new 3D model can be discretized and inverted algebraically in order to recover the magnetic particle concentration. To model and describe the magnetic fields, we use decompositions of the fields in spherical harmonics. We complement the description of the new model with several simulations and experiments.


title: Transferable Active Grasping and Real Embodied Dataset

abstract: Grasping in cluttered scenes is challenging for robot vision systems, as detection accuracy can be hindered by partial occlusion of objects. We adopt a reinforcement learning (RL) framework and 3D vision architectures to search for feasible viewpoints for grasping by the use of hand-mounted RGB-D cameras. To overcome the disadvantages of photo-realistic environment simulation, we propose a large-scale dataset called Real Embodied Dataset (RED), which includes full-viewpoint real samples on the upper hemisphere with amodal annotation and enables a simulator that has real visual feedback. Based on this dataset, a practical 3-stage transferable active grasping pipeline is developed, that is adaptive to unseen clutter scenes. In our pipeline, we propose a novel mask-guided reward to overcome the sparse reward issue in grasping and ensure category-irrelevant behavior. The grasping pipeline and its possible variants are evaluated with extensive experiments both in simulation and on a real-world UR-5 robotic arm.


title: Privacy Protection via Joint Real and Reactive Load Shaping in Smart Grids

abstract: Frequent metering of electricity consumption is crucial for demand side management in smart grids. However, metered data can be processed fairly easily by employing well-established nonintrusive appliance load monitoring techniques to infer appliance usage, which reveals information about consumers' private lives. Existing load shaping techniques for privacy primarily focus only on altering metered real power, whereas smart meters collect reactive power consumption data as well for various purposes. This study addresses consumer privacy preservation via load shaping in a demand response scheme, considering both real and reactive power. We build a multi-objective optimization framework that enables us to characterize the interplay between privacy maximization, user cost minimization, and user discomfort minimization objectives. Our results reveal that minimizing information leakage due to a single component, e.g., real power, would suffer from overlooking information leakage due to the other component, e.g., reactive power, causing sub-optimal decisions. In fact, joint shaping of real and reactive power components results in the best possible privacy preservation performance, which leads to more than a twofold increase in privacy in terms of mutual information.


title: Propagation phenomena with nonlocal diffusion in presence of an obstacle

abstract: We consider a nonlocal semi-linear parabolic equation on a connected exterior domain of the form $\mathbb{R}^N\setminus K$, where $K\subset\mathbb{R}^N$ is a compact "obstacle". The model we study is motivated by applications in biology and takes into account long range dispersal events that may be anisotropic depending on how a given population perceives the environment. To formulate this in a meaningful manner, we introduce a new theoretical framework which is of both mathematical and biological interest. The main goal of this paper is to construct an entire solution that behaves like a planar travelling wave as $t\to-\infty$ and to study how this solution propagates depending on the shape of the obstacle. We show that whether the solution recovers the shape of a planar front in the large time limit is equivalent to whether a certain Liouville type property is satisfied. We study the validity of this Liouville type property and we extend some previous results of Hamel, Valdinoci and the authors. Lastly, we show that the entire solution is a generalised transition front.


title: A lite parametric model for the Hemodynamic Response Function

abstract: When working with task-related fMRI data, one of the most crucial parts of the data analysis consists of determining a proper estimate of the BOLD response. The following document presents a lite model for the Hemodynamic Response Function HRF. Between other advances, the proposed model present less number of parameters compared to other similar HRF alternative, which reduces its optimization complexity and facilitates its potential applications.


title: Assessing differences in flow state induced by an adaptive music learning software

abstract: Technology can facilitate self-learning for academic and leisure activities such as music learning. In general, learning to play an unknown musical song at sight on the electric piano or any other instrument can be quite a chore. In a traditional self-learning setting, the musician only gets feedback in terms of what errors they can hear themselves by comparing what they have played with the score. Research has shown that reaching a flow state creates a more enjoyable experience during activities. This work explores whether principles from flow theory and game design can be applied to make the beginner's musical experience adapted to their need and create higher flow. We created and evaluated a tool oriented around these considerations in a study with 21 participants. We found that provided feedback and difficulty scaling can help to achieve flow and that the effects get more pronounced the more experience with music participants have. In further research, we want to examine the influence of our approach to learning sheet music.


title: Holistic Privacy for Electricity, Water, and Natural Gas Metering in Next Generation Smart Homes

abstract: In smart electricity grids, high time granularity (HTG) power consumption data can be decomposed into individual appliance load signatures via Nonintrusive Appliance Load Monitoring techniques to expose appliance usage profiles. Various methods ranging from load shaping to noise addition and data aggregation have been proposed to mitigate this problem. However, with the growing scarcity of natural resources, utilities other than electricity (such as water and natural gas) have also begun to be subject to HTG metering, which creates privacy issues similar to that of electricity. Therefore, employing privacy protection countermeasures for only electricity usage is ineffective for appliances that utilize additional/other metered resources. As such, existing privacy countermeasures and metrics need to be reevaluated to address not only electricity, but also any other resource that is metered. Furthermore, a holistic privacy protection approach for all metered resources must be adopted as the information leak from any of the resources has a potential to render the privacy preserving countermeasures for all the other resources futile. This paper introduces the privacy preservation problem for multiple HTG metered resources and explores potential solutions for its mitigation.


title: Gradient-Induced Co-Saliency Detection

abstract: Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection (GICD) method. We first abstract a consensus representation for the grouped images in the embedding space; then, by comparing the single image with consensus representation, we utilize the feedback gradient information to induce more attention to the discriminative co-salient features. In addition, due to the lack of Co-SOD training data, we design a jigsaw training strategy, with which Co-SOD networks can be trained on general saliency datasets without extra pixel-level annotations. To evaluate the performance of Co-SOD methods on discovering the co-salient object among multiple foregrounds, we construct a challenging CoCA dataset, where each image contains at least one extraneous foreground along with the co-salient object. Experiments demonstrate that our GICD achieves state-of-the-art performance. Our codes and dataset are available at https://mmcheng.net/gicd/.