title: Tight bounds on the maximal perimeter and the maximal width of convex small polygons

abstract: A small polygon is a polygon of unit diameter. The maximal perimeter and the maximal width of a convex small polygon with $n=2^s$ vertices are not known when $s \ge 4$. In this paper, we construct a family of convex small $n$-gons, $n=2^s$ and $s\ge 3$, and show that the perimeters and the widths obtained cannot be improved for large $n$ by more than $a/n^6$ and $b/n^4$ respectively, for certain positive constants $a$ and $b$. In addition, assuming that a conjecture of Mossinghoff is true, we formulate the maximal perimeter problem as a nonlinear optimization problem involving trigonometric functions and, for $n=2^s$ with $3 \le s\le 7$, we provide global optimal solutions.


title: Chirality memory stored in magnetic domain walls in the ferromagnetic state of MnP

abstract: Chirality in a helimagnetic structure is determined by the sense of magnetic moment rotation. We found that the chiral information did not disappear even after the phase transition to the high-temperature ferromagnetic phase in a helimagnet MnP. The 2nd harmonic resistivity $\rho^{\rm 2f}$, which reflects the breaking down of mirror symmetry, was found to be almost unchanged after heating the sample above the ferromagnetic transition temperature and cooling it back to the helimagnetic state. The application of a magnetic field along the easy axis in the ferromagnetic state quenched the chirality-induced $\rho^{\rm 2f}$. This indicates that the chirality memory effect originated from the ferromagnetic domain walls.


title: Quantitative Bioluminescence Tomography-guided System for Conformal Irradiation In Vivo

abstract: Although cone-beam CT (CBCT) has been used to guide irradiation for pre-clinical radiotherapy(RT) research, it is limited to localize soft tissue target especially in a low imaging contrast environment. Knowledge of target shape is a fundamental need for RT. Without such information to guide radiation, normal tissue can be irradiated unnecessarily, leading to experimental uncertainties. Recognition of this need led us to develop quantitative bioluminescence tomography (QBLT), which provides strong imaging contrast to localize optical targets. We demonstrated its capability of guiding conformal RT using an orthotopic bioluminescent glioblastoma (GBM) model. With multi-projection and multi-spectral bioluminescence imaging and a novel spectral derivative method, our QBLT system is able to reconstruct GBM with localization accuracy <1mm. An optimal threshold was determined to delineate QBLT reconstructed gross target volume (GTV_{QBLT}), which provides the best overlap between the GTV_{QBLT} and CBCT contrast labeled GBM (GTV), used as the ground truth for the GBM volume. To account for the uncertainty of QBLT in target localization and volume delineation, we also innovated a margin design; a 0.5mm margin was determined and added to GTV_{QBLT} to form a planning target volume (PTV_{QBLT}), which largely improved tumor coverage from 75% (0mm margin) to 98% and the corresponding variation (n=10) of the tumor coverage was significantly reduced. Moreover, with prescribed dose 5Gy covering 95% of PTV_{QBLT}, QBLT-guided 7-field conformal RT can irradiate 99.4 \pm 1.0% of GTV vs. 65.5 \pm 18.5% with conventional single field irradiation (n=10). Our QBLT-guided system provides a unique opportunity for researchers to guide irradiation for soft tissue targets and increase rigorous and reproducibility of scientific discovery.


title: Optimization with Least Constraint Violation

abstract: Study about theory and algorithms for constrained optimization usually assumes that the feasible region of the optimization problem is nonempty. However, there are many important practical optimization problems whose feasible regions are not known to be nonempty or not, and optimizers of the objective function with the least constraint violation prefer to be found. A natural way for dealing with these problems is to extend the constrained optimization problem as the one optimizing the objective function over the set of points with the least constraint violation. Firstly, the minimization problem with least constraint violation is proved to be an Lipschitz equality constrained optimization problem when the original problem is a convex optimization problem with possible inconsistent conic constraints, and it can be reformulated as an MPEC problem. Secondly, for nonlinear programming problems with possible inconsistent constraints, various types of stationary points are presented for the MPCC problem which is equivalent to the minimization problem with least constraint violation, and an elegant necessary optimality condition, named as L-stationary condition, is established from the classical optimality theory of Lipschitz continuous optimization. Finally, the smoothing Fischer-Burmeister function method for nonlinear programming case is constructed for solving the problem minimizing the objective function with the least constraint violation. It is demonstrated that, when the positive smoothing parameter approaches to zero, any point in the outer limit of the KKT-point mapping is an L-stationary point of the equivalent MPCC problem.


title: Help! Need Advice on Identifying Advice

abstract: Humans use language to accomplish a wide variety of tasks - asking for and giving advice being one of them. In online advice forums, advice is mixed in with non-advice, like emotional support, and is sometimes stated explicitly, sometimes implicitly. Understanding the language of advice would equip systems with a better grasp of language pragmatics; practically, the ability to identify advice would drastically increase the efficiency of advice-seeking online, as well as advice-giving in natural language generation systems. We present a dataset in English from two Reddit advice forums - r/AskParents and r/needadvice - annotated for whether sentences in posts contain advice or not. Our analysis reveals rich linguistic phenomena in advice discourse. We present preliminary models showing that while pre-trained language models are able to capture advice better than rule-based systems, advice identification is challenging, and we identify directions for future research. Comments: To be presented at EMNLP 2020.


title: Joint Turn and Dialogue level User Satisfaction Estimation on Multi-Domain Conversations

abstract: Dialogue level quality estimation is vital for optimizing data driven dialogue management. Current automated methods to estimate turn and dialogue level user satisfaction employ hand-crafted features and rely on complex annotation schemes, which reduce the generalizability of the trained models. We propose a novel user satisfaction estimation approach which minimizes an adaptive multi-task loss function in order to jointly predict turn-level Response Quality labels provided by experts and explicit dialogue-level ratings provided by end users. The proposed BiLSTM based deep neural net model automatically weighs each turn's contribution towards the estimated dialogue-level rating, implicitly encodes temporal dependencies, and removes the need to hand-craft features. On dialogues sampled from 28 Alexa domains, two dialogue systems and three user groups, the joint dialogue-level satisfaction estimation model achieved up to an absolute 27% (0.43->0.70) and 7% (0.63->0.70) improvement in linear correlation performance over baseline deep neural net and benchmark Gradient boosting regression models, respectively.


title: The hidden symmetry of the asymmetric quantum Rabi model

abstract: The asymmetric quantum Rabi model (AQRM) exhibits level crossings in the eigenspectrum for the values $\epsilon\in\frac{1}{2}\mathbb{Z}$ of the bias parameter $\epsilon$. Such level crossings are expected to be associated with some hidden symmetry of the model. The origin of this hidden symmetry is established by finding the operators which commute with the AQRM hamiltonian at these special values. The construction is given explicitly for the first several cases and can be applied to other related light-matter interaction models for which similar level crossings have been observed in the presence of a bias term.


title: Testing a Data-driven Active Region Evolution Model with Boundary Data at Different Heights from a Solar Magnetic Flux Emergence Simulation

abstract: A data-driven active region evolution (DARE) model has been developed to study the complex structures and dynamics of solar coronal magnetic fields. The model is configured with typical coronal environment of tenuous gas governed by strong magnetic field, and thus its lower boundary is set at the base of the corona, but driven by magnetic fields observed in the photosphere. A previous assessment of the model using data from a flux emergence simulation (FES) showed that the DARE failed to reproduce the coronal magnetic field in the FES, which is attributed to the fact that the photospheric data in the FES has a very strong Lorentz force and therefore spurious flows are generated in the DARE model. Here we further test the DARE by using three sets of data from the FES sliced at incremental heights, which correspond to the photosphere, the chromosphere and the base of the corona. It is found that the key difference in the three sets of data is the extent of the Lorentz force, which makes the data-driven model perform very differently. At the two higher levels above the photosphere, the Lorentz force decreases substantially, and the DARE model attains results in much better agreement with the FES, confirming that the Lorentz force in the boundary data is a key issue affecting the results of the DARE model. However, unlike the FES data, the photospheric field from SDO/HMI observations has recently been found to be very close to force-free. Therefore, we suggest that it is still reasonable to use the photospheric magnetic field as approximation of the field at the coronal base to drive the DARE model.


title: GRUEN for Evaluating Linguistic Quality of Generated Text

abstract: Automatic evaluation metrics are indispensable for evaluating generated text. To date, these metrics have focused almost exclusively on the content selection aspect of the system output, ignoring the linguistic quality aspect altogether. We bridge this gap by proposing GRUEN for evaluating Grammaticality, non-Redundancy, focUs, structure and coherENce of generated text. GRUEN utilizes a BERT-based model and a class of syntactic, semantic, and contextual features to examine the system output. Unlike most existing evaluation metrics which require human references as an input, GRUEN is reference-less and requires only the system output. Besides, it has the advantage of being unsupervised, deterministic, and adaptable to various tasks. Experiments on seven datasets over four language generation tasks show that the proposed metric correlates highly with human judgments.


title: Picosecond Timing Resolution Measurements of Low Gain Avalanche Detectors with a 120 GeV Proton Beam for the TOPSiDE Detector Concept

abstract: This paper presents results that take a critical step toward proving 10 ps timing resolution's feasibility for particle identification in the TOPSiDE detector concept for the Electron-Ion Collider. Measurements of LGADs with a thickness of 35 micro-m and 50 micro-m are evaluated with a 120 GeV proton beam. The performance of the gain and timing response is assessed, including the dependence on the reverse bias voltage and operating temperature. The best timing resolution of UFSDs in a test beam to date is achieved using three combined planes of 35 micro-m thick LGADs at -30 degree celsius with a precision of 14.3 ps (uncertainty 1.5 ps).


title: Efficient Meta Lifelong-Learning with Limited Memory

abstract: Current natural language processing models work well on a single task, yet they often fail to continuously learn new tasks without forgetting previous ones as they are re-trained throughout their lifetime, a challenge known as lifelong learning. State-of-the-art lifelong language learning methods store past examples in episodic memory and replay them at both training and inference time. However, as we show later in our experiments, there are three significant impediments: (1) needing unrealistically large memory module to achieve good performance, (2) suffering from negative transfer, (3) requiring multiple local adaptation steps for each test example that significantly slows down the inference speed. In this paper, we identify three common principles of lifelong learning methods and propose an efficient meta-lifelong framework that combines them in a synergistic fashion. To achieve sample efficiency, our method trains the model in a manner that it learns a better initialization for local adaptation. Extensive experiments on text classification and question answering benchmarks demonstrate the effectiveness of our framework by achieving state-of-the-art performance using merely 1% memory size and narrowing the gap with multi-task learning. We further show that our method alleviates both catastrophic forgetting and negative transfer at the same time.


title: A Unifying View on Implicit Bias in Training Linear Neural Networks

abstract: We study the implicit bias of gradient flow (i.e., gradient descent with infinitesimal step size) on linear neural network training. We propose a tensor formulation of neural networks that includes fully-connected, diagonal, and convolutional networks as special cases, and investigate the linear version of the formulation called linear tensor networks. With this formulation, we can characterize the convergence direction of the network parameters as singular vectors of a tensor defined by the network. For $L$-layer linear tensor networks that are orthogonally decomposable, we show that gradient flow on separable classification finds a stationary point of the $\ell_{2/L}$ max-margin problem in a "transformed" input space defined by the network. For underdetermined regression, we prove that gradient flow finds a global minimum which minimizes a norm-like function that interpolates between weighted $\ell_1$ and $\ell_2$ norms in the transformed input space. Our theorems subsume existing results in the literature while removing standard convergence assumptions. We also provide experiments that corroborate our analysis.


title: Denoising Diffusion Implicit Models

abstract: Denoising diffusion probabilistic models (DDPMs) have achieved high quality image generation without adversarial training, yet they require simulating a Markov chain for many steps to produce a sample. To accelerate sampling, we present denoising diffusion implicit models (DDIMs), a more efficient class of iterative implicit probabilistic models with the same training procedure as DDPMs. In DDPMs, the generative process is defined as the reverse of a Markovian diffusion process. We construct a class of non-Markovian diffusion processes that lead to the same training objective, but whose reverse process can be much faster to sample from. We empirically demonstrate that DDIMs can produce high quality samples $10 \times$ to $50 \times$ faster in terms of wall-clock time compared to DDPMs, allow us to trade off computation for sample quality, and can perform semantically meaningful image interpolation directly in the latent space.


title: Categorizing Online Shopping Behavior from Cosmetics to Electronics: An Analytical Framework

abstract: A success factor for modern companies in the age of Digital Marketing is to understand how customers think and behave based on their online shopping patterns. While the conventional method of gathering consumer insights through questionnaires and surveys still form the bases of descriptive analytics for market intelligence units, we propose a machine learning framework to automate this process. In this paper we present a modular consumer data analysis platform that processes session level interaction records between users and products to predict session level, user journey level and customer behavior specific patterns leading towards purchase events. We explore the computational framework and provide test results on two Big data sets-cosmetics and consumer electronics of size 2GB and 15GB, respectively. The proposed system achieves 97-99% classification accuracy and recall for user-journey level purchase predictions and categorizes buying behavior into 5 clusters with increasing purchase ratios for both data sets. Thus, the proposed framework is extendable to other large e-commerce data sets to obtain automated purchase predictions and descriptive consumer insights.


title: $q$-crystals and $q$-connections

abstract: We study how the category of $q$-connections depends on the choice of coordinates. We exploit Bhatt's and Scholze's $q$-crystalline site, which is based on a coordinate free formulation of $q$-PD structures, in order to relate $q$-crystals and $q$-connections in the $p$-adic setting. This yields a natural equivalence between the the categories of $q$-connections for different choices of coordinates in the $p$-adic setting. The equivalence can be described explicitly in terms of differential operators. In order to obtain a global equivalence, we patch the $p$-adic differential operators to create a global one. The process is not entirely formal, and we are only able to obtain a global equivalence after inverting $2$.


title: Optimization over Random and Gradient Probabilistic Pixel Sampling for Fast, Robust Multi-Resolution Image Registration

abstract: This paper presents an approach to fast image registration through probabilistic pixel sampling. We propose a practical scheme to leverage the benefits of two state-of-the-art pixel sampling approaches: gradient magnitude based pixel sampling and uniformly random sampling. Our framework involves learning the optimal balance between the two sampling schemes off-line during training, based on a small training dataset, using particle swarm optimization. We then test the proposed sampling approach on 3D rigid registration against two state-of-the-art approaches based on the popular, publicly available, Vanderbilt RIRE dataset. Our results indicate that the proposed sampling approach yields much faster, accurate and robust registration results when compared against the state-of-the-art.


title: Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

abstract: We study the problem of balancing effectiveness and efficiency in automated feature selection. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection is mostly efficient, but difficult to identify the best subset; 2) the emerging reinforced feature selection automatically navigates to the best subset, but is usually inefficient. Can we bridge the gap between effectiveness and efficiency under automation? Motivated by this dilemma, we aim to develop a novel feature space navigation method. In our preliminary work, we leveraged interactive reinforcement learning to accelerate feature selection by external trainer-agent interaction. In this journal version, we propose a novel interactive and closed-loop architecture to simultaneously model interactive reinforcement learning (IRL) and decision tree feedback (DTF). Specifically, IRL is to create an interactive feature selection loop and DTF is to feed structured feature knowledge back to the loop. First, the tree-structured feature hierarchy from decision tree is leveraged to improve state representation. In particular, we represent the selected feature subset as an undirected graph of feature-feature correlations and a directed tree of decision features. We propose a new embedding method capable of empowering graph convolutional network to jointly learn state representation from both the graph and the tree. Second, the tree-structured feature hierarchy is exploited to develop a new reward scheme. In particular, we personalize reward assignment of agents based on decision tree feature importance. In addition, observing agents' actions can be feedback, we devise another reward scheme, to weigh and assign reward based on the feature selected frequency ratio in historical action records. Finally, we present extensive experiments on real-world datasets to show the improved performance.


title: Fast DecreaseKey Heaps with worst-case variants

abstract: In the paper "Fast Fibonacci heaps with worst case extensions", we have described heaps with both Meld-DecreaseKey and DecreaseKey interfaces, allowing operations with guaranteed worst-case asymptotically optimal times. The paper was intended to concentrate on the DecreaseKey interface, but it could be hard to separate the two described data structures without careful reading. The current paper's goal is not to invent a novel data structure, but to describe a rather easy DecreaseKey version in a hopefully readable form. The paper is intended not to require reference to other papers.


title: Adversarial Boot Camp: label free certified robustness in one epoch

abstract: Machine learning models are vulnerable to adversarial attacks. One approach to addressing this vulnerability is certification, which focuses on models that are guaranteed to be robust for a given perturbation size. A drawback of recent certified models is that they are stochastic: they require multiple computationally expensive model evaluations with random noise added to a given input. In our work, we present a deterministic certification approach which results in a certifiably robust model. This approach is based on an equivalence between training with a particular regularized loss, and the expected values of Gaussian averages. We achieve certified models on ImageNet-1k by retraining a model with this loss for one epoch without the use of label information.


title: Finding Ethereum Smart Contracts Security Issues by Comparing History Versions

abstract: Smart contracts are Turing-complete programs running on the blockchain. They cannot be modified, even when bugs are detected. The Selfdestruct function is the only way to destroy a contract on the blockchain system and transfer all the Ethers on the contract balance. Thus, many developers use this function to destroy a contract and redeploy a new one when bugs are detected. In this paper, we propose a deep learning-based method to find security issues of Ethereum smart contracts by finding the updated version of a destructed contract. After finding the updated versions, we use open card sorting to find security issues.


title: Investigating African-American Vernacular English in Transformer-Based Text Generation

abstract: The growth of social media has encouraged the written use of African American Vernacular English (AAVE), which has traditionally been used only in oral contexts. However, NLP models have historically been developed using dominant English varieties, such as Standard American English (SAE), due to text corpora availability. We investigate the performance of GPT-2 on AAVE text by creating a dataset of intent-equivalent parallel AAVE/SAE tweet pairs, thereby isolating syntactic structure and AAVE- or SAE-specific language for each pair. We evaluate each sample and its GPT-2 generated text with pretrained sentiment classifiers and find that while AAVE text results in more classifications of negative sentiment than SAE, the use of GPT-2 generally increases occurrences of positive sentiment for both. Additionally, we conduct human evaluation of AAVE and SAE text generated with GPT-2 to compare contextual rigor and overall quality.


title: Pricing and Hedging the No-Negative-Equity Guarantee in Equity-Release Mortgages

abstract: We provide a practical superhedging strategy for the pricing and hedging of the No-Negative-Equity-Guarantee (NNEG) found in Equity-Release Mortgages (ERMs), or reverse mortgages, using a discrete-time model. In contrast to many papers on the NNEG and industry practice we work in an incomplete market setting so that deaths and property prices are not independent under most pricing measures. We give theoretical results and numerical illustrations to show that the assumption of market completeness leads to a considerable undervaluation of the NNEG. By introducing an Excess-of-Loss reinsurance asset, we show that it is possible to reduce the cost of the superhedge for a portfolio of ERMs with the average cost decreasing rapidly as the number of lives in the portfolio increases. All the hedging assets, with the exception of cash, have a term of one year making the availability of a property hedging asset from over-the-counter derivative providers more realistic. We outline how a practical multi-period ERM pricing and hedging model can be built. Although the prices identified by this model will be higher than prices under the completeness assumption, they are considerably lower than those under the Equivalent Value Test mandated by the UK's Prudential Regulatory Authority.


title: Target State Estimation and Prediction for High Speed Interception

abstract: Accurate estimation and prediction of trajectory is essential for interception of any high speed target. In this paper, an extended Kalman filter is used to estimate the current location of target from its visual information and then predict its future position by using the observation sequence. Target motion model is developed considering the approximate known pattern of the target trajectory. In this work, we utilise visual information of the target to carry out the predictions. The proposed algorithm is developed in ROS-Gazebo environment and is verified using hardware implementation.


title: Effects of a Magnetic Field on Superconductivity and Quantum Criticality in Quasi-Two-Dimensional Systems with Dirac Electrons

abstract: We study the effects of an external magnetic field on thensuperconducting phase diagram of a quasi-two-dimensional system of Dirac electrons at an arbitrary temperature. At zero temperature, there is a quantum phase transition connecting a normal and a superconducting phase, occurring at a critical line that corresponds to a magnetic field dependent critical coupling parameter, which should be observed in planar materials containing Dirac electrons, such as $Cu_xTiSe_2$. Moreover, the superconducting gap is obtained as a function of temperature, magnetic field and coupling parameter ($\lambda_{\rm R}$). From this, we extract the critical magnetic field $ B_{ c } $ as a function of the temperature. For small values of $ B_{ c } $, we obtain a linear decay of the critical field, which is similar to the behavior observed experimentally in the copper doped dichalcogenide $Cu_xTiSe_2$ and also in intercalated graphite.


title: Diffusion model and analysis of diffusion process at lagrangian method

abstract: Based on Fick's 2nd law the development of moving particle semi-implicit method for predicting diffusion process is proposed in this study


title: Observations with the 3.6 meter Devasthal Optical Telescope

abstract: The 3.6 meter Indo-Belgian Devasthal optical telescope (DOT) has been used for optical and near-infrared (NIR) observations of celestial objects. The telescope has detected stars of B = 24.5+-0.2; R = 24.6+-0.12 and g = 25.2+-0.2 mag in exposure times of 1200, 4320 and 3600 seconds respectively. In one hour of exposure time, a distant galaxy of 24.3+-0.2 mag and point sources of ~ 25 mag have been detected in the SDSS i band. The NIR observations show that stars up to J = 20+-0.1; H = 18.8+-0.1 and K = 18.2+-0.1 mag can be detected in effective exposure times of 500, 550 and 1000 seconds respectively. The nbL band sources brighter than ~9.2 mag and strong (> 0.4 Jy) PAH emitting sources like Sh 2-61 can also be observed with the 3.6 meter DOT. A binary star having angular separation of 0.4 arc-sec has been resolved by the telescope. Sky images with sub-arc-sec angular resolutions are observed with the telescope at wavelengths ranging from optical to NIR for a good fraction of observing time. The on-site performance of the telescope is found to be at par with the performance of other similar telescopes located elsewhere in the world. Due to advantage of its geographical location, the 3.6 meter DOT can provide optical and NIR observations for a number of front line Galactic and extra-galactic astrophysical research problems including optical follow up of GMRT and AstroSat sources and optical transient objects.


title: Mapping of Sparse 3D Data using Alternating Projection

abstract: We propose a novel technique to register sparse 3D scans in the absence of texture. While existing methods such as KinectFusion or Iterative Closest Points (ICP) heavily rely on dense point clouds, this task is particularly challenging under sparse conditions without RGB data. Sparse texture-less data does not come with high-quality boundary signal, and this prohibits the use of correspondences from corners, junctions, or boundary lines. Moreover, in the case of sparse data, it is incorrect to assume that the same point will be captured in two consecutive scans. We take a different approach and first re-parameterize the point-cloud using a large number of line segments. In this re-parameterized data, there exists a large number of line intersection (and not correspondence) constraints that allow us to solve the registration task. We propose the use of a two-step alternating projection algorithm by formulating the registration as the simultaneous satisfaction of intersection and rigidity constraints. The proposed approach outperforms other top-scoring algorithms on both Kinect and LiDAR datasets. In Kinect, we can use 100X downsampled sparse data and still outperform competing methods operating on full-resolution data.


title: A model-free method for learning flexibility capacity of loads providing grid support

abstract: Flexible loads are a resource for the Balancing Authority (BA) of the future to aid in the balance of power supply and demand. In order to be used as a resource, the BA must know the capacity of the flexible loads to vary their power demand over a baseline without violating consumers' quality of service (QoS). Existing work on capacity characterization is model-based: They need models relating power consumption to variables that dictate QoS, such as temperature in case of an air conditioning system. However, in many cases the model parameters are not known or difficult to obtain. In this work, we pose a data driven capacity characterization method that does not require model information, it only needs access to a simulator. The capacity is characterized as the set of feasible spectral densities (SDs) of the demand deviation. The proposed method is an extension of our recent work on SD-based capacity characterization that was limited to linear time invariant (LTI) dynamics of loads. The method proposed here is applicable to nonlinear dynamics. Numerical evaluation of the method is provided, including a comparison with the model-based solution for the LTI case.


title: Strongly separable matrices for nonadaptive combinatorial group testing

abstract: In nonadaptive combinatorial group testing (CGT), it is desirable to identify a small set of up to $d$ defectives from a large population of $n$ items with as few tests (i.e. large rate) and efficient identifying algorithm as possible. In the literature, $d$-disjunct matrices ($d$-DM) and $\bar{d}$-separable matrices ($\bar{d}$-SM) are two classical combinatorial structures having been studied for several decades. It is well-known that a $d$-DM provides a more efficient identifying algorithm than a $\bar{d}$-SM, while a $\bar{d}$-SM could have a larger rate than a $d$-DM. In order to combine the advantages of these two structures, in this paper, we introduce a new notion of \emph{strongly $d$-separable matrix} ($d$-SSM) for nonadaptive CGT and show that a $d$-SSM has the same identifying ability as a $d$-DM, but much weaker requirements than a $d$-DM. Accordingly, the general bounds on the largest rate of a $d$-SSM are established. Moreover, by the random coding method with expurgation, we derive an improved lower bound on the largest rate of a $2$-SSM which is much higher than the best known result of a $2$-DM.


title: Improved Analysis of Clipping Algorithms for Non-convex Optimization

abstract: Gradient clipping is commonly used in training deep neural networks partly due to its practicability in relieving the exploding gradient problem. Recently, \citet{zhang2019gradient} show that clipped (stochastic) Gradient Descent (GD) converges faster than vanilla GD/SGD via introducing a new assumption called $(L_0, L_1)$-smoothness, which characterizes the violent fluctuation of gradients typically encountered in deep neural networks. However, their iteration complexities on the problem-dependent parameters are rather pessimistic, and theoretical justification of clipping combined with other crucial techniques, e.g. momentum acceleration, are still lacking. In this paper, we bridge the gap by presenting a general framework to study the clipping algorithms, which also takes momentum methods into consideration. We provide convergence analysis of the framework in both deterministic and stochastic setting, and demonstrate the tightness of our results by comparing them with existing lower bounds. Our results imply that the efficiency of clipping methods will not degenerate even in highly non-smooth regions of the landscape. Experiments confirm the superiority of clipping-based methods in deep learning tasks.


title: Application of good coverings to collapsing Alexandrov spaces

abstract: Let $M$ be an Alexandrov space collapsing to an Alexandrov space $X$ of lower dimension. Suppose $X$ has no proper extremal subsets and let $F$ denote a regular fiber. We slightly improve the result of Perelman to construct an infinitely long exact sequence of homotopy groups and a spectral sequence of cohomology groups for the pair $(M,X,F)$. The proof is an application of the good coverings of Alexandrov spaces introduced by Mitsuishi-Yamaguchi. We also extend this result to each primitive extremal subset of $X$.


title: Augmented Transfer Regression Learning with Semi-non-parametric Nuisance Models

abstract: In contemporary statistical learning, covariate shift correction plays an important role in transfer learning when distribution of the testing data is shifted from the training data. Importance weighting, as a natural and principle strategy to adjust for covariate shift, has been commonly used in the field of transfer learning. However, this strategy is not robust to model misspecification or excessive estimation error. In this paper, we propose an augmented transfer regression learning (ATReL) approach that introduces an imputation model for the targeted response, and uses it to augment the importance weighting equation. With novel semi-non-parametric constructions and calibrated moment estimating equations for the two nuisance models, our ATReL method is less prone to (i) the curse of dimensionality compared to nonparametric approaches, and (ii) model mis-specification than parametric approaches. We show that our ATReL estimator is root-n-consistent when at least one nuisance model is correctly specified, estimation for the parametric part of the nuisance models achieves parametric rate, and the nonparametric components are rate doubly robust. Simulation studies demonstrate that our method is more robust and efficient than existing parametric and fully nonparametric (machine learning) estimators under various configurations. We also examine the utility of our method through a real example about transfer learning of phenotyping algorithm for rheumatoid arthritis across different time windows. Finally, we propose ways to enhance the intrinsic efficiency of our estimator and to incorporate modern machine learning methods with our proposed framework.


title: Computational tools for drawing, building and displaying carbohydrates: a visual guide

abstract: Drawing and visualisation of molecular structures are some of the most common tasks carried out in structural glycobiology, typically using various software. In this perspective article, we outline developments in the computational tools for the sketching, visualisation and modelling of glycans. The article also provides details on the standard representation of glycans, and glycoconjugates, which helps the communication of structure details within the scientific community. We highlight the comparative analysis of the available tools which could help researchers to perform various tasks related to structure representation and model building of glycans. These tools can be useful for glycobiologists or any researcher looking for a ready to use, simple program for the sketching or building of glycans.


title: Multi-task Learning for Multilingual Neural Machine Translation

abstract: While monolingual data has been shown to be useful in improving bilingual neural machine translation (NMT), effectively and efficiently leveraging monolingual data for Multilingual NMT (MNMT) systems is a less explored area. In this work, we propose a multi-task learning (MTL) framework that jointly trains the model with the translation task on bitext data and two denoising tasks on the monolingual data. We conduct extensive empirical studies on MNMT systems with 10 language pairs from WMT datasets. We show that the proposed approach can effectively improve the translation quality for both high-resource and low-resource languages with large margin, achieving significantly better results than the individual bilingual models. We also demonstrate the efficacy of the proposed approach in the zero-shot setup for language pairs without bitext training data. Furthermore, we show the effectiveness of MTL over pre-training approaches for both NMT and cross-lingual transfer learning NLU tasks; the proposed approach outperforms massive scale models trained on single task.


title: Secure Collaborative Training and Inference for XGBoost

abstract: In recent years, gradient boosted decision tree learning has proven to be an effective method of training robust models. Moreover, collaborative learning among multiple parties has the potential to greatly benefit all parties involved, but organizations have also encountered obstacles in sharing sensitive data due to business, regulatory, and liability concerns. We propose Secure XGBoost, a privacy-preserving system that enables multiparty training and inference of XGBoost models. Secure XGBoost protects the privacy of each party's data as well as the integrity of the computation with the help of hardware enclaves. Crucially, Secure XGBoost augments the security of the enclaves using novel data-oblivious algorithms that prevent access side-channel attacks on enclaves induced via access pattern leakage.


title: Non destructive testing of actively cooled plasma facing components by means of thermal transient excitation and infrared imaging

abstract: SATIR is a new test-bed installed at Tore Supra to perform non destructive examination of actively cooled plasma facing components. Hot and cold water flow successively in the cooling tube of the component and the surface temperature is recorded with an infrared camera. Defects are detected by a slower temperature response above unbrazed areas. The connection between temperature differences and defect sizes is the main difficulty. It is established by tests of standard defects and thermal transient calculations of defective geometries. SATIR has been in use for two years and has proved to be very valuable to test industrial components as well as prototypes.


title: Structural evolution of the elastic properties in nano-structured AlN film

abstract: A study of the transverse acoustic phonons on nano-structured AlN films has been carried out by using high-resolution micro-Brillouin spectroscopy. Dense films have been deposited by radio frequency (r.f.) magnetron sputtering under ultra high vacuum at room temperature. Films with different morphologies were prepared and investigated by transmission electron microscopy and Brillouin Spectroscopy (equiaxed nano-sized, nano-columnar grains and amorphous phase). Results show a dependence of the transverse modes on the nano-structure. The nano-columnar film exhibits two transversal modes as expected for the AlN w{\"u}rtzite while the equiaxed nano-sized and the amorphous films only exhibit one isotropic transverse mode as expected in amorphous materials. One important result is that the sound propagation velocity in the AlN amorphous phase is higher than the one in the non-textured nano-crystalline phase. This phenomenon has, however, already been observed in ferroelectric ceramics.


title: Superconductivity in Infinite-layer Nickelates : Role of Non-zero f-ness

abstract: Employing first-principles density functional theory calculations and Wannierization of the low energy band structure, we analyze the electronic structure of undoped, infinite-layer nickelate compounds, NdNiO$_2$, PrNiO$_2$ and LaNiO$_2$. Our study reveals important role of non-zero $f$-ness of Nd and Pr atoms, as opposed to $f^{0}$ occupancy of La. The non-zero $f$-ness becomes effective in lowering the energy of the rare-earth 5$d$ hybridized axial orbital, thereby enhancing the electron pockets and influencing the Fermi surface topology. The Fermi surface topology of NdNiO$_2$ and PrNiO$_2$ is strikingly similar, while differences are observed for LaNiO$_2$. This difference shows up in computed doping dependent superconducting properties of the three compounds within a weak coupling theory. We find two gap superconductivity for NdNiO$_2$ and PrNiO$_2$, and possibility of a single gap superconductivity for LaNiO$_2$ with the strength of superconductivity suppressed by almost a factor of two, compared to Nd or Pr compound.


title: On two extensions of Poncelet theorem

abstract: In this note I provide two extensions of a particular case of the classical Poncelet theorem.


title: PCAL: A Privacy-preserving Intelligent Credit Risk Modeling Framework Based on Adversarial Learning

abstract: Credit risk modeling has permeated our everyday life. Most banks and financial companies use this technique to model their clients' trustworthiness. While machine learning is increasingly used in this field, the resulting large-scale collection of user private information has reinvigorated the privacy debate, considering dozens of data breach incidents every year caused by unauthorized hackers, and (potentially even more) information misuse/abuse by authorized parties. To address those critical concerns, this paper proposes a framework of Privacy-preserving Credit risk modeling based on Adversarial Learning (PCAL). PCAL aims to mask the private information inside the original dataset, while maintaining the important utility information for the target prediction task performance, by (iteratively) weighing between a privacy-risk loss and a utility-oriented loss. PCAL is compared against off-the-shelf options in terms of both utility and privacy protection. Results indicate that PCAL can learn an effective, privacy-free representation from user data, providing a solid foundation towards privacy-preserving machine learning for credit risk analysis.


title: A characterization of non-collapsed $RCD(K, N)$ spaces via Einstein tensors

abstract: We investigate the second principal term in the expansion of metrics $c(n)t^{(n+2)/2}g_t$ induced by heat kernel embedding into $L^2$ on a compact $RCD(K, N)$ space. We prove that the divergence free property of this term in the weak, asymptotic sense if and only if the space is non-collapsed up to multiplying a constant to the reference measure. This seems new even for weighted Riemannian manifolds. Moreover an example tells us that the result cannot be generalized to the noncompact case. In this sense, our result is sharp.


title: Vlasov limit for a chain of oscillators with Kac potentials

abstract: We consider a chain of anharmonic oscillators with local mean field interaction and long-range stochastic exchanges of velocity. Even if the particles are not exchangeable, we prove the convergence of the empirical measure associated with this chain to a solution of a Vlasov-type equation. We then use this convergence to prove energy diffusion for a restricted class of anharmonic potentials.


title: Singular Neumann boundary problems for a class of fully nonlinear parabolic equations in one dimension

abstract: In this paper, we discuss singular Neumann boundary problem for a class of nonlinear parabolic equations in one space dimension. Our boundary problem describes motion of a planar curve sliding along the boundary with a zero contact angle, which can be viewed as a limiting model for the capillary phenomenon. We study the uniqueness and existence of solutions by using the viscosity solution theory. We also show the convergence of the solution to a traveling wave as time proceeds to infinity when the initial value is assumed to be convex.


title: Progressive InSAR phase estimation

abstract: This paper introduces a novel scheme to progressively estimate interferometric phases from a stack of synthetic aperture radar (SAR) images. The scheme is shown to yield comparable performance to full-covariance algorithms for a realistic decorrelation scenario. The implementation is suited for continuous processing and updating of phase products, without compromising long-term phase accuracy. It also limits the requirements in terms of data transfer between archive and processing facility, a significant issue for processing large archives of SAR data.


title: An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks

abstract: Typically, tokenization is the very first step in most text processing works. As a token serves as an atomic unit that embeds the contextual information of text, how to define a token plays a decisive role in the performance of a model.Even though Byte Pair Encoding (BPE) has been considered the de facto standard tokenization method due to its simplicity and universality, it still remains unclear whether BPE works best across all languages and tasks. In this paper, we test several tokenization strategies in order to answer our primary research question, that is, "What is the best tokenization strategy for Korean NLP tasks?" Experimental results demonstrate that a hybrid approach of morphological segmentation followed by BPE works best in Korean to/from English machine translation and natural language understanding tasks such as KorNLI, KorSTS, NSMC, and PAWS-X. As an exception, for KorQuAD, the Korean extension of SQuAD, BPE segmentation turns out to be the most effective.


title: Insights into nature of magnetization plateaus of a nickel complex [Ni4(CO3)2(aetpy)8](ClO4)4 from a spin-1 Heisenberg diamond cluster

abstract: Magnetic and magnetocaloric properties of a spin-1 Heisenberg diamond cluster with two different coupling constants are investigated with the help of an exact diagonalization based on the Kambe's method, which employs a local conservation of composite spins formed by spin-1 entities located in opposite corners of a diamond spin cluster. It is shown that the spin-1 Heisenberg diamond cluster exhibits several intriguing quantum ground states, which are manifested in low-temperature magnetization curves as intermediate plateaus at 1/4, 1/2 and 3/4 of the saturation magnetization. Besides, the spin-1 Heisenberg diamond cluster may also exhibit an enhanced magnetocaloric effect, which may be relevant for a low-temperature refrigeration achieved through the adiabatic demagnetization. It is evidenced that the spin-1 Heisenberg diamond cluster with the antiferromagnetic coupling constants J1/kB = 41.4 K and J2/kB = 9.2 K satisfactorily reproduces a low-temperature magnetization curve recorded for the tetranuclear nickel complex [Ni4(CO3)2(aetpy)8](ClO4)4 (aetpy = 2-aminoethyl-pyridine) including a size and position of intermediate plateaus detected at 1/2 and 3/4 of the saturation magnetization. A microscopic nature of fractional magnetization plateaus observed experimentally is clarified and interpreted in terms of valence-bond crystal with either a single or double valence bond. It is suggested that this frustrated magnetic molecule can provide a prospective cryogenic coolant with the maximal isothermal entropy change - Delta S = 10.6 J/(K.kg) in a temperature range below 2.3 K.


title: Boundary maps, germs and quasi-regular representations

abstract: We investigate the tracial and ideal structures of $C^*$-algebras of quasi-regular representations of stabilizers of boundary actions. Our main tool is the notion of boundary maps, namely $\Gamma$-equivariant unital completely positive maps from $\Gamma$-$C^*$-algebras to $C(\partial_F\Gamma)$, where $\partial_F\Gamma$ denotes the Furstenberg boundary of a group $\Gamma$. For a unitary representation $\pi$ coming from the groupoid of germs of a boundary action, we show that there is a unique boundary map on $C^*_\pi(\Gamma)$. Consequently, we completely describe the tracial structure of the $C^*$-algebras $C^*_\pi(\Gamma)$, and for any $\Gamma$-boundary $X$, we completely characterize the simplicity of the $C^*$-algebras generated by the quasi-regular representations $\lambda_{\Gamma/\Gamma_x}$ associated to stabilizer subgroups $\Gamma_x$ for any $x\in X$. As an application, we show that the $C^*$-algebra generated by the quasi-regular representation $\lambda_{T/F}$ associated to Thompson's groups $F\leq T$ does not admit traces and is simple.


title: Do Explicit Alignments Robustly Improve Multilingual Encoders?

abstract: Multilingual BERT (mBERT), XLM-RoBERTa (XLMR) and other unsupervised multilingual encoders can effectively learn cross-lingual representation. Explicit alignment objectives based on bitexts like Europarl or MultiUN have been shown to further improve these representations. However, word-level alignments are often suboptimal and such bitexts are unavailable for many languages. In this paper, we propose a new contrastive alignment objective that can better utilize such signal, and examine whether these previous alignment methods can be adapted to noisier sources of aligned data: a randomly sampled 1 million pair subset of the OPUS collection. Additionally, rather than report results on a single dataset with a single model run, we report the mean and standard derivation of multiple runs with different seeds, on four datasets and tasks. Our more extensive analysis finds that, while our new objective outperforms previous work, overall these methods do not improve performance with a more robust evaluation framework. Furthermore, the gains from using a better underlying model eclipse any benefits from alignment training. These negative results dictate more care in evaluating these methods and suggest limitations in applying explicit alignment objectives.


title: Error mitigation via verified phase estimation

abstract: The accumulation of noise in quantum computers is the dominant issue stymieing the push of quantum algorithms beyond their classical counterparts. We do not expect to be able to afford the overhead required for quantum error correction in the next decade, so in the meantime we must rely on low-cost, unscalable error mitigation techniques to bring quantum computing to its full potential. This paper presents a new error mitigation technique based on quantum phase estimation that can also reduce errors in expectation value estimation (e.g., for variational algorithms). The general idea is to apply phase estimation while effectively post-selecting for the system register to be in the starting state, which allows us to catch and discard errors which knock us away from there. We refer to this technique as "verified phase estimation" (VPE) and show that it can be adapted to function without the use of control qubits in order to simplify the control circuitry for near-term implementations. Using VPE, we demonstrate the estimation of expectation values on numerical simulations of intermediate scale quantum circuits with multiple orders of magnitude improvement over unmitigated estimation at near-term error rates (even after accounting for the additional complexity of phase estimation). Our numerical results suggest that VPE can mitigate against any single errors that might occur; i.e., the error in the estimated expectation values often scale as O(p^2), where p is the probability of an error occurring at any point in the circuit. This property, combined with robustness to sampling noise reveal VPE as a practical technique for mitigating errors in near-term quantum experiments.


title: Multi-typed Objects Multi-view Multi-instance Multi-label Learning

abstract: Multi-typed objects Multi-view Multi-instance Multi-label Learning (M4L) deals with interconnected multi-typed objects (or bags) that are made of diverse instances, represented with heterogeneous feature views and annotated with a set of non-exclusive but semantically related labels. M4L is more general and powerful than the typical Multi-view Multi-instance Multi-label Learning (M3L), which only accommodates single-typed bags and lacks the power to jointly model the naturally interconnected multi-typed objects in the physical world. To combat with this novel and challenging learning task, we develop a joint matrix factorization based solution (M4L-JMF). Particularly, M4L-JMF firstly encodes the diverse attributes and multiple inter(intra)-associations among multi-typed bags into respective data matrices, and then jointly factorizes these matrices into low-rank ones to explore the composite latent representation of each bag and its instances (if any). In addition, it incorporates a dispatch and aggregation term to distribute the labels of bags to individual instances and reversely aggregate the labels of instances to their affiliated bags in a coherent manner. Experimental results on benchmark datasets show that M4L-JMF achieves significantly better results than simple adaptions of existing M3L solutions on this novel problem.


title: Low Complexity Method for Simulation of Epidemics Based on Dijkstra's Algorithm

abstract: Models of epidemics over networks have become popular, as they describe the impact of individual behavior on infection spread. However, they come with high computational complexity, which constitutes a problem in case large-scale scenarios are considered. This paper presents a discrete-time multi-agent SIR (Susceptible, Infected, Recovered) model that extends known results in literature. Based on that, using the novel notion of Contagion Graph, it proposes a graphbased method derived from Dijkstra's algorithm that allows to decrease the computational complexity of a simulation. The Contagion Graph can be also employed as an approximation scheme describing the "mean behavior" of an epidemic over a network and requiring low computational power. Theoretical findings are confirmed by randomized large-scale simulation.


title: On the size of maximal intersecting families

abstract: We show that an $n$-uniform maximal intersecting family has size at most $e^{-n^{0.5+o(1)}}n^n$. This improves a recent bound by Frankl. The Spread Lemma of Alweiss, Lowett, Wu and Zhang plays an important role in the proof.


title: Astraea: Grammar-based Fairness Testing

abstract: Software often produces biased outputs. In particular, machine learning (ML) based software are known to produce erroneous predictions when processing discriminatory inputs. Such unfair program behavior can be caused by societal bias. In the last few years, Amazon, Microsoft and Google have provided software services that produce unfair outputs, mostly due to societal bias (e.g. gender or race). In such events, developers are saddled with the task of conducting fairness testing. Fairness testing is challenging; developers are tasked with generating discriminatory inputs that reveal and explain biases. We propose a grammar-based fairness testing approach (called ASTRAEA) which leverages context-free grammars to generate discriminatory inputs that reveal fairness violations in software systems. Using probabilistic grammars, ASTRAEA also provides fault diagnosis by isolating the cause of observed software bias. ASTRAEA's diagnoses facilitate the improvement of ML fairness. ASTRAEA was evaluated on 18 software systems that provide three major natural language processing (NLP) services. In our evaluation, ASTRAEA generated fairness violations with a rate of ~18%. ASTRAEA generated over 573K discriminatory test cases and found over 102K fairness violations. Furthermore, ASTRAEA improves software fairness by ~76%, via model-retraining.


title: A Semi-Grand Canonical Kinetic Monte Carlo study of Single-Walled Carbon Nanotubes growth

abstract: Single-walled carbon nanotubes exist in a variety of different geometries, so-called chiralities, that define their electronic properties. Chiral selectivity has been reported in catalytic chemical vapor deposition synthesis experiments, but the underlying mechanisms remain poorly understood. In this contribution, we establish a simple model for the prediction of the growth rates of carbon nanotubes of different chiralities, as a function of energies characterizing the carbon nanotube-catalyst interface and of parameters of the synthesis. The model is sampled efficiently using kinetic Monte Carlo simulations in the semi-grand canonical ensemble, uncovering the interplay of the external experimental conditions and the configuration and energetics of the interface with the catalyst. In particular, the distribution of chiral angle dependent growth rates follows non-monotonic trends as a function of interface energies. We analyze this behavior and use it to identify conditions that lead to high selectivity for a variety of chiral angles.


title: Theoretical study of ternary silver fluorides AgMF4 (M = Co, Ni, Cu) formation at pressures up to 20 GPa

abstract: Only several compounds bearing Ag(II) cation and other transition metal cation have been known. Herein, we predict stability and crystal structures of hypothetical ternary silver(II) fluorides with copper, nickel and cobalt in 1:1 stoichiometry at pressure range from 0 GPa up to 20 GPa within the frame of Density Functional Theory. Calculations show that AgCoF4 could be synthesized already at ambient conditions but this compound would host diamagnetic Ag(I) and high-spin Co(III). However, at increased pressure ternary fluorides of Ag(II) featuring Cu and Ni could be synthesized, in the pressure windows of 7-14 and 8-15 GPa, respectively. All title compounds would be semiconducting and magnetically ordered.


title: Rapid evolution of [WC] stars in the Magellanic Clouds

abstract: We obtained new spectra of fourteen Magellanic Cloud planetary nebulae with the South African Large Telescope to determine heating rates of their central stars and to verify evolutionary models of post-asymptotic giant branch stars. We compared new spectra with observations made in previous years. Five planetary nebulae showed an increase in excitation over time. Four of their central stars exhibit [WC] features in their spectra, including three new detections. This raises the total number of [WC] central stars of PNe in the Magellanic Clouds to ten. We compared determined heating rates of the four [WC] central stars with the He-burning post-asymptotic giant branch evolutionary tracks and the remaining star with the H-burning tracks. Determined heating rates are consistent with the evolutionary models for both H and He-burning post-asymptotic giant branch stars. The central stars of the PNe that show the fastest increase of excitation are also the most luminous in the sample. This indicates that [WC] central stars in the Magellanic Clouds evolve faster than H-burning central stars, and they originate from more massive progenitors.


title: Training Deep Neural Networks for Wireless Sensor Networks Using Loosely and Weakly Labeled Images

abstract: Although deep learning has achieved remarkable successes over the past years, few reports have been published about applying deep neural networks to Wireless Sensor Networks (WSNs) for image targets recognition where data, energy, computation resources are limited. In this work, a Cost-Effective Domain Generalization (CEDG) algorithm has been proposed to train an efficient network with minimum labor requirements. CEDG transfers networks from a publicly available source domain to an application-specific target domain through an automatically allocated synthetic domain. The target domain is isolated from parameters tuning and used for model selection and testing only. The target domain is significantly different from the source domain because it has new target categories and is consisted of low-quality images that are out of focus, low in resolution, low in illumination, low in photographing angle. The trained network has about 7M (ResNet-20 is about 41M) multiplications per prediction that is small enough to allow a digital signal processor chip to do real-time recognitions in our WSN. The category-level averaged error on the unseen and unbalanced target domain has been decreased by 41.12%.


title: Rayleigh-Sommerfeld scalar diffraction by apertures moving at relativistic speeds

abstract: We have analytically obtained the theoretical results for the Rayleigh-Sommerfeld (R-S) scalar diffraction by apertures, such as single-slit, double-slit, grating and circular aperture, moving at relativistic speeds with the velocities perpendicular to the direction of incidence. We also have studied diffraction by a single-slit of oscillatory shutter. Our study would be significant in probing the relativistic transverse Doppler effect on the intensity pattern of the diffracted field.


title: Extrusion without a motor: a new take on the loop extrusion model of genome organization

abstract: Chromatin loop extrusion is a popular model for the formation of CTCF loops and topological domains. Recent HiC data have revealed a strong bias in favour of a particular arrangement of the CTCF binding motifs that stabilize loops, and extrusion is the only model to date which can explain this. However, the model requires a motor to generate the loops, and although cohesin is a strong candidate for the extruding factor, a suitable motor protein (or a motor activity in cohesin itself) has yet to be found. Here we explore a new hypothesis: that there is no motor, and thermal motion within the nucleus drives extrusion. Using theoretical modelling and computer simulations we ask whether such diffusive extrusion could feasibly generate loops. Our simulations uncover an interesting ratchet effect (where an osmotic pressure promotes loop growth), and suggest, by comparison to recent in vitro and in vivo measurements, that diffusive extrusion can in principle generate loops of the size observed in the data. Extra View on : C. A. Brackley, J. Johnson, D. Michieletto, A. N. Morozov, M. Nicodemi, P. R. Cook, and D. Marenduzzo "Non-equilibrium chromosome looping via molecular slip-links", Physical Review Letters 119, 138101 (2017)


title: The noncommutative $\ell_1-\ell_2$ inequality for Hilbert C*-modules and the exact constant

abstract: Let $\mathcal{A}$ be a unital C*-algebra. Then the theory of Hilbert C*-modules tells that \begin{align*} \sum_{i=1}^{n}(a_ia_i^*)^\frac{1}{2}\leq \sqrt{n} \left(\sum_{i=1}^{n}a_ia_i^*\right)^\frac{1}{2}, \quad \forall n \in \mathbb{N}, \forall a_1, \dots, a_n \in \mathcal{A}. \end{align*} By modifications of arguments of Botelho-Andrade, Casazza, Cheng, and Tran given in 2019, for certain tuple $x=(a_1, \dots, a_n) \in \mathcal{A}^n$, we give a method to compute a positive element $c_x$ in the C*-algebra $\mathcal{A}$ such that the equality \begin{align*} \sum_{i=1}^{n}(a_ia_i^*)^\frac{1}{2}=c_x \sqrt{n} \left(\sum_{i=1}^{n}a_ia_i^*\right)^\frac{1}{2}. \end{align*} holds. We give an application for the integral of G. G. Kasparov. We also derive the formula for the exact constant for the continuous $\ell_1-\ell_2$ inequality.


title: Please Mind the Root: Decoding Arborescences for Dependency Parsing

abstract: The connection between dependency trees and spanning trees is exploited by the NLP community to train and to decode graph-based dependency parsers. However, the NLP literature has missed an important difference between the two structures: only one edge may emanate from the root in a dependency tree. We analyzed the output of state-of-the-art parsers on many languages from the Universal Dependency Treebank: although these parsers are often able to learn that trees which violate the constraint should be assigned lower probabilities, their ability to do so unsurprisingly de-grades as the size of the training set decreases. In fact, the worst constraint-violation rate we observe is 24%. Prior work has proposed an inefficient algorithm to enforce the constraint, which adds a factor of n to the decoding runtime. We adapt an algorithm due to Gabow and Tarjan (1984) to dependency parsing, which satisfies the constraint without compromising the original runtime.


title: Graphene on silicon: effects of the silicon surface orientation on the work function and carrier density of graphene

abstract: Density functional theory has been employed to study graphene on the (111), (100) and (110) surfaces of silicon (Si) substrates. There are several interesting findings. First, carbon atoms in graphene form covalent bonds with Si atoms, when placed close enough on Si (111) and (100) surfaces, but not on the (110) surface. The presence of a Si (111) surface shifts the Fermi level of graphene into its conduction band, resulting in an increase of the work function by 0.29 eV and of the electron density by three orders of magnitude. The carrier density of graphene can also be increased by eighty times on a Si (100) substrate without doping, due to the modification of the density of states near the Dirac point. No interfacial covalent bond can be formed on Si (110). These striking effects that different orientations of a silicon substrate can have on the properties of graphene are related to the surface density of the silicon surface. Applying the results to a real device of a specific orientation requires further consideration of surface reconstructions, lattice mismatch, temperature, and environmental effects.


title: Data Rejuvenation: Exploiting Inactive Training Examples for Neural Machine Translation

abstract: Large-scale training datasets lie at the core of the recent success of neural machine translation (NMT) models. However, the complex patterns and potential noises in the large-scale data make training NMT models difficult. In this work, we explore to identify the inactive training examples which contribute less to the model performance, and show that the existence of inactive examples depends on the data distribution. We further introduce data rejuvenation to improve the training of NMT models on large-scale datasets by exploiting inactive examples. The proposed framework consists of three phases. First, we train an identification model on the original training data, and use it to distinguish inactive examples and active examples by their sentence-level output probabilities. Then, we train a rejuvenation model on the active examples, which is used to re-label the inactive examples with forward-translation. Finally, the rejuvenated examples and the active examples are combined to train the final NMT model. Experimental results on WMT14 English-German and English-French datasets show that the proposed data rejuvenation consistently and significantly improves performance for several strong NMT models. Extensive analyses reveal that our approach stabilizes and accelerates the training process of NMT models, resulting in final models with better generalization capability.


title: Potential asteroid discoveries by the ESA Gaia mission: Results from follow-up observations

abstract: Since July 2014, the ESA Gaia mission has been surveying the entire sky down to magnitude 20.7 in the visible. In addition to the millions of stars, thousands of Solar System Objects (SSOs) are observed daily. By comparing their positions to those of known objects, a daily processing pipeline filters known objects from potential discoveries. However, owing to Gaia's specific scanning law designed for stars, potential newly discovered moving objects are characterized by very few observations, acquired over a limited time. This aspect was recognized early in the design of the Gaia data processing. A daily processing pipeline dedicated to these candidate discoveries was set up to release calls for observations to a network of ground-based telescopes. Their aim is to acquire follow-up astrometry and to characterize these objects. From the astrometry measured by Gaia, preliminary orbital solutions are determined, allowing to predict the position of these potentially new discovered objects in the sky accounting for the large parallax between Gaia and the Earth (separated by 0.01 au). A specific task within the Gaia Consortium has been responsible for the distribution of requests for follow-up observations of potential Gaia SSO discoveries. Since late 2016, these calls for observations (called alerts) are published daily via a Web interface, freely available to anyone world-wide. Between November 2016 and July 2020, over 1700 alerts have been published, leading to the successful recovery of more than 200 objects. Among those, six have provisional designation assigned with the Gaia observations, the others being previously known objects with poorly characterized orbits, precluding identification at the time of Gaia observations. There is a clear trend for objects with a high inclination to be unidentified, revealing a clear bias in the current census of SSOs against high inclination populations.


title: Recyclable Gaussian Processes

abstract: We present a new framework for recycling independent variational approximations to Gaussian processes. The main contribution is the construction of variational ensembles given a dictionary of fitted Gaussian processes without revisiting any subset of observations. Our framework allows for regression, classification and heterogeneous tasks, i.e. mix of continuous and discrete variables over the same input domain. We exploit infinite-dimensional integral operators based on the Kullback-Leibler divergence between stochastic processes to re-combine arbitrary amounts of variational sparse approximations with different complexity, likelihood model and location of the pseudo-inputs. Extensive results illustrate the usability of our framework in large-scale distributed experiments, also compared with the exact inference models in the literature.


title: Gene Regulatory Network Inference with Latent Force Models

abstract: Delays in protein synthesis cause a confounding effect when constructing Gene Regulatory Networks (GRNs) from RNA-sequencing time-series data. Accurate GRNs can be very insightful when modelling development, disease pathways, and drug side-effects. We present a model which incorporates translation delays by combining mechanistic equations and Bayesian approaches to fit to experimental data. This enables greater biological interpretability, and the use of Gaussian processes enables non-linear expressivity through kernels as well as naturally accounting for biological variation.


title: SHERLock: Self-Supervised Hierarchical Event Representation Learning

abstract: Temporal event representations are an essential aspect of learning among humans. They allow for succinct encoding of the experiences we have through a variety of sensory inputs. Also, they are believed to be arranged hierarchically, allowing for an efficient representation of complex long-horizon experiences. Additionally, these representations are acquired in a self-supervised manner. Analogously, here we propose a model that learns temporal representations from long-horizon visual demonstration data and associated textual descriptions, without explicit temporal supervision. Our method produces a hierarchy of representations that align more closely with ground-truth human-annotated events (+15.3) than state-of-the-art unsupervised baselines. Our results are comparable to heavily-supervised baselines in complex visual domains such as Chess Openings, YouCook2 and TutorialVQA datasets. Finally, we perform ablation studies illustrating the robustness of our approach. We release our code and demo visualizations in the Supplementary Material.


title: PolicyQA: A Reading Comprehension Dataset for Privacy Policies

abstract: Privacy policy documents are long and verbose. A question answering (QA) system can assist users in finding the information that is relevant and important to them. Prior studies in this domain frame the QA task as retrieving the most relevant text segment or a list of sentences from the policy document given a question. On the contrary, we argue that providing users with a short text span from policy documents reduces the burden of searching the target information from a lengthy text segment. In this paper, we present PolicyQA, a dataset that contains 25,017 reading comprehension style examples curated from an existing corpus of 115 website privacy policies. PolicyQA provides 714 human-annotated questions written for a wide range of privacy practices. We evaluate two existing neural QA models and perform rigorous analysis to reveal the advantages and challenges offered by PolicyQA.


title: Constraining Logits by Bounded Function for Adversarial Robustness

abstract: We propose a method for improving adversarial robustness by addition of a new bounded function just before softmax. Recent studies hypothesize that small logits (inputs of softmax) by logit regularization can improve adversarial robustness of deep learning. Following this hypothesis, we analyze norms of logit vectors at the optimal point under the assumption of universal approximation and explore new methods for constraining logits by addition of a bounded function before softmax. We theoretically and empirically reveal that small logits by addition of a common activation function, e.g., hyperbolic tangent, do not improve adversarial robustness since input vectors of the function (pre-logit vectors) can have large norms. From the theoretical findings, we develop the new bounded function. The addition of our function improves adversarial robustness because it makes logit and pre-logit vectors have small norms. Since our method only adds one activation function before softmax, it is easy to combine our method with adversarial training. Our experiments demonstrate that our method is comparable to logit regularization methods in terms of accuracies on adversarially perturbed datasets without adversarial training. Furthermore, it is superior or comparable to logit regularization methods and a recent defense method (TRADES) when using adversarial training.


title: LEGAL-BERT: The Muppets straight out of Law School

abstract: BERT has achieved impressive performance in several NLP tasks. However, there has been limited investigation on its adaptation guidelines in specialised domains. Here we focus on the legal domain, where we explore several approaches for applying BERT models to downstream legal tasks, evaluating on multiple datasets. Our findings indicate that the previous guidelines for pre-training and fine-tuning, often blindly followed, do not always generalize well in the legal domain. Thus we propose a systematic investigation of the available strategies when applying BERT in specialised domains. These are: (a) use the original BERT out of the box, (b) adapt BERT by additional pre-training on domain-specific corpora, and (c) pre-train BERT from scratch on domain-specific corpora. We also propose a broader hyper-parameter search space when fine-tuning for downstream tasks and we release LEGAL-BERT, a family of BERT models intended to assist legal NLP research, computational law, and legal technology applications.


title: Arbitrary Style Transfer using Graph Instance Normalization

abstract: Style transfer is the image synthesis task, which applies a style of one image to another while preserving the content. In statistical methods, the adaptive instance normalization (AdaIN) whitens the source images and applies the style of target images through normalizing the mean and variance of features. However, computing feature statistics for each instance would neglect the inherent relationship between features, so it is hard to learn global styles while fitting to the individual training dataset. In this paper, we present a novel learnable normalization technique for style transfer using graph convolutional networks, termed Graph Instance Normalization (GrIN). This algorithm makes the style transfer approach more robust by taking into account similar information shared between instances. Besides, this simple module is also applicable to other tasks like image-to-image translation or domain adaptation.


title: Comparing Pedestrian Navigation Methods in Virtual Reality and Real Life

abstract: Mobile navigation apps are among the most used mobile applications and are often used as a baseline to evaluate new mobile navigation technologies in field studies. As field studies often introduce external factors that are hard to control for, we investigate how pedestrian navigation methods can be evaluated in virtual reality (VR). We present a study comparing navigation methods in real life (RL) and VR to evaluate if VR environments are a viable alternative to RL environments when it comes to testing these. In a series of studies, participants navigated a real and a virtual environment using a paper map and a navigation app on a smartphone. We measured the differences in navigation performance, task load and spatial knowledge acquisition between RL and VR. From these we formulate guidelines for the improvement of pedestrian navigation systems in VR like improved legibility for small screen devices. We furthermore discuss appropriate low-cost and low-space VR-locomotion techniques and discuss more controllable locomotion techniques.


title: Cross-Lingual Text Classification with Minimal Resources by Transferring a Sparse Teacher

abstract: Cross-lingual text classification alleviates the need for manually labeled documents in a target language by leveraging labeled documents from other languages. Existing approaches for transferring supervision across languages require expensive cross-lingual resources, such as parallel corpora, while less expensive cross-lingual representation learning approaches train classifiers without target labeled documents. In this work, we propose a cross-lingual teacher-student method, CLTS, that generates "weak" supervision in the target language using minimal cross-lingual resources, in the form of a small number of word translations. Given a limited translation budget, CLTS extracts and transfers only the most important task-specific seed words across languages and initializes a teacher classifier based on the translated seed words. Then, CLTS iteratively trains a more powerful student that also exploits the context of the seed words in unlabeled target documents and outperforms the teacher. CLTS is simple and surprisingly effective in 18 diverse languages: by transferring just 20 seed words, even a bag-of-words logistic regression student outperforms state-of-the-art cross-lingual methods (e.g., based on multilingual BERT). Moreover, CLTS can accommodate any type of student classifier: leveraging a monolingual BERT student leads to further improvements and outperforms even more expensive approaches by up to 12% in accuracy. Finally, CLTS addresses emerging tasks in low-resource languages using just a small number of word translations.


title: Properties of the remnant disk and the dynamical ejecta produced in low-mass black hole-neutron star mergers

abstract: We systematically perform numerical-relativity simulations for low-mass black hole-neutron star mergers for the models with seven mass ratios $Q=M_{\rm BH}/M_{\rm NS}$ ranging from 1.5 to 4.4, and three neutron-star equations of state, focusing on properties of matter remaining outside the black hole and ejected dynamically during the merger. We pay particular attention to the dependence on the mass ratio of the binaries. It is found that the rest mass remaining outside the apparent horizon after the merger depends only weakly on the mass ratio for the models with low mass ratios. It is also clarified that the rest mass of the ejecta has a peak at $Q \sim 3$, and decreases steeply as the mass ratio decreases for the low mass-ratio case. We present a novel analysis method for the behavior of matter during the merger, focusing on the matter distribution in the phase space of specific energy and specific angular momentum. Then we model the matter distribution during and after the merger. Using the result of the analysis, we discuss the properties of the ejecta.


title: Numerical Investigation of Traffic State Reconstruction and Control Using Connected Automated Vehicles

abstract: In this paper we present a numerical study on control and observation of traffic flow using Lagrangian measurements and actuators. We investigate the effect of some basic control and observation schemes using probe and actuated vehicles within the flow. The aim is to show the effect of the state reconstruction on the efficiency of the control, compared to the case using full information about the traffic. The effectiveness of the proposed state reconstruction and control algorithms is demonstrated in simulations. They show that control using the reconstructed state approaches the full-information control when the gap between the connected vehicles is not too large, reducing the delay by more than $60\%$ when the gap between the sensor vehicles is $1.25$~km on average, compared to a delay reduction of almost $80\%$ in the full-information control case. %It shows that the reconstruction is well achieved if the distance between two connected and autonomous vehicles is not too large (more than 1 vehicle per kilometer). %We also show that it is possible to further improve the control performance by employing a simple adaptive probe vehicle selection scheme. Moreover, we propose a simple scheme for selecting which vehicles to use as sensors, in order to reduce the communication burden. Numerical simulations demonstrate that %It also demonstrates that it is possible to reduce the communication burden using a triggering mechanism with with this triggering mechanism, the delay is reduced by around $65\%$, compared to a reduction of $72\%$ if all connected vehicles are communicating at all times.


title: Disentangle-based Continual Graph Representation Learning

abstract: Graph embedding (GE) methods embed nodes (and/or edges) in graph into a low-dimensional semantic space, and have shown its effectiveness in modeling multi-relational data. However, existing GE models are not practical in real-world applications since it overlooked the streaming nature of incoming data. To address this issue, we study the problem of continual graph representation learning which aims to continually train a GE model on new data to learn incessantly emerging multi-relational data while avoiding catastrophically forgetting old learned knowledge. Moreover, we propose a disentangle-based continual graph representation learning (DiCGRL) framework inspired by the human's ability to learn procedural knowledge. The experimental results show that DiCGRL could effectively alleviate the catastrophic forgetting problem and outperform state-of-the-art continual learning models.


title: Search for charged-lepton-flavour violation in $Z$-boson decays with the ATLAS detector

abstract: Leptons with essentially the same properties apart from their mass are grouped into three families (or flavours). The number of leptons of each flavour is conserved in interactions, but this is not imposed by fundamental principles. Since the formulation of the standard model of particle physics, the observation of flavour oscillations among neutrinos has shown that lepton flavour is not conserved in neutrino weak interactions. So far, there has been no experimental evidence that this also occurs in interactions between charged leptons. Such an observation would be a sign for undiscovered particles or a yet unknown type of interaction. Here, the ATLAS experiment at the Large Hadron Collider at CERN reports a constraint on lepton-flavour-violating effects in weak interactions, searching for $Z$-boson decays into a $\tau$ lepton and another lepton of different flavour with opposite electric charge. The branching fractions for these decays are measured to be less than $8.1\times10^{-6}$ ($e\tau$) and $9.5\times10^{-6}$ ($\mu\tau$) at 95% confidence level using 139 fb$^{-1}$ of proton-proton collision data at a centre-of-mass energy $\sqrt{s}=13$ TeV and 20.3 fb$^{-1}$ at $\sqrt{s}=8$ TeV. These results supersede the limits from the Large Electron-Positron Collider experiments conducted more than two decades ago.


title: Evolution of longitudinal plasma-density profiles in discharge capillaries for plasma wakefield accelerators

abstract: Precise characterization and tailoring of the spatial and temporal evolution of plasma density within plasma sources is critical for realizing high-quality accelerated beams in plasma wakefield accelerators. The simultaneous use of two independent diagnostic techniques allowed the temporally and spatially resolved detection of plasma density with unprecedented sensitivity and enabled the characterization of the plasma temperature at local thermodynamic equilibrium in discharge capillaries. A common-path two-color laser interferometer for obtaining the average plasma density with a sensitivity of $2\times 10^{15}$ cm$^{-2}$ was developed together with a plasma emission spectrometer for analyzing spectral line broadening profiles with a resolution of $5\times 10^{15}$ cm$^{-3}$. Both diagnostics show good agreement when applying the spectral line broadening analysis methodology of Gigosos and Carde{\~n}oso. Measured longitudinally resolved plasma density profiles exhibit a clear temporal evolution from an initial flat-top to a Gaussian-like shape in the first microseconds as material is ejected out from the capillary, deviating from the often-desired flat-top profile. For plasma with densities of 0.5-$2.5\times 10^{17}$ cm$^{-3}$, temperatures of 1-7 eV were indirectly measured. These measurements pave the way for highly detailed parameter tuning in plasma sources for particle accelerators and beam optics.


title: SupMMD: A Sentence Importance Model for Extractive Summarization using Maximum Mean Discrepancy

abstract: Most work on multi-document summarization has focused on generic summarization of information present in each individual document set. However, the under-explored setting of update summarization, where the goal is to identify the new information present in each set, is of equal practical interest (e.g., presenting readers with updates on an evolving news topic). In this work, we present SupMMD, a novel technique for generic and update summarization based on the maximum mean discrepancy from kernel two-sample testing. SupMMD combines both supervised learning for salience and unsupervised learning for coverage and diversity. Further, we adapt multiple kernel learning to make use of similarity across multiple information sources (e.g., text features and knowledge based concepts). We show the efficacy of SupMMD in both generic and update summarization tasks by meeting or exceeding the current state-of-the-art on the DUC-2004 and TAC-2009 datasets.


title: StyleDGPT: Stylized Response Generation with Pre-trained Language Models

abstract: Generating responses following a desired style has great potentials to extend applications of open-domain dialogue systems, yet is refrained by lacking of parallel data for training. In this work, we explore the challenging task with pre-trained language models that have brought breakthrough to various natural language tasks. To this end, we introduce a KL loss and a style classifier to the fine-tuning step in order to steer response generation towards the target style in both a word-level and a sentence-level. Comprehensive empirical studies with two public datasets indicate that our model can significantly outperform state-of-the-art methods in terms of both style consistency and contextual coherence.


title: Does the Objective Matter? Comparing Training Objectives for Pronoun Resolution

abstract: Hard cases of pronoun resolution have been used as a long-standing benchmark for commonsense reasoning. In the recent literature, pre-trained language models have been used to obtain state-of-the-art results on pronoun resolution. Overall, four categories of training and evaluation objectives have been introduced. The variety of training datasets and pre-trained language models used in these works makes it unclear whether the choice of training objective is critical. In this work, we make a fair comparison of the performance and seed-wise stability of four models that represent the four categories of objectives. Our experiments show that the objective of sequence ranking performs the best in-domain, while the objective of semantic similarity between candidates and pronoun performs the best out-of-domain. We also observe a seed-wise instability of the model using sequence ranking, which is not the case when the other objectives are used.


title: Cochain level May-Steenrod operations

abstract: Steenrod defined in 1947 the Steenrod squares on the mod 2 cohomology of spaces using explicit cochain formulae for the cup-$i$ products; a family of coherent homotopies derived from the broken symmetry of Alexander--Whitney's chain approximation to the diagonal. He later defined his homonymous operations for all primes using the homology of symmetric groups. This approach enhanced the conceptual understanding of the operations and allowed for many advances, but lacked the concreteness of their definition at the even prime. In recent years, thanks to the development of new applications of cohomology, the need to have an effectively computable definition of Steenrod operations has become a key issue. Using the operadic viewpoint of May, this article provides such definitions at all primes introducing multioperations that generalize the Steenrod cup-$i$ products on the simplicial and cubical cochains of spaces.


title: A note on function algebras on disks

abstract: Let $D$ be a closed disk in the complex plane centered at the origin, $f, g$ complex valued continuous function on $D$. Let $P[f,g; D]$ (res. $R[f, g; D])$) be the uniform closure on $D$ of polynomials (res. rational functions) in variables $f$ and $g$. In \cite{OS}, using complex dynamical systems, O'Farrell and Sanabria-Garcia proved that $\{\Big(z^2, \cfrac{\overline z}{1+\overline{z}}\Big): z\in D\}$ is not polynomially convex with $D$ small enough and so that $P[z^2,\cfrac{\overline z}{1+\overline z}; D]\ne C(D)$ if $D$ is sufficient small. In this paper, we first give a certain conditions for rational convexity of union of two compact set of $\Bbb C^n$ and apply to show that $R[z^2, \cfrac{\overline z}{1+\overline z}; D]= C(D)$ for all $D$ small enough


title: The Multilingual Amazon Reviews Corpus

abstract: We present the Multilingual Amazon Reviews Corpus (MARC), a large-scale collection of Amazon reviews for multilingual text classification. The corpus contains reviews in English, Japanese, German, French, Spanish, and Chinese, which were collected between 2015 and 2019. Each record in the dataset contains the review text, the review title, the star rating, an anonymized reviewer ID, an anonymized product ID, and the coarse-grained product category (e.g., 'books', 'appliances', etc.) The corpus is balanced across the 5 possible star ratings, so each rating constitutes 20% of the reviews in each language. For each language, there are 200,000, 5,000, and 5,000 reviews in the training, development, and test sets, respectively. We report baseline results for supervised text classification and zero-shot cross-lingual transfer learning by fine-tuning a multilingual BERT model on reviews data. We propose the use of mean absolute error (MAE) instead of classification accuracy for this task, since MAE accounts for the ordinal nature of the ratings.


title: Gaussian Process Models with Low-Rank Correlation Matrices for Both Continuous and Categorical Inputs

abstract: We introduce a method that uses low-rank approximations of cross-correlation matrices in mixed continuous and categorical Gaussian Process models. This new method -- called Low-Rank Correlation (LRC) -- offers the ability to flexibly adapt the number of parameters to the problem at hand by choosing an appropriate rank of the approximation. Furthermore, we present a systematic approach of defining test functions that can be used for assessing the accuracy of models or optimization methods that are concerned with both continuous and categorical inputs. We compare LRC to existing approaches of modeling the cross-correlation matrix. It turns out that the new approach performs well in terms of estimation of cross-correlations and response surface prediction. Therefore, LRC is a flexible and useful addition to existing methods, especially for increasing numbers of combinations of levels of the categorical inputs.


title: Designing a Quantum Network Protocol

abstract: The second quantum revolution brings with it the promise of a quantum internet. As the first quantum network hardware prototypes near completion new challenges emerge. A functional network is more than just the physical hardware, yet work on scalable quantum network systems is in its infancy. In this paper we present a quantum network protocol designed to enable end-to-end quantum communication in the face of the new fundamental and technical challenges brought by quantum mechanics. We develop a quantum data plane protocol that enables end-to-end quantum communication and can serve as a building block for more complex services. One of the key challenges in near-term quantum technology is decoherence -- the gradual decay of quantum information -- which imposes extremely stringent limits on storage times. Our protocol is designed to be efficient in the face of short quantum memory lifetimes. We demonstrate this using a simulator for quantum networks and show that the protocol is able to deliver its service even in the face of significant losses due to decoherence. Finally, we conclude by showing that the protocol remains functional on the extremely resource limited hardware that is being developed today underlining the timeliness of this work.


title: A Note on High-Probability versus In-Expectation Guarantees of Generalization Bounds in Machine Learning

abstract: Statistical machine learning theory often tries to give generalization guarantees of machine learning models. Those models naturally underlie some fluctuation, as they are based on a data sample. If we were unlucky, and gathered a sample that is not representative of the underlying distribution, one cannot expect to construct a reliable machine learning model. Following that, statements made about the performance of machine learning models have to take the sampling process into account. The two common approaches for that are to generate statements that hold either in high-probability, or in-expectation, over the random sampling process. In this short note we show how one may transform one statement to another. As a technical novelty we address the case of unbounded loss function, where we use a fairly new assumption, called the witness condition.


title: Memory and Computation-Efficient Kernel SVM via Binary Embedding and Ternary Model Coefficients

abstract: Kernel approximation is widely used to scale up kernel SVM training and prediction. However, the memory and computation costs of kernel approximation models are still too high if we want to deploy them on memory-limited devices such as mobile phones, smartwatches, and IoT devices. To address this challenge, we propose a novel memory and computation-efficient kernel SVM model by using both binary embedding and binary model coefficients. First, we propose an efficient way to generate compact binary embedding of the data, preserving the kernel similarity. Second, we propose a simple but effective algorithm to learn a linear classification model with ternary coefficients that can support different types of loss function and regularizer. Our algorithm can achieve better generalization accuracy than existing works on learning binary coefficients since we allow coefficient to be $-1$, $0$, or $1$ during the training stage, and coefficient $0$ can be removed during model inference for binary classification. Moreover, we provide a detailed analysis of the convergence of our algorithm and the inference complexity of our model. The analysis shows that the convergence to a local optimum is guaranteed, and the inference complexity of our model is much lower than other competing methods. Our experimental results on five large real-world datasets have demonstrated that our proposed method can build accurate nonlinear SVM models with memory costs less than 30KB.