title: Cross-Loss Influence Functions to Explain Deep Network Representations

abstract: As machine learning is increasingly deployed in the real world, it is paramount that we develop the tools necessary to analyze the decision-making of the models we train and deploy to end-users. Recently, researchers have shown that influence functions, a statistical measure of sample impact, can approximate the effects of training samples on classification accuracy for deep neural networks. However, this prior work only applies to supervised learning, where training and testing share an objective function. No approaches currently exist for estimating the influence of unsupervised training examples for deep learning models. To bring explainability to unsupervised and semi-supervised training regimes, we derive the first theoretical and empirical demonstration that influence functions can be extended to handle mismatched training and testing (i.e., "cross-loss") settings. Our formulation enables us to compute the influence in an unsupervised learning setup, explain cluster memberships, and identify and augment biases in language models. Our experiments show that our cross-loss influence estimates even exceed matched-objective influence estimation relative to ground-truth sample impact.


title: Dynamic Asynchronous Iterations

abstract: Many problems can be solved by iteration by multiple participants (processors, servers, routers etc.). Previous mathematical models for such asynchronous iterations assume a single function being iterated by a fixed set of participants. We will call such iterations static since the system's configuration does not change. However in several real-world examples, such as inter-domain routing, both the function being iterated and the set of participants change frequently while the system continues to function. In this paper we extend Uresin & Dubois's work on static iterations to develop a model for this class of "dynamic" or "always on" asynchronous iterations. We explore what it means for such an iteration to be implemented correctly, and then prove two different conditions on the set of iterated functions that guarantee the full asynchronous iteration satisfies this new definition of correctness. These results have been formalised in Agda and the resulting library is publicly available.


title: Adapt-and-Adjust: Overcoming the Long-Tail Problem of Multilingual Speech Recognition

abstract: One crucial challenge of real-world multilingual speech recognition is the long-tailed distribution problem, where some resource-rich languages like English have abundant training data, but a long tail of low-resource languages have varying amounts of limited training data. To overcome the long-tail problem, in this paper, we propose Adapt-and-Adjust (A2), a transformer-based multi-task learning framework for end-to-end multilingual speech recognition. The A2 framework overcomes the long-tail problem via three techniques: (1) exploiting a pretrained multilingual language model (mBERT) to improve the performance of low-resource languages; (2) proposing dual adapters consisting of both language-specific and language-agnostic adaptation with minimal additional parameters; and (3) overcoming the class imbalance, either by imposing class priors in the loss during training or adjusting the logits of the softmax output during inference. Extensive experiments on the CommonVoice corpus show that A2 significantly outperforms conventional approaches.


title: Spontaneous CP violation by modulus $\tau$ in $A_4$ model of lepton flavors

abstract: We discuss the modular $A_4$ invariant model of leptons combining with the generalized CP symmetry. In our model, both CP and modular symmetries are broken spontaneously by the vacuum expectation value of the modulus $\tau$. The source of the CP violation is a non-trivial value of ${\rm Re} [\tau]$ while other parameters of the model are real. The allowed region of $\tau$ is in very narrow one close to the fixed point $\tau=i$ for both normal hierarchy (NH) and inverted ones (IH) of neutrino masses. The CP violating Dirac phase $\delta_{CP}$ is predicted clearly in $[98^\circ,\,110^\circ]$ and $[250^\circ,\,262^\circ]$ for NH at $3\,\sigma$ confidence level. On the other hand, $\delta_{CP}$ is in $[95^\circ,100^\circ]$ and $[260^\circ,\,265^\circ]$ for IH at $5\,\sigma$ confidence level. The predicted $\sum m_i$ is in $[82,\,102]$ meV for NH and $\sum m_i=[134,\,180]$ meV for IH. The effective mass $\langle m_{ee}\rangle$ for the $0\nu\beta\beta$ decay is predicted in $[12.5,\,20.5]$ meV and $[54,\,67]$ meV for NH and IH, respectively.


title: A low order divergence-free H(div)-conforming finite element method for Stokes flows

abstract: In this paper, we propose a ${ P_{1}^{c}}\oplus {RT0}-P0$ discretization of the Stokes equations on general simplicial meshes in two/three dimensions (2D/3D), which yields an exactly divergence-free and pressure-independent velocity approximation with optimal order. Our method has the following features. Firstly, the global number of the degrees of freedom of our method is the same as the low order Bernardi and Raugel ($B$-$R$) finite element method (Bernardi and Raugel, 1985), while the number of {the non-zero entries} of the former is about half of the latter in the velocity-velocity region of the coefficient matrix. Secondly, the ${ P_{1}^{c}}$ component of the velocity, the $RT0$ component of the velocity and the pressure seem to solve a popular ${ P_{1}^{c}}-{RT0}-P0$ discretization of a poroelastic-type system formally. Finally, our method can be easily transformed into a pressure-robust and stabilized ${ P_{1}^{c}}-P0$ discretization for the Stokes problem via the static condensation of the $RT0$ component, which has a much smaller number of global degrees of freedom. Numerical experiments illustrating the robustness of our method are also provided.


title: Motion-based Camera Localization System in Colonoscopy Videos

abstract: Optical colonoscopy is an essential diagnostic and prognostic tool for many gastrointestinal diseases, including cancer screening and staging, intestinal bleeding, diarrhea, abdominal symptom evaluation, and inflammatory bowel disease assessment. Automated assessment of colonoscopy is of interest considering the subjectivity present in qualitative human interpretations of colonoscopy findings. Localization of the camera is essential to interpreting the meaning and context of findings for diseases evaluated by colonoscopy. In this study, we propose a camera localization system to estimate the relative location of the camera and classify the colon into anatomical segments. The camera localization system begins with non-informative frame detection and removal. Then a self-training end-to-end convolutional neural network is built to estimate the camera motion, where several strategies are proposed to improve its robustness and generalization on endoscopic videos. Using the estimated camera motion a camera trajectory can be derived and a relative location index calculated. Based on the estimated location index, anatomical colon segment classification is performed by constructing a colon template. The proposed motion estimation algorithm was evaluated on an external dataset containing the ground truth for camera pose. The experimental results show that the performance of the proposed method is superior to other published methods. The relative location index estimation and anatomical region classification were further validated using colonoscopy videos collected from routine clinical practice. This validation yielded an average accuracy in classification of 0.754, which is substantially higher than the performances obtained using location indices built from other methods.


title: The Wedge Picking Model: A dynamic graph model based on triadic closure

abstract: Social networks have become an inseparable part of human life and processing them in an efficient manner is a top priority in the study of networks. These networks are highly dynamic and they are growing incessantly. Inspired by the concept of triadic closure, we propose a probabilistic mechanism to model the evolution of these dynamic graphs. Although triadic closure is ubiquitous in social networks and its presence helps forming communities, probabilistic models encapsulating it have not been studied adequately. We theoretically analyze our model and show how to bound the growth rate of some characteristics of the graph, such as degree of vertices. Leveraging our theoretical results, we develop a scheduling subroutine to process modifications of the graph in batches. Our scheduling subroutine is then used to speed up the state-of-the-art algorithms with negligible loss in their approximation guarantees. We demonstrate the applicability of our method by applying it to the densest subgraph and tri-densest subgraph discovery problem.


title: Some Remarks on the Entanglement Number

abstract: Gudder, in a recent paper, defined a candidate entanglement measure which is called the entanglement number. The entanglement number is first defined on pure states and then it extends to mixed states by the convex roof construction. In Gudder's article it was left as an open problem to show that Optimal Pure State Ensembles (OPSE) exist for the convex roof extension of the entanglement number from pure to mixed states. We answer Gudder's question in the affirmative, and therefore we obtain that the entanglement number vanishes only on the separable states. More generally we show that OPSE exist for the convex roof extension of any function that is norm continuous on the pure states of a finite dimensional Hilbert space. Further we prove that the entanglement number is an LOCC monotone, (and thus an entanglement measure), by using a criterion that was developed by Vidal in 2000. We present a simplified proof of Vidal's result where moreover we use an interesting point of view of tree representations for LOCC communications. Lastly, we generalize Gudder's entanglement number by producing a monotonic family of entanglement measures which converge in a natural way to the entropy of entanglement.


title: Relational Learning for Skill Preconditions

abstract: To determine if a skill can be executed in any given environment, a robot needs to learn the preconditions for the skill. As robots begin to operate in dynamic and unstructured environments, precondition models will need to generalize to variable number of objects with different shapes and sizes. In this work, we focus on learning precondition models for manipulation skills in unconstrained environments. Our work is motivated by the intuition that many complex manipulation tasks, with multiple objects, can be simplified by focusing on less complex pairwise object relations. We propose an object-relation model that learns continuous representations for these pairwise object relations. Our object-relation model is trained completely in simulation, and once learned, is used by a separate precondition model to predict skill preconditions for real world tasks. We evaluate our precondition model on $3$ different manipulation tasks: sweeping, cutting, and unstacking. We show that our approach leads to significant improvements in predicting preconditions for all 3 tasks, across objects of different shapes and sizes.


title: Variational optimization of the quantum annealing schedule for the Lechner-Hauke-Zoller scheme

abstract: The annealing schedule is optimized for a parameter in the Lechner-Hauke-Zoller (LHZ) scheme for quantum annealing designed for the all-to-all-interacting Ising model representing generic combinatorial optimization problems. We adapt the variational approach proposed by Matsuura et al. (arXiv:2003.09913) to the annealing schedule of a term representing a constraint for variables intrinsic to the LHZ scheme with the annealing schedule of other terms kept intact. Numerical results for a simple ferromagnetic model and the spin-glass problem show that nonmonotonic annealing schedules optimize the performance measured by the residual energy and the final ground-state fidelity. This improvement does not accompany a notable increase in the instantaneous energy gap, which suggests the importance of a dynamical viewpoint in addition to static analyses in the study of practically relevant diabatic processes in quantum annealing.


title: Design of on-chip plasmonic modulator with vanadium-dioxide in hybrid orthogonal junctions on Silicon-on-Insulator

abstract: We present a plasmonic modulator based on hybrid orthogonal silver junctions using vanadium dioxide as the modulating material on the silicon on insulator. The modulator has an ultra-compact footprint of 1.8{\mu}m x 1{\mu}m with a 100nm x 100nm modulating section based on the orthogonal geometry. We take advantage of large change in the refractive index of vanadium dioxide during its phase transition to achieve a high modulation depth of 46.89dB/{\mu}m. We also provide a fabrication strategy for the development of this device. The device geometry has potential applications in the development of next generation high frequency photonic modulators for optical communications which require a nanometer scale footprint, large modulation depth and small insertion losses.


title: FairBatch: Batch Selection for Model Fairness

abstract: Training a fair machine learning model is essential to prevent demographic disparity. Existing techniques for improving model fairness require broad changes in either data preprocessing or model training, rendering themselves difficult-to-adopt for potentially already complex machine learning systems. We address this problem via the lens of bilevel optimization. While keeping the standard training algorithm as an inner optimizer, we incorporate an outer optimizer so as to equip the inner problem with an additional functionality: Adaptively selecting minibatch sizes for the purpose of improving model fairness. Our batch selection algorithm, which we call FairBatch, implements this optimization and supports prominent fairness measures: equal opportunity, equalized odds, and demographic parity. FairBatch comes with a significant implementation benefit -- it does not require any modification to data preprocessing or model training. For instance, a single-line change of PyTorch code for replacing batch selection part of model training suffices to employ FairBatch. Our experiments conducted both on synthetic and benchmark real data demonstrate that FairBatch can provide such functionalities while achieving comparable (or even greater) performances against the state of the arts. Furthermore, FairBatch can readily improve fairness of any pre-trained model simply via fine-tuning. It is also compatible with existing batch selection techniques intended for different purposes, such as faster convergence, thus gracefully achieving multiple purposes.


title: General Behaviour of P-Values Under the Null and Alternative

abstract: Hypothesis testing results often rely on simple, yet important assumptions about the behaviour of the distribution of p-values under the null and the alternative. We examine tests for one dimensional parameters of interest that converge to a normal distribution, possibly in the presence of nuisance parameters, and characterize the distribution of the p-values using techniques from the higher order asymptotics literature. We show that commonly held beliefs regarding the distribution of p-values are misleading when the variance and location of the test statistic are not well-calibrated or when the higher order cumulants of the test statistic are not negligible. Corrected tests are proposed and are shown to perform better than their first order counterparts in certain settings.


title: Neural Network Approximations of Compositional Functions With Applications to Dynamical Systems

abstract: As demonstrated in many areas of real-life applications, neural networks have the capability of dealing with high dimensional data. In the fields of optimal control and dynamical systems, the same capability was studied and verified in many published results in recent years. Towards the goal of revealing the underlying reason why neural networks are capable of solving some high dimensional problems, we develop an algebraic framework and an approximation theory for compositional functions and their neural network approximations. The theoretical foundation is developed in a way so that it supports the error analysis for not only functions as input-output relations, but also numerical algorithms. This capability is critical because it enables the analysis of approximation errors for problems for which analytic solutions are not available, such as differential equations and optimal control. We identify a set of key features of compositional functions and the relationship between the features and the complexity of neural networks. In addition to function approximations, we prove several formulae of error upper bounds for neural networks that approximate the solutions to differential equations, optimization, and optimal control.


title: Content-Adaptive Pixel Discretization to Improve Model Robustness

abstract: Preprocessing defenses such as pixel discretization are appealing to remove adversarial attacks due to their simplicity. However, they have been shown to be ineffective except on simple datasets like MNIST. We hypothesize that existing discretization approaches failed because using a fixed codebook for the entire dataset limits their ability to balance image representation and codeword separability. We first formally prove that adaptive codebooks can provide stronger robustness guarantees than fixed codebooks as a preprocessing defense on some datasets. Based on that insight, we propose a content-adaptive pixel discretization defense called Essential Features, which discretizes the image to a per-image adaptive codebook to reduce the color space. We then find that Essential Features can be further optimized by applying adaptive blurring before the discretization to push perturbed pixel values back to their original value before determining the codebook. Against adaptive attacks, we show that content-adaptive pixel discretization extends the range of datasets that benefit in terms of both L_2 and L_infinity robustness where previously fixed codebooks were found to have failed. Our findings suggest that content-adaptive pixel discretization should be part of the repertoire for making models robust.


title: Robust Federated Learning with Noisy Labels

abstract: Federated learning is a paradigm that enables local devices to jointly train a server model while keeping the data decentralized and private. In federated learning, since local data are collected by clients, it is hardly guaranteed that the data are correctly annotated. Although a lot of studies have been conducted to train the networks robust to these noisy data in a centralized setting, these algorithms still suffer from noisy labels in federated learning. Compared to the centralized setting, clients' data can have different noise distributions due to variations in their labeling systems or background knowledge of users. As a result, local models form inconsistent decision boundaries and their weights severely diverge from each other, which are serious problems in federated learning. To solve these problems, we introduce a novel federated learning scheme that the server cooperates with local models to maintain consistent decision boundaries by interchanging class-wise centroids. These centroids are central features of local data on each device, which are aligned by the server every communication round. Updating local models with the aligned centroids helps to form consistent decision boundaries among local models, although the noise distributions in clients' data are different from each other. To improve local model performance, we introduce a novel approach to select confident samples that are used for updating the model with given labels. Furthermore, we propose a global-guided pseudo-labeling method to update labels of unconfident samples by exploiting the global model. Our experimental results on the noisy CIFAR-10 dataset and the Clothing1M dataset show that our approach is noticeably effective in federated learning with noisy labels.


title: FenceBox: A Platform for Defeating Adversarial Examples with Data Augmentation Techniques

abstract: It is extensively studied that Deep Neural Networks (DNNs) are vulnerable to Adversarial Examples (AEs). With more and more advanced adversarial attack methods have been developed, a quantity of corresponding defense solutions were designed to enhance the robustness of DNN models. It has become a popularity to leverage data augmentation techniques to preprocess input samples before inference to remove adversarial perturbations. By obfuscating the gradients of DNN models, these approaches can defeat a considerable number of conventional attacks. Unfortunately, advanced gradient-based attack techniques (e.g., BPDA and EOT) were introduced to invalidate these preprocessing effects. In this paper, we present FenceBox, a comprehensive framework to defeat various kinds of adversarial attacks. FenceBox is equipped with 15 data augmentation methods from three different categories. We comprehensively evaluated that these methods can effectively mitigate various adversarial attacks. FenceBox also provides APIs for users to easily deploy the defense over their models in different modes: they can either select an arbitrary preprocessing method, or a combination of functions for a better robustness guarantee, even under advanced adversarial attacks. We open-source FenceBox, and expect it can be used as a standard toolkit to facilitate the research of adversarial attacks and defenses.


title: Empirical formalism for the production of neutron-rich nuclei using fragmentation of medium heavy neutron-rich Rare Isotope Beam

abstract: We report here an empirical formalism for predicting the cross-sections of neutron-rich nuclei produced in fragmentation of relativistic \b{eta}-unstable neutron-rich projectiles in the mid-mass region. The formalism is based on the abrasion-ablation picture of the projectile fragmentation reaction. It has been shown that the formalism can accurately reproduce the experimental cross-section data for nuclei produced in the fragmentation of 132Sn. The formalism, it is shown, can also reproduce the experimental cross-sections of neutron-rich nuclei produced in the fragmentation of 129Xe fairly accurately. The formalism is used to bring out the advantage in the production cross-sections of neutron-rich isotopes, especially the more neutron-rich ones; that one can expect by using unstable doubly magic neutron-rich projectile 132Sn as compared to comparatively less neutron-rich unstable projectile 128Sn and also 124Sn, the isotope which is most neutron-rich among the stable isotopes of Sn (tin). The formalism is used to predict the cross-sections of neutron-rich nuclei produced in the fragmentation reaction of unstable 144Xe and 146Cs, which are expected to be produced with sufficient intensity in the upcoming RIB facilities and in the existing RIB facilities after beam intensity upgrade.


title: From Femtoseconds to Gigaseconds: The SolDeg Platform for the Performance Degradation Analysis of Silicon Heterojunction Solar Cells

abstract: Heterojunction Si solar cells exhibit notable performance degradation. We developed the SolDeg platform to model this degradation as electronic defects getting generated by thermal activation across energy barriers over time. First, molecular dynamics simulations were performed to create a-Si/c-Si stacks, using a machine-learning-based Gaussian approximation potential. Second, we created shocked clusters by a cluster blaster. Third, the shocked clusters were analyzed to identify which of them supported electronic defects. Fourth, the distribution of energy barriers that control the generation of these electronic defects was determined. Fifth, an accelerated Monte Carlo method was developed to simulate the thermally activated time dependent defect generation across the barriers. Our main conclusions are as follows. (1) The degradation of a-Si/c-Si stacks via defect generation is controlled by a broad distribution of energy barriers. (2) We developed the SolDeg platform to track the microscopic dynamics of defect generation across this wide barrier distribution, and determined the time dependent defect density $N(t)$ from femtoseconds to gigaseconds, over 24 orders of magnitude in time. (3) We have shown that a stretched exponential analytical form can successfully describe the defect generation $N(t)$. (4) We found that in relative terms $V_\mathrm{oc}$ degrades at a rate of 0.2%/year over the first year, slowing with advancing time. (5) We developed the Time Correspondence Curve to calibrate and validate the accelerated testing of solar cells. We found a compellingly simple scaling relationship between accelerated and normal times $t_\mathrm{accelerated} \propto t_\mathrm{normal}^{0.85}$. (6) We ourselves carried out experimental studies of defect generation in a-Si:H/c-Si stacks. We found a relatively high degradation rate at early times, that slowed considerably at longer time scales.


title: Multilingual Neural RST Discourse Parsing

abstract: Text discourse parsing plays an important role in understanding information flow and argumentative structure in natural language. Previous research under the Rhetorical Structure Theory (RST) has mostly focused on inducing and evaluating models from the English treebank. However, the parsing tasks for other languages such as German, Dutch, and Portuguese are still challenging due to the shortage of annotated data. In this work, we investigate two approaches to establish a neural, cross-lingual discourse parser via: (1) utilizing multilingual vector representations; and (2) adopting segment-level translation of the source content. Experiment results show that both methods are effective even with limited training data, and achieve state-of-the-art performance on cross-lingual, document-level discourse parsing on all sub-tasks.


title: Online learning with dynamics: A minimax perspective

abstract: We study the problem of online learning with dynamics, where a learner interacts with a stateful environment over multiple rounds. In each round of the interaction, the learner selects a policy to deploy and incurs a cost that depends on both the chosen policy and current state of the world. The state-evolution dynamics and the costs are allowed to be time-varying, in a possibly adversarial way. In this setting, we study the problem of minimizing policy regret and provide non-constructive upper bounds on the minimax rate for the problem. Our main results provide sufficient conditions for online learnability for this setup with corresponding rates. The rates are characterized by 1) a complexity term capturing the expressiveness of the underlying policy class under the dynamics of state change, and 2) a dynamics stability term measuring the deviation of the instantaneous loss from a certain counterfactual loss. Further, we provide matching lower bounds which show that both the complexity terms are indeed necessary. Our approach provides a unifying analysis that recovers regret bounds for several well studied problems including online learning with memory, online control of linear quadratic regulators, online Markov decision processes, and tracking adversarial targets. In addition, we show how our tools help obtain tight regret bounds for a new problems (with non-linear dynamics and non-convex losses) for which such bounds were not known prior to our work.


title: State Masking Over a Two-State Compound Channel

abstract: We consider fundamental limits for communicating over a compound channel when the state of the channel needs to be masked. Our model is closely related to an area of study known as covert communication that is a setting in which the transmitter wishes to communicate to legitimate receiver(s) while ensuring that the communication is not detected by an adversary. The main contribution in our two-state masking setup is the establishment of bounds on the throughput-key region when the constraint that quantifies how much the states are masked is defined to be the total variation distance between the two channel-induced distributions. For the scenario in which the key length is infinite, we provide sufficient conditions for when the bounds to coincide for the throughput, which follows the square-root law. Numerical examples, including that of a Gaussian channel, are provided to illustrate our results.


title: Leveraging Abstract Meaning Representation for Knowledge Base Question Answering

abstract: Knowledge base question answering (KBQA)is an important task in Natural Language Processing. Existing approaches face significant challenges including complex question understanding, necessity for reasoning, and lack of large end-to-end training datasets. In this work, we propose Neuro-Symbolic Question Answering (NSQA), a modular KBQA system, that leverages (1) Abstract Meaning Representation (AMR) parses for task-independent question understanding; (2) a simple yet effective graph transformation approach to convert AMR parses into candidate logical queries that are aligned to the KB; (3) a pipeline-based approach which integrates multiple, reusable modules that are trained specifically for their individual tasks (semantic parser, entity andrelationship linkers, and neuro-symbolic reasoner) and do not require end-to-end training data. NSQA achieves state-of-the-art performance on two prominent KBQA datasets based on DBpedia (QALD-9 and LC-QuAD1.0). Furthermore, our analysis emphasizes that AMR is a powerful tool for KBQA systems.


title: Feature-Based Software Design Pattern Detection

abstract: Software design patterns are standard solutions to common problems in software design and architecture. Knowing that a particular module implements a design pattern is a shortcut to design comprehension. Manually detecting design patterns is a time consuming and challenging task, therefore, researchers have proposed automatic design pattern detection techniques. However, these techniques show low performance for certain design patterns. In this work, we introduce a design pattern detection approach, DPD_F that improves the performance over the state-of-the-art by using code features with machine learning classifiers to automatically train a design pattern detector. DPD_F creates a semantic representation of Java source code using the code features and the call graph, and applies the \textit{Word2Vec} algorithm on the semantic representation to construct the word-space geometric model of the Java source code. DPD$_F$ then builds a Machine Learning classifier trained on a labelled dataset and identifies software design patterns with over 80% Precision and over 79\% Recall. Additionally, we have compared DPD_F with two existing design pattern detection techniques namely FeatureMaps & MARPLE-DPD. Empirical results demonstrate that our approach outperforms the state-of-the-art approaches by approximately 35% and 15% respectively in terms of Precision. The run-time performance also supports the practical applicability of our classifier.


title: Optimal CMB Lensing Reconstruction and Parameter Estimation with SPTpol Data

abstract: We perform the first simultaneous Bayesian parameter inference and optimal reconstruction of the gravitational lensing of the cosmic microwave background (CMB), using 100 deg$^2$ of polarization observations from the SPTpol receiver on the South Pole Telescope. These data reach noise levels as low as 5.8 $\mu$K-arcmin in polarization, which are low enough that the typically used quadratic estimator (QE) technique for analyzing CMB lensing is significantly sub-optimal. Conversely, the Bayesian procedure extracts all lensing information from the data and is optimal at any noise level. We infer the amplitude of the gravitational lensing potential to be $A_\phi\,{=}\,0.949\,{\pm}\,0.122$ using the Bayesian pipeline, consistent with our QE pipeline result, but with 17\% smaller error bars. The Bayesian analysis also provides a simple way to account for systematic uncertainties, performing a similar job as frequentist "bias hardening," and reducing the systematic uncertainty on $A_\phi$ due to polarization calibration from almost half of the statistical error to effectively zero. Finally, we jointly constrain $A_\phi$ along with $A_{\rm L}$, the amplitude of lensing-like effects on the CMB power spectra, demonstrating that the Bayesian method can be used to easily infer parameters both from an optimal lensing reconstruction and from the delensed CMB, while exactly accounting for the correlation between the two. These results demonstrate the feasibility of the Bayesian approach on real data, and pave the way for future analysis of deep CMB polarization measurements with SPT-3G, Simons Observatory, and CMB-S4, where improvements relative to the QE can reach 1.5 times tighter constraints on $A_\phi$ and 7 times lower effective lensing reconstruction noise.


title: A classification of left-invariant symplectic structures on some Lie groups

abstract: We are interested in the classification of left-invariant symplectic structures on Lie groups. Some classifications are known, especially in low dimensions. In this paper we establish a new approach to classify (up to automorphism and scale) left-invariant symplectic structures on Lie groups. The procedure is based on the moduli space of left-invariant nondegenerate $2$-forms. Then we apply our procedure for two particular Lie groups of dimension $2n$ and give classifications of left-invariant symplectic structures on them.


title: A Study on the Autoregressive and non-Autoregressive Multi-label Learning

abstract: Extreme classification tasks are multi-label tasks with an extremely large number of labels (tags). These tasks are hard because the label space is usually (i) very large, e.g. thousands or millions of labels, (ii) very sparse, i.e. very few labels apply to each input document, and (iii) highly correlated, meaning that the existence of one label changes the likelihood of predicting all other labels. In this work, we propose a self-attention based variational encoder-model to extract the label-label and label-feature dependencies jointly and to predict labels for a given input. In more detail, we propose a non-autoregressive latent variable model and compare it to a strong autoregressive baseline that predicts a label based on all previously generated labels. Our model can therefore be used to predict all labels in parallel while still including both label-label and label-feature dependencies through latent variables, and compares favourably to the autoregressive baseline. We apply our models to four standard extreme classification natural language data sets, and one news videos dataset for automated label detection from a lexicon of semantic concepts. Experimental results show that although the autoregressive models, where use a given order of the labels for chain-order label prediction, work great for the small scale labels or the prediction of the highly ranked label, but our non-autoregressive model surpasses them by around 2% to 6% when we need to predict more labels, or the dataset has a larger number of the labels.


title: On the behavior of multiple zeta-functions with identical arguments on the real line I

abstract: In the present series of papers, we study the behavior of the r-fold zeta-function of Euler-Zagier type with identical arguments on the real line. In this first part, we consider the behavior on the interval [0,1]. Our basic tool is an "infinite" version of Newton's classical identities. We carry out numerical computations, and draw graphs for real s in [0,1], for several small values of r. Those graphs suggest various properties of the r-fold zeta-function, some of which we prove rigorously. For example, we show that the r-fold zeta-function has r asymptotes, and determine the asymptotic behavior close to those asymptotes. Until now, the existence of one real zero for r=2 has been known. Our present computations establish several new real zeros between asymptotes in the cases r=3,...,10. Moreover, on the number of real zeros, we raise a conjecture, and a formula for calculating the number of zeros on the interval [0,1] is derived.


title: Residues of manifolds

abstract: The Riesz $z$-energy of a manifold $X$ is the integration of the distance between two points to the power $z$ over the product space $X\times X$. Considered as a function of a complex variable $z$, it can be generalized to a meromorphic function by analytic continuation, which we will call the meromorphic energy function of $X$. It has only simple poles at some negative integers. The residues of a manifold $X$ are the residues of the meromorphic energy function. For example, the volume and the Willmore energy for surfaces in $\mathbb{R}^3$ can be obtained as residues. In this paper we first show the M\"obius invariance of the residue at $z=-2\dim X$ of a closed submanifold or a compact body in a Euclidean space. We introduce the relative residues for compact bodies and weighted residues, and show that the scalar curvature and the mean curvature as well as the Euler characteristic of compact bodies of dimension less than $4$ can be expressed in terms of residues and local residues. We study the order of differentiaion of a local defining function of $X$ that is necessary to obtain the (global) residues when $X$ is a closed submanifold of a Euclidean space. We also show the inclusion-exclusion principle. Residues appear to be similar to quantities obtained by asymptotic expansion such as intrinsic volumes (Lipschitz-Killing curvatures), spectra of Laplacian, and the Graham-Witten energy. We show that residues are independent from them. Finally we introduce a \M invariant principal curvature energy for $4$-dimensional hypersurfaces in $\mathbb{R}^5$, and express the Graham-Witten energy in terms of the residues, Weyl tensor, and this M\"obius invariant principal curvature energy.


title: AutoInt: Automatic Integration for Fast Neural Volume Rendering

abstract: Numerical integration is a foundational technique in scientific computing and is at the core of many computer vision applications. Among these applications, neural volume rendering has recently been proposed as a new paradigm for view synthesis, achieving photorealistic image quality. However, a fundamental obstacle to making these methods practical is the extreme computational and memory requirements caused by the required volume integrations along the rendered rays during training and inference. Millions of rays, each requiring hundreds of forward passes through a neural network are needed to approximate those integrations with Monte Carlo sampling. Here, we propose automatic integration, a new framework for learning efficient, closed-form solutions to integrals using coordinate-based neural networks. For training, we instantiate the computational graph corresponding to the derivative of the network. The graph is fitted to the signal to integrate. After optimization, we reassemble the graph to obtain a network that represents the antiderivative. By the fundamental theorem of calculus, this enables the calculation of any definite integral in two evaluations of the network. Applying this approach to neural rendering, we improve a tradeoff between rendering speed and image quality: improving render times by greater than 10 times with a tradeoff of slightly reduced image quality.


title: Multiscalar $B-L$ extension based on $S_4$ flavor symmetry for neutrino mass and mixing

abstract: A multiscalar and nonrenormalizable $B-L$ extension of the standard model (SM) with $S_4$ symmetry which successfully explains the recent observed neutrino oscillation data is proposed. The tiny neutrino masses and their hierarchies are generated via the type-I seesaw mechanism. The model reproduces the recent experiments of neutrino mixing angles and Dirac CP violating phase in which the atmospheric angle $(\theta_{23})$ and the reactor angle $(\theta_{13})$ get the best-fit values while the solar angle $(\theta_{12})$ and Dirac CP violating phase ($\delta $) belong to $3\, \si $ range of the best-fit value for normal hierarchy (NH). For inverted hierarchy (IH), $\theta_{13}$ gets the best-fit value and $\theta_{23}$ together with $\de $ belongs to $1\, \si $ range while $\theta_{12}$ belongs to $3\, \si $ range of the best-fit value. The effective neutrino masses are predicted to be $\langle m_{ee}\rangle=6.81 \,\, \mbox{meV}$ for NH and $\langle m_{ee}\rangle=48.48\,\, \mbox{meV}$ for IH being in good agreement with the most recent experimental data.


title: Rainbow triangles in edge-colored complete graphs

abstract: Let $G$ be a graph of order $n$ with an edge-coloring $c$, and let $\delta^c(G)$ denote the minimum color-degree of $G$. A subgraph $F$ of $G$ is called rainbow if any two edges of $F$ have distinct colors. There have been a lot results in the existing literature on rainbow triangles in edge-colored complete graphs. Fujita and Magnant showed that for an edge-colored complete graph $G$ of order $n$, if $\delta^c(G)\geq \frac{n+1}{2}$, then every vertex of $G$ is contained in a rainbow triangle. In this paper, we show that if $\delta^c(G)\geq \frac{n+k}{2}$, then every vertex of $G$ is contained in at least $k$ rainbow triangles, which can be seen as a generalization of their result. Li showed that for an edge-colored graph $G$ of order $n$, if $\delta^c(G)\geq \frac{n+1}{2}$, then $G$ contains a rainbow triangle. We show that if $G$ is complete and $\delta^c(G)\geq \frac{n}{2}$, then $G$ contains a rainbow triangle and the bound is sharp. Hu et al. showed that for an edge-colored graph $G$ of order $n\geq 20$, if $\delta^c(G)\geq \frac{n+2}{2}$, then $G$ contains two vertex-disjoint rainbow triangles. We show that if $G$ is complete with order $n\geq 8$ and $\delta^c(G)\geq \frac{n+1}{2}$, then $G$ contains two vertex-disjoint rainbow triangles. Moreover, we improve the result of Hu et al. from $n\geq 20$ to $n\geq 7$, the best possible.


title: Perturbative $S$-matrix unitarity ($S^{\dagger}S=1$) in $R_{\mu \nu} ^2$ gravity

abstract: We show that in the quadratic curvature theory of gravity, or simply $R_{\mu \nu} ^2$ gravity, the tree-level unitariy bound (tree unitarity) is violated in the UV region but an analog for $S$-matrix unitarity ($SS^{\dagger} = 1$) is satisfied. This theory is renormalizable, and hence the failure of tree unitarity is a counter example of Llewellyn Smith's conjecture on the relation between them. We have recently proposed a new conjecture that $S$-matrix unitarity gives the same conditions as renormalizability. We verify that $S$-matrix unitarity holds in the matter-graviton scattering at tree level in the $R_{\mu \nu} ^2$ gravity, demonstrating our new conjecture.


title: Control design for inhomogeneous broadening compensation in single-photon transducers

abstract: A transducer of single photons between microwave and optical frequencies can be used to realize quantum communication over optical fiber links between distant superconducting quantum computers. A promising scalable approach to constructing such a transducer is to use ensembles of quantum emitters interacting simultaneously with electromagnetic fields at optical and microwave frequencies. However, inhomogeneous broadening in the transition frequencies of the emitters can be detrimental to this collective action. In this article, we utilise a gradient-based optimization strategy to design the temporal shape of the laser field driving the transduction system to mitigate the effects of inhomogeneous broadening. We study the improvement of transduction efficiencies as a function of inhomogeneous broadening in different single-emitter cooperativity regimes and correlate it with a restoration of superradiance effects in the emitter ensembles. Furthermore, to assess the optimality of our pulse designs, we provide certifiable bounds on the design problem and compare them to the achieved performance.


title: Fano-Kondo resonance versus Kondo plateau in an Aharonov-Bohm ring with an embedded quantum dot

abstract: We theoretically examine the transport through an Aharonov-Bohm ring with an embedded quantum dot (QD), the so-called QD interferometer, to address two controversial issues regarding the shape of the Coulomb peaks and measurement of the transmission phase shift through a QD. We extend a previous model [B. R. Bulka and P. Stefanski, Phys. Rev. Lett. 86, 5128 (2001); W. Hofstetter, J. Konig, and H. Schoeller, ibid. 87, 156803 (2001)] to consider multiple conduction channels in two external leads, L and R. We introduce a parameter p_{\alpha} (|p_{\alpha}| \le 1) to characterize a connection between the two arms of the ring through lead \alpha (=L, R), which is the overlap integral between the conduction modes coupled to the two arms. First, we study the shape of a conductance peak as a function of energy level in the QD, in the absence of electron-electron interaction U. We show an asymmetric Fano resonance for |p_{L,R}| = 1 in the case of single conduction channel in the leads and an almost symmetric Breit-Wigner resonance for |p_{L,R}| < 0.5 in the case of multiple channels. Second, the Kondo effect is taken into account by the Bethe ansatz exact solution in the presence of U. We precisely evaluate the conductance at temperature T=0 and show a crossover from an asymmetric Fano-Kondo resonance to the Kondo plateau with changing p_{L,R}. Our model is also applicable to the multi-terminal geometry of the QD interferometer. We discuss the measurement of the transmission phase shift through the QD in a three-terminal geometry by a "double-slit experiment." We derive an analytical expression for the relation between the measured value and the intrinsic value of the phase shift.


title: On the behavior of multiple zeta-functions with identical arguments on the real line

abstract: We study the behavior of $r$-fold zeta-functions of Euler-Zagier type with identical arguments $\zeta_r(s,s,\ldots,s)$ on the real line. Our basic tool is an "infinite'' version of Newton's classical identities. We carry out numerical computations, and draw graphs of $\zeta_r(s,s,\ldots,s)$ for real $s$, for several small values of $r$. Those graphs suggest various properties of $\zeta_r(s,s,\ldots,s)$, some of which we prove rigorously. When $s \in [0,1]$, we show that $\zeta_r(s,s,\ldots,s)$ has $r$ asymptotes at $\Re s=1/k$ ($1\leq k\leq r$), and determine the asymptotic behavior of $\zeta_r(s,s,\ldots,s)$ close to those asymptotes. Numerical computations establish the existence of several real zeros for $2\leq r\leq 10$ (in which only the case $r=2$ was previously known). Based on those computations, we raise a conjecture on the number of zeros for general $r$, and gives a formula for calculating the number of zeros. We also consider the behavior of $\zeta_r(s,s,\ldots,s)$ outside the interval $[0,1]$. We prove asymptotic formulas for $\zeta_r(-k,-k,\ldots,-k)$, where $k$ takes odd positive integer values and tends to $+\infty$. Moreover, on the number of real zeros of $\zeta_r(s,s,\ldots,s)$, we prove that there are exactly $(r-1)$ real zeros on the interrval $(-2n,-2(n-1))$ for any $n \geq 2$.


title: Learning Class-Transductive Intent Representations for Zero-shot Intent Detection

abstract: Zero-shot intent detection (ZSID) aims to deal with the continuously emerging intents without annotated training data. However, existing ZSID systems suffer from two limitations: 1) They are not good at modeling the relationship between seen and unseen intents. 2) They cannot effectively recognize unseen intents under the generalized intent detection (GZSID) setting. A critical problem behind these limitations is that the representations of unseen intents cannot be learned in the training stage. To address this problem, we propose a novel framework that utilizes unseen class labels to learn Class-Transductive Intent Representations (CTIR). Specifically, we allow the model to predict unseen intents during training, with the corresponding label names serving as input utterances. On this basis, we introduce a multi-task learning objective, which encourages the model to learn the distinctions among intents, and a similarity scorer, which estimates the connections among intents more accurately. CTIR is easy to implement and can be integrated with existing methods. Experiments on two real-world datasets show that CTIR brings considerable improvement to the baseline systems.


title: Empirical Model for Discharge Current and Momentum Injection in Dielectric Barrier Discharge

abstract: Dielectric Barrier Discharge (DBD) plasma actuators with an asymmetric, straight edge electrode configuration generate a wall-bounded jet without moving parts. Mechanistic description of the interaction between the Coulombic forces and fluid motion as a function of DBD parameters remains unclear. This paper presents an experimental investigation of DBD actuator, including electrical current associated with microdischarges, plasma volume, and the wall jet momentum over a range of AC frequencies (0.5 - 2 kHz) and peak-to-peak voltages up to 19.5 kV. Discharge current is measured with a high temporal resolution, and plasma volume is characterized optically, and the momentum induced by the DBD wall jet is computed based on the axial velocities measured downstream of the actuator using a custom-built pitot tube. Discharge current analysis demonstrated asymmetry between the positive and negative semi-cycle; both currents yielded a power-law relationship with empirical fitting coefficients. Plasma length varies linearly and volume quadratically with voltage. Although plasma length reached an asymptotic value at a higher frequency, the plasma volume grows due to the increasing height of the ionization region. In a simple 2D configuration, the DBD wall jet momentum shows near-linear dependency with discharge current in the range of voltages and frequencies considered in this work. The presented empirical model characterizes the DBD wall jet momentum and the discharge current based only on the AC inputs. With the estimation of plasma volume, the model can be applied for determining more realistic boundary conditions in numerical simulations.


title: Improving accuracy of turbulence models by neural network

abstract: Neural networks of simple structures are used to construct a turbulence model for large-eddy simulation (LES). Data obtained by direct numerical simulation (DNS) of homogeneous isotropic turbulence are used to train neural networks. It is shown that two methods are effective for improvement of accuracy of the model: weighting data for training and addition of the second-order derivatives of velocity to the input variables. As a result, high correlation between the exact subgrid scale stress and the prediction by the neural network is obtained for large filter width; the correlation coefficient is about 0:9 and 0:8 for filter widths 48:8\eta and 97:4\eta, respectively, where \eta is the Kolmogorov scale. The models established by neural networks are close to but not identical with the gradient models. LES with the neural network model is performed for the homogeneous isotropic turbulence and the initial-value problem of the Taylor-Green vortices. The results obtained with the neural network model are in reasonable agreement with those of the filtered DNS. However, symmetry in the latter problem is broken since the neural network model does not possess rigorous symmetry under orthogonal transformations.


title: Parallel Residual Bi-Fusion Feature Pyramid Network for Accurate Single-Shot Object Detection

abstract: This paper proposes the Parallel Residual Bi-Fusion Feature Pyramid Network (PRB-FPN) for fast and accurate single-shot object detection. Feature Pyramid (FP) is widely used in recent visual detection, however the top-down pathway of FP cannot preserve accurate localization due to pooling shifting. The advantage of FP is weakened as deeper backbones with more layers are used. In addition, it cannot keep up accurate detection of both small and large objects at the same time. To address these issues, we propose a new parallel FP structure with bi-directional (top-down and bottom-up) fusion and associated improvements to retain high-quality features for accurate localization. We provide the following design improvements: (1) A parallel bifusion FP structure with a bottom-up fusion module (BFM) to detect both small and large objects at once with high accuracy. (2) A concatenation and re-organization (CORE) module provides a bottom-up pathway for feature fusion, which leads to the bi-directional fusion FP that can recover lost information from lower-layer feature maps. (3) The CORE feature is further purified to retain richer contextual information. Such CORE purification in both top-down and bottom-up pathways can be finished in only a few iterations. (4) The adding of a residual design to CORE leads to a new Re-CORE module that enables easy training and integration with a wide range of deeper or lighter backbones. The proposed network achieves state-of-the-art performance on the UAVDT17 and MS COCO datasets. Code is available at https://github.com/pingyang1117/PRBNet_PyTorch.


title: Satellite Quantum Communications: Fundamental Bounds and Practical Security

abstract: Satellite quantum communications are emerging within the panorama of quantum technologies as a more effective strategy to distribute completely-secure keys at very long distances, therefore playing an important role in the architecture of a large-scale quantum network. In this work, we apply and extend recent results in free-space quantum communications to determine the ultimate limits at which secret (and entanglement) bits can be distributed via satellites. Our study is comprehensive of the various practical scenarios, encompassing both downlink and uplink configurations, with satellites at different altitudes and zenith angles. It includes effects of diffraction, extinction, background noise and fading, due to pointing errors and atmospheric turbulence (appropriately developed for slant distances). Besides identifying upper bounds, we also discuss lower bounds, i.e., achievable rates for key generation and entanglement distribution. In particular, we study the composable finite-size secret key rates that are achievable by protocols of continuous variable quantum key distribution, for both downlink and uplink, showing the feasibility of this approach for all configurations. Finally, we present a study with a sun-synchronous satellite, showing that its key distribution rate is able to outperform a ground chain of ideal quantum repeaters.

categories: quant-ph physics.ao-ph physics.app-ph physics.optics physics.space-ph


title: A 3D Non-Stationary Channel Model for 6G Wireless Systems Employing Intelligent Reflecting Surface

abstract: As one of the key technologies for the sixth generation (6G) mobile communications, intelligent reflecting surface IRS) has the advantages of low power consumption, low cost, and simple design methods. But channel modeling is still an open issue in this field currently. In this paper, we propose a three-dimensional (3D) geometry based stochastic model (GBSM) for a massive multiple-input multiple-output (MIMO) communication system employing IRS. The model supports the movements of the transmitter, the receiver, and clusters. The evolution of clusters on the linear array and planar array is also considered in the proposed model. In addition, the generation of reflecting coefficient is incorporated into the model and the path loss of the sub-channel assisted by IRS is also proposed. The steering vector is set up at the base station for the cooperation with IRS. Through studying statistical properties such as the temporal autocorrelation function and space correlation function, the nonstationary properties are verified. The good agreement between the simulation results and the analytical results illustrates the correctness of the proposed channel model.


title: Classification of ancient flows by sub-affine-critical powers of curvature in $\mathbb{R}^2$

abstract: We classify closed convex $\alpha$-curve shortening flows for sub-affine-critical powers $\alpha \leq \frac{1}{3}$. In addition, we show that closed convex smooth finite entropy $\alpha$-curve shortening flows with $\frac{1}{3}<\alpha$ is a shrinking circle. After normalization, the ancient flows satisfying the above conditions converge exponentially fast to smooth closed convex shrinkers at the backward infinity. In particular, when $\alpha=\frac{1}{k^2-1}$ with $3\leq k \in \mathbb{N}$, the round circle shrinker has non-trivial Jacobi fields, but the ancient flows do not evolve along the Jacobi fields.


title: A Novel 3D Non-Stationary Multi-Frequency Multi-Link Wideband MIMO Channel Model

abstract: In this paper, a multi-frequency multi-link three-dimensional (3D) non-stationary wideband multiple-input multiple-output (MIMO) channel model is proposed. The spatial consistency and multi-frequency correlation are considered in parameters initialization of every single-link and different frequencies, including large scale parameters (LSPs) and small scale parameters (SSPs). Moreover, SSPs are time-variant and updated when scatterers and the receiver (Rx) are moving. The temporal evolution of clusters is modeled by birth and death processes. The single-link channel model which has considered the inter-correlation can be easily extended to multi-link channel model. Statistical properties, including spatial cross-correlation function (CCF), power delay profile (PDP), and correlation matrix collinearity (CMC) are investigated and compared with the 3rd generation partner project (3GPP) TR 38.901 and quasi deterministic radio channel generator (QuaDRiGa) channel models. Besides, the CCF is validated against measurement data.


title: Spin-spiral state of a Mn monolayer on W(110) studied by soft x-ray absorption spectroscopy at variable temperatures

abstract: The noncollinear magnetic state of epitaxial Mn monolayers on tungsten (110) crystal surfaces is investigated by means of soft x-ray absorption spectroscopy, to complement earlier spin-polarized STM experiments. X-ray absorption spectra (XAS), x-ray linear dichroism (XLD) and x-ray magnetic circular dichroism (XMCD) Mn L23-edge spectra were measured in the temperature range from 8 to 300 K and compared to results of fully-relativistic ab initio calculations. We show that antiferromagnetic (AFM) helical and cycloidal spirals give rise to significantly different Mn L23-edge XLD signals, enabling thus to distinguish between them. It follows from our results that the magnetic ground state of a Mn monolayer on W(110) is an AFM cycloidal spin spiral. Based on temperature-dependent XAS, XLD and field-induced XMCD spectra we deduce that magnetic properties of the Mn monolayer on W(110) vary with temperature, but this variation lacks a clear indication of a phase transition in the investigated temperature range up to 300 K - even though a crossover exists around 170 K in the temperature dependence of XAS branching ratios and in XLD profiles.


title: On initial-boundary value problem of the stochastic Navier--Stokes equations in the half space

abstract: We study the initial-boundary value problem of the stochastic Navier--Stokes equations in the half space. We prove the existence of weak solutions in the standard Besov space valued random processes when the initial data belong to the critical Besov space.


title: Efficient Algorithms for Causal Order Discovery in Quantum Networks

abstract: Given black-box access to the input and output systems, we develop the first efficient quantum causal order discovery algorithm with polynomial query complexity with respect to the number of systems. We model the causal order with quantum combs, and our algorithms output the order of inputs and outputs that the given process is compatible with. Our algorithm searches for the last input and the last output in the causal order, removes them, and iteratively repeats the above procedure until we get the order of all inputs and outputs. Our method guarantees a polynomial running time for quantum combs with a low Kraus rank, namely processes with low noise and little information loss. For special cases where the causal order can be inferred from local observations, we also propose algorithms that have lower query complexity and only require local state preparation and local measurements. Our algorithms will provide efficient ways to detect and optimize available transmission paths in quantum communication networks, as well as methods to verify quantum circuits and to discover the latent structure of multipartite quantum systems.


title: Identification of Prototypical Task Executions Based on Smoothness as Basis of Human-to-Robot Kinematic Skill Transfer

abstract: In this paper we investigate human-to-robot skill transfer based on the identification of prototypical task executions by clustering a set of examples performed by human demonstrators, where smoothness and kinematic features represent skill and task performance, respectively. We exemplify our skill transfer approach with data from an experimental task in which a tool touches a support surface with a target velocity. Prototypical task executions are identified and transferred to a generic robot arm in simulation. The results illustrate how task models based on skill and performance features can provide analysis and design criteria for robotic applications.


title: Dual Refinement Feature Pyramid Networks for Object Detection

abstract: FPN is a common component used in object detectors, it supplements multi-scale information by adjacent level features interpolation and summation. However, due to the existence of nonlinear operations and the convolutional layers with different output dimensions, the relationship between different levels is much more complex, the pixel-wise summation is not an efficient approach. In this paper, we first analyze the design defects from pixel level and feature map level. Then, we design a novel parameter-free feature pyramid networks named Dual Refinement Feature Pyramid Networks (DRFPN) for the problems. Specifically, DRFPN consists of two modules: Spatial Refinement Block (SRB) and Channel Refinement Block (CRB). SRB learns the location and content of sampling points based on contextual information between adjacent levels. CRB learns an adaptive channel merging method based on attention mechanism. Our proposed DRFPN can be easily plugged into existing FPN-based models. Without bells and whistles, for two-stage detectors, our model outperforms different FPN-based counterparts by 1.6 to 2.2 AP on the COCO detection benchmark, and 1.5 to 1.9 AP on the COCO segmentation benchmark. For one-stage detectors, DRFPN improves anchor-based RetinaNet by 1.9 AP and anchor-free FCOS by 1.3 AP when using ResNet50 as backbone. Extensive experiments verifies the robustness and generalization ability of DRFPN. The code will be made publicly available.


title: Observation of many-body quantum phase transitions beyond the Kibble-Zurek mechanism

abstract: Quantum critical behavior of many-body phase transitions is one of the most fascinating yet challenging questions in quantum physics. Here, we improved the band-mapping method to investigate the quantum phase transition from superfluid to Mott insulators, and we observed the critical behaviors of quantum phase transitions in both dynamical steady-state-relaxation region and phase-oscillation region. Based on various observables, two different values for the same quantum critical parameter are observed. This result is beyond a universal-scaling-law description of quantum phase transitions known as the Kibble-Zurek mechanism, and suggests that multiple quantum critical mechanisms are competing in many-body quantum phase transition experiments in inhomogeneous systems.


title: Modeling of the ALMA HL Tau Polarization by Mixture of Grain Alignment and Self-scattering

abstract: Dust polarization at (sub)millimeter wavelengths has been observed for many protoplanetary disks. Theoretically, multiple origins potentially contribute to the polarized emission but it is still uncertain what mechanism is dominant in disk millimeter polarization. To quantitatively address the origin, we perform radiative transfer calculations of the mixture of alignment and self-scattering induced polarization to reproduce the 3.1 mm polarization of the HL Tau disk, which shows azimuthal pattern in polarization vectors. We find that a mixture of the grain alignment and self-scattering is essential to reproduce the HL Tau 3.1 mm polarization properties. Our model shows that the polarization of the HL Tau at 3.1 mm can be decomposed to be the combination of the self-scattering parallel to the minor axis and the alignment-induced polarization parallel to the major axis, with the orders of $\sim 0.5\%$ fraction for each component. This slightly eases the tight constraints on the grain size of $\sim 70~{\rm~\mu m}$ to be $\sim 130 {\rm~\mu m}$ in the previous studies but further modeling is needed. In addition, the grain alignment model requires effectively prolate grains but the physics to reproduce it in protoplanetary disks is still a mystery.


title: Designing a Prospective COVID-19 Therapeutic with Reinforcement Learning

abstract: The SARS-CoV-2 pandemic has created a global race for a cure. One approach focuses on designing a novel variant of the human angiotensin-converting enzyme 2 (ACE2) that binds more tightly to the SARS-CoV-2 spike protein and diverts it from human cells. Here we formulate a novel protein design framework as a reinforcement learning problem. We generate new designs efficiently through the combination of a fast, biologically-grounded reward function and sequential action-space formulation. The use of Policy Gradients reduces the compute budget needed to reach consistent, high-quality designs by at least an order of magnitude compared to standard methods. Complexes designed by this method have been validated by molecular dynamics simulations, confirming their increased stability. This suggests that combining leading protein design methods with modern deep reinforcement learning is a viable path for discovering a Covid-19 cure and may accelerate design of peptide-based therapeutics for other diseases.


title: Automatic Routability Predictor Development Using Neural Architecture Search

abstract: The rise of machine learning technology inspires a boom of its applications in electronic design automation (EDA) and helps improve the degree of automation in chip designs. However, manually crafted machine learning models require extensive human expertise and tremendous engineering efforts. In this work, we leverage neural architecture search (NAS) to automate the development of high-quality neural architectures for routability prediction, which can help to guide cell placement toward routable solutions. Our search method supports various operations and highly flexible connections, leading to architectures significantly different from all previous human-crafted models. Experimental results on a large dataset demonstrate that our automatically generated neural architectures clearly outperform multiple representative manually crafted solutions. Compared to the best case of manually crafted models, NAS-generated models achieve 5.85% higher Kendall's $\tau$ in predicting the number of nets with DRC violations and 2.12% better area under ROC curve (ROC-AUC) in DRC hotspot detection. Moreover, compared with human-crafted models, which easily take weeks to develop, our efficient NAS approach finishes the whole automatic search process with only 0.3 days.


title: The Affine Index Polynomial and the Sawollek Polynomial

abstract: The purpose of this paper is to give a new basis for examining the relationships of the Affine Index Polynomial and the Sawollek Polynomial. Blake Mellor has written a pioneering paper showing how the Affine Index Polynomial may be extracted from the Sawollek Polynomial. The Affine Index Polynomial is an elementary combinatorial invariant of virtual knots. The Sawollek polynomial is a relative of the classical Alexander polynomial and is defined in terms of a generalization of the Alexander module to virtual knots that derives from the so-called Alexander Biquandle. The present paper constructs the groundwork for a new approach to this relationship, and gives a concise proof of the basic Theorem of Mellor extracting the Affine Index Polynomial from the Sawollek Polynomial.


title: A model independent study of nonlocality with polarization entangled photons

abstract: Nonlocality as a fundamental aspect of quantum mechanics is witnessed by violation of Bell inequality or its variants, for which all relevant studies assume some correlations exhibited by local realistic theories. The strategy of Bell's theorem is to establish some criteria to distinguish local realistic theories from quantum mechanics with respect to the nonlocal nature of entangled systems. Here we propose a model independent study of nonlocality that needs not to assume any local theory since observation of the expected nonlocal effect is straightforward quantum mechanically. Our proposal involves a bipartite polarization-entangled system in which one photon immediately reduces into a circular-polarization (CP) state when its partner at a space-like distance is detected in another CP state. The state reduction of the photon can be mechanically monitored because a CP photon carries angular momentum and exerts a torque on a half-wave plate whose mechanical motion is measurable, which is well described by quantum mechanics and independent of any local realistic assumption.


title: Sparse Semi-Supervised Action Recognition with Active Learning

abstract: Current state-of-the-art methods for skeleton-based action recognition are supervised and rely on labels. The reliance is limiting the performance due to the challenges involved in annotation and mislabeled data. Unsupervised methods have been introduced, however, they organize sequences into clusters and still require labels to associate clusters with actions. In this paper, we propose a novel approach for skeleton-based action recognition, called SESAR, that connects these approaches. SESAR leverages the information from both unlabeled data and a handful of sequences actively selected for labeling, combining unsupervised training with sparsely supervised guidance. SESAR is composed of two main components, where the first component learns a latent representation for unlabeled action sequences through an Encoder-Decoder RNN which reconstructs the sequences, and the second component performs active learning to select sequences to be labeled based on cluster and classification uncertainty. When the two components are simultaneously trained on skeleton-based action sequences, they correspond to a robust system for action recognition with only a handful of labeled samples. We evaluate our system on common datasets with multiple sequences and actions, such as NW UCLA, NTU RGB+D 60, and UWA3D. Our results outperform standalone skeleton-based supervised, unsupervised with cluster identification, and active-learning methods for action recognition when applied to sparse labeled samples, as low as 1% of the data.


title: Deterministic transfer of optical-quality carbon nanotubes for atomically defined technology

abstract: When continued device scaling reaches the ultimate limit imposed by atoms, technology based on atomically precise structures is expected to emerge. Device fabrication will then require building blocks with identified atomic arrangements and assembly of the components without contamination. Here we report on a versatile dry transfer technique for deterministic placement of optical-quality carbon nanotubes. Single-crystalline anthracene is used as a medium which readily sublimes by mild heating, leaving behind clean nanotubes and thus enabling bright photoluminescence. We are able to position nanotubes of a desired chirality with a sub-micron accuracy under in-situ optical monitoring, thereby demonstrating deterministic coupling of a nanotube to a photonic crystal nanobeam cavity. A cross junction structure is also designed and constructed by repeating the nanotube transfer, where intertube exciton transfer is observed. Our results represent an important step towards development of devices consisting of atomically precise components and interfaces.


title: Gaia Early Data Release 3: Parallax bias versus magnitude, colour, and position

abstract: Gaia Early Data Release 3 (Gaia EDR3) gives trigonometric parallaxes for nearly 1.5 billion sources. Inspection of the EDR3 data for sources identified as quasars reveals that their parallaxes are biased, that is systematically offset from the expected distribution around zero, by a few tens of microarcsec. We attempt to map the main dependencies of the parallax bias in EDR3. In principle this could provide a recipe for correcting the EDR3 parallaxes. For faint sources the quasars provide the most direct way to estimate parallax bias. In order to extend this to brighter sources and a broader range of colours, we use differential methods based on physical pairs (binaries) and sources in the Large Magellanic Cloud. The functional forms of the dependencies are explored by mapping the systematic differences between EDR3 and DR2 parallaxes. The parallax bias is found to depend in a non-trivial way on (at least) the magnitude, colour, and ecliptic latitude of the source. Different dependencies apply to the five- and six-parameter solutions in EDR3. While it is not possible to derive a definitive recipe for the parallax correction, we give tentative expressions to be used at the researcher's discretion and point out some possible paths towards future improvements.


title: 3D-NVS: A 3D Supervision Approach for Next View Selection

abstract: We present a classification based approach for the next best view selection and show how we can plausibly obtain a supervisory signal for this task. The proposed approach is end-to-end trainable and aims to get the best possible 3D reconstruction quality with a pair of passively acquired 2D views. The proposed model consists of two stages: a classifier and a reconstructor network trained jointly via the indirect 3D supervision from ground truth voxels. While testing, the proposed method assumes no prior knowledge of the underlying 3D shape for selecting the next best view. We demonstrate the proposed method's effectiveness via detailed experiments on synthetic and real images and show how it provides improved reconstruction quality than the existing state of the art 3D reconstruction and the next best view prediction techniques.


title: Sample-Efficient L0-L2 Constrained Structure Learning of Sparse Ising Models

abstract: We consider the problem of learning the underlying graph of a sparse Ising model with $p$ nodes from $n$ i.i.d. samples. The most recent and best performing approaches combine an empirical loss (the logistic regression loss or the interaction screening loss) with a regularizer (an L1 penalty or an L1 constraint). This results in a convex problem that can be solved separately for each node of the graph. In this work, we leverage the cardinality constraint L0 norm, which is known to properly induce sparsity, and further combine it with an L2 norm to better model the non-zero coefficients. We show that our proposed estimators achieve an improved sample complexity, both (a) theoretically, by reaching new state-of-the-art upper bounds for recovery guarantees, and (b) empirically, by showing sharper phase transitions between poor and full recovery for graph topologies studied in the literature, when compared to their L1-based state-of-the-art methods.


title: Unsupervised Alternating Optimization for Blind Hyperspectral Imagery Super-resolution

abstract: Despite the great success of deep model on Hyperspectral imagery (HSI) super-resolution(SR) for simulated data, most of them function unsatisfactory when applied to the real data, especially for unsupervised HSI SR methods. One of the main reason comes from the fact that the predefined degeneration models (e.g. blur in spatial domain) utilized by most HSI SR methods often exist great discrepancy with the real one, which results in these deep models overfit and ultimately degrade their performance on real data. To well mitigate such a problem, we explore the unsupervised blind HSI SR method. Specifically, we investigate how to effectively obtain the degeneration models in spatial and spectral domain, respectively, and makes them can well compatible with the fusion based SR reconstruction model. To this end, we first propose an alternating optimization based deep framework to estimate the degeneration models and reconstruct the latent image, with which the degeneration models estimation and HSI reconstruction can mutually promotes each other. Then, a meta-learning based mechanism is further proposed to pre-train the network, which can effectively improve the speed and generalization ability adapting to different complex degeneration. Experiments on three benchmark HSI SR datasets report an excellent superiority of the proposed method on handling blind HSI fusion problem over other competing methods.


title: Ultra-Wideband Radar and Wireless Human Sensing

abstract: This study presents the progress of our recent research regarding wireless measurements of the human body. First, we explain radar imaging algorithms for screening passengers at security checkpoints that can process data faster than existing algorithms to generate accurate and high-resolution images of human bodies. Second, we introduce signal processing techniques for accurately measuring radar micro-Doppler signals associated with human motions and activities. Finally, we present radar signal processing algorithms for measuring human respiration, heartbeat, and other types of motion. Such algorithms can be applied in various fields including healthcare, security, biometric identification, and man-machine interfaces. These fields have one thing in common: prior knowledge about the human shape, motion, and physiology are effectively exploited to improve performance by optimizing the radar systems and signal processing algorithms.


title: Bengali Abstractive News Summarization(BANS): A Neural Attention Approach

abstract: Abstractive summarization is the process of generating novel sentences based on the information extracted from the original text document while retaining the context. Due to abstractive summarization's underlying complexities, most of the past research work has been done on the extractive summarization approach. Nevertheless, with the triumph of the sequence-to-sequence (seq2seq) model, abstractive summarization becomes more viable. Although a significant number of notable research has been done in the English language based on abstractive summarization, only a couple of works have been done on Bengali abstractive news summarization (BANS). In this article, we presented a seq2seq based Long Short-Term Memory (LSTM) network model with attention at encoder-decoder. Our proposed system deploys a local attention-based model that produces a long sequence of words with lucid and human-like generated sentences with noteworthy information of the original document. We also prepared a dataset of more than 19k articles and corresponding human-written summaries collected from bangla.bdnews24.com1 which is till now the most extensive dataset for Bengali news document summarization and publicly published in Kaggle2. We evaluated our model qualitatively and quantitatively and compared it with other published results. It showed significant improvement in terms of human evaluation scores with state-of-the-art approaches for BANS.


title: A journey in ESN and LSTM visualisations on a language task

abstract: Echo States Networks (ESN) and Long-Short Term Memory networks (LSTM) are two popular architectures of Recurrent Neural Networks (RNN) to solve machine learning task involving sequential data. However, little have been done to compare their performances and their internal mechanisms on a common task. In this work, we trained ESNs and LSTMs on a Cross-Situationnal Learning (CSL) task. This task aims at modelling how infants learn language: they create associations between words and visual stimuli in order to extract meaning from words and sentences. The results are of three kinds: performance comparison, internal dynamics analyses and visualization of latent space. (1) We found that both models were able to successfully learn the task: the LSTM reached the lowest error for the basic corpus, but the ESN was quicker to train. Furthermore, the ESN was able to outperform LSTMs on datasets more challenging without any further tuning needed. (2) We also conducted an analysis of the internal units activations of LSTMs and ESNs. Despite the deep differences between both models (trained or fixed internal weights), we were able to uncover similar inner mechanisms: both put emphasis on the units encoding aspects of the sentence structure. (3) Moreover, we present Recurrent States Space Visualisations (RSSviz), a method to visualize the structure of latent state space of RNNs, based on dimension reduction (using UMAP). This technique enables us to observe a fractal embedding of sequences in the LSTM. RSSviz is also useful for the analysis of ESNs (i) to spot difficult examples and (ii) to generate animated plots showing the evolution of activations across learning stages. Finally, we explore qualitatively how the RSSviz could provide an intuitive visualisation to understand the influence of hyperparameters on the reservoir dynamics prior to ESN training.


title: Cross-Correlation Based Discriminant Criterion for Channel Selection in Motor Imagery BCI Systems

abstract: Objective. Many electroencephalogram (EEG)-based brain-computer interface (BCI) systems use a large amount of channels for higher performance, which is time-consuming to set up and inconvenient for practical applications. Finding an optimal subset of channels without compromising the performance is a necessary and challenging task. Approach. In this article, we proposed a cross-correlation based discriminant criterion (XCDC) which assesses the importance of a channel for discriminating the mental states of different motor imagery (MI) tasks. Channels are ranked and selected according to the proposed criterion. The efficacy of XCDC is evaluated on two motor imagery EEG datasets. Main results. In both datasets, XCDC significantly reduces the amount of channels without compromising classification accuracy compared to the all-channel setups. Under the same constraint of accuracy, the proposed method requires fewer channels than existing channel selection methods based on Pearson's correlation coefficient and common spatial pattern. Visualization of XCDC shows consistent results with neurophysiological principles. Significance. This work proposes a quantitative criterion for assessing and ranking the importance of EEG channels in MI tasks and provides a practical method for selecting the ranked channels in the calibration phase of MI BCI systems, which alleviates the computational complexity and configuration difficulty in the subsequent steps, leading to real-time and more convenient BCI systems.


title: Understanding Failures of Deep Networks via Robust Feature Extraction

abstract: Traditional evaluation metrics for learned models that report aggregate scores over a test set are insufficient for surfacing important and informative patterns of failure over features and instances. We introduce and study a method aimed at characterizing and explaining failures by identifying visual attributes whose presence or absence results in poor performance. In distinction to previous work that relies upon crowdsourced labels for visual attributes, we leverage the representation of a separate robust model to extract interpretable features and then harness these features to identify failure modes. We further propose a visualization method aimed at enabling humans to understand the meaning encoded in such features and we test the comprehensibility of the features. An evaluation of the methods on the ImageNet dataset demonstrates that: (i) the proposed workflow is effective for discovering important failure modes, (ii) the visualization techniques help humans to understand the extracted features, and (iii) the extracted insights can assist engineers with error analysis and debugging.


title: Anomalous gas in ESO 149-G003: A MeerKAT-16 View

abstract: ESO 149-G003 is a close-by, isolated dwarf irregular galaxy. Previous observations with the ATCA indicated the presence of anomalous neutral hydrogen (HI) deviating from the kinematics of a regularly rotating disc. We conducted follow-up observations with the MeerKAT radio telescope during the 16-dish Early Science programme as well as with the MeerLICHT optical telescope. Our more sensitive radio observations confirm the presence of anomalous gas in ESO 149-G003, and further confirm the formerly tentative detection of an extraplanar HI component in the galaxy. Employing a simple tilted-ring model, in which the kinematics is determined with only four parameters but including morphological asymmetries, we reproduce the galaxy's morphology, which shows a high degree of asymmetry. By comparing our model with the observed HI, we find that in our model we cannot account for a significant (but not dominant) fraction of the gas. From the differences between our model and the observed data cube we estimate that at least 7%-8% of the HI in the galaxy exhibits anomalous kinematics, while we estimate a minimum mass fraction of less than 1% for the morphologically confirmed extraplanar component. We investigate a number of global scaling relations and find that, besides being gas-dominated with a neutral gas-to-stellar mass ratio of 1.7, the galaxy does not show any obvious global peculiarities. Given its isolation, as confirmed by optical observations, we conclude that the galaxy is likely currently acquiring neutral gas. It is either re-accreting gas expelled from the galaxy or accreting pristine intergalactic material.


title: Distributed algorithms for fractional coloring

abstract: In this paper we study fractional coloring from the angle of distributed computing. Fractional coloring is the linear relaxation of the classical notion of coloring, and has many applications, in particular in scheduling. It was proved by Hasemann, Hirvonen, Rybicki and Suomela (2016) that for every real $\alpha>1$ and integer $\Delta$, a fractional coloring of total weight at most $\alpha(\Delta+1)$ can be obtained deterministically in a single round in graphs of maximum degree $\Delta$, in the LOCAL model of computation. However, a major issue of this result is that the output of each vertex has unbounded size. Here we prove that even if we impose the more realistic assumption that the output of each vertex has constant size, we can find fractional colorings of total weight arbitrarily close to known tight bounds for the fractional chromatic number in several cases of interest. More precisely, we show that for any fixed $\epsilon > 0$ and $\Delta$, a fractional coloring of total weight at most $\Delta+\epsilon$ can be found in $O(\log^*n)$ rounds in graphs of maximum degree $\Delta$ with no $K_{\Delta+1}$, while finding a fractional coloring of total weight at most $\Delta$ in this case requires $\Omega(\log \log n)$ rounds for randomized algorithms and $\Omega( \log n)$ rounds for deterministic algorithms. We also show how to obtain fractional colorings of total weight at most $2+\epsilon$ in grids of any fixed dimension, for any $\epsilon>0$, in $O(\log^*n)$ rounds. Finally, we prove that in sparse graphs of large girth from any proper minor-closed family we can find a fractional coloring of total weight at most $2+\epsilon$, for any $\epsilon>0$, in $O(\log n)$ rounds.


title: Perfectly Matched Layers for nonlocal Helmholtz equations II: multi-dimensional cases

abstract: Perfectly matched layers (PMLs) are formulated and applied to numerically solve nonlocal Helmholtz equations in one and two dimensions. In one dimension, we present the PML modifications for the nonlocal Helmholtz equation with general kernels and theoretically show its effectiveness in some sense. In two dimensions, we give the PML modifications in both Cartesian coordinates and polar coordinates. Based on the PML modifications, nonlocal Helmholtz equations are truncated in one and two dimensional spaces, and asymptotic compatibility schemes are introduced to discretize the resulting truncated problems. Finally, numerical examples are provided to study the "numerical reflections" by PMLs and demonstrate the effectiveness and validation of our nonlocal PML strategy.


title: Explicit Gain Equations for Single Crystalline Photoconductors

abstract: Photoconductors based on semiconducting thin films, nanowires and 2-dimensional atomic layers have been extensively investigated. But there is no explicit photogain equation that allows for fitting and designing photoresponses of these devices. In this work, we managed to derive explicit photogain equations for silicon nanowire photoconductors based on experimental observations. The silicon nanowires were fabricated by patterning the device layer of silicon-on-insulator wafers by standard lithography that were doped with boron. It was found that the as-fabricated silicon nanowires have a surface depletion region ~ 32 nm wide. This depletion region protects charge carriers in the channel from surface scatterings, resulting in the independence of charge carrier mobilities on nanowire size. It is consistent with our Hall effect measurements but in contradiction with the accepted conclusion in the past decades that charge carrier mobilities become smaller for smaller nanowires due to surface scatterings. Under light illumination, the depletion region logarithmically narrows down and the nanowire channel widens accordingly. Photo Hall effect measurements show that the nanowire photoconductance is not contributed by the increase of carrier concentrations but the widening of the nanowire channel. As a result, a nanowire photoconductor can be modeled as a resistor in connection with floating Schottky junctions near the nanowire surfaces. Based on the photoresponses of a Schottky junction, we derived explicit photogain equations for nanowire photoconductors that are a function of light intensity and device physical parameters. The gain equations fit well with the experimental data, from which we extracted the minority carrier lifetimes that are consistent with the minority carrier lifetime in nanowires reported in literature.


title: Explicit gain equations for hybrid graphene-quantum-dot photodetectors

abstract: Graphene is an attractive material for broadband photodetection but suffers from weak light absorption. Coating graphene with quantum dots can significantly enhance light absorption and create extraordinarily high photo gain. This high gain is often explained by the classical gain theory which is unfortunately an implicit function and may even be questionable. In this work, we managed to derive explicit gain equations for hybrid graphene-quantum-dot photodetectors. Due to the work function mismatch, lead sulfide (PbS) quantum dots coated on graphene will form a surface depletion region near the interface of quantum dots and graphene. Light illumination narrows down the surface depletion region, creating a photovoltage that gates the graphene. As a result, high photo gain in graphene is observed. The explicit gain equations are derived from the theoretical gate transfer characteristics of graphene and the correlation of the photovoltage with the light illumination intensity. The derived explicit gain equations fit well with the experimental data, from which physical parameters are extracted.


title: QCD evolution of the gluon Sivers function in heavy flavor dijet production at the Electron-Ion Collider

abstract: Using Soft-Collinear Effective Theory, we develop the transverse-momentum-dependent factorization formalism for heavy flavor dijet production in polarized-proton-electron collisions. We consider heavy flavor mass corrections in the collinear-soft and jet functions, as well as the associated evolution equations. Using this formalism, we generate a prediction for the gluon Sivers asymmetry for charm and bottom dijet production at the future Electron-Ion Collider. Furthermore, we compare theoretical predictions with and without the inclusion of finite quark masses. We find that the heavy flavor mass effects can give sizable corrections to the predicted asymmetry.


title: Pedestrian Trajectory Prediction using Context-Augmented Transformer Networks

abstract: Forecasting the trajectory of pedestrians in shared urban traffic environments is still considered one of the challenging problems facing the development of autonomous vehicles (AVs). In the literature, this problem is often tackled using recurrent neural networks (RNNs). Despite the powerful capabilities of RNNs in capturing the temporal dependency in the pedestrians' motion trajectories, they were argued to be challenged when dealing with longer sequential data. Thus, in this work, we are introducing a framework based on the transformer networks that were shown recently to be more efficient and outperformed RNNs in many sequential-based tasks. We relied on a fusion of the past positional information, agent interactions information and scene physical semantics information as an input to our framework in order to provide a robust trajectory prediction of pedestrians. We have evaluated our framework on two real-life datasets of pedestrians in shared urban traffic environments and it has outperformed the compared baseline approaches in both short-term and long-term prediction horizons.


title: Non-parametric Quantile Regression via the K-NN Fused Lasso

abstract: Quantile regression is a statistical method for estimating conditional quantiles of a response variable. In addition, for mean estimation, it is well known that quantile regression is more robust to outliers than $l_2$-based methods. By using the fused lasso penalty over a $K$-nearest neighbors graph, we propose an adaptive quantile estimator in a non-parametric setup. We show that the estimator attains optimal rate of $n^{-1/d}$ up to a logarithmic factor, under mild assumptions on the data generation mechanism of the $d$-dimensional data. We develop algorithms to compute the estimator and discuss methodology for model selection. Numerical experiments on simulated and real data demonstrate clear advantages of the proposed estimator over state of the art methods.


title: Folding and Unfolding on Metagraphs

abstract: Typed metagraphs are defined as hypergraphs with types assigned to hyperedges and their targets, and the potential to have targets of hyperedges connect to whole links as well as targets. Directed typed metagraphs (DTMGs) are introduced via partitioning the targets of each edge in a typed metagraph into input, output and lateral sets; one can then look at "metapaths" in which edges' output-sets are linked to other edges' input-sets. An initial algebra approach to DTMGs is presented, including introduction of constructors for building up DTMGs and laws regarding relationships among multiple ways of using these constructors. A menagerie of useful morphism types is then defined on DTMGs (catamorphisms, anamorphisms, histomorphisms, futumorphisms, hylomorphisms, chronomorphisms, metamorphisms and metachronomorphisms), providing a general abstract framework for formulating a broad variety of metagraph operations. Deterministic and stochastic processes on typed metagraphs are represented in terms of forests of DTMGs defined over a common TMG, where the various morphisms can be straightforwardly extended to these forests. A variation of the approach to undirected typed metagraphs is presented; and it is indicated how the framework outlined can applied to realistic metagraphs involving complexities like dependent and probabilistic types, multidimensional values and dynamic processing including insertion and deletion of edges.


title: Effect of ageing on the properties of the W-containing IRIS-TiAl alloy

abstract: The effects of ageing at 800 $^\circ$C on the properties of the IRIS alloy (Ti$_{49.9}$Al$_{48}$W$_2$B$_{0.1}$) are studied. The initial microstructure of this alloy densified by Spark Plasma Sintering (SPS) is mainly composed of lamellar colonies which are surrounded by $\gamma$ grains. The evolutions of the alloy strength and creep resistance resulting from this ageing treatment are measured by the related mechanical tests. The microstructural changes are investigated by scanning and transmission electron microscopies and by X-ray diffraction. The main structural evolutions consist in a shrinkage of the lamellar areas and in a precipitation of $\beta_0$ phase, which is accompanied by a moderate segregation of tungsten and a decrease of the $\alpha_2$ lamellar width. However, these evolutions are relatively limited and the microstructural stability is found to result mainly from the low diffusivity of tungsten. Conversely, a moderate effect of this ageing treatment on mechanical properties, at room and high temperatures, is measured. Such experimental results are interpreted and discussed in terms of the microstructural evolutions and of the deformation mechanisms which are activated at different temperatures under various solicitations.


title: An infinite-dimensional representation of the Ray-Knight theorems

abstract: The classical Ray-Knight theorems for Brownian motion determine the law of its local time process either at the first hitting time of a given value a by the local time at the origin, or at the first hitting time of a given position b by Brownian motion. We extend these results by describing the local time process jointly for all a and all b, by means of stochastic integral with respect to an appropriate white noise. Our result applies to $\mu$-processes, and has an immediate application: a $\mu$-process is the height process of a Feller continuous-state branching process (CSBP) with immigration (Lambert [10]), whereas a Feller CSBP with immigration satisfies a stochastic differential equation driven by a white noise (Dawson and Li [7]); our result gives an explicit relation between these two descriptions and shows that the stochastic differential equation in question is a reformulation of Tanaka's formula.