title: Sub-clusters of Normal Data for Anomaly Detection

abstract: Anomaly detection in data analysis is an interesting but still challenging research topic in real world applications. As the complexity of data dimension increases, it requires to understand the semantic contexts in its description for effective anomaly characterization. However, existing anomaly detection methods show limited performances with high dimensional data such as ImageNet. Existing studies have evaluated their performance on low dimensional, clean and well separated data set such as MNIST and CIFAR-10. In this paper, we study anomaly detection with high dimensional and complex normal data. Our observation is that, in general, anomaly data is defined by semantically explainable features which are able to be used in defining semantic sub-clusters of normal data as well. We hypothesize that if there exists reasonably good feature space semantically separating sub-clusters of given normal data, unseen anomaly also can be well distinguished in the space from the normal data. We propose to perform semantic clustering on given normal data and train a classifier to learn the discriminative feature space where anomaly detection is finally performed. Based on our careful and extensive experimental evaluations with MNIST, CIFAR-10, and ImageNet with various combinations of normal and anomaly data, we show that our anomaly detection scheme outperforms state of the art methods especially with high dimensional real world images.


title: Conspiracy and debunking narratives about COVID-19 origination on Chinese social media: How it started and who is to blame

abstract: This paper studies conspiracy and debunking narratives about COVID-19 origination on a major Chinese social media platform, Weibo, from January to April 2020. Popular conspiracies about COVID-19 on Weibo, including that the virus is human-synthesized or a bioweapon, differ substantially from those in the US. They attribute more responsibility to the US than to China, especially following Sino-US confrontations. Compared to conspiracy posts, debunking posts are associated with lower user participation but higher mobilization. Debunking narratives can be more engaging when they come from women and influencers and cite scientists. Our findings suggest that conspiracy narratives can carry highly cultural and political orientations. Correction efforts should consider political motives and identify important stakeholders to reconstruct international dialogues toward intercultural understanding.


title: Semi-Supervised Few-Shot Atomic Action Recognition

abstract: Despite excellent progress has been made, the performance on action recognition still heavily relies on specific datasets, which are difficult to extend new action classes due to labor-intensive labeling. Moreover, the high diversity in Spatio-temporal appearance requires robust and representative action feature aggregation and attention. To address the above issues, we focus on atomic actions and propose a novel model for semi-supervised few-shot atomic action recognition. Our model features unsupervised and contrastive video embedding, loose action alignment, multi-head feature comparison, and attention-based aggregation, together of which enables action recognition with only a few training examples through extracting more representative features and allowing flexibility in spatial and temporal alignment and variations in the action. Experiments show that our model can attain high accuracy on representative atomic action datasets outperforming their respective state-of-the-art classification accuracy in full supervision setting.


title: Semiparametric proximal causal inference

abstract: Skepticism about the assumption of no unmeasured confounding, also known as exchangeability, is often warranted in making causal inferences from observational data; because exchangeability hinges on an investigator's ability to accurately measure covariates that capture all potential sources of confounding. In practice, the most one can hope for is that covariate measurements are at best proxies of the true underlying confounding mechanism operating in a given observational study. In this paper, we consider the framework of proximal causal inference introduced by Miao et al. (2018); Tchetgen Tchetgen et al. (2020), which while explicitly acknowledging covariate measurements as imperfect proxies of confounding mechanisms, offers an opportunity to learn about causal effects in settings where exchangeability on the basis of measured covariates fails. We make a number of contributions to proximal inference including (i) an alternative set of conditions for nonparametric proximal identification of the average treatment effect; (ii) general semiparametric theory for proximal estimation of the average treatment effect including efficiency bounds for key semiparametric models of interest; (iii) a characterization of proximal doubly robust and locally efficient estimators of the average treatment effect. Moreover, we provide analogous identification and efficiency results for the average treatment effect on the treated. Our approach is illustrated via simulation studies and a data application on evaluating the effectiveness of right heart catheterization in the intensive care unit of critically ill patients.


title: Adaptive Tracking Control of Soft Robots using Integrated Sensing Skin and Recurrent Neural Networks

abstract: In this paper, we study integrated estimation and control of soft robots. A significant challenge in deploying closed loop controllers is reliable proprioception via integrated sensing in soft robots. Despite the considerable advances accomplished in fabrication, modelling, and model-based control of soft robots, integrated sensing and estimation is still in its infancy. To that end, this paper introduces a new method of estimating the degree of curvature of a soft robot using a stretchable sensing skin. The skin is a spray-coated piezoresistive sensing layer on a latex membrane. The mapping from the strain signal to the degree of curvature is estimated by using a recurrent neural network. We investigate uni-directional bending as well as bi-directional bending of a single-segment soft robot. Moreover, an adaptive controller is developed to track the degree of curvature of the soft robot in the presence of dynamic uncertainties. Subsequently, using the integrated soft sensing skin, we experimentally demonstrate successful curvature tracking control of the soft robot.


title: Quantifying Sources of Uncertainty in Deep Learning-Based Image Reconstruction

abstract: Image reconstruction methods based on deep neural networks have shown outstanding performance, equalling or exceeding the state-of-the-art results of conventional approaches, but often do not provide uncertainty information about the reconstruction. In this work we propose a scalable and efficient framework to simultaneously quantify aleatoric and epistemic uncertainties in learned iterative image reconstruction. We build on a Bayesian deep gradient descent method for quantifying epistemic uncertainty, and incorporate the heteroscedastic variance of the noise to account for the aleatoric uncertainty. We show that our method exhibits competitive performance against conventional benchmarks for computed tomography with both sparse view and limited angle data. The estimated uncertainty captures the variability in the reconstructions, caused by the restricted measurement model, and by missing information, due to the limited angle geometry.


title: Noise adaptive beamforming for linear array photoacoustic imaging

abstract: Delay-and-sum (DAS) algorithms are widely used for beamforming in linear array photoacoustic imaging systems and are characterized by fast execution. However, these algorithms suffer from various drawbacks like low resolution, low contrast, high sidelobe artifacts and lack of visual coherence. More recently, adaptive weighting was introduced to improve the reconstruction image quality. Unfortunately, the existing state-of-the-art adaptive beamforming algorithms are computationally expensive and do not consider the specific noise characteristics of the acquired ultrasonic signal. In this article, we present a new adaptive weighting factor named the variational coherence factor (VCF), which takes into account the noise level variations of radio-frequency data. The proposed technique provides superior results in terms of image resolution, sidelobe reduction, signal-to-noise and contrast level improvement. The quantitative results of the numerical simulations and phantom imaging show that the proposed VCF assisted DAS method leads to 55% and 25% improvement in FWHM, 57% and 32% improvement in SNR, respectively, compared to the state-of-the-art DAS-based methods. The results demonstrate that the proposed method can effectively improve the reconstructed image quality and deliver satisfactory imaging performance even with a limited number of sensor elements. The proposed method can potentially reduce the instrumentation cost of the photoacoustic imaging system and contribute toward the clinical translation of the modality.


title: Neutrino amplitude decomposition in matter

abstract: Observation of the interference between the atmospheric-scale and solar-scale oscillations is one of the challenging and tantalizing goals of the ongoing and upcoming neutrino experiments. An inevitable first step required for such analyses is to establish the way of how the oscillation $S$ matrix can be decomposed into the atmospheric and solar waves, the procedure dubbed as the amplitude decomposition. In this paper, with use of the perturbative framework proposed by Denton et al. (DMP), we establish the prescription for amplitude decomposition which covers the whole kinematical region of the terrestrial neutrino experiments. We analyze the limits to the atmospheric- and solar-resonance regions to argue that the dynamical two modes of the DMP decomposition can be interpreted as the matter-dressed atmospheric and solar oscillations. The expressions of the oscillation probability, which are decomposed into the non-interference and interference terms, are derived for all the relevant flavor oscillation channels. Through construction of the DMP decomposition, we reveal the nature of $\psi$ ($\theta_{12}$ in matter) symmetry as due to the $S$ matrix rephasing invariance. A new picture of the DMP perturbation theory emerged, a unified perturbative framework for neutrino oscillation in earth matter.


title: An SU(3) Yang-Mills Structure for Electron-Phonon Interactions Resulting from Strong Electron Correlations in 2D hexagonal lattices

abstract: Concise and powerful mathematical descriptions of the interplay of spin and charge degrees of degrees of freedom with crystal lattice fluctuations are of extreme importance in materials science. Such descriptions allow structured approaches to optimizing material efficiencies resulting in considerable resource savings and higher performance devices. In this work, by re-imagining the the Gell-Mann matrices as 3$\times$3 linear transformations acting on a column vector of position states, an SU(3) theory of the interplay between lattice fluctuations and strong electron correlations in 2-dimensional hexagonal materials such as graphene is formulated.


title: Sampling with censored data: a practical guide

abstract: In this review, we present a simple guide for researchers to obtain pseudo-random samples with censored data. We focus our attention on the most common types of censored data, such as type I, type II, and random censoring. We discussed the necessary steps to sample pseudo-random values from long-term survival models where an additional cure fraction is informed. For illustrative purposes, these techniques are applied in the Weibull distribution. The algorithms and codes in R are presented, enabling the reproducibility of our study. Finally, we have developed an R package that encapsulates these methodologies, providing researchers with practical tools for implementation.


title: Improved Visual-Inertial Localization for Low-cost Rescue Robots

abstract: This paper improves visual-inertial systems to boost the localization accuracy for low-cost rescue robots. When robots traverse on rugged terrain, the performance of pose estimation suffers from big noise on the measurements of the inertial sensors due to ground contact forces, especially for low-cost sensors. Therefore, we propose \textit{Threshold}-based and \textit{Dynamic Time Warping}-based methods to detect abnormal measurements and mitigate such faults. The two methods are embedded into the popular VINS-Mono system to evaluate their performance. Experiments are performed on simulation and real robot data, which show that both methods increase the pose estimation accuracy. Moreover, the \textit{Threshold}-based method performs better when the noise is small and the \textit{Dynamic Time Warping}-based one shows greater potential on large noise.


title: Transducer Adaptive Ultrasound Volume Reconstruction

abstract: Reconstructed 3D ultrasound volume provides more context information compared to a sequence of 2D scanning frames, which is desirable for various clinical applications such as ultrasound-guided prostate biopsy. Nevertheless, 3D volume reconstruction from freehand 2D scans is a very challenging problem, especially without the use of external tracking devices. Recent deep learning based methods demonstrate the potential of directly estimating inter-frame motion between consecutive ultrasound frames. However, such algorithms are specific to particular transducers and scanning trajectories associated with the training data, which may not be generalized to other image acquisition settings. In this paper, we tackle the data acquisition difference as a domain shift problem and propose a novel domain adaptation strategy to adapt deep learning algorithms to data acquired with different transducers. Specifically, feature extractors that generate transducer-invariant features from different datasets are trained by minimizing the discrepancy between deep features of paired samples in a latent space. Our results show that the proposed domain adaptation method can successfully align different feature distributions while preserving the transducer-specific information for universal freehand ultrasound volume reconstruction.


title: Weak Links in Authentication Chains: A Large-scale Analysis of Email Sender Spoofing Attacks

abstract: As a fundamental communicative service, email is playing an important role in both individual and corporate communications, which also makes it one of the most frequently attack vectors. An email's authenticity is based on an authentication chain involving multiple protocols, roles and services, the inconsistency among which creates security threats. Thus, it depends on the weakest link of the chain, as any failed part can break the whole chain-based defense. This paper systematically analyzes the transmission of an email and identifies a series of new attacks capable of bypassing SPF, DKIM, DMARC and user-interface protections. In particular, by conducting a "cocktail" joint attack, more realistic emails can be forged to penetrate the celebrated email services, such as Gmail and Outlook. We conduct a large-scale experiment on 30 popular email services and 23 email clients, and find that all of them are vulnerable to certain types of new attacks. We have duly reported the identified vulnerabilities to the related email service providers, and received positive responses from 11 of them, including Gmail, Yahoo, iCloud and Alibaba. Furthermore, we propose key mitigating measures to defend against the new attacks. Therefore, this work is of great value for identifying email spoofing attacks and improving the email ecosystem's overall security.


title: Reachability-based Trajectory Safeguard (RTS): A Safe and Fast Reinforcement Learning Safety Layer for Continuous Control

abstract: Reinforcement Learning (RL) algorithms have achieved remarkable performance in decision making and control tasks due to their ability to reason about long-term, cumulative reward using trial and error. However, during RL training, applying this trial-and-error approach to real-world robots operating in safety critical environment may lead to collisions. To address this challenge, this paper proposes a Reachability-based Trajectory Safeguard (RTS), which leverages reachability analysis to ensure safety during training and operation. Given a known (but uncertain) model of a robot, RTS precomputes a Forward Reachable Set of the robot tracking a continuum of parameterized trajectories. At runtime, the RL agent selects from this continuum in a receding-horizon way to control the robot; the FRS is used to identify if the agent's choice is safe or not, and to adjust unsafe choices. The efficacy of this method is illustrated on three nonlinear robot models, including a 12-D quadrotor drone, in simulation and in comparison with state-of-the-art safe motion planning methods.


title: The smooth algebra of a one-dimensional singular foliation

abstract: Androulidakis and Skandalis showed how to associate a holonomy groupoid, a smooth convolution algebra and a C*-algebra to any singular foliation. In this note, we consider the singular foliations of a one-dimensional manifold given by vector fields that vanish to order k at a point. We show that, whereas the C*-algebras of these foliations are divided into two isomorphism classes according to the parity of k, the smooth algebras are pairwise nonisomorphic. This is accomplished by analyzing certain natural ideals in the smooth algebras. Issues of factorization with respect to convolution arise and are resolved using a context-appropriate version of the Diximier-Malliavin theorem.


title: Four-Dimensional Wave Transformations By Space-Time Metasurfaces

abstract: Static metasurfaces have shown to be prominent compact structures for reciprocal and frequency-invariant transformation of electromagnetic waves in space. However, incorporating temporal variation to static metasurfaces would result in dynamic apparatuses which are capable of four-dimensional tailoring of both the spatial and temporal characteristics of electromagnetic waves, leading to functionalities that are far beyond the capabilities of conventional static metasurfaces. This includes nonreciprocal full-duplex wave transmission, pure frequency conversion, parametric wave amplification, spatiotemporal decomposition, and space-time wave diffraction. This paper reviews recent progress and opportunities offered by space-time metasurfaces to break reciprocity, revealing their potential for low-energy, compact, integrated non-reciprocal devices and sub-systems, and discusses the future of this exciting research front.


title: Deep Affordance Foresight: Planning Through What Can Be Done in the Future

abstract: Planning in realistic environments requires searching in large planning spaces. Affordances are a powerful concept to simplify this search, because they model what actions can be successful in a given situation. However, the classical notion of affordance is not suitable for long horizon planning because it only informs the robot about the immediate outcome of actions instead of what actions are best for achieving a long-term goal. In this paper, we introduce a new affordance representation that enables the robot to reason about the long-term effects of actions through modeling what actions are afforded in the future, thereby informing the robot the best actions to take next to achieve a task goal. Based on the new representation, we develop a learning-to-plan method, Deep Affordance Foresight (DAF), that learns partial environment models of affordances of parameterized motor skills through trial-and-error. We evaluate DAF on two challenging manipulation domains and show that it can effectively learn to carry out multi-step tasks, share learned affordance representations among different tasks, and learn to plan with high-dimensional image inputs. Additional material is available at https://sites.google.com/stanford.edu/daf


title: Dynamic Valuation of Battery Lifetime

abstract: This paper proposes a dynamic valuation framework to determine the opportunity value of battery capacity degradation in grid applications based on the internal degradation mechanism and utilization scenarios. The proposed framework follows a dynamic programming approach and includes a piecewise linear value function approximation solution that solves the optimization problem over a long planning horizon. The paper provides two case studies on price arbitrage and frequency regulation using real market and system data to demonstrate the broad applicability of the proposed framework. Results show that the battery lifetime value is critically dependent on both the external market environment and its internal state of health. On the grid service side, results show that second-life batteries can provide more than 50% of the value compared to new batteries, and frequency regulation provides two times more revenue than price arbitrage throughout the battery lifetime.


title: First-Principles Prediction of Electronic Transport in Experimental Semiconductor Heterostructures via Physics-Based Machine Learning

abstract: First-principles techniques for electronic transport property prediction have seen rapid progress in recent years. However, it remains a challenge to model heterostructures incorporating variability due to fabrication processes. Machine-learning (ML)-based materials informatics approaches (MI) are increasingly used to accelerate design and discovery of new materials with targeted properties, and extend the applicability of first-principles techniques to larger systems. However, few studies exploited MI to learn electronic structure properties and use the knowledge to predict the respective transport coefficients. In this work, we propose an electronic-transport-informatics (ETI) framework that trains on ab initio models of small systems and predicts thermopower of silicon/germanium heterostructures beyond the length-scale accessible with first-principles techniques, matching measured data. We demonstrate application of MI to extract important physics that determines electronic transport in semiconductor heterostructures, breaking from combinatorial strategies pursued especially for thermoelectric materials. We anticipate that ETI would have broad applicability to diverse materials classes.


title: Simple functional equations for generalized Selberg zeta functions with Tate motives

abstract: We prove that for a compact locally symmetric Riemannian space $M$ of rank 1 there exist infinitely many automorphic Tate motives $f$ such that the generalized Selberg zeta function $Z_{M(f)}(s)$ satisfies a simple functional equation in the sense that it has no gamma factors.


title: Neutron Star Mergers in AGN Accretion Disks: Cocoon and Ejecta Shock Breakouts

abstract: Neutron star mergers are believed to occur in accretion disks around supermassive black holes. Here we show that a putative jet launched from the merger of a binary neutron star (BNS) or a neutron star--black hole (NSBH) merger occurring at the migration trap in an active galactic nucleus (AGN) disk would be choked. The jet energy is deposited within the disk materials to power a hot cocoon. The cocoon is energetic enough to break out from the AGN disk and produce a bright X-ray shock breakout transient peaking at $\sim0.15\,{\rm d}$ after the merger. The peak luminosity is estimated as $\sim 10^{46}\,{\rm erg}\,{\rm s}^{-1}$, which can be discovered by Einstein Probe from $z\lesssim 0.5$. Later on, the non-relativistic ejecta launched from the merger would break out the disk, powering an X-ray/UV flare peaking at $\sim 0.5\,{\rm d}$ after the merger. This second shock breakout signal may be detected by UV transient searches. The cocoon cooling emission and kilonova emission are outshone by the disk emission and difficult to be detected. Future joint observations of gravitational waves from BNS/NSBH mergers and associated two shock breakout signatures can provide a strong support for the compact binary coalescence formation channel in AGN disks.


title: Functional equations for Selberg zeta functions with Tate motives

abstract: For a compact Riemann surface $M$ of genus $g\ge 2$, we study the functional equations of the Selberg zeta functions attached with the Tate motives $f$. We prove that certain functional equations hold if and only if $f$ has the absolute automorphy.


title: Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks

abstract: The rapid development of Industrial Internet of Things (IIoT) requires industrial production towards digitalization to improve network efficiency. Digital Twin is a promising technology to empower the digital transformation of IIoT by creating virtual models of physical objects. However, the provision of network efficiency in IIoT is very challenging due to resource-constrained devices, stochastic tasks, and resources heterogeneity. Distributed resources in IIoT networks can be efficiently exploited through computation offloading to reduce energy consumption while enhancing data processing efficiency. In this paper, we first propose a new paradigm Digital Twin Networks (DTN) to build network topology and the stochastic task arrival model in IIoT systems. Then, we formulate the stochastic computation offloading and resource allocation problem to minimize the long-term energy efficiency. As the formulated problem is a stochastic programming problem, we leverage Lyapunov optimization technique to transform the original problem into a deterministic per-time slot problem. Finally, we present Asynchronous Actor-Critic (AAC) algorithm to find the optimal stochastic computation offloading policy. Illustrative results demonstrate that our proposed scheme is able to significantly outperforms the benchmarks.


title: Association Rules Enhanced Knowledge Graph Attention Network

abstract: Most existing knowledge graphs suffer from incompleteness. Embedding knowledge graphs into continuous vector spaces has recently attracted increasing interest in knowledge base completion. However, in most existing embedding methods, only fact triplets are utilized, and logical rules have not been thoroughly studied for the knowledge base completion task. To overcome the problem, we propose an association rules enhanced knowledge graph attention network (AR-KGAT). The AR-KGAT captures both entity and relation features for high-order neighborhoods of any given entity in an end-to-end manner under the graph attention network framework. The major component of AR-KGAT is an encoder of an effective neighborhood aggregator, which addresses the problems by aggregating neighbors with both association-rules-based and graph-based attention weights. Additionally, the proposed model also encapsulates the representations from multi-hop neighbors of nodes to refine their embeddings. The decoder enables AR-KGAT to be translational between entities and relations while keeping the superior link prediction performance. A logic-like inference pattern is utilized as constraints for knowledge graph embedding. Then, the global loss is minimized over both atomic and complex formulas to achieve the embedding task. In this manner, we learn embeddings compatible with triplets and rules, which are certainly more predictive for knowledge acquisition and inference. We conduct extensive experiments on two benchmark datasets: WN18RR and FB15k-237, for two knowledge graph completion tasks: the link prediction and triplet classification to evaluate the proposed AR-KGAT model. The results show that the proposed AR-KGAT model achieves significant and consistent improvements over state-of-the-art methods.


title: Revisiting the Sample Complexity of Sparse Spectrum Approximation of Gaussian Processes

abstract: We introduce a new scalable approximation for Gaussian processes with provable guarantees which hold simultaneously over its entire parameter space. Our approximation is obtained from an improved sample complexity analysis for sparse spectrum Gaussian processes (SSGPs). In particular, our analysis shows that under a certain data disentangling condition, an SSGP's prediction and model evidence (for training) can well-approximate those of a full GP with low sample complexity. We also develop a new auto-encoding algorithm that finds a latent space to disentangle latent input coordinates into well-separated clusters, which is amenable to our sample complexity analysis. We validate our proposed method on several benchmarks with promising results supporting our theoretical analysis.


title: Influence of a Galactic Gamma-Ray Burst on Ocean Plankton

abstract: The hypothesis that one or more biodiversity drops in the Phanerozoic eon, evident in the geological record, might have been caused by the most powerful kind of stellar explosion so far known Gamma Ray Bursts (GRB) has been discussed in several works. These stellar explosions could have left an imprint in the biological evolution on Earth and in other habitable planets. In this work we calculate the short-term lethality that a GRB would produce in the aquatic primary producers on Earth. This effect on life appears because of ultraviolet (UV) retransmission in the atmosphere of a fraction of the gamma energy, resulting in an intense UV flash capable of penetrating tens of meters in the water column in the ocean. We focus on the action of the UV flash on phytoplankton, as they are the main contributors to global aquatic primary productivity. Our results suggest that the UV flash could cause a significant reduction of phytoplankton biomass in the upper mixed layer of the World Ocean.


title: Simple and optimal methods for stochastic variational inequalities, II: Markovian noise and policy evaluation in reinforcement learning

abstract: The focus of this paper is on stochastic variational inequalities (VI) under Markovian noise. A prominent application of our algorithmic developments is the stochastic policy evaluation problem in reinforcement learning. Prior investigations in the literature focused on temporal difference (TD) learning by employing nonsmooth finite time analysis motivated by stochastic subgradient descent leading to certain limitations. These encompass the requirement of analyzing a modified TD algorithm that involves projection to an a-priori defined Euclidean ball, achieving a non-optimal convergence rate and no clear way of deriving the beneficial effects of parallel implementation. Our approach remedies these shortcomings in the broader context of stochastic VIs and in particular when it comes to stochastic policy evaluation. We developed a variety of simple TD learning type algorithms motivated by its original version that maintain its simplicity, while offering distinct advantages from a non-asymptotic analysis point of view. We first provide an improved analysis of the standard TD algorithm that can benefit from parallel implementation. Then we present versions of a conditional TD algorithm (CTD), that involves periodic updates of the stochastic iterates, which reduce the bias and therefore exhibit improved iteration complexity. This brings us to the fast TD (FTD) algorithm which combines elements of CTD and the stochastic operator extrapolation method of the companion paper. For a novel index resetting policy FTD exhibits the best known convergence rate. We also devised a robust version of the algorithm that is particularly suitable for discounting factors close to 1.


title: AdCo: Adversarial Contrast for Efficient Learning of Unsupervised Representations from Self-Trained Negative Adversaries

abstract: Contrastive learning relies on constructing a collection of negative examples that are sufficiently hard to discriminate against positive queries when their representations are self-trained. Existing contrastive learning methods either maintain a queue of negative samples over minibatches while only a small portion of them are updated in an iteration, or only use the other examples from the current minibatch as negatives. They could not closely track the change of the learned representation over iterations by updating the entire queue as a whole, or discard the useful information from the past minibatches. Alternatively, we present to directly learn a set of negative adversaries playing against the self-trained representation. Two players, the representation network and negative adversaries, are alternately updated to obtain the most challenging negative examples against which the representation of positive queries will be trained to discriminate. We further show that the negative adversaries are updated towards a weighted combination of positive queries by maximizing the adversarial contrastive loss, thereby allowing them to closely track the change of representations over time. Experiment results demonstrate the proposed Adversarial Contrastive (AdCo) model not only achieves superior performances (a top-1 accuracy of 73.2\% over 200 epochs and 75.7\% over 800 epochs with linear evaluation on ImageNet), but also can be pre-trained more efficiently with fewer epochs.


title: Shared Cross-Modal Trajectory Prediction for Autonomous Driving

abstract: Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are equipped with various types of sensors (e.g., LiDAR scanner, RGB camera, radar, etc.), we propose a Cross-Modal Embedding framework that aims to benefit from the use of multiple input modalities. At training time, our model learns to embed a set of complementary features in a shared latent space by jointly optimizing the objective functions across different types of input data. At test time, a single input modality (e.g., LiDAR data) is required to generate predictions from the input perspective (i.e., in the LiDAR space), while taking advantages from the model trained with multiple sensor modalities. An extensive evaluation is conducted to show the efficacy of the proposed framework using two benchmark driving datasets.


title: Are temporal quantum correlations generally non-monogamous?

abstract: In this paper we focus on the underlying quantum structure of temporal correlations and show their peculiar nature which differentiate them from spatial quantum correlations. We show rigorously that a particular entangled history, which can be associated with a quantum propagator, is monogamous to conserve its consistency throughout time. Yet evolving systems violate monogamous Bell-like multi-time inequalities. This dichotomy, being a novel feature of temporal correlations, has its roots in the measurement process itself which is discussed by means of the bundles of entangled histories. We introduce and discuss a concept of a probabilistic mixture of quantum processes by means of which we clarify why the spatial-like Bell-type monogamous inequalities are further violated. We prove that Tsirelson bound on temporal Bell-like inequalities can be derived from the entangled histories approach and as a generalization, we derive the quantum bound for multi-time Bell-like inequalities. It is also pointed out that what mimics violation of monogamy of temporal entanglement is actually just a kind of polyamory in time but monogamy of entanglement for a particular evolution still holds.


title: Spacelike Loxodromes on Helicoidal Surfaces in Lorentzian n--Space

abstract: In this paper, we study three types of helicoidal surfaces in a Lorentzian n--space $\mathbb{E}^n_1$. First, we find the parametrizations of spacelike loxodromes on such spacelike helicoidal surfaces in $\mathbb{E}^n_1$. Then, we make a similar classification for spacelike loxodromes on such timelike helicoidal surfaces of a Lorentzian n--space $\mathbb{E}^n_1$.


title: A variational characterisation of projective spherical designs over the quaternions

abstract: We give an inequality on the packing of vectors/lines in quaternionic Hilbert space $\Hd$, which generalises those of Sidelnikov and Welch for unit vectors in $\Rd$ and $\Cd$. This has a parameter $t$, and depends only on the vectors up to projective unitary equivalence. The sequences of vectors in ${\mathbb{F}}^d={\mathbb{R}}^d,{\mathbb{C}}^d,{\mathbb{H}}^d$ that give equality, which we call spherical $(t,t)$-designs, are seen to satisfy a cubature rule on the unit sphere in ${\mathbb{F}}^d$ for a suitable polynomial space $\Hom_{\Fd}(t,t)$. Using this, we show that the projective spherical $t$-designs on the Delsarte spaces $\FF P^{d-1}$ coincide with the spherical $(t,t)$-designs of unit vectors in ${\mathbb{F}}^d$. We then explore a number of examples in quaternionic space. The unitarily invariant polynomial space ${\mathop{\rm Hom}\nolimits}_{{\mathbb{H}}^d}(t,t)$ and the inner product that we define on it so the reproducing kernel has a simple form are of independent interest.


title: Asymptotic analysis of target fluxes in the three-dimensional narrow capture problem

abstract: We develop an asymptotic analysis of target fluxes in the three-dimensional (3D) narrow capture problem. The latter concerns a diffusive search process in which the targets are much smaller than the size of the search domain. The small target assumption allows us to use matched asymptotic expansions and Green's functions to solve the diffusion equation in Laplace space. In particular, we derive an asymptotic expansion of the Laplace transformed flux into each target in powers of the non-dimensionalized target size $\epsilon$. One major advantage of working directly with fluxes is that one can generate statistical quantities such as splitting probabilities and conditional first passage time moments without having to solve a separate boundary value problem in each case. However, in order to derive asymptotic expansions of these quantities, it is necessary to eliminate Green's function singularities that arise in the limit $s\rightarrow 0$, where $s$ is the Laplace variable. We achieve this by considering a triple expansion in $\epsilon$, $s$ and $\Lambda\sim \epsilon /s$. This allows us to perform partial summations over infinite power series in $\Lambda$, which leads to multiplicative factors of the form $\Lambda^n/(1+\Lambda)^n $. Since $\Lambda^n/(1+\Lambda)^n \rightarrow 1$ as $s\rightarrow 0$, the singularities in $s$ are eliminated. We then show how corresponding asymptotic expansions of the splitting probabilities and conditional MFPTs can be derived in the small-$s$ limit. Finally, we illustrate the theory by considering a pair of targets in a spherical search domain, for which the Green's functions can be calculated explicitly.


title: Formulation and properties of a divergence used to compare probability measures without absolute continuity and its application to uncertainty quantification

abstract: This thesis develops a new divergence that generalizes relative entropy and can be used to compare probability measures without a requirement of absolute continuity. We establish properties of the divergence, and in particular derive and exploit a representation as an infimum convolution of optimal transport cost and relative entropy. We include examples of computation and approximation of the divergence, and its applications in uncertainty quantification in discrete models and Gauss-Markov models.


title: Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

abstract: 5G beyond is an end-edge-cloud orchestrated network that can exploit heterogeneous capabilities of the end devices, edge servers, and the cloud and thus has the potential to enable computation-intensive and delay-sensitive applications via computation offloading. However, in multi user wireless networks, diverse application requirements and the possibility of various radio access modes for communication among devices make it challenging to design an optimal computation offloading scheme. In addition, having access to complete network information that includes variables such as wireless channel state, and available bandwidth and computation resources, is a major issue. Deep Reinforcement Learning (DRL) is an emerging technique to address such an issue with limited and less accurate network information. In this paper, we utilize DRL to design an optimal computation offloading and resource allocation strategy for minimizing system energy consumption. We first present a multi-user end-edge-cloud orchestrated network where all devices and base stations have computation capabilities. Then, we formulate the joint computation offloading and resource allocation problem as a Markov Decision Process (MDP) and propose a new DRL algorithm to minimize system energy consumption. Numerical results based on a real-world dataset demonstrate that the proposed DRL-based algorithm significantly outperforms the benchmark policies in terms of system energy consumption. Extensive simulations show that learning rate, discount factor, and number of devices have considerable influence on the performance of the proposed algorithm.


title: Advanced Refinements of Numerical Radius Inequalities

abstract: We prove several numerical radius inequalities for linear operators in Hilbert spaces. It is shown, among other inequalities, that if $A$ is a bounded linear operator on a complex Hilbert space, then \[\omega \left( A \right)\le \frac{1}{2}\sqrt{\left\| {{\left| A \right|}^{2}}+{{\left| {{A}^{*}} \right|}^{2}} \right\|+\left\| \left| A \right|\left| {{A}^{*}} \right|+\left| {{A}^{*}} \right|\left| A \right| \right\|},\] where $\omega \left( A \right)$, $\left\| A \right\|$, and $\left| A \right|$ are the numerical radius, the usual operator norm, and the absolute value of $A$, respectively. This inequality provides a refinement of an earlier numerical radius inequality due to Kittaneh, namely, \[\omega \left( A \right)\le \frac{1}{2}\left( \left\| A \right\|+{{\left\| {{A}^{2}} \right\|}^{\frac{1}{2}}} \right).\] Some related inequalities are also discussed.


title: Resolving Molecular Contributions of Ion Channel Noise to Interspike Interval Variability through Stochastic Shielding

abstract: The contributions of independent noise sources to the variability of action potential timing has not previously been studied at the level of individual directed molecular transitions within a conductance-based model ion-state graph. The underlying connection provides an important example of how mathematics can be applied to study the effects of unobservable microscopic fluctuations to macroscopically observable quantities. We study a stochastic Langevin model and show how to resolve the individual contributions that each transition in the ion channel graph makes to the variance of the interspike interval (ISI). We extend the mean--return-time (MRT) phase reduction developed in (Cao et al. 2020, SIAM J. Appl. Math) to the second moment of the return time from an MRT isochron to itself. Because fixed-voltage spike-detection triggers do not correspond to MRT isochrons, the inter-phase interval (IPI) variance only approximates the ISI variance. We find the IPI variance and ISI variance agree to within a few percent when both can be computed. Moreover, we prove rigorously, and show numerically, that our expression for the IPI variance is accurate in the small noise (large system size) regime; our theory is exact in the limit of small noise. By selectively including the noise associated with only those few transitions responsible for most of the ISI variance, our analysis extends the stochastic shielding (SS) paradigm (Schmandt et al. 2012, Phys. Rev. Lett.) from the stationary voltage-clamp case to the current-clamp case. We show numerically that the SS approximation has a high degree of accuracy even for larger, physiologically relevant noise levels. We show that the ISI variance is not an unambiguously defined quantity, but depends on the choice of voltage level set as the spike-detection threshold, both in vitro and in silico.


title: Nonequilibrium effects of cavity leakage and vibrational dissipation in thermally-activated polariton chemistry

abstract: In vibrational strong coupling (VSC), molecular vibrations strongly interact with the modes of an optical cavity to form hybrid light-matter states known as vibrational polaritons. Experiments show that the kinetics of thermally activated chemical reactions can be modified by VSC. Transition-state theory, which assumes that internal thermalization is fast compared to reactive transitions, has been unable to explain the observed findings. Here, we carry out kinetic simulations to understand how dissipative processes, namely those that VSC introduces to the chemical system, affect reactions where internal thermalization and reactive transitions occur on similar timescales. Using the Marcus-Levich-Jortner type of electron transfer as a model reaction, we show that such dissipation can change reactivity by accelerating internal thermalization, thereby suppressing nonequilibrium effects that occur in the reaction outside the cavity. This phenomenon is attributed mainly to cavity decay (i.e., photon leakage), but a supporting role is played by the relaxation between polaritons and dark states. When nonequilibrium effects are already suppressed in the bare reaction (the reactive species are essentially at internal thermal equilibrium throughout the reaction), we find that reactivity does not change significantly under VSC. Connections are made between our results and experimental observations.


title: EvoPose2D: Pushing the Boundaries of 2D Human Pose Estimation using Accelerated Neuroevolution with Weight Transfer

abstract: Neural architecture search has proven to be highly effective in the design of efficient convolutional neural networks that are better suited for mobile deployment than hand-designed networks. Hypothesizing that neural architecture search holds great potential for human pose estimation, we explore the application of neuroevolution, a form of neural architecture search inspired by biological evolution, in the design of 2D human pose networks for the first time. Additionally, we propose a new weight transfer scheme that enables us to accelerate neuroevolution in a flexible manner. Our method produces network designs that are more efficient and more accurate than state-of-the-art hand-designed networks. In fact, the generated networks process images at higher resolutions using less computation than previous hand-designed networks at lower resolutions, allowing us to push the boundaries of 2D human pose estimation. Our base network designed via neuroevolution, which we refer to as EvoPose2D-S, achieves comparable accuracy to SimpleBaseline while being 50% faster and 12.7x smaller in terms of file size. Our largest network, EvoPose2D-L, achieves new state-of-the-art accuracy on the Microsoft COCO Keypoints benchmark, is 4.3x smaller than its nearest competitor, and has similar inference speed. The code is publicly available at https://github.com/wmcnally/evopose2d.


title: Exact recovery of Planted Cliques in Semi-random graphs

abstract: In this paper, we study the Planted Clique problem in a semi-random model. Our model is inspired from the Feige-Kilian model [FK01] which has been studied in many other works [FK00, Ste17, MMT20] for a variety of graph problems. Our algorithm and analysis is on similar lines to the one studied for the Densest $k$-subgraph problem in the recent work of Khanna and Louis [KL20]. However since our algorithm fully recovers the planted clique w.h.p. (for a "large" range of input parameters), we require some new ideas. As a by-product of our main result, we give an alternate SDP based rounding algorithm (with matching guarantees) for solving the Planted Clique problem in a random graph. Also, we are able to solve special cases of the models introduced for the Densest $k$-subgraph problem in [KL20], when the planted subgraph is a clique instead of an arbitrary $d$-regular graph.


title: Optimal diameter computation within bounded clique-width graphs

abstract: Coudert et al. (SODA'18) proved that under the Strong Exponential-Time Hypothesis, for any $\epsilon >0$, there is no ${\cal O}(2^{o(k)}n^{2-\epsilon})$-time algorithm for computing the diameter within the $n$-vertex cubic graphs of clique-width at most $k$. We present an algorithm which given an $n$-vertex $m$-edge graph $G$ and a $k$-expression, computes all the eccentricities in ${\cal O}(2^{{\cal O}(k)}(n+m)^{1+o(1)})$ time, thus matching their conditional lower bound. It can be modified in order to compute the Wiener index and the median set of $G$ within the same amount of time. On our way, we get a distance-labeling scheme for $n$-vertex $m$-edge graphs of clique-width at most $k$, using ${\cal O}(k\log^2{n})$ bits per vertex and constructible in ${\cal O}(k(n+m)\log{n})$ time from a given $k$-expression. Doing so, we match the label size obtained by Courcelle and Vanicat (DAM 2016), while we considerably improve the dependency on $k$ in their scheme. As a corollary, we get an ${\cal O}(kn^2\log{n})$-time algorithm for computing All-Pairs Shortest-Paths on $n$-vertex graphs of clique-width at most $k$. This partially answers an open question of Kratsch and Nelles (STACS'20).


title: Deep Reinforcement Learning and Permissioned Blockchain for Content Caching in Vehicular Edge Computing and Networks

abstract: Vehicular Edge Computing (VEC) is a promising paradigm to enable huge amount of data and multimedia content to be cached in proximity to vehicles. However, high mobility of vehicles and dynamic wireless channel condition make it challenge to design an optimal content caching policy. Further, with much sensitive personal information, vehicles may be not willing to caching their contents to an untrusted caching provider. Deep Reinforcement Learning (DRL) is an emerging technique to solve the problem with high-dimensional and time-varying features. Permission blockchain is able to establish a secure and decentralized peer-to-peer transaction environment. In this paper, we integrate DRL and permissioned blockchain into vehicular networks for intelligent and secure content caching. We first propose a blockchain empowered distributed content caching framework where vehicles perform content caching and base stations maintain the permissioned blockchain. Then, we exploit the advanced DRL approach to design an optimal content caching scheme with taking mobility into account. Finally, we propose a new block verifier selection method, Proof-of-Utility (PoU), to accelerate block verification process. Security analysis shows that our proposed blockchain empowered content caching can achieve security and privacy protection. Numerical results based on a real dataset from Uber indicate that the DRL-inspired content caching scheme significantly outperforms two benchmark policies.


title: A Quantitative Perspective on Values of Domain Knowledge for Machine Learning

abstract: With the exploding popularity of machine learning, domain knowledge in various forms has been playing a crucial role in improving the learning performance, especially when training data is limited. Nonetheless, there is little understanding of to what extent domain knowledge can affect a machine learning task from a quantitative perspective. To increase the transparency and rigorously explain the role of domain knowledge in machine learning, we study the problem of quantifying the values of domain knowledge in terms of its contribution to the learning performance in the context of informed machine learning. We propose a quantification method based on Shapley value that fairly attributes the overall learning performance improvement to different domain knowledge. We also present Monte-Carlo sampling to approximate the fair value of domain knowledge with a polynomial time complexity. We run experiments of injecting symbolic domain knowledge into semi-supervised learning tasks on both MNIST and CIFAR10 datasets, providing quantitative values of different symbolic knowledge and rigorously explaining how it affects the machine learning performance in terms of test accuracy.


title: Optimizing Graph Processing and Preprocessing with Hardware Assisted Propagation Blocking

abstract: Extensive prior research has focused on alleviating the characteristic poor cache locality of graph analytics workloads. However, graph pre-processing tasks remain relatively unexplored. In many important scenarios, graph pre-processing tasks can be as expensive as the downstream graph analytics kernel. We observe that Propagation Blocking (PB), a software optimization designed for SpMV kernels, generalizes to many graph analytics kernels as well as common pre-processing tasks. In this work, we identify the lingering inefficiencies of a PB execution on conventional multicores and propose architecture support to eliminate PB's bottlenecks, further improving the performance gains from PB. Our proposed architecture -- COBRA -- optimizes the PB execution of both graph processing and pre-processing alike to provide end-to-end speedups of up to 4.6x (3.5x on average).


title: Plasma shielding effects on nuclear spectra: $^{18}$Ne application

abstract: In this study, for the first time, in particular to astrophysics and fusion studies, how atomic nuclei embedded in the plasma environment are affected by plasma are systematically analysed. The related interactions in plasma environments considered as Debye and quantum plasma are depicted by more general exponential cosine screened Coulomb (MGECSC) potential. The plasma effects on the change of nuclear energy levels are probed through computations performed within the nuclear shell-model framework. For this purpose, the single-particle energy (spe) values to be used in the calculations are obtained by considering the modified Woods-Saxon (WS) potential due to shielding effect of plasma environment. As the modification in question is executed on Coulomb interaction term in WS potential, the computations are carried out for $ ^{18} $Ne nucleus which has two valence protons. Under the influence of the plasma, it is confirmed that the spe's change within certain limit value ranges. When considering the nuclear shell-model for the related computing, it is clear that this change leads to an obvious shifting in the energies of the nuclear states. It is observed that proton spe values are sensitive to plasma shielding effect, and shielding effect has a significant potent on the ground-state and excited energy states of the nucleus. In particular, the ground-state binding energies are determined to be extremely sensitive to the plasma shielding parameters. Plasma environments affect the proton spe and ground state energy (gse) in the same way. The alternative to each other of plasma shielding parameters on the spe, gse and excited energy levels is also analysed.


title: Cohen-Macaulay fiber cones and defining ideal of Rees algebras of modules

abstract: Generic Bourbaki ideals were introduced by Simis, Ulrich and Vasconcelos to study the Cohen-Macaulay property of Rees algebras of modules. In this article we prove that the same technique can sometimes be used to investigate the Cohen-Macaulay property of fiber cones of modules and to study the defining ideal of Rees algebras. This is possible as long as the Rees algebra of a given module $E$ is a deformation of the Rees algebra of a generic Bourbaki ideal $I$ of $E$. Our main technical result provides a deformation condition that in fact extends the applicability of generic Bourbaki ideals to situations not covered by previous work.


title: On a class of forced active scalar equations with small diffusive parameters

abstract: Many equations that model fluid behaviour are derived from systems that encompass multiple physical forces. When the equations are written in non dimensional form appropriate to the physics of the situation, the resulting partial differential equations often contain several small parameters. We study a general class of such PDEs called active scalar equations which in specific parameter regimes produce certain well known models for fluid motion. We address various mathematical questions relating to well-posedness, regularity and long time behaviour of the solutions to this general class including vanishing limits of several diffusive parameters.


title: Revising the classic computing paradigm and its technological implementations

abstract: Today's computing is told to be based on the classic paradigm, proposed by von Neumann, a three-quarter century ago. However, that paradigm was justified (for the timing relations of) vacuum tubes only. The technological development invalidated the classic paradigm (but not the model!) and led to catastrophic performance losses in computing systems, from operating gate level to large networks, including the neuromorphic ones. The paper reviews the critical points of the classic paradigm and scrutinizes the confusion made around it. It discusses some of the consequences of improper technological implementation, from the shared media to the parallelized operation. The model is perfect, but it is applied outside of its range of validity. The paradigm is extended by providing the "procedure" that enables computing science to work with cases where the transfer time is not negligible apart from processing time.


title: Collusion-Resistant Identity-based Proxy Re-Encryption: Lattice-based Constructions in Standard Model

abstract: The concept of proxy re-encryption (PRE) dates back to the work of Blaze, Bleumer, and Strauss in 1998. PRE offers delegation of decryption rights, i.e., it securely enables the re-encryption of ciphertexts from one key to another, without relying on trusted parties. PRE allows a semi-trusted third party termed as a ``proxy" to securely divert encrypted files of user A (delegator) to user B (delegatee) without revealing any information about the underlying files to the proxy. To eliminate the necessity of having a costly certificate verification process, Green and Ateniese introduced an identity-based PRE (IB-PRE). The potential applicability of IB-PRE sprung up a long line of intensive research from its first instantiation. Unfortunately, till today, there is no collusion-Resistant unidirectional IB-PRE secure in the standard model, which can withstand quantum attack. In this paper, we present the first concrete constructions of collusion-Resistant unidirectional IB-PRE, for both selective and adaptive identity, which are secure in standard model based on the hardness of learning with error problem.


title: Global scheme of sweeping cluster algorithm to sample among topological sectors

abstract: Local constraint is closely related to the gauge field, so constrained models are usually effective low energy descriptions and important in condensed matter physics. On the other hand, local restriction hinders the application of numerical algorithms. In addition to the computational difficulties of the constraints, the various topological sectors which cannot be connected through local operators are also one of the key computational difficulties. Taking quantum dimer model as an example in this paper, we construct a global scheme based on sweeping cluster Monte Carlo method, which can sample among different topological sectors. In principle, this method can be generalized to other models.


title: Learning Dense Rewards for Contact-Rich Manipulation Tasks

abstract: Rewards play a crucial role in reinforcement learning. To arrive at the desired policy, the design of a suitable reward function often requires significant domain expertise as well as trial-and-error. Here, we aim to minimize the effort involved in designing reward functions for contact-rich manipulation tasks. In particular, we provide an approach capable of extracting dense reward functions algorithmically from robots' high-dimensional observations, such as images and tactile feedback. In contrast to state-of-the-art high-dimensional reward learning methodologies, our approach does not leverage adversarial training, and is thus less prone to the associated training instabilities. Instead, our approach learns rewards by estimating task progress in a self-supervised manner. We demonstrate the effectiveness and efficiency of our approach on two contact-rich manipulation tasks, namely, peg-in-hole and USB insertion. The experimental results indicate that the policies trained with the learned reward function achieves better performance and faster convergence compared to the baselines.


title: SRF-GAN: Super-Resolved Feature GAN for Multi-Scale Representation

abstract: Recent convolutional object detectors exploit multi-scale feature representations added with top-down pathway in order to detect objects at different scales and learn stronger semantic feature responses. In general, during the top-down feature propagation, the coarser feature maps are upsampled to be combined with the features forwarded from bottom-up pathway, and the combined stronger semantic features are inputs of detector's headers. However, simple interpolation methods (e.g. nearest neighbor and bilinear) are still used for increasing feature resolutions although they cause noisy and blurred features. In this paper, we propose a novel generator for super-resolving features of the convolutional object detectors. To achieve this, we first design super-resolved feature GAN (SRF-GAN) consisting of a detection-based generator and a feature patch discriminator. In addition, we present SRF-GAN losses for generating the high quality of super-resolved features and improving detection accuracy together. Our SRF generator can substitute for the traditional interpolation methods, and easily fine-tuned combined with other conventional detectors. To prove this, we have implemented our SRF-GAN by using the several recent one-stage and two-stage detectors, and improved detection accuracy over those detectors. Code is available at https://github.com/SHLee-cv/SRF-GAN.


title: A universal simulating framework for quantum key distribution systems

abstract: Quantum key distribution (QKD) provides a physical-based way to conciliate keys between remote users securely. Simulation is an essential method for designing and optimizing QKD systems. We develop a universal simulation framework based on quantum operator descriptions of photon signals and optical devices. The optical devices can be freely combined and driven by the photon excitation events, which make it appropriate for arbitrary QKD systems in principle. Our framework focuses on realistic characters of optical devices and system structures. The imperfections of the devices and the non-local properties of a quantum system are taken into account when modeling. We simulate the single-photon and Hong-Ou-Mandel (HOM) interference optical units, which are fundamental of QKD systems. The results using this event-driven framework agree well with the theoretical results, which indicate its feasibility for QKD.


title: Deep Learning Framework From Scratch Using Numpy

abstract: This work is a rigorous development of a complete and general-purpose deep learning framework from the ground up. The fundamental components of deep learning - automatic differentiation and gradient methods of optimizing multivariable scalar functions - are developed from elementary calculus and implemented in a sensible object-oriented approach using only Python and the Numpy library. Demonstrations of solved problems using the framework, named ArrayFlow, include a computer vision classification task, solving for the shape of a catenary, and a 2nd order differential equation.


title: Constructive exact control of semilinear 1D wave equations by a least-squares approach

abstract: It has been proved by Zuazua in the nineties that the internally controlled semilinear 1D wave equation $\partial_{tt}y-\partial_{xx}y + g(y)=f 1_{\omega}$, with Dirichlet boundary conditions, is exactly controllable in $H^1_0(0,1)\cap L^2(0,1)$ with controls $f\in L^2((0,1)\times(0,T))$, for any $T>0$ and any nonempty open subset $\omega$ of $(0,1)$, assuming that $g\in \mathcal{C}^1(\R)$ does not grow faster than $\beta\vert x\vert \ln^{2}\vert x\vert$ at infinity for some $\beta>0$ small enough. The proof, based on the Leray-Schauder fixed point theorem, is however not constructive. In this article, we design a constructive proof and algorithm for the exact controllability of semilinear 1D wave equations. Assuming that $g^\prime$ does not grow faster than $\beta \ln^{2}\vert x\vert$ at infinity for some $\beta>0$ small enough and that $g^\prime$ is uniformly H\"older continuous on $\R$ with exponent $s\in[0,1]$, we design a least-squares algorithm yielding an explicit sequence converging to a controlled solution for the semilinear equation, at least with order $1+s$ after a finite number of iterations.


title: Meta Automatic Curriculum Learning

abstract: A major challenge in the Deep RL (DRL) community is to train agents able to generalize their control policy over situations never seen in training. Training on diverse tasks has been identified as a key ingredient for good generalization, which pushed researchers towards using rich procedural task generation systems controlled through complex continuous parameter spaces. In such complex task spaces, it is essential to rely on some form of Automatic Curriculum Learning (ACL) to adapt the task sampling distribution to a given learning agent, instead of randomly sampling tasks, as many could end up being either trivial or unfeasible. Since it is hard to get prior knowledge on such task spaces, many ACL algorithms explore the task space to detect progress niches over time, a costly tabula-rasa process that needs to be performed for each new learning agents, although they might have similarities in their capabilities profiles. To address this limitation, we introduce the concept of Meta-ACL, and formalize it in the context of black-box RL learners, i.e. algorithms seeking to generalize curriculum generation to an (unknown) distribution of learners. In this work, we present AGAIN, a first instantiation of Meta-ACL, and showcase its benefits for curriculum generation over classical ACL in multiple simulated environments including procedurally generated parkour environments with learners of varying morphologies. Videos and code are available at https://sites.google.com/view/meta-acl .


title: Exploring intermediate representation for monocular vehicle pose estimation

abstract: We present a new learning-based framework to recover vehicle pose in SO(3) from a single RGB image. In contrast to previous works that map from local appearance to observation angles, we explore a progressive approach by extracting meaningful Intermediate Geometrical Representations (IGRs) to estimate egocentric vehicle orientation. This approach features a deep model that transforms perceived intensities to IGRs, which are mapped to a 3D representation encoding object orientation in the camera coordinate system. Core problems are what IGRs to use and how to learn them more effectively. We answer the former question by designing IGRs based on an interpolated cuboid that derives from primitive 3D annotation readily. The latter question motivates us to incorporate geometry knowledge with a new loss function based on a projective invariant. This loss function allows unlabeled data to be used in the training stage to improve representation learning. Without additional labels, our system outperforms previous monocular RGB-based methods for joint vehicle detection and pose estimation on the KITTI benchmark, achieving performance even comparable to stereo methods. Code and pre-trained models are available at this https URL.


title: Assessing Wireless Sensing Potential with Large Intelligent Surfaces

abstract: Sensing capability is one of the most highlighted new feature of future 6G wireless networks. This paper addresses the sensing potential of Large Intelligent Surfaces (LIS) in an exemplary Industry 4.0 scenario. Besides the attention received by LIS in terms of communication aspects, it can offer a high-resolution rendering of the propagation environment. This is because, in an indoor setting, it can be placed in proximity to the sensed phenomena, while the high resolution is offered by densely spaced tiny antennas deployed over a large area. By treating an LIS as a radio image of the environment relying on the received signal power, we develop techniques to sense the environment, by leveraging the tools of image processing and machine learning. Once a holographic image is obtained, a Denoising Autoencoder (DAE) network can be used for constructing a super-resolution image leading to sensing advantages not available in traditional sensing systems. Also, we derive a statistical test based on the Generalized Likelihood Ratio (GLRT) as a benchmark for the machine learning solution. We test these methods for a scenario where we need to detect whether an industrial robot deviates from a predefined route. The results show that the LIS-based sensing offers high precision and has a high application potential in indoor industrial environments.


title: Geometry of tree-based tensor formats in tensor Banach spaces

abstract: In the paper `On the Dirac-Frenkel Variational Principle on Tensor Banach Spaces', we provided a geometrical description of manifolds of tensors in Tucker format with fixed multilinear (or Tucker) rank in tensor Banach spaces, that allowed to extend the Dirac-Frenkel variational principle in the framework of topological tensor spaces. The purpose of this note is to extend these results to more general tensor formats. More precisely, we provide a new geometrical description of manifolds of tensors in tree-based (or hierarchical) format, also known as tree tensor networks, which are intersections of manifolds of tensors in Tucker format associated with different partitions of the set of dimensions. The proposed geometrical description of tensors in tree-based format is compatible with the one of manifolds of tensors in Tucker format.


title: Learn2Sing: Target Speaker Singing Voice Synthesis by learning from a Singing Teacher

abstract: Singing voice synthesis has been paid rising attention with the rapid development of speech synthesis area. In general, a studio-level singing corpus is usually necessary to produce a natural singing voice from lyrics and music-related transcription. However, such a corpus is difficult to collect since it's hard for many of us to sing like a professional singer. In this paper, we propose an approach -- Learn2Sing that only needs a singing teacher to generate the target speakers' singing voice without their singing voice data. In our approach, a teacher's singing corpus and speech from multiple target speakers are trained in a frame-level auto-regressive acoustic model where singing and speaking share the common speaker embedding and style tag embedding. Meanwhile, since there is no music-related transcription for the target speaker, we use log-scale fundamental frequency (LF0) as an auxiliary feature as the inputs of the acoustic model for building a unified input representation. In order to enable the target speaker to sing without singing reference audio in the inference stage, a duration model and an LF0 prediction model are also trained. Particularly, we employ domain adversarial training (DAT) in the acoustic model, which aims to enhance the singing performance of target speakers by disentangling style from acoustic features of singing and speaking data. Our experiments indicate that the proposed approach is capable of synthesizing singing voice for target speaker given only their speech samples.


title: Highway freight transportation diversity of cities based on radiation models

abstract: Using a unique data set containing about 15.06 million truck transportation records in five months, we investigate the highway freight transportation diversity of 338 Chinese cities based on the truck transportation probability $p_{ij}$ from one city to the other. The transportation probabilities are calculated from the radiation model based on the geographic distance and its cost-based version based on the driving distance as the proxy of cost. For each model, we consider both the population and the gross domestic product, and find quantitatively very similar results. We find that the transportation probabilities have nice power-law tails with the tail exponents close to 0.5 for all the models. The two transportation probabilities in each model fall around the diagonal $p_{ij}=p_{ji}$ but are often not the same. In addition, the corresponding transportation probabilities calculated from the raw radiation model and the cost-based radiation model also fluctuate around the diagonal $p_{ij}^{\rm{geo}}=p_{ij}^{\rm{cost}}$. We calculate four sets of highway truck transportation diversity according to the four sets of transportation probabilities that are found to be close to each other for each city pair. Further, it is found that the population, the gross domestic product, the in-flux, and the out-flux scale as power laws with respect to the transportation diversity in the raw and cost-based radiation models. It implies that a more developed city usually has higher diversity in highway truck transportation, which reflects the fact that a more developed city usually has a more diverse economic structure.


title: Cascade RNN-Transducer: Syllable Based Streaming On-device Mandarin Speech Recognition with a Syllable-to-Character Converter

abstract: End-to-end models are favored in automatic speech recognition (ASR) because of its simplified system structure and superior performance. Among these models, recurrent neural network transducer (RNN-T) has achieved significant progress in streaming on-device speech recognition because of its high-accuracy and low-latency. RNN-T adopts a prediction network to enhance language information, but its language modeling ability is limited because it still needs paired speech-text data to train. Further strengthening the language modeling ability through extra text data, such as shallow fusion with an external language model, only brings a small performance gain. In view of the fact that Mandarin Chinese is a character-based language and each character is pronounced as a tonal syllable, this paper proposes a novel cascade RNN-T approach to improve the language modeling ability of RNN-T. Our approach firstly uses an RNN-T to transform acoustic feature into syllable sequence, and then converts the syllable sequence into character sequence through an RNN-T-based syllable-to-character converter. Thus a rich text repository can be easily used to strengthen the language model ability. By introducing several important tricks, the cascade RNN-T approach surpasses the character-based RNN-T by a large margin on several Mandarin test sets, with much higher recognition quality and similar latency.


title: Towards All-around Knowledge Transferring: Learning From Task-irrelevant Labels

abstract: Deep neural models have hitherto achieved significant performances on numerous classification tasks, but meanwhile require sufficient manually annotated data. Since it is extremely time-consuming and expensive to annotate adequate data for each classification task, learning an empirically effective model with generalization on small dataset has received increased attention. Existing efforts mainly focus on transferring task-relevant knowledge from other similar data to tackle the issue. These approaches have yielded remarkable improvements, yet neglecting the fact that the task-irrelevant features could bring out massive negative transfer effects. To date, no large-scale studies have been performed to investigate the impact of task-irrelevant features, let alone the utilization of this kind of features. In this paper, we firstly propose Task-Irrelevant Transfer Learning (TIRTL) to exploit task-irrelevant features, which mainly are extracted from task-irrelevant labels. Particularly, we suppress the expression of task-irrelevant information and facilitate the learning process of classification. We also provide a theoretical explanation of our method. In addition, TIRTL does not conflict with those that have previously exploited task-relevant knowledge and can be well combined to enable the simultaneous utilization of task-relevant and task-irrelevant features for the first time. In order to verify the effectiveness of our theory and method, we conduct extensive experiments on facial expression recognition and digit recognition tasks. Our source code will be also available in the future for reproducibility.


title: On Isomorphic K-rational Groups of Isogenous Elliptic Curves over Finite Fields

abstract: We show that two ordinary isogenous elliptic curves have isomorphic groups of rational points if they have the same $j$-invariant and we extend this result to certain isogenous supersingular elliptic curves, namely those with equal $j$-invariant of either 0 or 1728. Using a result by Heuberger and Mazzoli we establish a general case of this relationship within isogenous elliptic curves not necessarily having equal $j$-invariant.


title: Data-Driven Reachability Analysis Using Matrix Zonotopes

abstract: In this paper, we propose a data-driven reachability analysis approach for unknown system dynamics. Reachability analysis is an essential tool for guaranteeing safety properties. However, most current reachability analysis heavily relies on the existence of a suitable system model, which is often not directly available in practice. We instead propose a data-driven reachability analysis approach from noisy data. More specifically, we first provide an algorithm for over-approximating the reachable set of a linear time-invariant system using matrix zonotopes. Then we introduce an extension for Lipschitz nonlinear systems. We provide theoretical guarantees in both cases. Numerical examples show the potential and applicability of the introduced methods.


title: Beyond Cell-free MIMO: Energy Efficient Reconfigurable Intelligent Surface Aided Cell-free MIMO Communications

abstract: Cell-free systems can effectively eliminate the inter-cell interference by enabling multiple base stations (BSs) to cooperatively serve users without cell boundaries at the expense of high costs of hardware and power sources due to the large-scale deployment of BSs. To tackle this issue, the low-cost reconfigurable intelligent surface (RIS) can serve as a promising technique to improve the energy efficiency of cell-free systems. In this paper, we consider an RIS aided cell-free MIMO system where multiple RISs are deployed around BSs and users to create favorable propagation conditions via reconfigurable reflections in a low-cost way, thereby enhancing cell-free MIMO communications. To maximize the energy efficiency, a hybrid beamforming (HBF) scheme consisting of the digital beamforming at BSs and the RIS-based analog beamforming is proposed. The energy efficiency maximization problem is formulated and an iterative algorithm is designed to solve this problem. The impact of the transmit power, the number of RIS, and the RIS size on energy efficiency are investigated. Both theoretical analysis and simulation results reveal that the optimal energy efficiency depends on the numbers of RISs and the RIS size. Numerical evaluations also show that the proposed system can achieve a higher energy efficiency than conventional ones.


title: Federated Composite Optimization

abstract: Federated Learning (FL) is a distributed learning paradigm that scales on-device learning collaboratively and privately. Standard FL algorithms such as FedAvg are primarily geared towards smooth unconstrained settings. In this paper, we study the Federated Composite Optimization (FCO) problem, in which the loss function contains a non-smooth regularizer. Such problems arise naturally in FL applications that involve sparsity, low-rank, monotonicity, or more general constraints. We first show that straightforward extensions of primal algorithms such as FedAvg are not well-suited for FCO since they suffer from the "curse of primal averaging," resulting in poor convergence. As a solution, we propose a new primal-dual algorithm, Federated Dual Averaging (FedDualAvg), which by employing a novel server dual averaging procedure circumvents the curse of primal averaging. Our theoretical analysis and empirical experiments demonstrate that FedDualAvg outperforms the other baselines.


title: Density Estimation using Entropy Maximization for Semi-continuous Data

abstract: Semi-continuous data comes from a distribution that is a mixture of the point mass at zero and a continuous distribution with support on the positive real line. A clear example is the daily rainfall data. In this paper, we present a novel algorithm to estimate the density function for semi-continuous data using the principle of maximum entropy. Unlike existing methods in the literature, our algorithm needs only the sample values of the constraint functions in the entropy maximization problem and does not need the entire sample. Using simulations, we show that the estimate of the entropy produced by our algorithm has significantly less bias compared to existing methods. An application to the daily rainfall data is provided.


title: Inductive blockwise Alperin weight condition for type B and odd primes

abstract: By the reduction theorems of Navarro--Tiep and Sp\"ath, a way to prove the Alperin weight conjecture and its blockwise version is to verify the co-called inductive Alperin weight condition and inductive blockwise Alperin weight condition for all finie simple groups respectively. In this paper, we establish the inductive blockwise Alperin weight condition for simple groups of type $\mathsf B$ and odd primes, using a criterion given by Brough and Sp\"ath recently.


title: Fine-grained Emotion Strength Transfer, Control and Prediction for Emotional Speech Synthesis

abstract: This paper proposes a unified model to conduct emotion transfer, control and prediction for sequence-to-sequence based fine-grained emotional speech synthesis. Conventional emotional speech synthesis often needs manual labels or reference audio to determine the emotional expressions of synthesized speech. Such coarse labels cannot control the details of speech emotion, often resulting in an averaged emotion expression delivery, and it is also hard to choose suitable reference audio during inference. To conduct fine-grained emotion expression generation, we introduce phoneme-level emotion strength representations through a learned ranking function to describe the local emotion details, and the sentence-level emotion category is adopted to render the global emotions of synthesized speech. With the global render and local descriptors of emotions, we can obtain fine-grained emotion expressions from reference audio via its emotion descriptors (for transfer) or directly from phoneme-level manual labels (for control). As for the emotional speech synthesis with arbitrary text inputs, the proposed model can also predict phoneme-level emotion expressions from texts, which does not require any reference audio or manual label.


title: Thermodynamic signatures of the polaron-molecule transition in a Fermi gas

abstract: We consider the highly spin-imbalanced limit of a two-component Fermi gas, where there is a small density of $\downarrow$ impurities attractively interacting with a sea of $\uparrow$ fermions. In the single-impurity limit at zero temperature, there exists the so-called polaron-molecule transition, where the impurity sharply changes its character by binding a $\uparrow$ fermion at sufficiently strong attraction. Using a recently developed variational approach, we calculate the thermodynamic properties of the impurity, and we show that the transition becomes a smooth crossover at finite temperature due to the thermal occupation of excited states in the impurity spectral function. However, remnants of the single-impurity transition are apparent in the momentum-resolved spectral function, which can in principle be probed with Raman spectroscopy. We furthermore show that the Tan contact exhibits a characteristic non-monotonic dependence on temperature that provides a signature of the zero-temperature polaron-molecule transition. For a finite impurity density, we argue that descriptions purely based on the behavior of the Fermi polaron are invalid near the polaron-molecule transition, since correlations between impurities cannot be ignored. In particular, we show that the spin-imbalanced system undergoes phase separation at low temperatures due to the strong attraction between $\uparrow\downarrow$ molecules induced by the Fermi sea. Thus, we find that the impurity spectrum and the induced impurity-impurity interactions are key to understanding the phase diagram of the spin-imbalanced Fermi gas.


title: Stability and Evolution of Fallen Particles Around the Surface of Asteroid (101955) Bennu

abstract: In this work, we study the dynamics of particles around Bennu. The goal is to understand the stability, evolution, and final outcome of the simulated particles around the asteroid. According to the results, the particle sizes can be divided into two main groups depending on their behavior. Particles smaller than a centimeter are quickly removed from the system by solar radiation pressure, while the dynamics of particles larger than a few centimeters is dominated by the gravitational field of Bennu. Because of its shape and spin period, Bennu has eight equilibrium points around it. The structure of the phase space near its equatorial surface is directly connected to these equilibrium points. Therefore, we performed numerical simulations to obtain information about the orbital evolution near the equilibrium points. The results show that most of the particles larger than a few centimeters fall in the equatorial region close to the Kingfisher area or close to the region diametrically opposite to it. In contrast, almost none of these particles fall in the equatorial region close to the Osprey area. In addition, we also performed computational experiments considering a spherical cloud of particles initially orbiting Bennu. Most of the particles in prograde orbits fall on the surface within our integration period, which was limited to 1.14 years. The particles preferentially fall near high-altitude regions at low equatorial latitudes and close to the north pole. The mid-latitudes are those more depleted of falls, as in the Nightingale and Sandpiper areas.


title: s-Transformer: Segment-Transformer for Robust Neural Speech Synthesis

abstract: Neural end-to-end text-to-speech (TTS) , which adopts either a recurrent model, e.g. Tacotron, or an attention one, e.g. Transformer, to characterize a speech utterance, has achieved significant improvement of speech synthesis. However, it is still very challenging to deal with different sentence lengths, particularly, for long sentences where sequence model has limitation of the effective context length. We propose a novel segment-Transformer (s-Transformer), which models speech at segment level where recurrence is reused via cached memories for both the encoder and decoder. Long-range contexts can be captured by the extended memory, meanwhile, the encoder-decoder attention on segment which is much easier to handle. In addition, we employ a modified relative positional self attention to generalize sequence length beyond a period possibly unseen in the training data. By comparing the proposed s-Transformer with the standard Transformer, on short sentences, both achieve the same MOS scores of 4.29, which is very close to 4.32 by the recordings; similar scores of 4.22 vs 4.2 on long sentences, and significantly better for extra-long sentences with a gain of 0.2 in MOS. Since the cached memory is updated with time, the s-Transformer generates rather natural and coherent speech for a long period of time.


title: Impact of ATLAS $V$ + jets data on PDF fits

abstract: This proceeding presents a new set of proton parton distribution functions, ATLASepWZVjet20, produced in an analysis at next-to-next-to-leading-order in QCD. The new datasets considered are the ATLAS measurements of $W^{\pm}$ and $Z$ boson production in association with jets in $pp$ collisions at $\sqrt{s}$ = 8 TeV at the LHC with integrated luminosities of 20.2 fb$^{-1}$ and 19.9 fb$^{-1}$ respectively. The analysis also considers the ATLAS measurements of differential $W^{\pm}$ and $Z$ boson production at $\sqrt{s}$ = 7 TeV with an integrated luminosity of 4.6 fb$^{-1}$ and deep-inelastic scattering data from $e^{\pm}p$ collisions at the HERA accelerator. An improved determination of the sea-quark densities at high Bjorken $x$ is shown, while confirming a strange-quark density of similar size as the up-and down-sea quark densities in the range $x\sim$ 0.02 found by previous ATLAS analyses.


title: Collaborative Three-Tier Architecture Non-contact Respiratory Rate Monitoring using Target Tracking and False Peaks Eliminating Algorithms

abstract: Monitoring the respiratory rate is crucial for helping us identify respiratory disorders. Devices for conventional respiratory monitoring are inconvenient and scarcely available. Recent research has demonstrated the ability of non-contact technologies, such as photoplethysmography and infrared thermography, to gather respiratory signals from the face and monitor breathing. However, the current non-contact respiratory monitoring techniques have poor accuracy because they are sensitive to environmental influences like lighting and motion artifacts. Furthermore, frequent contact between users and the cloud in real-world medical application settings might cause service request delays and potentially the loss of personal data. We proposed a non-contact respiratory rate monitoring system with a cooperative three-layer design to increase the precision of respiratory monitoring and decrease data transmission latency. To reduce data transmission and network latency, our three-tier architecture layer-by-layer decomposes the computing tasks of respiration monitoring. Moreover, we improved the accuracy of respiratory monitoring by designing a target tracking algorithm and an algorithm for eliminating false peaks to extract high-quality respiratory signals. By gathering the data and choosing several regions of interest on the face, we were able to extract the respiration signal and investigate how different regions affected the monitoring of respiration. The results of the experiment indicate that when the nasal region is used to extract the respiratory signal, it performs experimentally best. Our approach performs better than rival approaches while transferring fewer data.


title: FoolHD: Fooling speaker identification by Highly imperceptible adversarial Disturbances

abstract: Speaker identification models are vulnerable to carefully designed adversarial perturbations of their input signals that induce misclassification. In this work, we propose a white-box steganography-inspired adversarial attack that generates imperceptible adversarial perturbations against a speaker identification model. Our approach, FoolHD, uses a Gated Convolutional Autoencoder that operates in the DCT domain and is trained with a multi-objective loss function, in order to generate and conceal the adversarial perturbation within the original audio files. In addition to hindering speaker identification performance, this multi-objective loss accounts for human perception through a frame-wise cosine similarity between MFCC feature vectors extracted from the original and adversarial audio files. We validate the effectiveness of FoolHD with a 250-speaker identification x-vector network, trained using VoxCeleb, in terms of accuracy, success rate, and imperceptibility. Our results show that FoolHD generates highly imperceptible adversarial audio files (average PESQ scores above 4.30), while achieving a success rate of 99.6% and 99.2% in misleading the speaker identification model, for untargeted and targeted settings, respectively.


title: Combining Reinforcement Learning with Model Predictive Control for On-Ramp Merging

abstract: We consider the problem of designing an algorithm to allow a car to autonomously merge on to a highway from an on-ramp. Two broad classes of techniques have been proposed to solve motion planning problems in autonomous driving: Model Predictive Control (MPC) and Reinforcement Learning (RL). In this paper, we first establish the strengths and weaknesses of state-of-the-art MPC and RL-based techniques through simulations. We show that the performance of the RL agent is worse than that of the MPC solution from the perspective of safety and robustness to out-of-distribution traffic patterns, i.e., traffic patterns which were not seen by the RL agent during training. On the other hand, the performance of the RL agent is better than that of the MPC solution when it comes to efficiency and passenger comfort. We subsequently present an algorithm which blends the model-free RL agent with the MPC solution and show that it provides better trade-offs between all metrics -- passenger comfort, efficiency, crash rate and robustness.


title: Probing Predictions on OOD Images via Nearest Categories

abstract: We study out-of-distribution (OOD) prediction behavior of neural networks when they classify images from unseen classes or corrupted images. To probe the OOD behavior, we introduce a new measure, nearest category generalization (NCG), where we compute the fraction of OOD inputs that are classified with the same label as their nearest neighbor in the training set. Our motivation stems from understanding the prediction patterns of adversarially robust networks, since previous work has identified unexpected consequences of training to be robust to norm-bounded perturbations. We find that robust networks have consistently higher NCG accuracy than natural training, even when the OOD data is much farther away than the robustness radius. This implies that the local regularization of robust training has a significant impact on the network's decision regions. We replicate our findings using many datasets, comparing new and existing training methods. Overall, adversarially robust networks resemble a nearest neighbor classifier when it comes to OOD data. Code available at https://github.com/yangarbiter/nearest-category-generalization.


title: Formal self duality

abstract: We study the notion of formal self duality in finite abelian groups. Formal duality in finite abelian groups has been proposed by Cohn, Kumar, Reiher and Sch\"urmann. In this paper we give a precise definition of formally self dual sets and discuss results from the literature in this perspective. Also, we discuss the connection to formally dual codes. We prove that formally self dual sets can be reduced to primitive formally self dual sets similar to a previously known result on general formally dual sets. Furthermore, we describe several properties of formally self dual sets. Also, some new examples of formally self dual sets are presented within this paper. Lastly, we study formally self dual sets of the form $\{(x,F(x)) \ : \ x\in\mathbb{F}_{2^n}\}$ where $F$ is a vectorial Boolean function mapping $\mathbb{F}_{2^n}$ to $\mathbb{F}_{2^n}$.


title: Notes on distinguishability of postselected computations

abstract: The framework of postselection is becoming more and more important in various recent directions in Quantum Computation research. Postselection renders simple computational models able to perform general quantum computation. This was first observed for the linear optics model [E. Knill, R. Laflamme, G. J. Milburn, Nature 409, 46 (2001)], and has since provided us with many near-term candidates for the quantum advantage, commuting computations [M. J. Bremner, R. Jozsa, D. J. Shepherd, Proc. R. Soc. A 467, 459 (2011)] being the first. To facilitate the discussion of errors in the presence of postselection, we define and characterize trace-induced distance and diamond distance of postselected computations. We show counterexamples to simple properties that one would expect of any distance measure; the properties of convexity (when considering only the pure-state inputs would suffice), contractivity, and subadditivity of errors. On the positive side, we prove that certain weaker versions of contractivity and subadditivity and a number of other properties are preserved in the postselected setting. We achieve this via a "conversion lemma" that translates any inequality from the standard to the postselected setting.


title: Gender Differences in Public Code Contributions: a 50-year Perspective

abstract: Gender imbalance in information technology in general, and Free/Open Source Software specifically, is a well-known problem in the field. Still, little is known yet about the large-scale extent and long-term trends that underpin the phenomenon. We contribute to fill this gap by conducting a longitudinal study of the population of contributors to publicly available software source code. We analyze 1.6 billion commits corresponding to the development history of 120 million projects, contributed by 33 million distinct authors over a period of 50 years. We classify author names by gender and study their evolution over time.We show that, while the amount of commits by female authors remains low overall, there is evidence of a stable long-term increase in their proportion over all contributions, providing hope of a more gender-balanced future for collaborative software development.


title: Continuous Open Source License Compliance

abstract: In this article we consider the role of policy and process in open source usage and propose in-workflow automation as the best path to promoting compliance.


title: Non-smooth atomic decomposition of variable 2-microlocal Besov-type and Triebel-Lizorkin-type spaces

abstract: In this paper we provide non-smooth atomic decompositions of 2-microlocal Besov-type and Triebel-Lizorkin-type spaces with variable exponents $B^{\mathrm{\boldsymbol{\omega}}, \phi}_{p(\cdot),q(\cdot)}(\mathbb{R}^n)$ and $F^{\mathrm{\boldsymbol{\omega}}, \phi}_{p(\cdot),q(\cdot)}(\mathbb{R}^n)$. Of big importance in general, and an essential tool here, are the characterizations of the spaces via maximal functions and local means, that we also present. These spaces were recently introduced by Wu at al. and cover not only variable 2-microlocal Besov and Triebel-Lizorkin spaces $B^{\mathrm{\boldsymbol{\omega}}}_{p(\cdot),q(\cdot)}(\mathbb{R}^n)$ and $F^{\mathrm{\boldsymbol{\omega}}}_{p(\cdot),q(\cdot)}(\mathbb{R}^n)$, but also the more classical smoothness Morrey spaces $B^{s, \tau}_{p,q}(\mathbb{R}^n)$ and $F^{s,\tau}_{p,q}(\mathbb{R}^n)$. Afterwards, we state a pointwise multipliers assertion for this scale.