title: Discrete Bessel and Mathieu functions

abstract: The two-dimensional Helmholtz equation separates in elliptic coordinates based on two distinct foci, a limit case of which includes polar coordinate systems when the two foci coalesce. This equation is invariant under the Euclidean group of translations and orthogonal transformations; we replace the latter by the discrete dihedral group of N discrete rotations and reflections. The separation of variables in polar and elliptic coordinates is then used to define discrete Bessel and Mathieu functions, as approximants to the well-known continuous Bessel and Mathieu functions, as N-point Fourier transforms approximate the Fourier transform over the circle, with integrals replaced by finite sums. We find that these 'discrete' functions approximate the numerical values of their continuous counterparts very closely and preserve some key special function relations.


title: Scheduling the NASA Deep Space Network with Deep Reinforcement Learning

abstract: With three complexes spread evenly across the Earth, NASA's Deep Space Network (DSN) is the primary means of communications as well as a significant scientific instrument for dozens of active missions around the world. A rapidly rising number of spacecraft and increasingly complex scientific instruments with higher bandwidth requirements have resulted in demand that exceeds the network's capacity across its 12 antennae. The existing DSN scheduling process operates on a rolling weekly basis and is time-consuming; for a given week, generation of the final baseline schedule of spacecraft tracking passes takes roughly 5 months from the initial requirements submission deadline, with several weeks of peer-to-peer negotiations in between. This paper proposes a deep reinforcement learning (RL) approach to generate candidate DSN schedules from mission requests and spacecraft ephemeris data with demonstrated capability to address real-world operational constraints. A deep RL agent is developed that takes mission requests for a given week as input, and interacts with a DSN scheduling environment to allocate tracks such that its reward signal is maximized. A comparison is made between an agent trained using Proximal Policy Optimization and its random, untrained counterpart. The results represent a proof-of-concept that, given a well-shaped reward signal, a deep RL agent can learn the complex heuristics used by experts to schedule the DSN. A trained agent can potentially be used to generate candidate schedules to bootstrap the scheduling process and thus reduce the turnaround cycle for DSN scheduling.


title: Deterministic Tree Embeddings with Copies for Algorithms Against Adaptive Adversaries

abstract: Embeddings of graphs into distributions of trees that preserve distances in expectation are a cornerstone of many optimization algorithms. Unfortunately, online or dynamic algorithms which use these embeddings seem inherently randomized and ill-suited against adaptive adversaries. In this paper we provide a new tree embedding which addresses these issues by deterministically embedding a graph into a single tree containing $O(\log n)$ copies of each vertex while preserving the connectivity structure of every subgraph and $O(\log^2 n)$-approximating the cost of every subgraph. Using this embedding we obtain several new algorithmic results: We reduce an open question of Alon et al. [SODA 2004] -- the existence of a deterministic poly-log-competitive algorithm for online group Steiner tree on a general graph -- to its tree case. We give a poly-log-competitive deterministic algorithm for a closely related problem -- online partial group Steiner tree -- which, roughly, is a bicriteria version of online group Steiner tree. Lastly, we give the first poly-log approximations for demand-robust Steiner forest, group Steiner tree and group Steiner forest.


title: Decontextualization: Making Sentences Stand-Alone

abstract: Models for question answering, dialogue agents, and summarization often interpret the meaning of a sentence in a rich context and use that meaning in a new context. Taking excerpts of text can be problematic, as key pieces may not be explicit in a local window. We isolate and define the problem of sentence decontextualization: taking a sentence together with its context and rewriting it to be interpretable out of context, while preserving its meaning. We describe an annotation procedure, collect data on the Wikipedia corpus, and use the data to train models to automatically decontextualize sentences. We present preliminary studies that show the value of sentence decontextualization in a user facing task, and as preprocessing for systems that perform document understanding. We argue that decontextualization is an important subtask in many downstream applications, and that the definitions and resources provided can benefit tasks that operate on sentences that occur in a richer context.


title: Exact lower bound on an "exactly one" probability

abstract: The exact lower bound on the probability of the occurrence of exactly one of $n$ random events each of probability $p$ is obtained.


title: The Cognition of Counterexample in Mathematics Students

abstract: Studying Mathematics requires a synthesis of skills from a multitude of academic disciplines; logical reasoning being chief among them. This paper explores mathematical logical preparedness of students entering first year university mathematics courses and also the effectiveness of using logical facility to predict successful course outcomes. We analyze data collected from students enrolled at the University of Winnipeg in a pre-service course for high school teachers. We do find that, being able to successfully answer logical questions, both before and after intervention, are significant in relation to improved student outcomes.


title: Differential Privacy for Binary Functions via Randomized Graph Colorings

abstract: We present a framework for designing differentially private (DP) mechanisms for binary functions via a graph representation of datasets. Datasets are nodes in the graph and any two neighboring datasets are connected by an edge. The true binary function we want to approximate assigns a value (or true color) to a dataset. Randomized DP mechanisms are then equivalent to randomized colorings of the graph. A key notion we use is that of the boundary of the graph. Any two neighboring datasets assigned a different true color belong to the boundary. Under this framework, we show that fixing the mechanism behavior at the boundary induces a unique optimal mechanism. Moreover, if the mechanism is to have a homogeneous behavior at the boundary, we present a closed expression for the optimal mechanism, which is obtained by means of a \emph{pullback} operation on the optimal mechanism of a line graph. For balanced mechanisms, not favoring one binary value over another, the optimal $(\epsilon,\delta)$-DP mechanism takes a particularly simple form, depending only on the minimum distance to the boundary, on $\epsilon$, and on $\delta$.


title: Energetic Electron Distribution of the Coronal Acceleration Region: First results from Joint Microwave and Hard X-ray Imaging Spectroscopy

abstract: Nonthermal sources located above bright flare arcades, referred to as the "above-the-loop-top" sources, have been often suggested as the primary electron acceleration site in major solar flares. The X8.2 limb flare on 2017 September 10 features such an above-the-loop-top source, which was observed in both microwaves and hard X-rays (HXRs) by the Expanded Owens Valley Solar Array (EOVSA) and the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI), respectively. By combining the microwave and HXR imaging spectroscopy observations with multi-filter extreme ultraviolet and soft X-ray imaging data, we derive the energetic electron distribution of this source over a broad energy range from $<$10 keV up to $\sim$MeV during the early impulsive phase of the flare. The best-fit electron distribution consists of a thermal "core" from $\sim$25 MK plasma. Meanwhile, a nonthermal power-law "tail" joins the thermal core at $\sim$16 keV with a spectral index of $\sim$3.6, which breaks down at above $\sim$160 keV to $>$6.0. In addition, temporally resolved analysis suggests that the electron distribution above the break energy rapidly hardens with the spectral index decreasing from $>$20 to $\sim$6.0 within 20 s, or less than $\sim$10 Alfv\'{e}n crossing times in the source. These results provide strong support for the above-the-loop-top source as the primary site where an on-going bulk acceleration of energetic electrons is taking place very early in the flare energy release.


title: On the Hardness of PAC-learning Stabilizer States with Noise

abstract: We consider the problem of learning stabilizer states with noise in the Probably Approximately Correct (PAC) framework of Aaronson (2007) for learning quantum states. In the noiseless setting, an algorithm for this problem was recently given by Rocchetto (2018), but the noisy case was left open. Motivated by approaches to noise tolerance from classical learning theory, we introduce the Statistical Query (SQ) model for PAC-learning quantum states, and prove that algorithms in this model are indeed resilient to common forms of noise, including classification and depolarizing noise. We prove an exponential lower bound on learning stabilizer states in the SQ model. Even outside the SQ model, we prove that learning stabilizer states with noise is in general as hard as Learning Parity with Noise (LPN) using classical examples. Our results position the problem of learning stabilizer states as a natural quantum analogue of the classical problem of learning parities: easy in the noiseless setting, but seemingly intractable even with simple forms of noise.


title: Transition space for the continuity of the Lyapunov exponent of quasiperiodic Schr\"odinger cocycles

abstract: We construct discontinuous point of the Lyapunov exponent of quasiperiodic Schr\"odinger cocycles in the Gevrey space $G^{s}$ with $s>2$. In contrast, the Lyapunov exponent has been proved to be continuous in the Gevrey space $G^{s}$ with $s<2$ \cite{klein,cgyz}. This shows that $G^2$ is the transition space for the continuity of the Lyapunov exponent.


title: Transfer learning based few-shot classification using optimal transport mapping from preprocessed latent space of backbone neural network

abstract: MetaDL Challenge 2020 focused on image classification tasks in few-shot settings. This paper describes second best submission in the competition. Our meta learning approach modifies the distribution of classes in a latent space produced by a backbone network for each class in order to better follow the Gaussian distribution. After this operation which we call Latent Space Transform algorithm, centers of classes are further aligned in an iterative fashion of the Expectation Maximisation algorithm to utilize information in unlabeled data that are often provided on top of few labelled instances. For this task, we utilize optimal transport mapping using the Sinkhorn algorithm. Our experiments show that this approach outperforms previous works as well as other variants of the algorithm, using K-Nearest Neighbour algorithm, Gaussian Mixture Models, etc.


title: Time Dependent Quantum Perturbations Uniform in the Semiclassical Regime

abstract: We present a time dependent quantum perturbation result, uniform in the Planck constant, for perturbations of potentials whose gradients are Lipschitz continuous by potentials whose gradients are only bounded a.e.. Though this low regularity of the full potential is not enough to provide the existence of the classical underlying dynamics, at variance with the quantum one, our result shows that the classical limit of the perturbed quantum dynamics remains in a tubular neighbourhood of the classical unperturbed one of size of order of the square root of the size of the perturbation. We treat both Schr\"odinger and von Neumann-Heisenberg equations.


title: Medical Image Quality Metrics for Foveated Model Observers

abstract: A recently proposed model observer mimics the foveated nature of the human visual system by processing the entire image with varying spatial detail, executing eye movements and scrolling through slices. The model can predict how human search performance changes with signal type and modality (2D vs. 3D), yet its implementation is computationally expensive and time-consuming. Here, we evaluate various image quality metrics using extensions of the classic index of detectability expressions and assess foveated model observers for location-known exactly tasks. We evaluated foveated extensions of a Channelized Hotelling and Non-prewhitening model with an eye filter. The proposed methods involve calculating a model index of detectability (d') for each retinal eccentricity and combining these with a weighting function into a single detectability metric. We assessed different versions of the weighting function that varied in the required measurements of the human observers' search (no measurements, eye movement patterns, and size of the image and median search times). We show that the index of detectability across eccentricities weighted using the eye movement patterns of observers best predicted human performance in 2D vs. 3D search performance for a small microcalcification-like signal and a larger mass-like. The metric with weighting function based on median search times was the second best at predicting human results. The findings provide a set of model observer tools to evaluate image quality in the early stages of imaging system evaluation or design without implementing the more computationally complex foveated search model.


title: Structure-preserving Model Reduction of Parametric Power Networks

abstract: We develop a structure-preserving parametric model reduction approach for linearized swing equations where parametrization corresponds to variations in operating conditions. We employ a global basis approach to develop the parametric reduced model in which we concatenate the local bases obtained via $\mathcal{H}_2$-based interpolatory model reduction. The residue of the underlying dynamics corresponding to the simple pole at zero varies with the parameters. Therefore, to have bounded $\mathcal{H}_2$ and $\mathcal{H}_\infty$ errors, the reduced model residue for the pole at zero should match the original one over the entire parameter domain. Our framework achieves this goal by enriching the global basis based on a residue analysis. The effectiveness of the proposed method is illustrated through two numerical examples.


title: Pulse interactions in weakly nonlinear coherent optical communication links

abstract: The intrachannel interaction of pulses in weakly nonlinear coherent optical fiber lines is theoretically investigated. It is shown that the main contribution to the perturbation of the optical field comes from resonant interactions of ordered triplets of pulses. The structure of triplets is determined. The weight contributions of such interactions are calculated. A classification of interactions using Loeschian numbers is proposed. Using computer simulation, the dependence of the average energy of the optical field perturbations on the distance is shown. Based on the performed analysis, an effective algorithm is proposed for assessing the perturbations resulting from intrachannel interaction.


title: CoIL: Coordinate-based Internal Learning for Imaging Inverse Problems

abstract: We propose Coordinate-based Internal Learning (CoIL) as a new deep-learning (DL) methodology for the continuous representation of measurements. Unlike traditional DL methods that learn a mapping from the measurements to the desired image, CoIL trains a multilayer perceptron (MLP) to encode the complete measurement field by mapping the coordinates of the measurements to their responses. CoIL is a self-supervised method that requires no training examples besides the measurements of the test object itself. Once the MLP is trained, CoIL generates new measurements that can be used within a majority of image reconstruction methods. We validate CoIL on sparse-view computed tomography using several widely-used reconstruction methods, including purely model-based methods and those based on DL. Our results demonstrate the ability of CoIL to consistently improve the performance of all the considered methods by providing high-fidelity measurement fields.


title: A Deep Learning Approach for Characterizing Major Galaxy Mergers

abstract: Fine-grained estimation of galaxy merger stages from observations is a key problem useful for validation of our current theoretical understanding of galaxy formation. To this end, we demonstrate a CNN-based regression model that is able to predict, for the first time, using a single image, the merger stage relative to the first perigee passage with a median error of 38.3 million years (Myrs) over a period of 400 Myrs. This model uses no specific dynamical modeling and learns only from simulated merger events. We show that our model provides reasonable estimates on real observations, approximately matching prior estimates provided by detailed dynamical modeling. We provide a preliminary interpretability analysis of our models, and demonstrate first steps toward calibrated uncertainty estimation.


title: Parametric study of upstream flame propagation in hydrogen-enriched premixed combustion: effects of swirl, geometry and premixedness

abstract: The effect of swirl, premixedness and geometry has been investigated for hydrogen enriched premixed flame using Large Eddy Simulation (LES) with a Thickened Flame (TF) model. Swirl strength has been varied to study the effects of swirl on flame behavior in a laboratory-scale premixed combustor operated under atmospheric conditions. In addition, the levels of premixedness and geometry have also been changed to study the role of these quantities on flame behavior. The turbulent flow field and the chemistry are coupled through TF model. In the LES-TF approach, the flame front is resolved on the computational grid through artificial thickening and the individual species transport equations are directly solved with the reaction rates specified using Arrhenius chemistry. Good agreement is found when comparing predictions with the published experimental data including the predicted RMS fluctuations. Also, the results show that higher swirl strength and increase in level of premixedness make the system more susceptible to upstream flame movement due to higher combustibility of hydrogen, which increases the reaction along the flame front, thereby raises temperature in the reaction zone and leads to combustion induced vortex breakdown (CIVB). Moreover, upstream flame movement is always observed at higher swirl strength irrespective of level of premixedness and burner geometry, whereas the premixed systems exhibit stable behavior while operating at low swirl.


title: Quantum and Semiquantum Pseudometrics and Applications

abstract: We establish a Kantorovich duality for the pseudometric $\mathcal{E}_\hbar$ introduced in [F. Golse, T. Paul, Arch. Rational Mech. Anal. 223 (2017), 57--94], obtained from the usual Monge-Kantorovich distance $d_{MK,2}$ between classical densities by quantization of one of the two densities involved. We show several type of inequalities comparing $d_{MK,2}$, $\mathcal{E}_\hbar$ and $MK_\hbar$, a full quantum analogue of $d_{MK,2}$ introduced in [F. Golse, C. Mouhot, T. Paul, Commun. Math. Phys. 343 (2016), 165--205], including an up to $\hbar$ triangle inequality for $MK_\hbar$. Finally, we show that, when nice optimal Kantorovich potentials exist for $\mathcal{E}_\hbar$, optimal couplings induce classical/quantum optimal transports and the potentials are linked by a semiquantum Legendre type transform.


title: Benchmarks, Algorithms, and Metrics for Hierarchical Disentanglement

abstract: In representation learning, there has been recent interest in developing algorithms to disentangle the ground-truth generative factors behind a dataset, and metrics to quantify how fully this occurs. However, these algorithms and metrics often assume that both representations and ground-truth factors are flat, continuous, and factorized, whereas many real-world generative processes involve rich hierarchical structure, mixtures of discrete and continuous variables with dependence between them, and even varying intrinsic dimensionality. In this work, we develop benchmarks, algorithms, and metrics for learning such hierarchical representations.


title: Triple clasp formulas for $C_2$ webs

abstract: Using the light ladder basis for Kuperberg's $C_2$ webs, we derive triple clasp formulas for idempotents projecting to the top summand in each tensor product of fundamental representations. We then find explicit formulas for the coefficients occurring in the clasps, by computing these coefficients as local intersection forms. Our formulas provide further evidence for Elias's clasp conjecture, which was given for type $A$ webs, and suggests how to generalize the conjecture to non-simply laced types.


title: A High-Performance Sparse Tensor Algebra Compiler in Multi-Level IR

abstract: Tensor algebra is widely used in many applications, such as scientific computing, machine learning, and data analytics. The tensors represented real-world data are usually large and sparse. There are tens of storage formats designed for sparse matrices and/or tensors and the performance of sparse tensor operations depends on a particular architecture and/or selected sparse format, which makes it challenging to implement and optimize every tensor operation of interest and transfer the code from one architecture to another. We propose a tensor algebra domain-specific language (DSL) and compiler infrastructure to automatically generate kernels for mixed sparse-dense tensor algebra operations, named COMET. The proposed DSL provides high-level programming abstractions that resemble the familiar Einstein notation to represent tensor algebra operations. The compiler performs code optimizations and transformations for efficient code generation while covering a wide range of tensor storage formats. COMET compiler also leverages data reordering to improve spatial or temporal locality for better performance. Our results show that the performance of automatically generated kernels outperforms the state-of-the-art sparse tensor algebra compiler, with up to 20.92x, 6.39x, and 13.9x performance improvement, for parallel SpMV, SpMM, and TTM over TACO, respectively.


title: CaPC Learning: Confidential and Private Collaborative Learning

abstract: Machine learning benefits from large training datasets, which may not always be possible to collect by any single entity, especially when using privacy-sensitive data. In many contexts, such as healthcare and finance, separate parties may wish to collaborate and learn from each other's data but are prevented from doing so due to privacy regulations. Some regulations prevent explicit sharing of data between parties by joining datasets in a central location (confidentiality). Others also limit implicit sharing of data, e.g., through model predictions (privacy). There is currently no method that enables machine learning in such a setting, where both confidentiality and privacy need to be preserved, to prevent both explicit and implicit sharing of data. Federated learning only provides confidentiality, not privacy, since gradients shared still contain private information. Differentially private learning assumes unreasonably large datasets. Furthermore, both of these learning paradigms produce a central model whose architecture was previously agreed upon by all parties rather than enabling collaborative learning where each party learns and improves their own local model. We introduce Confidential and Private Collaborative (CaPC) learning, the first method provably achieving both confidentiality and privacy in a collaborative setting. We leverage secure multi-party computation (MPC), homomorphic encryption (HE), and other techniques in combination with privately aggregated teacher models. We demonstrate how CaPC allows participants to collaborate without having to explicitly join their training sets or train a central model. Each party is able to improve the accuracy and fairness of their model, even in settings where each party has a model that performs well on their own dataset or when datasets are not IID and model architectures are heterogeneous across parties.


title: Pluripotential Monge-Amp{\`e}re flows in Big Cohomology Classes

abstract: We study pluripotential complex Monge-Amp\`ere flows in big cohomology classes on compact K{\"a}hler manifolds. We use the Perron method, considering pluripotential subsolutions to the Cauchy problem. We prove that, under natural assumptions on the data, the upper envelope of all subsolutions is continuous in space and semi-concave in time, and provides a unique pluripotential solution with such regularity. We apply this theory to study pluripotential K{\"a}hler-Ricci flows on compact K{\"a}hler manifolds of general type as well as on stable varieties.


title: Cartesian Fibrations of Complete Segal Spaces

abstract: Cartesian fibrations were originally defined by Lurie in the context of quasi-categories and are commonly used in $(\infty,1)$-category theory to study presheaves valued in $(\infty,1)$-categories. In this work we define and study fibrations modeling presheaves valued in simplicial spaces and their localizations. This includes defining a model structure for these fibrations and giving effective tools to recognize its fibrations and weak equivalences. This in particular gives us a new method to construct Cartesian fibrations via complete Segal spaces. In addition to that, it allows us to define and study fibrations modeling presheaves of Segal spaces.


title: DHLink: A Microservice Platform supporting Rapid Application Development and Secure Real-time Data Sharing in Digital Health

abstract: Digital health applications that leverage multiple sources of patient data for insights to patients' behaviours or disease symptoms as well as remote patient monitoring, nudging and treatments are becoming increasingly popular in various medical practices and research. One common issue among these applications is that they are generally based on project-specific solutions and developed from scratch. Such application development fashion results in large amounts of repetitive effort, for example, in building study specific websites and mobile frontends, deploying customised infrastructures, and collecting data that may have already been collected in other studies and projects. What is worse, the data collected, and functions built cannot be easily reused by other applications. In this paper, we present an event-driven microservice platform, namely DHLink, to address this issue. DHLink securely links existing digital health applications of different projects, facilitates real-time data sharing, and supports rapid application development by reusing data and functions of existing digital health applications. In addition, comes with DHLink, a set of highly generic and reusable microservices is provided, which allows developers to rapidly create a typical above-mentioned digital health application by only developing the core algorithms. Two use cases outlined in this paper have shown the use of DHLink and the set of microservices for application collaboration and new application development to be efficient and practical.


title: Quasi-Categories vs. Segal Spaces: Cartesian Edition

abstract: We prove that four different ways of defining Cartesian fibrations and the Cartesian model structure are all Quillen equivalent: On marked simplicial sets, on bisimplicial spaces, on bisimplicial sets, on marked simplicial spaces. The main way to prove these equivalences is by using the Quillen equivalences between quasi-categories and complete Segal spaces as defined by Joyal-Tierney and the straightening construction due to Lurie.


title: Staggered modules of $N=2$ superconformal minimal models

abstract: We investigate a class of reducible yet indecomposable modules over the $N=2$ superconformal algebras. These so-called staggered modules exhibit a non-diagonalisable action of the Virasoro mode $L_{0}$. Using recent results on the coset construction of $N=2$ minimal models, we explicitly construct such modules for central charges $c = -1$ and $c = -6$. We also describe spectral-flow orbits and symmetries of the families of staggered modules which arise via the coset.


title: Boosting Template-based SSVEP Decoding by Cross-domain Transfer Learning

abstract: Objective: This study aims to establish a generalized transfer-learning framework for boosting the performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) by leveraging cross-domain data transferring. Approach: We enhanced the state-of-the-art template-based SSVEP decoding through incorporating a least-squares transformation (LST)-based transfer learning to leverage calibration data across multiple domains (sessions, subjects, and EEG montages). Main results: Study results verified the efficacy of LST in obviating the variability of SSVEPs when transferring existing data across domains. Furthermore, the LST-based method achieved significantly higher SSVEP-decoding accuracy than the standard task-related component analysis (TRCA)-based method and the non-LST naive transfer-learning method. Significance: This study demonstrated the capability of the LST-based transfer learning to leverage existing data across subjects and/or devices with an in-depth investigation of its rationale and behavior in various circumstances. The proposed framework significantly improved the SSVEP decoding accuracy over the standard TRCA approach when calibration data are limited. Its performance in calibration reduction could facilitate plug-and-play SSVEP-based BCIs and further practical applications.


title: DOVE: A Data-Oblivious Virtual Environment

abstract: Users can improve the security of remote communications by using Trusted Execution Environments (TEEs) to protect against direct introspection and tampering of sensitive data. This can even be done with applications coded in high-level languages with complex programming stacks such as R, Python, and Ruby. However, this creates a trade-off between programming convenience versus the risk of attacks using microarchitectural side channels. In this paper, we argue that it is possible to address this problem for important applications by instrumenting a complex programming environment (like R) to produce a Data-Oblivious Transcript (DOT) that is explicitly designed to support computation that excludes side channels. Such a transcript is then evaluated on a Trusted Execution Environment (TEE) containing the sensitive data using a small trusted computing base called the Data-Oblivious Virtual Environment (DOVE). To motivate the problem, we demonstrate a number of subtle side-channel vulnerabilities in the R language. We then provide an illustrative design and implementation of DOVE for R, creating the first side-channel resistant R programming stack. We demonstrate that the two-phase architecture provided by DOT generation and DOVE evaluation can provide practical support for complex programming languages with usable performance and high security assurances against side channels.


title: Once is Never Enough: Foundations for Sound Statistical Inference in Tor Network Experimentation

abstract: Tor is a popular low-latency anonymous communication system that focuses on usability and performance: a faster network will attract more users, which in turn will improve the anonymity of everyone using the system. The standard practice for previous research attempting to enhance Tor performance is to draw conclusions from the observed results of a single simulation for standard Tor and for each research variant. But because the simulations are run in sampled Tor networks, it is possible that sampling error alone could cause the observed effects. Therefore, we call into question the practical meaning of any conclusions that are drawn without considering the statistical significance of the reported results. In this paper, we build foundations upon which we improve the Tor experimental method. First, we present a new Tor network modeling methodology that produces more representative Tor networks as well as new and improved experimentation tools that run Tor simulations faster and at a larger scale than was previously possible. We showcase these contributions by running simulations with 6,489 relays and 792k simultaneously active users, the largest known Tor network simulations and the first at a network scale of 100%. Second, we present new statistical methodologies through which we: (i) show that running multiple simulations in independently sampled networks is necessary in order to produce informative results; and (ii) show how to use the results from multiple simulations to conduct sound statistical inference. We present a case study using 420 simulations to demonstrate how to apply our methodologies to a concrete set of Tor experiments and how to analyze the results.


title: Economic controls co-design of hybrid microgrids with tidal/PV generation and lithium ion/flow battery storage

abstract: Islanded microgrids powered by renewable energy require costly energy storage systems due to the uncontrollable generators. Energy storage needs are amplified when load and generation are misaligned on hourly, monthly, or seasonal timescales. Diversification of both loads and generation can smooth out such mismatches. The ideal type of battery to smooth out remaining generation deficits will depend on the duration(s) that energy is stored. This study presents a controls co-design approach to design an islanded microgrid, showing the benefit of hybridizing tidal and solar generation and hybridizing lithium-ion and flow battery energy storage. The optimization of the microgrid's levelized cost of energy is initially studied in grid-search slices to understand convexity and smoothness, then a particle swarm optimization is proposed and used to study the sensitivity of the hybrid system configuration to variations in component costs. The study highlights the benefits of controls co-design, the need to model premature battery failure, and the importance of using battery cost models that are applicable across orders of magnitude variations in energy storage durations. The results indicate that such a hybrid microgrid would currently produce energy at five times the cost of diesel generation, but flow battery innovations could bring this closer to only twice the cost while using 100% renewable energy.


title: Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithm

abstract: Statistical machine learning models trained with stochastic gradient algorithms are increasingly being deployed in critical scientific applications. However, computing the stochastic gradient in several such applications is highly expensive or even impossible at times. In such cases, derivative-free or zeroth-order algorithms are used. An important question which has thus far not been addressed sufficiently in the statistical machine learning literature is that of equipping stochastic zeroth-order algorithms with practical yet rigorous inferential capabilities so that we not only have point estimates or predictions but also quantify the associated uncertainty via confidence intervals or sets. Towards this, in this work, we first establish a central limit theorem for Polyak-Ruppert averaged stochastic zeroth-order gradient algorithm. We then provide online estimators of the asymptotic covariance matrix appearing in the central limit theorem, thereby providing a practical procedure for constructing asymptotically valid confidence sets (or intervals) for parameter estimation (or prediction) in the zeroth-order setting.


title: Modeling and SAR Imaging of the Sea Surface: a Review of the State-of-the-Art with Simulations

abstract: Among other remote sensing technologies, synthetic aperture radar (SAR) has become firmly established in the practice of oceanographic research. Despite solid experience in this field, comprehensive knowledge and interpretation of ocean/sea and vessel wave signatures on radar images are still very challenging. Many technical parameters and scanning conditions vary for different SAR platforms, which also imposes some restrictions on the cross-analysis of their respective images. Numerical simulation of SAR images allows the analysis of many radar imaging parameters including environmental, ship, or platform related. In this paper, we present a universal simulation framework for SAR imagery of the sea surface, which includes the superposition of sea-ship waves. This paper is the first attempt to cover exhaustively all SAR imaging effects for the sea waves and ship wakes scene. The study is based on well proven concepts: the linear theory of sea surface modeling, Michell thin-ship theory for Kelvin wake modeling, and ocean SAR imaging theory. We demonstrate the role of two main factors that affect imaging of both types of waves: (i) SAR parameters and (ii) Hydrodynamic related parameters such as wind state and Froude number. The SAR parameters include frequency, signal polarization, mean incidence angle, image resolution, variation by scanning platform (airborne or spaceborne) of the range-to-velocity (R/V) ratio, and velocity bunching with associated shifting, smearing and azimuthal cutoff effects. We perform modeling for five wave frequency spectra and four ship models. We also compare spectra in two aspects: with Cox and Munk's probability density function (PDF), and with a novel proposed evaluation of ship wake detectability. The simulation results agree well with SAR imaging theory. The study gives a fuller understanding of radar imaging mechanisms for sea waves and ship wakes.


title: Non-flow effects in correlation between harmonic flow and transverse momentum in nuclear collisions

abstract: A large anti-correlation signal between elliptic flow $v_2$ and average transverse momentum $[p_{\mathrm{T}}]$ was recently measured in small collision systems, consistent with a final-state hydrodynamic response to the initial geometry. This negative $v_2$-$[p_{\mathrm{T}}]$ correlation was predicted to change to positive correlation for events with very small charged particle multiplicity $N_{\mathrm{ch}}$ due to initial-state momentum anisotropies of the gluon saturation effects. However, the role of non-flow correlations is expected to be important in these systems, which is not yet studied. We estimate the non-flow effects in $pp$, $p$Pb and peripheral PbPb collisions using {\tt Pythia} and {\tt Hijing} models, and compare them with the experimental data. We show that the non-flow effects are largely suppressed using the rapidity-separated subevent cumulant method (details of the cumulant framework are also provided). The magnitude of the residual non-flow is much less than the experimental observation in the higher $N_{\mathrm{ch}}$ region, supporting the final-state response interpretation. In the very low $N_{\mathrm{ch}}$ region, however, the sign and magnitude of the residual non-flow depend on the model details. Therefore, it is unclear at this moment whether the sign change of $v_2$-$[p_{\mathrm{T}}]$ can serve as evidence for initial state momentum anisotropies predicted by the gluon saturation.


title: Refactoring Practices in the Context of Modern Code Review: An Industrial Case Study at Xerox

abstract: Modern code review is a common and essential practice employed in both industrial and open-source projects to improve software quality, share knowledge, and ensure conformance with coding standards. During code review, developers may inspect and discuss various changes including refactoring activities before merging code changes in the codebase. To date, code review has been extensively studied to explore its general challenges, best practices and outcomes, and socio-technical aspects. However, little is known about how refactoring activities are being reviewed, perceived, and practiced. This study aims to reveal insights into how reviewers develop a decision about accepting or rejecting a submitted refactoring request, and what makes such review challenging. We present an industrial case study with 24 professional developers at Xerox. Particularly, we study the motivations, documentation practices, challenges, verification, and implications of refactoring activities during code review. Our study delivers several important findings. Our results report the lack of a proper procedure to follow by developers when documenting their refactorings for review. Our survey with reviewers has also revealed several difficulties related to understanding the refactoring intent and implications on the functional and non-functional aspects of the software. In light of our findings, we recommended a procedure to properly document refactoring activities, as part of our survey feedback.


title: Rigity results on $\rho$-Einstein solitons with zero scalar curvature

abstract: In this paper we show that a $\rho$-Einstein solitons conformal to a pseudo-Euclidean space, invariant under the action of the pseudo-orthogonal group with zero scalar curvature is stady and consequently flat. How application of the results obtained we present an explicit example for a the question proposed by Kazdan in [17].


title: Star-topology Registers: NMR and Quantum Information Perspectives

abstract: Quantum control of large spin registers is crucial for many applications ranging from spectroscopy to quantum information. A key factor that determines the efficiency of a register for implementing a given information processing task is its network topology. One particular type, called star-topology, involves a central qubit uniformly interacting with a set of ancillary qubits. A particular advantage of the star-topology quantum registers is in the efficient preparation of large entangled states, called NOON states, and their generalized variants. Thanks to the robust generation of such correlated states, spectral simplicity, ease of polarization transfer from ancillary qubits to the central qubit, as well as the availability of large spin-clusters, the star-topology registers have been utilized for several interesting applications over the last few years. Here we review some recent progress with the star-topology registers, particularly via nuclear magnetic resonance methods.


title: NumaPerf: Predictive and Full NUMA Profiling

abstract: Parallel applications are extremely challenging to achieve the optimal performance on the NUMA architecture, which necessitates the assistance of profiling tools. However, existing NUMA-profiling tools share some similar shortcomings, such as portability, effectiveness, and helpfulness issues. This paper proposes a novel profiling tool - NumaPerf - that overcomes these issues. NumaPerf aims to identify potential performance issues for any NUMA architecture, instead of only on the current hardware. To achieve this, NumaPerf focuses on memory sharing patterns between threads, instead of real remote accesses. NumaPerf further detects potential thread migrations and load imbalance issues that could significantly affect the performance but are omitted by existing profilers. NumaPerf also separates cache coherence issues that may require different fix strategies. Based on our extensive evaluation, NumaPerf is able to identify more performance issues than any existing tool, while fixing these bugs leads to up to 5.94x performance speedup.


title: Spectrum of Weighted Composition Operators Part VII Essential spectra of weighted composition operators on $C(K)$. The case of non-invertible homeomorphisms

abstract: We provide a complete description of the spectrum and the essential spectra of weighted composition operators $T=wT_\varphi$ on $C(K)$ in the case when the map $\varphi$ is a non-invertible homeomorphism of $K$ into itself.


title: Microwave Sensing of Andreev Bound States in a Gate-Defined Superconducting Quantum Point Contact

abstract: We use a superconducting microresonator as a cavity to sense absorption of microwaves by a superconducting quantum point contact defined by surface gates over a proximitized two-dimensional electron gas. Renormalization of the cavity frequency with phase difference across the point contact is consistent with adiabatic coupling to Andreev bound states. Near $\pi$ phase difference, we observe random fluctuations in absorption with gate voltage, related to quantum interference-induced modulations in the electron transmission. We identify features consistent with the presence of single Andreev bound states and describe the Andreev-cavity interaction using a dispersive Jaynes-Cummings model. By fitting the weak Andreev-cavity coupling, we extract ~GHz decoherence consistent with charge noise and the transmission dispersion associated with a localized state.


title: Transfer Reinforcement Learning across Homotopy Classes

abstract: The ability for robots to transfer their learned knowledge to new tasks -- where data is scarce -- is a fundamental challenge for successful robot learning. While fine-tuning has been well-studied as a simple but effective transfer approach in the context of supervised learning, it is not as well-explored in the context of reinforcement learning. In this work, we study the problem of fine-tuning in transfer reinforcement learning when tasks are parameterized by their reward functions, which are known beforehand. We conjecture that fine-tuning drastically underperforms when source and target trajectories are part of different homotopy classes. We demonstrate that fine-tuning policy parameters across homotopy classes compared to fine-tuning within a homotopy class requires more interaction with the environment, and in certain cases is impossible. We propose a novel fine-tuning algorithm, Ease-In-Ease-Out fine-tuning, that consists of a relaxing stage and a curriculum learning stage to enable transfer learning across homotopy classes. Finally, we evaluate our approach on several robotics-inspired simulated environments and empirically verify that the Ease-In-Ease-Out fine-tuning method can successfully fine-tune in a sample-efficient way compared to existing baselines.


title: Attentive Gaussian processes for probabilistic time-series generation

abstract: The transduction of sequence has been mostly done by recurrent networks, which are computationally demanding and often underestimate uncertainty severely. We propose a computationally efficient attention-based network combined with the Gaussian process regression to generate real-valued sequence, which we call the Attentive-GP. The proposed model not only improves the training efficiency by dispensing recurrence and convolutions but also learns the factorized generative distribution with Bayesian representation. However, the presence of the GP precludes the commonly used mini-batch approach to the training of the attention network. Therefore, we develop a block-wise training algorithm to allow mini-batch training of the network while the GP is trained using full-batch, resulting in a scalable training method. The algorithm has been proved to converge and shows comparable, if not better, quality of the found solution. As the algorithm does not assume any specific network architecture, it can be used with a wide range of hybrid models such as neural networks with kernel machine layers in the scarcity of resources for computation and memory.


title: Learning k-qubit Quantum Operators via Pauli Decomposition

abstract: Motivated by the limited qubit capacity of current quantum systems, we study the quantum sample complexity of $k$-qubit quantum operators, i.e., operations applicable on only $k$ out of $d$ qubits. The problem is studied according to the quantum probably approximately correct (QPAC) model abiding by quantum mechanical laws such as no-cloning, state collapse, and measurement incompatibility. With the delicacy of quantum samples and the richness of quantum operations, one expects a significantly larger quantum sample complexity. This paper proves the contrary. We show that the quantum sample complexity of $k$-qubit quantum operations is comparable to the classical sample complexity of their counterparts (juntas), at least when $\frac{k}{d}\ll 1$. This is surprising, especially since sample duplication is prohibited, and measurement incompatibility would lead to an exponentially larger sample complexity with standard methods. Our approach is based on the Pauli decomposition of quantum operators and a technique that we name Quantum Shadow Sampling (QSS) to reduce the sample complexity exponentially. The results are proved by developing (i) a connection between the learning loss and the Pauli decomposition; (ii) a scalable QSS circuit for estimating the Pauli coefficients; and (iii) a quantum algorithm for learning $k$-qubit operators with sample complexity $O(\frac{k4^k}{\epsilon^2}\log d)$.


title: D2A U-Net: Automatic Segmentation of COVID-19 Lesions from CT Slices with Dilated Convolution and Dual Attention Mechanism

abstract: Coronavirus Disease 2019 (COVID-19) has caused great casualties and becomes almost the most urgent public health events worldwide. Computed tomography (CT) is a significant screening tool for COVID-19 infection, and automated segmentation of lung infection in COVID-19 CT images will greatly assist diagnosis and health care of patients. However, accurate and automatic segmentation of COVID-19 lung infections remains to be challenging. In this paper we propose a dilated dual attention U-Net (D2A U-Net) for COVID-19 lesion segmentation in CT slices based on dilated convolution and a novel dual attention mechanism to address the issues above. We introduce a dilated convolution module in model decoder to achieve large receptive field, which refines decoding process and contributes to segmentation accuracy. Also, we present a dual attention mechanism composed of two attention modules which are inserted to skip connection and model decoder respectively. The dual attention mechanism is utilized to refine feature maps and reduce semantic gap between different levels of the model. The proposed method has been evaluated on open-source dataset and outperforms cutting edges methods in semantic segmentation. Our proposed D2A U-Net with pretrained encoder achieves a Dice score of 0.7298 and recall score of 0.7071. Besides, we also build a simplified D2A U-Net without pretrained encoder to provide a fair comparison with other models trained from scratch, which still outperforms popular U-Net family models with a Dice score of 0.7047 and recall score of 0.6626. Our experiment results have shown that by introducing dilated convolution and dual attention mechanism, the number of false positives is significantly reduced, which improves sensitivity to COVID-19 lesions and subsequently brings significant increase to Dice score.


title: Delay-Phase Precoding for Wideband THz Massive MIMO

abstract: Benefiting from tens of GHz bandwidth, terahertz (THz) communication is considered to be a promising technology to provide ultra-high speed data rates for future 6G wireless systems. To compensate for the serious propagation attenuation of THz signals, massive multiple-input multiple-output (MIMO) with hybrid precoding can be utilized to generate directional beams with high array gains. However, the standard hybrid precoding architecture based on frequency-independent phase-shifters cannot cope with the beam split effect in THz massive MIMO systems, where the directional beams will split into different physical directions at different subcarrier frequencies. The beam split effect will result in a serious array gain loss across the entire bandwidth, which has not been well investigated in THz massive MIMO systems. In this paper, we first reveal and quantify the seriousness of the beam split effect in THz massive MIMO systems by analyzing the array gain loss it causes. Then, we propose a new precoding architecture called delay-phase precoding (DPP) to mitigate this effect. Specifically, the proposed DPP introduces a time delay network as a new precoding layer between radio-frequency chains and phase-shifters in the standard hybrid precoding architecture. In this way, conventional phase-controlled analog beamforming can be converted into delay-phase controlled analog beamforming. Unlike frequency-independent phase shifts, the time delay network introduced in the DPP can realize frequency-dependent phase shifts, which can be designed to generate frequency-dependent beams towards the target physical direction across the entire THz bandwidth. Due to the joint control of delay and phase, the proposed DPP can significantly relieve the array gain loss caused by the beam split effect. Furthermore, we propose a hardware structure by using true-time-delayers to realize the concept of DPP.


title: Polarimetric Monocular Dense Mapping Using Relative Deep Depth Prior

abstract: This paper is concerned with polarimetric dense map reconstruction based on a polarization camera with the help of relative depth information as a prior. In general, polarization imaging is able to reveal information about surface normal such as azimuth and zenith angles, which can support the development of solutions to the problem of dense reconstruction, especially in texture-poor regions. However, polarimetric shape cues are ambiguous due to two types of polarized reflection (specular/diffuse). Although methods have been proposed to address this issue, they either are offline and therefore not practical in robotics applications, or use incomplete polarimetric cues, leading to sub-optimal performance. In this paper, we propose an online reconstruction method that uses full polarimetric cues available from the polarization camera. With our online method, we can propagate sparse depth values both along and perpendicular to iso-depth contours. Through comprehensive experiments on challenging image sequences, we demonstrate that our method is able to significantly improve the accuracy of the depthmap as well as increase its density, specially in regions of poor texture.


title: Small scale formations in the incompressible porous media equation

abstract: We construct examples of solutions to the incompressible porous media (IPM) equation that must exhibit infinite in time growth of derivatives provided they remain smooth. As an application, this allows us to obtain nonlinear instability for a class of stratified steady states of IPM.


title: Task-Optimal Exploration in Linear Dynamical Systems

abstract: Exploration in unknown environments is a fundamental problem in reinforcement learning and control. In this work, we study task-guided exploration and determine what precisely an agent must learn about their environment in order to complete a particular task. Formally, we study a broad class of decision-making problems in the setting of linear dynamical systems, a class that includes the linear quadratic regulator problem. We provide instance- and task-dependent lower bounds which explicitly quantify the difficulty of completing a task of interest. Motivated by our lower bound, we propose a computationally efficient experiment-design based exploration algorithm. We show that it optimally explores the environment, collecting precisely the information needed to complete the task, and provide finite-time bounds guaranteeing that it achieves the instance- and task-optimal sample complexity, up to constant factors. Through several examples of the LQR problem, we show that performing task-guided exploration provably improves on exploration schemes which do not take into account the task of interest. Along the way, we establish that certainty equivalence decision making is instance- and task-optimal, and obtain the first algorithm for the linear quadratic regulator problem which is instance-optimal. We conclude with several experiments illustrating the effectiveness of our approach in practice.


title: Fast deterministic approximation of symmetric indefinite kernel matrices with high dimensional datasets

abstract: Kernel methods are used frequently in various applications of machine learning. For large-scale high dimensional applications, the success of kernel methods hinges on the ability to operate certain large dense kernel matrix K. An enormous amount of literature has been devoted to the study of symmetric positive semi-definite (SPSD) kernels, where Nystrom methods compute a low-rank approximation to the kernel matrix via choosing landmark points. In this paper, we study the Nystrom method for approximating both symmetric indefinite kernel matrices as well SPSD ones. We first develop a theoretical framework for general symmetric kernel matrices, which provides a theoretical guidance for the selection of landmark points. We then leverage discrepancy theory to propose the anchor net method for computing accurate Nystrom approximations with optimal complexity. The anchor net method operates entirely on the dataset without requiring the access to $K$ or its matrix-vector product. Results on various types of kernels (both indefinite and SPSD ones) and machine learning datasets demonstrate that the new method achieves better accuracy and stability with lower computational cost compared to the state-of-the-art Nystrom methods.


title: VINS: Visual Search for Mobile User Interface Design

abstract: Searching for relative mobile user interface (UI) design examples can aid interface designers in gaining inspiration and comparing design alternatives. However, finding such design examples is challenging, especially as current search systems rely on only text-based queries and do not consider the UI structure and content into account. This paper introduces VINS, a visual search framework, that takes as input a UI image (wireframe, high-fidelity) and retrieves visually similar design examples. We first survey interface designers to better understand their example finding process. We then develop a large-scale UI dataset that provides an accurate specification of the interface's view hierarchy (i.e., all the UI components and their specific location). By utilizing this dataset, we propose an object-detection based image retrieval framework that models the UI context and hierarchical structure. The framework achieves a mean Average Precision of 76.39\% for the UI detection and high performance in querying similar UI designs.


title: Inverse scattering on the quantum graph for graphene

abstract: We consider the inverse scattering on the quantum graph associated with the hexagonal lattice. Assuming that the potentials on the edges are compactly supported and symmetric, we show that the S-matrix for all energies in any given open set in the continuous spectrum determines the potentials.


title: FLOP: Federated Learning on Medical Datasets using Partial Networks

abstract: The outbreak of COVID-19 Disease due to the novel coronavirus has caused a shortage of medical resources. To aid and accelerate the diagnosis process, automatic diagnosis of COVID-19 via deep learning models has recently been explored by researchers across the world. While different data-driven deep learning models have been developed to mitigate the diagnosis of COVID-19, the data itself is still scarce due to patient privacy concerns. Federated Learning (FL) is a natural solution because it allows different organizations to cooperatively learn an effective deep learning model without sharing raw data. However, recent studies show that FL still lacks privacy protection and may cause data leakage. We investigate this challenging problem by proposing a simple yet effective algorithm, named \textbf{F}ederated \textbf{L}earning \textbf{o}n Medical Datasets using \textbf{P}artial Networks (FLOP), that shares only a partial model between the server and clients. Extensive experiments on benchmark data and real-world healthcare tasks show that our approach achieves comparable or better performance while reducing the privacy and security risks. Of particular interest, we conduct experiments on the COVID-19 dataset and find that our FLOP algorithm can allow different hospitals to collaboratively and effectively train a partially shared model without sharing local patients' data.


title: Neural Network flows of low q-state Potts and clock Models

abstract: It is known that a trained Restricted Boltzmann Machine (RBM) on the binary Monte Carlo Ising spin configurations, generates a series of iterative reconstructed spin configurations which spontaneously flow and stabilize to the critical point of physical system. Here we construct a variety of Neural Network (NN) flows using the RBM and (variational) autoencoders, to study the q-state Potts and clock models on the square lattice for q = 2, 3, 4. The NN are trained on Monte Carlo spin configurations at various temperatures. We find that the trained NN flow does develop a stable point that coincides with critical point of the q-state spin models. The behavior of the NN flow is nontrivial and generative, since the training is unsupervised and without any prior knowledge about the critical point and the Hamiltonian of the underlying spin model. Moreover, we find that the convergence of the flow is independent of the types of NNs and spin models, hinting a universal behavior. Our results strengthen the potential applicability of the notion of the NN flow in studying various states of matter and offer additional evidence on the connection with the Renormalization Group flow.


title: Study of the $\eta$ to $\pi^0$ Ratio in Heavy-Ion Collisions

abstract: We demonstrate that the $p_T$ dependence of the $\eta/\pi^0$ ratio is universal within a few percent for high energy $p$+$p$, $p$+A and $d$+A collisions, over a broad range of collision energies. The $\eta/\pi^0$ ratio increases with $p_T$ up to 4 to 5 GeV/$c$ where it saturates at a nearly constant value of 0.487$\pm$0.024. Above $p_T = 5$ GeV/$c$ the same constant value is also observed in A+A collisions independent of collision system, energy, and centrality. At lower $p_T$, where accurate $\eta/\pi^0$ data is absent for A+A collisions, we estimate possible deviations from the universal behavior, which could arise due to the rapid radial hydrodynamic expansion of the A+A collision system. For A+A collisions at RHIC we find that possible deviations are limited to the $p_T$ range from 0.4 to 3 GeV/$c$, and remain less than 20% for the most central collisions.


title: Early Abandoning and Pruning for Elastic Distances including Dynamic Time Warping

abstract: Nearest neighbor search under elastic distances is a key tool for time series analysis, supporting many applications. However, straightforward implementations of distances require $O(n^2)$ space and time complexities, preventing these applications from scaling to long series. Much work has been devoted to speeding up the NN search process, mostly with the development of lower bounds, allowing to avoid costly distance computations when a given threshold is exceeded. This threshold, provided by the similarity search process, also allows to early abandon the computation of a distance itself. Another approach, is to prune parts of the computation. All these techniques are othogonal to each other. In this work, we develop a new generic strategy, "EAPruned", that tightly integrates pruning with early abandoning. We apply it to six elastic distance measures: DTW, CDTW, WDTW, ERP, MSM and TWE, showing substantial speedup in NN search applications. Pruning alone also shows substantial speedup for some distances, benefiting applications beyond the scope of NN search (e.g. requiring all pairwise distances), and hence where early abandoning is not applicable. We~release our implementation as part of a new C++ library for time series classification, along with easy to use Python/Numpy bindings.


title: The Rayleigh collapse of two spherical bubbles

abstract: The inertial collapse of two interacting and non-translating spherical bubbles of equal size is considered. The exact analytic solution to the nonlinear ordinary differential equation that governs the bubble radii during collapse is first obtained via a slowly converging power series. An asymptotic approximant is then constructed that accelerates convergence of the series and imposes the asymptotic collapse behavior when the radii are small. The solution generalizes the classical 1917 Rayleigh problem of single bubble collapse, as this configuration is recovered when the distance between the bubble centers far exceeds that of their radii.


title: Bayesian Knockoff Filter

abstract: In many scientific fields, researchers are interested in discovering features with substantial effect on the response from a large number of features while controlling the proportion of false discoveries. By incorporating the knockoff procedure in the Bayesian framework, we develop the Bayesian knockoff filter (BKF) for selecting features that have important effect on the response. In contrast to the fixed knockoff variables in a frequentist procedure, we allow the knockoff variables to be continuously updated using the Markov chain Monte Carlo. Based on the posterior samples and the elaborated greedy selection procedure, our method can distinguish the truly important features from unimportant ones and the Bayesian false discovery rate can be controlled at a desirable level. Numerical experiments on both synthetic and real data demonstrate the advantages of our BKF over existing knockoff methods and Bayesian variable selection approaches, i.e., the BKF possesses higher power and yields a lower false discovery rate.


title: Downlink Channel Reconstruction for Spatial Multiplexing in Massive MIMO Systems

abstract: To get channel state information (CSI) at a base station (BS), most of researches on massive multiple-input multiple-output (MIMO) systems consider time division duplexing (TDD) to get benefit from the uplink and downlink channel reciprocity. Even in TDD, however, the BS still needs to transmit downlink training signals, which are referred to as channel state information reference signals (CSI-RSs) in the 3GPP standard, to support spatial multiplexing in practice. This is because there are many cases that the number of transmit antennas is less than the number of receive antennas at a user equipment (UE) due to power consumption and circuit complexity issues. Because of this mismatch, uplink sounding reference signals (SRSs) from the UE are not enough for the BS to obtain full downlink MIMO CSI. Therefore, after receiving the downlink CSI-RSs, the UE needs to feed back quantized CSI to the BS using a pre-defined codebook to support spatial multiplexing. In this paper, possible approaches to reconstruct full downlink MIMO CSI at the BS are proposed by exploiting both the SRS and quantized downlink CSI considering practical antenna structures with reduced downlink CSI-RS overhead. Numerical results show that the spectral efficiencies by spatial multiplexing based on the proposed downlink MIMO CSI reconstruction techniques outperform the conventional methods solely based on the quantized CSI.


title: Exploring Automatic COVID-19 Diagnosis via voice and symptoms from Crowdsourced Data

abstract: The development of fast and accurate screening tools, which could facilitate testing and prevent more costly clinical tests, is key to the current pandemic of COVID-19. In this context, some initial work shows promise in detecting diagnostic signals of COVID-19 from audio sounds. In this paper, we propose a voice-based framework to automatically detect individuals who have tested positive for COVID-19. We evaluate the performance of the proposed framework on a subset of data crowdsourced from our app, containing 828 samples from 343 participants. By combining voice signals and reported symptoms, an AUC of $0.79$ has been attained, with a sensitivity of $0.68$ and a specificity of $0.82$. We hope that this study opens the door to rapid, low-cost, and convenient pre-screening tools to automatically detect the disease.


title: Optimal Design of Membrane Cascades for Gaseous and Liquid Mixtures via MINLP

abstract: Given the growing concern of reducing CO2 emissions, it is desirable to identify, for a given separation carried out through a membrane cascade, the optimum design that yields the lowest energy consumption. Nevertheless, designing a membrane cascade is challenging since, there are often multiple feasible configurations that differ in their energy consumption and cost. In this work, we develop a Mixed Integer Non-linear Program (MINLP) that, for a given binary separation, which may be either liquid or gaseous, finds the cascade and its operating conditions that minimize energy consumption. To model the separation at each membrane in the cascade, we utilize the analytical solution of a system of differential and algebraic equations derived from the crossflow model and the solution-diffusion theory. We provide numerical evidence which shows that our single-stage membrane model accurately predicts experimental data. Unfortunately, the resulting membrane model is non-convex and, even state-of-the-art solvers struggle to prove global optimality of the cascades and the operating conditions identified. In this paper, we derive various cuts that help with relaxation quality and, consequently, accelerate convergence of branch-and-bound based solvers. More specifically, we demonstrate, on various examples, that our cuts help branch-and-bound solvers converge within 5\% optimality gap in a reasonable amount of time and such a tolerance level was not achieved by a simple formulation of the membrane model. The proposed optimization model is an easy-to-use tool for practitioners and researchers to design energy efficient membrane cascades.


title: Continuous Variable Quantum Advantages and Applications in Quantum Optics

abstract: This thesis focuses on three main questions in the continuous variable and optical settings: where does a quantum advantage, that is, the ability of quantum machines to outperform classical machines, come from? How to ensure the proper functioning of a quantum machine? What advantages can be gained in practice from the use of quantum information? Quantum advantage in continuous variable comes in particular from the use of so-called non-Gaussian quantum states. We introduce the stellar formalism to characterize these states. We then study the transition from classically simulable models to models which are universal for quantum computing. We show that quantum computational supremacy, the dramatic speedup of quantum computers over their classical counterparts, may be realised with non-Gaussian states and Gaussian measurements. Quantum certification denotes the methods seeking to verify the correct functioning of a quantum machine. We consider certification of quantum states in continuous variable, introducing several protocols according to the assumptions made on the tested state. We develop efficient methods for the verification of a large class of multimode quantum states, including the output states of the Boson Sampling model, enabling the experimental verification of quantum supremacy with photonic quantum computing. We give several new examples of practical applications of quantum information in linear quantum optics. Generalising the swap test, we highlight a connection between the ability to distinguish two quantum states and the ability to perform universal programmable quantum measurements, for which we give various implementations in linear optics, based on the use of single photons or coherent states. Finally, we obtain, thanks to linear optics, the first implementation of a quantum protocol for weak coin flipping, a building block for many cryptographic applications.


title: Towards Better Explanations of Class Activation Mapping

abstract: Increasing demands for understanding the internal behavior of convolutional neural networks (CNNs) have led to remarkable improvements in explanation methods. Particularly, several class activation mapping (CAM) based methods, which generate visual explanation maps by a linear combination of activation maps from CNNs, have been proposed. However, the majority of the methods lack a clear theoretical basis on how they assign the coefficients of the linear combination. In this paper, we revisit the intrinsic linearity of CAM with respect to the activation maps; we construct an explanation model of CNN as a linear function of binary variables that denote the existence of the corresponding activation maps. With this approach, the explanation model can be determined by additive feature attribution methods in an analytic manner. We then demonstrate the adequacy of SHAP values, which is a unique solution for the explanation model with a set of desirable properties, as the coefficients of CAM. Since the exact SHAP values are unattainable, we introduce an efficient approximation method, LIFT-CAM, based on DeepLIFT. Our proposed LIFT-CAM can estimate the SHAP values of the activation maps with high speed and accuracy. Furthermore, it greatly outperforms other previous CAM-based methods in both qualitative and quantitative aspects.


title: Sequential vessel segmentation via deep channel attention network

abstract: This paper develops a novel encoder-decoder deep network architecture which exploits the several contextual frames of 2D+t sequential images in a sliding window centered at current frame to segment 2D vessel masks from the current frame. The architecture is equipped with temporal-spatial feature extraction in encoder stage, feature fusion in skip connection layers and channel attention mechanism in decoder stage. In the encoder stage, a series of 3D convolutional layers are employed to hierarchically extract temporal-spatial features. Skip connection layers subsequently fuse the temporal-spatial feature maps and deliver them to the corresponding decoder stages. To efficiently discriminate vessel features from the complex and noisy backgrounds in the XCA images, the decoder stage effectively utilizes channel attention blocks to refine the intermediate feature maps from skip connection layers for subsequently decoding the refined features in 2D ways to produce the segmented vessel masks. Furthermore, Dice loss function is implemented to train the proposed deep network in order to tackle the class imbalance problem in the XCA data due to the wide distribution of complex background artifacts. Extensive experiments by comparing our method with other state-of-the-art algorithms demonstrate the proposed method's superior performance over other methods in terms of the quantitative metrics and visual validation. The source codes are at https://github.com/Binjie-Qin/SVS-net


title: GitHub Discussions: An Exploratory Study of Early Adoption

abstract: Discussions is a new feature of GitHub for asking questions or discussing topics outside of specific Issues or Pull Requests. Before being available to all projects in December 2020, it had been tested on selected open source software projects. To understand how developers use this novel feature, how they perceive it, and how it impacts the development processes, we conducted a mixed-methods study based on early adopters of GitHub discussions from January until July 2020. We found that: (1) errors, unexpected behavior, and code reviews are prevalent discussion categories; (2) there is a positive relationship between project member involvement and discussion frequency; (3) developers consider GitHub Discussions useful but face the problem of topic duplication between Discussions and Issues; (4) Discussions play a crucial role in advancing the development of projects; and (5) positive sentiment in Discussions is more frequent than in Stack Overflow posts. Our findings are a first step towards data-informed guidance for using GitHub Discussions, opening up avenues for future work on this novel communication channel.


title: Culture-inspired Multi-modal Color Palette Generation and Colorization: A Chinese Youth Subculture Case

abstract: Color is an essential component of graphic design, acting not only as a visual factor but also carrying cultural implications. However, existing research on algorithmic color palette generation and colorization largely ignores the cultural aspect. In this paper, we contribute to this line of research by first constructing a unique color dataset inspired by a specific culture, i.e., Chinese Youth Subculture (CYS), which is an vibrant and trending cultural group especially for the Gen Z population. We show that the colors used in CYS have special aesthetic and semantic characteristics that are different from generic color theory. We then develop an interactive multi-modal generative framework to create CYS-styled color palettes, which can be used to put a CYS twist on images using our automatic colorization model. Our framework is illustrated via a demo system designed with the human-in-the-loop principle that constantly provides feedback to our algorithms. User studies are also conducted to evaluate our generation results.


title: Extracting Rationale for Open Source Software Development Decisions -- A Study of Python Email Archives

abstract: A sound Decision-Making (DM) process is key to the successful governance of software projects. In many Open Source Software Development (OSSD) communities, DM processes lie buried amongst vast amounts of publicly available data. Hidden within this data lie the rationale for decisions that led to the evolution and maintenance of software products. While there have been some efforts to extract DM processes from publicly available data, the rationale behind how the decisions are made have seldom been explored. Extracting the rationale for these decisions can facilitate transparency (by making them known), and also promote accountability on the part of decision-makers. This work bridges this gap by means of a large-scale study that unearths the rationale behind decisions from Python development email archives comprising about 1.5 million emails. This paper makes two main contributions. First, it makes a knowledge contribution by unearthing and presenting the rationale behind decisions made. Second, it makes a methodological contribution by presenting a heuristics-based rationale extraction system called Rationale Miner that employs multiple heuristics, and follows a data-driven, bottom-up approach to infer the rationale behind specific decisions (e.g., whether a new module is implemented based on core developer consensus or benevolent dictator's pronouncement). Our approach can be applied to extract rationale in other OSSD communities that have similar governance structures.


title: Scale interactions in turbulent plane Couette flows in minimal domains

abstract: Interscale energy transfer in wall turbulence has been intensively studied in recent years, and both the forward (i.e. from larger to smaller scales) and reversed transfers of turbulent energy have been found whereas their corresponding physical phenomena have not been revealed. In the present study, we perform DNS of turbulent plane Couette flow with reduced-size computational domains, where either the streamwise or spanwise domain size is reduced to their minimal lengths, aiming at elucidating the role of scale interactions in each direction. Our computational results with the streamwise-minimal domain suggest that the interplays between streamwise-elongated streaks and vortices smaller than the streamwise minimal length are the essential scale interactions for both the inner and outer structures. We further show that these streamwise-independent and smaller-scale structures exchange energy through forward and reversed interscale energy transfers, and the reversed energy transfer maintains the energy production at larger scales. Based on the resemblance of the observed Reynolds-stress transport and the scenario of the self-sustaining cycle, we conjecture that the forward and reversed energy transfers mainly represent the streak instabilities and regeneration of streamwise vortices, respectively. Furthermore, the computation with the spanwise-minimal domain indicates that the interscale energy transfers observed by one-dimensional spanwise spectral analysis are likely related to individual dynamics of each inner and outer structure, rather than represent their interactions.


title: Driver2vec: Driver Identification from Automotive Data

abstract: With increasing focus on privacy protection, alternative methods to identify vehicle operator without the use of biometric identifiers have gained traction for automotive data analysis. The wide variety of sensors installed on modern vehicles enable autonomous driving, reduce accidents and improve vehicle handling. On the other hand, the data these sensors collect reflect drivers' habit. Drivers' use of turn indicators, following distance, rate of acceleration, etc. can be transformed to an embedding that is representative of their behavior and identity. In this paper, we develop a deep learning architecture (Driver2vec) to map a short interval of driving data into an embedding space that represents the driver's behavior to assist in driver identification. We develop a custom model that leverages performance gains of temporal convolutional networks, embedding separation power of triplet loss and classification accuracy of gradient boosting decision trees. Trained on a dataset of 51 drivers provided by Nervtech, Driver2vec is able to accurately identify the driver from a short 10-second interval of sensor data, achieving an average pairwise driver identification accuracy of 83.1% from this 10-second interval, which is remarkably higher than performance obtained in previous studies. We then analyzed performance of Driver2vec to show that its performance is consistent across scenarios and that modeling choices are sound.


title: Advanced Ore Mine Optimisation under Uncertainty Using Evolution

abstract: In this paper, we investigate the impact of uncertainty in advanced ore mine optimisation. We consider Maptek's software system Evolution which optimizes extraction sequences based on evolutionary computation techniques and quantify the uncertainty of the obtained solutions with respect to the ore deposit based on predictions obtained by ensembles of neural networks. Furthermore, we investigate the impact of staging on the obtained optimized solutions and discuss a wide range of components for this large scale stochastic optimisation problem which allow to mitigate the uncertainty in the ore deposit while maintaining high profitability.


title: A General Framework for Revealing Human Mind with auto-encoding GANs

abstract: Addressing the question of visualising human mind could help us to find regions that are associated with observed cognition and responsible for expressing the elusive mental image, leading to a better understanding of cognitive function. The traditional approach treats brain decoding as a classification problem, reading the mind through statistical analysis of brain activity. However, human thought is rich and varied, that it is often influenced by more of a combination of object features than a specific type of category. For this reason, we propose an end-to-end brain decoding framework which translates brain activity into an image by latent space alignment. To find the correspondence from brain signal features to image features, we embedded them into two latent spaces with modality-specific encoders and then aligned the two spaces by minimising the distance between paired latent representations. The proposed framework was trained by simultaneous electroencephalogram and functional MRI data, which were recorded when the subjects were viewing or imagining a set of image stimuli. In this paper, we focused on implementing the fMRI experiment. Our experimental results demonstrated the feasibility of translating brain activity to an image. The reconstructed image matches image stimuli approximate in both shape and colour. Our framework provides a promising direction for building a direct visualisation to reveal human mind.


title: Quincke oscillations of colloids at planar electrodes

abstract: Dielectric particles in weakly conducting fluids rotate spontaneously when subject to strong electric fields. Such Quincke rotation near a plane electrode leads to particle translation that enables physical models of active matter. Here, we show that Quincke rollers can also exhibit oscillatory dynamics, whereby particles move back and forth about a fixed location. We explain how oscillations arise for micron-scale particles commensurate with the thickness of a field-induced boundary layer in the nonpolar electrolyte. This work enables the design of colloidal oscillators.


title: Concealer: SGX-based Secure, Volume Hiding, and Verifiable Processing of Spatial Time-Series Datasets

abstract: This paper proposes a system, entitled Concealer that allows sharing time-varying spatial data (e.g., as produced by sensors) in encrypted form to an untrusted third-party service provider to provide location-based applications (involving aggregation queries over selected regions over time windows) to users. Concealer exploits carefully selected encryption techniques to use indexes supported by database systems and combines ways to add fake tuples in order to realize an efficient system that protects against leakage based on output-size. Thus, the design of Concealer overcomes two limitations of existing symmetric searchable encryption (SSE) techniques: (i) it avoids the need of specialized data structures that limit usability/practicality of SSE in large scale deployments, and (ii) it avoids information leakages based on the output-size, which may leak data distributions. Experimental results validate the efficiency of the proposed algorithms over a spatial time-series dataset (collected from a smart space) and TPC-H datasets, each of 136 Million rows, the size of which prior approaches have not scaled to.


title: Very High Interfacial Thermal Conductance in Fully hBN-Encapsulated MoS2 van der Waals Heterostructure

abstract: We report experimental and computational studies of thermal transport properties in hexagonal boron nitride (hBN) encapsulated molybdenum disulfide (MoS2) structure using refined optothermal Raman techniques, and reveal very high interfacial thermal conductance between hBN and MoS2. By studying the Raman shift of hBN and MoS2 in suspended and substrate-supported thin films under varying laser power and temperature, we calibrate lateral (in-plane) thermal conductivity of hBN and MoS2 and the vertical interfacial thermal conductance in the hBN/MoS2/hBN heterostructure as well as the interfaces between heterostructure and substrate. Crucially, we have found that interfacial thermal conductance between hBN and encapsulated MoS2 is 74MW/m2K and 72MW/m2K in supported and suspended films, respectively, which are significantly higher than interfacial thermal conductance between MoS2 and other substrates. Molecular dynamics (MD) computations conducted in parallel have shown consistent results. This work provides clear evidence of significantly efficient heat dissipation in hBN/MoS2/hBN heterostructures and sheds light on building novel hBN encapsulated nanoelectronics with efficient thermal management.


title: Slow wave and truly rainbow trapping in one-way terahertz waveguide

abstract: Slow or even stop electromagnetic (EM) waves attract researchers' attentions for its potential applications in energy storage, optical buffer and nonlinearity enhancement. However, in most cases of the EM waves trapping, the EM waves are not truly trapped due to the existence of reflection. In this paper, a novel metal-semiconductor-semiconductor-metal (MSSM) structure, and a novel truly rainbow trapping in a tapered MSSM model at terahertz frequencies are demonstrated by theoretical analysis and numerical simulations. More importantly, functional devices such as optical buffer, optical switch and optical filter are achieved in our designed MSSM structure based on truly rainbow trapping theory. Owing to the property of one-way propagation, these new types of optical devices can be high-performance and are expected to be used in integrated optical circuits.


title: Detecting Localized Adversarial Examples: A Generic Approach using Critical Region Analysis

abstract: Deep neural networks (DNNs) have been applied in a wide range of applications,e.g.,face recognition and image classification; however,they are vulnerable to adversarial examples. By adding a small amount of imperceptible perturbations,an attacker can easily manipulate the outputs of a DNN. Particularly,the localized adversarial examples only perturb a small and contiguous region of the target object,so that they are robust and effective in both digital and physical worlds. Although the localized adversarial examples have more severe real-world impacts than traditional pixel attacks,they have not been well addressed in the literature. In this paper,we propose a generic defense system called TaintRadar to accurately detect localized adversarial examples via analyzing critical regions that have been manipulated by attackers. The main idea is that when removing critical regions from input images,the ranking changes of adversarial labels will be larger than those of benign labels. Compared with existing defense solutions,TaintRadar can effectively capture sophisticated localized partial attacks, e.g.,the eye-glasses attack,while not requiring additional training or fine-tuning of the original model's structure. Comprehensive experiments have been conducted in both digital and physical worlds to verify the effectiveness and robustness of our defense.


title: Patterns, predictions, and actions: A story about machine learning

abstract: This graduate textbook on machine learning tells a story of how patterns in data support predictions and consequential actions. Starting with the foundations of decision making, we cover representation, optimization, and generalization as the constituents of supervised learning. A chapter on datasets as benchmarks examines their histories and scientific bases. Self-contained introductions to causality, the practice of causal inference, sequential decision making, and reinforcement learning equip the reader with concepts and tools to reason about actions and their consequences. Throughout, the text discusses historical context and societal impact. We invite readers from all backgrounds; some experience with probability, calculus, and linear algebra suffices.


title: Quotients of the Gordian and H(2)-Gordian graphs

abstract: The Gordian graph and H(2)-Gordian graphs of knots are abstract graphs whose vertex sets represent isotopy classes of unoriented knots, and whose edge sets record whether pairs of knots are related by crossing changes or H(2)-moves, respectively. We investigate quotients of these graphs under equivalence relations defined by several knot invariants including the determinant, the span of the Jones polynomial, and an invariant related to tricolorability. We show, in all cases considered, that the quotient graphs are Gromov hyperbolic. We then prove a collection of results about the graph isomorphism type of the quotient graphs. In particular, we find that the H(2)-Gordian graph of links modulo the relation induced by the span of the Jones polynomial is isomorphic with the complete graph on infinitely many vertices.


title: Physical and kinematic conditions of the local merging galaxy NGC 1487

abstract: We present optical VLT/MUSE integral field spectroscopy data of the merging galaxy NGC 1487. We use fitting techniques to study the ionized gas emission of this merger and its main morphological and kinematical properties. We measured flat and sometimes inverted oxygen abundance gradients in the subsystems composing NGC 1487, explained by metal mixing processes common in merging galaxies. We also measured widespread star-forming bursts, indicating that photoionisation by stars is the primary ionization source of the galaxy. The kinematic map revealed a rotating pattern in the gas in the northern tail of the system, suggesting that the galaxy may be in the process of rebuilding a disc. The gas located in the central region has larger velocity dispersion ($\sigma\approx 50$ km s$^{-1}$) than the remaining regions, indicating kinematic heating, possibly owing to the ongoing interaction. Similar trends were, however, not observed in the stellar velocity-dispersion map, indicating that the galaxy has not yet achieved equilibrium, and the nebular and stellar components are still kinematically decoupled. Based on all our measurements and findings, and specially on the mass estimates, metallicity gradients and velocity fields of the system, we propose that NGC 1487 is the result of an ongoing merger event involving smallish dwarf galaxies within a group, in a pre-merger phase, resulting in a relic with mass and physical parameters similar to a dwarf galaxy. Thus, we may be witnessing the formation of a dwarf galaxy by merging of smaller clumps at z=0.


title: Low-Complexity, Real-Time Joint Neural Echo Control and Speech Enhancement Based On PercepNet

abstract: Speech enhancement algorithms based on deep learning have greatly surpassed their traditional counterparts and are now being considered for the task of removing acoustic echo from hands-free communication systems. This is a challenging problem due to both real-world constraints like loudspeaker non-linearities, and to limited compute capabilities in some communication systems. In this work, we propose a system combining a traditional acoustic echo canceller, and a low-complexity joint residual echo and noise suppressor based on a hybrid signal processing/deep neural network (DSP/DNN) approach. We show that the proposed system outperforms both traditional and other neural approaches, while requiring only 5.5% CPU for real-time operation. We further show that the system can scale to even lower complexity levels.


title: Memory-Associated Differential Learning

abstract: Conventional Supervised Learning approaches focus on the mapping from input features to output labels. After training, the learnt models alone are adapted onto testing features to predict testing labels in isolation, with training data wasted and their associations ignored. To take full advantage of the vast number of training data and their associations, we propose a novel learning paradigm called Memory-Associated Differential (MAD) Learning. We first introduce an additional component called Memory to memorize all the training data. Then we learn the differences of labels as well as the associations of features in the combination of a differential equation and some sampling methods. Finally, in the evaluating phase, we predict unknown labels by inferencing from the memorized facts plus the learnt differences and associations in a geometrically meaningful manner. We gently build this theory in unary situations and apply it on Image Recognition, then extend it into Link Prediction as a binary situation, in which our method outperforms strong state-of-the-art baselines on ogbl-ddi dataset.


title: Explicit forms of zero modes in symmetric interacting Kitaev chain without and with dimerization

abstract: The fermionic and bosonic zero modes of the 1D interacting Kitaev chain at the symmetric point are unveiled. The many-body structures of the Majorana zero modes in the topological region are given explicitly by carrying out perturbation expansion up to infinite order. We also give the analytic expressions of the bosonic zero modes in the topologically trivial phase. Our results are generalized to the hybrid fermion system comprised of the interacting Kitaev model and the Su-Schrieffer-Heeger model, in which we show that these two types of zero modes can coexist in certain region of its phase diagram.


title: A linear input dependence model for interdependent networks

abstract: We consider a linear relaxation of a generalized minimum-cost network flow problem with binary input dependencies. In this model the flows through certain arcs are bounded by linear (or more generally, piecewise linear concave) functions of the flows through other arcs. This formulation can be used to model interrelated systems in which the components of one system require the delivery of material from another system in order to function (for example, components of a subway system may require delivery of electrical power from a separate system). We propose and study randomized rounding schemes for how this model can be used to approximate solutions to a related mixed integer linear program for modeling binary input dependencies. The introduction of side constraints prevents this problem from being solved using the well-known network simplex algorithm, however by characterizing its basis structure we develop a generalization of network simplex algorithm that can be used for its {computationally} efficient solution.


title: Policy Augmentation: An Exploration Strategy for Faster Convergence of Deep Reinforcement Learning Algorithms

abstract: Despite advancements in deep reinforcement learning algorithms, developing an effective exploration strategy is still an open problem. Most existing exploration strategies either are based on simple heuristics, or require the model of the environment, or train additional deep neural networks to generate imagination-augmented paths. In this paper, a revolutionary algorithm, called Policy Augmentation, is introduced. Policy Augmentation is based on a newly developed inductive matrix completion method. The proposed algorithm augments the values of unexplored state-action pairs, helping the agent take actions that will result in high-value returns while the agent is in the early episodes. Training deep reinforcement learning algorithms with high-value rollouts leads to the faster convergence of deep reinforcement learning algorithms. Our experiments show the superior performance of Policy Augmentation. The code can be found at: https://github.com/arashmahyari/PolicyAugmentation.