title: Robust Policies For Proactive ICU Transfers

abstract: Patients whose transfer to the Intensive Care Unit (ICU) is unplanned are prone to higher mortality rates than those who were admitted directly to the ICU. Recent advances in machine learning to predict patient deterioration have introduced the possibility of \emph{proactive transfer} from the ward to the ICU. In this work, we study the problem of finding \emph{robust} patient transfer policies which account for uncertainty in statistical estimates due to data limitations when optimizing to improve overall patient care. We propose a Markov Decision Process model to capture the evolution of patient health, where the states represent a measure of patient severity. Under fairly general assumptions, we show that an optimal transfer policy has a threshold structure, i.e., that it transfers all patients above a certain severity level to the ICU (subject to available capacity). As model parameters are typically determined based on statistical estimations from real-world data, they are inherently subject to misspecification and estimation errors. We account for this parameter uncertainty by deriving a robust policy that optimizes the worst-case reward across all plausible values of the model parameters. We show that the robust policy also has a threshold structure under fairly general assumptions. Moreover, it is more aggressive in transferring patients than the optimal nominal policy, which does not take into account parameter uncertainty. We present computational experiments using a dataset of hospitalizations at 21 KNPC hospitals, and present empirical evidence of the sensitivity of various hospital metrics (mortality, length-of-stay, average ICU occupancy) to small changes in the parameters. Our work provides useful insights into the impact of parameter uncertainty on deriving simple policies for proactive ICU transfer that have strong empirical performance and theoretical guarantees.


title: Malware propagation in urban D2D networks

abstract: We introduce and analyze models for the propagation of malware in pure D2D networks given via stationary Cox-Gilbert graphs. Here, the devices form a Poisson point process with random intensity measure $\lambda\Lambda$, where $\Lambda$ is stationary and given, for example, by the edge-length measure of a realization of a Poisson-Voronoi tessellation that represents an urban street system. We assume that, at initial time, a typical device at the center of the network carries a malware and starts to infect neighboring devices after random waiting times. Here we focus on Markovian models, where the waiting times are exponential random variables, and non-Markovian models, where the waiting times feature strictly positive minimal and finite maximal waiting times. We present numerical results for the speed of propagation depending on the system parameters. In a second step, we introduce and analyze a counter measure for the malware propagation given by special devices called white knights, which have the ability, once attacked, to eliminate the malware from infected devices and turn them into white knights. Based on simulations, we isolate parameter regimes in which the malware survives or is eliminated, both in the Markovian and non-Markovian setting.


title: Coronal Dimming as a Proxy for Stellar Coronal Mass Ejections

abstract: Solar coronal dimmings have been observed extensively in the past two decades and are believed to have close association with coronal mass ejections (CMEs). Recent study found that coronal dimming is the only signature that could differentiate powerful ares that have CMEs from those that do not. Therefore, dimming might be one of the best candidates to observe the stellar CMEs on distant Sun-like stars. In this study, we investigate the possibility of using coronal dimming as a proxy to diagnose stellar CMEs. By simulating a realistic solar CME event and corresponding coronal dimming using a global magnetohydrodynamics model (AWSoM: Alfven-wave Solar Model), we first demonstrate the capability of the model to reproduce solar observations. We then extend the model for simulating stellar CMEs by modifying the input magnetic flux density as well as the initial magnetic energy of the CME flux rope. Our result suggests that with improved instrument sensitivity, it is possible to detect the coronal dimming signals induced by the stellar CMEs.


title: Mapping Motor Cortex Stimulation to Muscle Responses: A Deep Neural Network Modeling Approach

abstract: A deep neural network (DNN) that can reliably model muscle responses from corresponding brain stimulation has the potential to increase knowledge of coordinated motor control for numerous basic science and applied use cases. Such cases include the understanding of abnormal movement patterns due to neurological injury from stroke, and stimulation based interventions for neurological recovery such as paired associative stimulation. In this work, potential DNN models are explored and the one with the minimum squared errors is recommended for the optimal performance of the M2M-Net, a network that maps transcranial magnetic stimulation of the motor cortex to corresponding muscle responses, using: a finite element simulation, an empirical neural response profile, a convolutional autoencoder, a separate deep network mapper, and recordings of multi-muscle activation. We discuss the rationale behind the different modeling approaches and architectures, and contrast their results. Additionally, to obtain a comparative insight of the trade-off between complexity and performance analysis, we explore different techniques, including the extension of two classical information criteria for M2M-Net. Finally, we find that the model analogous to mapping the motor cortex stimulation to a combination of direct and synergistic connection to the muscles performs the best, when the neural response profile is used at the input.


title: The Design of Dynamic Probabilistic Caching with Time-Varying Content Popularity

abstract: In this paper, we design dynamic probabilistic caching for the scenario when the instantaneous content popularity may vary with time while it is possible to predict the average content popularity over a time window. Based on the average content popularity, optimal content caching probabilities can be found, e.g., from solving optimization problems, and existing results in the literature can implement the optimal caching probabilities via static content placement. The objective of this work is to design dynamic probabilistic caching that: i) converge (in distribution) to the optimal content caching probabilities under time-invariant content popularity, and ii) adapt to the time-varying instantaneous content popularity under time-varying content popularity. Achieving the above objective requires a novel design of dynamic content replacement because static caching cannot adapt to varying content popularity while classic dynamic replacement policies, such as LRU, cannot converge to target caching probabilities (as they do not exploit any content popularity information). We model the design of dynamic probabilistic replacement policy as the problem of finding the state transition probability matrix of a Markov chain and propose a method to generate and refine the transition probability matrix. Extensive numerical results are provided to validate the effectiveness of the proposed design.


title: Study of Two-Photon Exchange via the Beam Transverse Single Spin Asymmetry in Electron-Proton Elastic Scattering at Forward Angles over a Wide Energy Range

abstract: We report on a new measurement of the beam transverse single spin asymmetry in electron-proton elastic scattering, $A^{ep}_{\perp}$, at five beam energies from 315.1 MeV to 1508.4 MeV and at a scattering angle of $30^{\circ} < \theta < 40^{\circ}$. The covered $Q^2$ values are 0.032, 0.057, 0.082, 0.218, 0.613 (GeV/c)$^2$. The measurement clearly indicates significant inelastic contributions to the two-photon-exchange (TPE) amplitude in the low-$Q^2$ kinematic region. No theoretical calculation is able to reproduce our result. Comparison with a calculation based on unitarity, which only takes into account elastic and $\mathrm{\pi N}$ inelastic intermediate states, suggests that there are other inelastic intermediate states such as $\mathrm{\pi \pi N}$, $\mathrm{K \Lambda}$ and $\mathrm{\eta N}$. Covering a wide energy range, our new high-precision data provide a benchmark to study those intermediate states.


title: Polytopes associated with lattices of subsets and maximising expectation of random variables

abstract: The present paper originated from a problem in Financial Mathematics concerned with calculating the value of a European call option based on multiple assets each following the binomial model. The model led to an interesting family of polytopes $P(b)$ associated with the power-set $\mathcal{L} = \wp\{1,\dots,m\}$ and parameterized by $b \in \mathbb{R}^m$, each of which is a collection of probability density function on $\mathcal{L}$. For each non-empty $P(b)$ there results a family of probability measures on $\mathcal{L}^n$ and, given a function $F \colon \mathcal{L}^n \to \mathbb{R}$, our goal is to find among these probability measures one which maximises (resp. minimises) the expectation of $F$. In this paper we identify a family of such functions $F$, all of whose expectations are maximised (resp. minimised under some conditions) by the same {\em product} probability measure defined by a distinguished vertex of $P(b)$ called the supervertex (resp. the subvertex). The pay-offs of European call options belong to this family of functions.


title: Cache Allocations for Consecutive Requests of Categorized Contents: Service Provider's Perspective

abstract: In wireless caching networks, a user generally has a concrete purpose of consuming contents in a certain preferred category, and requests multiple contents in sequence. While most existing research on wireless caching and delivery has focused only on one-shot requests, the popularity distribution of contents requested consecutively is definitely different from the one-shot request and has been not considered. Also, especially from the perspective of the service provider, it is advantageous for users to consume as many contents as possible. Thus, this paper proposes two cache allocation policies for categorized contents and consecutive user demands, which maximize 1) the cache hit rate and 2) the number of consecutive content consumption, respectively. Numerical results show how categorized contents and consecutive content requests have impacts on the cache allocation.


title: Proportional Fairness through Dual Connectivity in Heterogeneous Networks

abstract: Proportional Fair (PF) is a scheduling technique to maintain a balance between maximizing throughput and ensuring fairness to users. Dual Connectivity (DC) technique was introduced by the 3rd Generation Partnership Project (3GPP) to improve the mobility robustness and system capacity in heterogeneous networks. In this paper, we demonstrate the utility of DC in improving proportional fairness in the system. We propose a low complexity centralized PF scheduling scheme for DC and show that it outperforms the standard PF scheduling scheme. Since the problem of dual association of users for maximizing proportional fairness in the system is NP-hard, we propose three heuristic user association schemes for DC. We demonstrate that DC, along with the proposed PF scheme, gives remarkable gains on PF utility over single connectivity and performs almost close to the optimal PF scheme in heterogeneous networks.


title: Open5G: A Software-Defined Networking Protocol for 5G Multi-RAT Wireless Networks

abstract: Mobile Networks today comprise of multiple Radio Access Technologies (RATs), e.g., 4G LTE, Wireless Local Area Network (WLAN), and the upcoming 5G-New Radio (5G-NR). The access networks of these RATs are controlled by RAT-specific entities, e.g., the resource management function located inside an individual LTE eNB is used for the eNB control, or access controllers are used for controlling WLAN Access Points. Even in the 3GPP's 5G architecture, which has a common Core supporting multiple RATs, radio access related decisions are taken independently within individual RATs. Due to the fragmented nature of control-plane in multi-RAT Radio Access Network (RAN), a unified global view of network resources is unavailable, hindering optimized allocation of resources. It also brings complexity to the features involving multiple RATs, e.g., dual connectivity. To address these issues, we introduced an SDN-based Multi-RAT RAN architecture (SMRAN) in our earlier work [arXiv:1812.11825], where the RAN control-plane is segregated from the data-plane. As part of the SMRAN architecture, we defined a logically centralized multi-RAT RAN Controller and individual RAT-specific data-plane functions. In the current work, we define a protocol, called Open5G, to be used for control and management of the SMRAN data-plane. Open5G is based on OpenFlow (OF) and OF-Config, which are commonly used protocols in the SDN-based wired networks and data centers.


title: A Numerical Study of Bravyi-Bacon-Shor and Subsystem Hypergraph Product Codes

abstract: We provide a numerical investigation of two families of subsystem quantum codes that are related to hypergraph product codes by gauge-fixing. The first family consists of the Bravyi-Bacon-Shor (BBS) codes which have optimal code parameters for subsystem quantum codes local in 2-dimensions. The second family consists of the constant rate "generalized Shor" codes of Bacon and Cassicino \cite{bacon2006quantum}, which we re-brand as subsystem hypergraph product (SHP) codes. We show that any hypergraph product code can be obtained by entangling the gauge qubits of two SHP codes. To evaluate the performance of these codes, we simulate both small and large examples. For circuit noise, a $[[21,4,3]]$ BBS code and a $[[49,16,3]]$ SHP code have pseudthresholds of $2\times10^{-3}$ and $8\times10^{-4}$, respectively. Simulations for phenomenological noise show that large BBS and SHP codes start to outperform surface codes with similar encoding rate at physical error rates $1\times 10^{-6}$ and $4\times10^{-4}$, respectively.


title: Big Data Staging with MPI-IO for Interactive X-ray Science

abstract: New techniques in X-ray scattering science experiments produce large data sets that can require millions of high-performance processing hours per week of computation for analysis. In such applications, data is typically moved from X-ray detectors to a large parallel file system shared by all nodes of a petascale supercomputer and then is read repeatedly as different science application tasks proceed. However, this straightforward implementation causes significant contention in the file system. We propose an alternative approach in which data is instead staged into and cached in compute node memory for extended periods, during which time various processing tasks may efficiently access it. We describe here such a big data staging framework, based on MPI-IO and the Swift parallel scripting language. We discuss a range of large-scale data management issues involved in X-ray scattering science and measure the performance benefits of the new staging framework for high-energy diffraction microscopy, an important emerging application in data-intensive X-ray scattering. We show that our framework accelerates scientific processing turnaround from three months to under 10 minutes, and that our I/O technique reduces input overheads by a factor of 5 on 8K Blue Gene/Q nodes.


title: BLCS: Brain-Like based Distributed Control Security in Cyber Physical Systems

abstract: Cyber-physical system (CPS) has operated, controlled and coordinated the physical systems integrated by a computing and communication core applied in industry 4.0. To accommodate CPS services, fog radio and optical networks (F-RON) has become an important supporting physical cyber infrastructure taking advantage of both the inherent ubiquity of wireless technology and the large capacity of optical networks. However, cyber security is the biggest issue in CPS scenario as there is a tradeoff between security control and privacy exposure in F-RON. To deal with this issue, we propose a brain-like based distributed control security (BLCS) architecture for F-RON in CPS, by introducing a brain-like security (BLS) scheme. BLCS can accomplish the secure cross-domain control among tripartite controllers verification in the scenario of decentralized F-RON for distributed computing and communications, which has no need to disclose the private information of each domain against cyber-attacks. BLS utilizes parts of information to perform control identification through relation network and deep learning of behavior library. The functional modules of BLCS architecture are illustrated including various controllers and brain-like knowledge base. The interworking procedures in distributed control security modes based on BLS are described. The overall feasibility and efficiency of architecture are experimentally verified on the software defined network testbed in terms of average mistrust rate, path provisioning latency, packet loss probability and blocking probability. The emulation results are obtained and dissected based on the testbed.


title: Why Do Line Drawings Work? A Realism Hypothesis

abstract: Why is it that we can recognize object identity and 3D shape from line drawings, even though they do not exist in the natural world? This paper hypothesizes that the human visual system perceives line drawings as if they were approximately realistic images. Moreover, the techniques of line drawing are chosen to accurately convey shape to a human observer. Several implications and variants of this hypothesis are explored.


title: Stress Test Evaluation of Transformer-based Models in Natural Language Understanding Tasks

abstract: There has been significant progress in recent years in the field of Natural Language Processing thanks to the introduction of the Transformer architecture. Current state-of-the-art models, via a large number of parameters and pre-training on massive text corpus, have shown impressive results on several downstream tasks. Many researchers have studied previous (non-Transformer) models to understand their actual behavior under different scenarios, showing that these models are taking advantage of clues or failures of datasets and that slight perturbations on the input data can severely reduce their performance. In contrast, recent models have not been systematically tested with adversarial-examples in order to show their robustness under severe stress conditions. For that reason, this work evaluates three Transformer-based models (RoBERTa, XLNet, and BERT) in Natural Language Inference (NLI) and Question Answering (QA) tasks to know if they are more robust or if they have the same flaws as their predecessors. As a result, our experiments reveal that RoBERTa, XLNet and BERT are more robust than recurrent neural network models to stress tests for both NLI and QA tasks. Nevertheless, they are still very fragile and demonstrate various unexpected behaviors, thus revealing that there is still room for future improvement in this field.


title: Why Do Deep Residual Networks Generalize Better than Deep Feedforward Networks? -- A Neural Tangent Kernel Perspective

abstract: Deep residual networks (ResNets) have demonstrated better generalization performance than deep feedforward networks (FFNets). However, the theory behind such a phenomenon is still largely unknown. This paper studies this fundamental problem in deep learning from a so-called "neural tangent kernel" perspective. Specifically, we first show that under proper conditions, as the width goes to infinity, training deep ResNets can be viewed as learning reproducing kernel functions with some kernel function. We then compare the kernel of deep ResNets with that of deep FFNets and discover that the class of functions induced by the kernel of FFNets is asymptotically not learnable, as the depth goes to infinity. In contrast, the class of functions induced by the kernel of ResNets does not exhibit such degeneracy. Our discovery partially justifies the advantages of deep ResNets over deep FFNets in generalization abilities. Numerical results are provided to support our claim.


title: Weak convergence to the fractional Brownian sheet from a L\'evy sheet

abstract: In this paper, we show an approximation in law, in the space of the continuous functions on $[0,1]^2$, of two-parameter Gaussian processes that can be represented as a Wiener type integral by processes constructed from processes that converge to the Brownian sheet. As an application, we obtain a sequence of processes constructed from a L\'evy sheet that converges in law towards the fractional Brownian sheet.


title: Layered Embeddings for Amodal Instance Segmentation

abstract: The proposed method extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding across two layers such that, when clustered, the results convey the full spatial extent and depth ordering of each instance. Results demonstrate that the network can accurately estimate complete masks in the presence of occlusion and outperform leading top-down bounding-box approaches. Source code available at https://github.com/yanfengliu/layered_embeddings


title: On Extensions of Maximal Repeats in Compressed Strings

abstract: This paper provides an upper bound for several subsets of maximal repeats and maximal pairs in compressed strings and also presents a formerly unknown relationship between maximal pairs and the run-length Burrows-Wheeler transform. This relationship is used to obtain a different proof for the Burrows-Wheeler conjecture which has recently been proven by Kempa and Kociumaka in "Resolution of the Burrows-Wheeler Transform Conjecture". More formally, this paper proves that a string $S$ with $z$ LZ77-factors and without $q$-th powers has at most $73(\log_2 |S|)(z+2)^2$ runs in the run-length Burrows-Wheeler transform and the number of arcs in the compacted directed acyclic word graph of $S$ is bounded from above by $18q(1+\log_q |S|)(z+2)^2$.


title: On the strong convergence of multiple ordinary integrals to multiple Stratonovich integrals

abstract: Given $\{W^{(m)}(t), t \in [0,T]\}_{m \ge 1}$ a sequence of approximations to a standard Brownian motion $W$ in $[0,T]$ such that $W^{(m)}(t)$ converges almost surely to $W(t)$ we show that, under regular conditions on the approximations, the multiple ordinary integrals with respect to $dW^{(m)}$ converge to the multiple Stratonovich integral. We are integrating functions of the type $$f(x_1,\ldots,x_n)=f_1(x_1)\ldots f_n(x_n) I_{\{x_1\le \ldots \le x_n\}},$$ where for each $i \in \{1,\ldots,n\}$, $f_i$ has continuous derivatives in $[0,T].$ We apply this result to approximations obtained from uniform transport processes.


title: A generalized wave-vortex decomposition for rotating Boussinesq flows with arbitrary stratification

abstract: The linear wave and geostrophic (vortex) solutions are shown to be a complete basis for physical variables $(u,v,w,\rho)$ in a rotating non-hydrostatic Boussinesq model with arbitrary stratification. As a consequence, the fluid can be unambiguously separated into linear wave and geostrophic components at each instant in time, without the need for temporal filtering. The fluid can then be diagnosed for temporal changes in wave and geostrophic coefficients at each unique wavenumber and mode, including those that inevitably occur due to nonlinear interactions. We demonstrate that this methodology can be used to determine which physical interactions cause the transfer of energy between modes by projecting the nonlinear equations of motion onto the wave-vortex basis. In the particular example given, we show that an eddy in geostrophic balance superimposed with inertial oscillations at the surface transfers energy from the inertial oscillations to internal gravity wave modes. This approach can be applied more generally to determine which mechanisms are involved in energy transfers between wave and vortices, including their respective scales. Finally, we show that the nonlinear equations of motion expressed in a wave-vortex basis are computationally efficient for certain problems. In cases where stratification profiles vary strongly with depth, this approach may be an attractive alternative to traditional spectral models for rotating Boussinesq flow.


title: Influence of Modeling Methods on the Estimation of the Nonlinear Noise Statistics Considering Joint PMD and Kerr Effects in Fiber Transmission Systems

abstract: In the recent context of Software Defined Optical Network, the fast and accurate Quality of Transmission (QoT) estimation of the transmission link is essential. Gaussian Noise models are shown to yield a fast estimation of the average QoT derived from deterministic system parameters, but do not capture the QoT variability. In order to assess numerically the stochastic joint effect of Polarization Mode Dispersion (PMD) and Kerr nonlinearities, system designers generally use the Split Step Fourier Method (SSFM) based on Manakov-PMD equation neglecting the nonlinear-PMD term which is faster than using Coupled NonLinear Schrodinger Equation (CNLSE) and enough accurate for fiber with short birefringence correlation length (around less than 10m). In this work, we present insights of the way to tune the parameters of this Manakov-PMD method and its limitation when seeking an accurate estimation of the Non-Linear Interference (NLI) noise statistical distribution for all fibers potentially installed in the current optical network. In particular we compare this Manakov-PMD method results with respect to the one obtained by CNLSE while varying the fiber birefringence correlation length, PMD coefficient and the fiber type. Our results highlight a potential discrepancy of 0.5 dB in the estimation of the Q^2 factor in one span Polarization Division Multiplexed Quadrature Phase Shift Keying (PDM-QPSK) transmission with optimal launch power per channel and yield guidelines to choose the most suitable numerical estimation method.


title: Optimally weighted loss functions for solving PDEs with Neural Networks

abstract: Recent works have shown that deep neural networks can be employed to solve partial differential equations, giving rise to the framework of physics informed neural networks. We introduce a generalization for these methods that manifests as a scaling parameter which balances the relative importance of the different constraints imposed by partial differential equations. A mathematical motivation of these generalized methods is provided, which shows that for linear and well-posed partial differential equations, the functional form is convex. We then derive a choice for the scaling parameter that is optimal with respect to a measure of relative error. Because this optimal choice relies on having full knowledge of analytical solutions, we also propose a heuristic method to approximate this optimal choice. The proposed methods are compared numerically to the original methods on a variety of model partial differential equations, with the number of data points being updated adaptively. For several problems, including high-dimensional PDEs the proposed methods are shown to significantly enhance accuracy.


title: Resurgent Trans-Series for Generalized Hastings-McLeod Solutions

abstract: We show that the physical Hastings-McLeod solution of the integrable Painleve II equation generalizes in a natural way to a class of non-integrable equations, in a way that preserves many of the significant qualitative properties. We derive the trans-series structure of these generalized solutions, demonstrating that integrability is not essential for the resurgent asymptotic properties of the solutions.


title: First Principles Homogenization of Periodic Metamaterials and Application to Wire Media

abstract: Here, we present an overview of a first principles homogenization theory of periodic metamaterials. It is shown that in a rather general context it is possible to formally introduce effective parameters that describe the time evolution of macroscopic (slowly-varying in space) initial states of the electromagnetic field using an effective medium formalism. The theory is applied to different types of "wire metamaterials" characterized by a strong spatial dispersion in the long wavelength limit. It is highlighted that the spatial dispersion may tailor in unique ways the wave phenomena in wire metamaterials leading to exotic tunneling effects and broadband lossless anomalous dispersion.


title: Range of applicability of the Hu-Paz-Zhang master equation

abstract: We investigate a case of the Hu-Paz-Zhang master equation of the Caldeira-Leggett model without Lindblad form obtained in the weak-coupling limit up to the second-order perturbation. In our study, we use Gaussian initial states to be able to employ a sufficient and necessary condition, which can expose positivity violations of the density operator during the time evolution. We demonstrate that the evolution of the non-Markovian master equation has problems when the stationary solution is not a positive operator, i.e., does not have physical interpretation. We also show that solutions always remain physical for small-times of evolution. Moreover, we identify a strong anomalous behavior, when the trace of the solution is diverging. We also provide results for the corresponding Markovian master equation and show that positivity violations occur for various types of initial conditions even when the stationary solution is a positive operator. Based on our numerical results, we conclude that this non-Markovian master equation is superior to the corresponding Markovian one.


title: Collapsing and the convex hull property in a soap film capillarity model

abstract: Soap films hanging from a wire frame are studied in the framework of capillarity theory. Minimizers in the corresponding variational problem are known to consist of positive volume regions with boundaries of constant mean curvature/pressure, possibly connected by "collapsed" minimal surfaces. We prove here that collapsing only occurs if the mean curvature/pressure of the bulky regions is negative, and that, when this last property holds, the whole soap film lies in the convex hull of its boundary wire frame.


title: Single Unit Status in Deep Convolutional Neural Network Codes for Face Identification: Sparseness Redefined

abstract: Deep convolutional neural networks (DCNNs) trained for face identification develop representations that generalize over variable images, while retaining subject (e.g., gender) and image (e.g., viewpoint) information. Identity, gender, and viewpoint codes were studied at the "neural unit" and ensemble levels of a face-identification network. At the unit level, identification, gender classification, and viewpoint estimation were measured by deleting units to create variably-sized, randomly-sampled subspaces at the top network layer. Identification of 3,531 identities remained high (area under the ROC approximately 1.0) as dimensionality decreased from 512 units to 16 (0.95), 4 (0.80), and 2 (0.72) units. Individual identities separated statistically on every top-layer unit. Cross-unit responses were minimally correlated, indicating that units code non-redundant identity cues. This "distributed" code requires only a sparse, random sample of units to identify faces accurately. Gender classification declined gradually and viewpoint estimation fell steeply as dimensionality decreased. Individual units were weakly predictive of gender and viewpoint, but ensembles proved effective predictors. Therefore, distributed and sparse codes co-exist in the network units to represent different face attributes. At the ensemble level, principal component analysis of face representations showed that identity, gender, and viewpoint information separated into high-dimensional subspaces, ordered by explained variance. Identity, gender, and viewpoint information contributed to all individual unit responses, undercutting a neural tuning analogy for face attributes. Interpretation of neural-like codes from DCNNs, and by analogy, high-level visual codes, cannot be inferred from single unit responses. Instead, "meaning" is encoded by directions in the high-dimensional space.


title: TwinBERT: Distilling Knowledge to Twin-Structured BERT Models for Efficient Retrieval

abstract: Pre-trained language models like BERT have achieved great success in a wide variety of NLP tasks, while the superior performance comes with high demand in computational resources, which hinders the application in low-latency IR systems. We present TwinBERT model for effective and efficient retrieval, which has twin-structured BERT-like encoders to represent query and document respectively and a crossing layer to combine the embeddings and produce a similarity score. Different from BERT, where the two input sentences are concatenated and encoded together, TwinBERT decouples them during encoding and produces the embeddings for query and document independently, which allows document embeddings to be pre-computed offline and cached in memory. Thereupon, the computation left for run-time is from the query encoding and query-document crossing only. This single change can save large amount of computation time and resources, and therefore significantly improve serving efficiency. Moreover, a few well-designed network layers and training strategies are proposed to further reduce computational cost while at the same time keep the performance as remarkable as BERT model. Lastly, we develop two versions of TwinBERT for retrieval and relevance tasks correspondingly, and both of them achieve close or on-par performance to BERT-Base model. The model was trained following the teacher-student framework and evaluated with data from one of the major search engines. Experimental results showed that the inference time was significantly reduced and was firstly controlled around 20ms on CPUs while at the same time the performance gain from fine-tuned BERT-Base model was mostly retained. Integration of the models into production systems also demonstrated remarkable improvements on relevance metrics with negligible influence on latency.


title: Trustworthy AI

abstract: The promise of AI is huge. AI systems have already achieved good enough performance to be in our streets and in our homes. However, they can be brittle and unfair. For society to reap the benefits of AI systems, society needs to be able to trust them. Inspired by decades of progress in trustworthy computing, we suggest what trustworthy properties would be desired of AI systems. By enumerating a set of new research questions, we explore one approach--formal verification--for ensuring trust in AI. Trustworthy AI ups the ante on both trustworthy computing and formal methods.


title: A mean-field analysis of two-player zero-sum games

abstract: Finding Nash equilibria in two-player zero-sum continuous games is a central problem in machine learning, e.g. for training both GANs and robust models. The existence of pure Nash equilibria requires strong conditions which are not typically met in practice. Mixed Nash equilibria exist in greater generality and may be found using mirror descent. Yet this approach does not scale to high dimensions. To address this limitation, we parametrize mixed strategies as mixtures of particles, whose positions and weights are updated using gradient descent-ascent. We study this dynamics as an interacting gradient flow over measure spaces endowed with the Wasserstein-Fisher-Rao metric. We establish global convergence to an approximate equilibrium for the related Langevin gradient-ascent dynamic. We prove a law of large numbers that relates particle dynamics to mean-field dynamics. Our method identifies mixed equilibria in high dimensions and is demonstrably effective for training mixtures of GANs.


title: Algorithmic Recourse: from Counterfactual Explanations to Interventions

abstract: As machine learning is increasingly used to inform consequential decision-making (e.g., pre-trial bail and loan approval), it becomes important to explain how the system arrived at its decision, and also suggest actions to achieve a favorable decision. Counterfactual explanations -- "how the world would have (had) to be different for a desirable outcome to occur" -- aim to satisfy these criteria. Existing works have primarily focused on designing algorithms to obtain counterfactual explanations for a wide range of settings. However, one of the main objectives of "explanations as a means to help a data-subject act rather than merely understand" has been overlooked. In layman's terms, counterfactual explanations inform an individual where they need to get to, but not how to get there. In this work, we rely on causal reasoning to caution against the use of counterfactual explanations as a recommendable set of actions for recourse. Instead, we propose a shift of paradigm from recourse via nearest counterfactual explanations to recourse through minimal interventions, moving the focus from explanations to recommendations. Finally, we provide the reader with an extensive discussion on how to realistically achieve recourse beyond structural interventions.


title: A Comparison of Pooling Methods on LSTM Models for Rare Acoustic Event Classification

abstract: Acoustic event classification (AEC) and acoustic event detection (AED) refer to the task of detecting whether specific target events occur in audios. As long short-term memory (LSTM) leads to state-of-the-art results in various speech related tasks, it is employed as a popular solution for AEC as well. This paper focuses on investigating the dynamics of LSTM model on AEC tasks. It includes a detailed analysis on LSTM memory retaining, and a benchmarking of nine different pooling methods on LSTM models using 1.7M generated mixture clips of multiple events with different signal-to-noise ratios. This paper focuses on understanding: 1) utterance-level classification accuracy; 2) sensitivity to event position within an utterance. The analysis is done on the dataset for the detection of rare sound events from DCASE 2017 Challenge. We find max pooling on the prediction level to perform the best among the nine pooling approaches in terms of classification accuracy and insensitivity to event position within an utterance. To authors' best knowledge, this is the first kind of such work focused on LSTM dynamics for AEC tasks.


title: I-nteract: A cyber-physical system for real-time interaction with physical and virtual objects using mixed reality technologies for additive manufacturing

abstract: This paper presents I-nteract, a cyber-physical system that enables real-time interaction with real and virtual objects in a mixed augmented reality environment to design 3D models for additive manufacturing. The system has been developed using mixed reality technologies such as HoloLens, for augmenting visual feedback, and haptic gloves, for augmenting haptic force feedback. The efficacy of the system has been demonstrated by generating 3D model using a novel scanning method to 3D print a customized orthopedic cast for human arm, by estimating spring rates of compression springs, and by simulating interaction with a virtual spring using hand.


title: A Robust Traffic Control Model Considering Uncertainties in Turning Ratios

abstract: The effects of model parameter uncertainty on traffic flow control problems have recently drawn research attention. While the uncertainty in fundamental diagram related parameters has been investigated in the past, few articles have focused on network parameters uncertainty, including turning ratio uncertainty. To fill this gap, this article proposes a robust control model to deal with the uncertainties in the turning ratio by using distributionally robust chance constraints. The model allows one to compute the optimal control action that maximizes some objective, under all possible distributions of network parameters. We then apply this robust control framework to both a freeway network and an urban network, and evaluate the impact of uncertainty on optimal control inputs, over the test networks. The case studies show that compared to non-robust control, the proposed robust model can reduce congestion brought by the uncertainties and improve the overall throughput.


title: Accurate Stress Assessment based on functional Near Infrared Spectroscopy using Deep Learning Approach

abstract: Stress is known as one of the major factors threatening human health. A large number of studies have been performed in order to either assess or relieve stress by analyzing the brain and heart-related signals. In this study, signals produced by functional Near-Infrared Spectroscopy (fNIRS) of the brain recorded from 10 healthy volunteers are employed to assess the stress induced by the Montreal Imaging Stress Task by means of a deep learning system. The proposed deep learning system consists of two main parts: First, the one-dimensional convolutional neural network is employed to build informative feature maps. Then, a stack of deep fully connected layers is used to predict the stress existence probability. Experiment results showed that the trained fNIRS model performs stress classification by achieving 88.52 -+ 0.77% accuracy. Employment of the proposed deep learning system trained on the fNIRS measurements leads to higher stress classification accuracy than the existing methods proposed in fNIRS studies in which the same experimental procedure has been employed. The proposed method suggests better stability with lower variation in prediction. Furthermore, its low computational cost opens up the possibility to be applied in real-time stress assessment.


title: Low energy magnons in the chiral ferrimagnet $\text{Cu}_2\text{OSeO}_3$: a coarse-grained approach

abstract: We report a comprehensive neutron scattering study of low energy magnetic excitations in the breathing pyrochlore helimagnetic $\text{Cu}_2\text{OSeO}_3$. Fully documenting the four lowest energy magnetic modes that leave the ferrimagnetic configuration of the "strong tetrahedra" intact ($|\hbar\omega|<13$ meV), we find gapless quadratic dispersion at the $\Gamma$ point for energies above 0.2 meV, two doublets separated by 1.6(2) meV at the $R$ point, and a bounded continuum at the $X$ point. Our constrained rigid spin cluster model relates these features to Dzyaloshinskii-Moriya (DM) interactions and the incommensurate helical ground state. Combining conventional spin wave theory with a spin cluster form-factor accurately reproduces the measured equal time structure factor through multiple Brillouin zones. An effective spin Hamiltonian describing the complex anisotropic inter-cluster interactions is obtained.


title: Leveraging Coupled BBR and Adaptive Packet Scheduling to Boost MPTCP

abstract: Quite a few algorithms have been proposed to optimize the transmission performance of Multipath TCP (MPTCP). However, existing MPTCP protocols are still far from satisfactory in lossy and ever-changing networks because of their loss-based congestion control and the difficulty of managing multiple subflows. Recently, a congestion-based congestion control, BBR, is proposed to promote TCP transmission performance through better use of bandwidth. Due to the superior performance of BBR, we try to boost MPTCP with it. For this propose, coupled congestion control should be redesigned for MPTCP, and a functional scheduler able to effectively make use of the characteristics of BBR must also be developed for better performance. In this paper, we first propose Coupled BBR as a coupled congestion control algorithm for MPTCP to achieve high throughput and stable sending rate in lossy network scenarios with guaranteed fairness with TCP BBR flows and balanced congestion. Then, to further improve the performance, we propose an Adaptively Redundant and Packet-by-Packet (AR\&P) scheduler, which includes two scheduling methods to improve adaptability in highly dynamic network scenarios and keep in-order packet delivery in asymmetric networks. Based on Linux kernel implementation and experiments in both testbed and real network scenarios, we show that the proposed scheme not only provides higher throughput, but also improves robustness and reduces out-of-order packets in some harsh circumstances.


title: Higher order co-occurrence tensors for hypergraphs via face-splitting

abstract: A popular trick for computing a pairwise co-occurrence matrix is the product of an incidence matrix and its transpose. We present an analog for higher order tuple co-occurrences using the face-splitting product, or alternately known as the transpose Khatri-Rao product. These higher order co-occurrences encode the commonality of tokens in the company of other tokens, and thus generalize the mutual information commonly studied. We demonstrate this tensor's use via a popular NLP model, and hypergraph models of similarity.


title: Non-asymptotic Convergence of Adam-type Reinforcement Learning Algorithms under Markovian Sampling

abstract: Despite the wide applications of Adam in reinforcement learning (RL), the theoretical convergence of Adam-type RL algorithms has not been established. This paper provides the first such convergence analysis for two fundamental RL algorithms of policy gradient (PG) and temporal difference (TD) learning that incorporate AMSGrad updates (a standard alternative of Adam in theoretical analysis), referred to as PG-AMSGrad and TD-AMSGrad, respectively. Moreover, our analysis focuses on Markovian sampling for both algorithms. We show that under general nonlinear function approximation, PG-AMSGrad with a constant stepsize converges to a neighborhood of a stationary point at the rate of $\mathcal{O}(1/T)$ (where $T$ denotes the number of iterations), and with a diminishing stepsize converges exactly to a stationary point at the rate of $\mathcal{O}(\log^2 T/\sqrt{T})$. Furthermore, under linear function approximation, TD-AMSGrad with a constant stepsize converges to a neighborhood of the global optimum at the rate of $\mathcal{O}(1/T)$, and with a diminishing stepsize converges exactly to the global optimum at the rate of $\mathcal{O}(\log T/\sqrt{T})$. Our study develops new techniques for analyzing the Adam-type RL algorithms under Markovian sampling.


title: Traveling waves in a mean field learning model

abstract: Lucas and Moll have proposed a system of forward-backward partial differential equations that model knowledge diffusion and economic growth. It arises from a microscopic model of learning for a mean-field type interacting system of individual agents. In this paper, we prove existence of traveling wave solutions to this system. They correspond to what is known in economics as balanced growth path solutions. We also study the dependence of the solutions and their propagation speed on various economic parameters of the system.


title: Let Me At Least Learn What You Really Like: Dealing With Noisy Humans When Learning Preferences

abstract: Learning the preferences of a human improves the quality of the interaction with the human. The number of queries available to learn preferences maybe limited especially when interacting with a human, and so active learning is a must. One approach to active learning is to use uncertainty sampling to decide the informativeness of a query. In this paper, we propose a modification to uncertainty sampling which uses the expected output value to help speed up learning of preferences. We compare our approach with the uncertainty sampling baseline, as well as conduct an ablation study to test the validity of each component of our approach.


title: 3D Dynamic Scene Graphs: Actionable Spatial Perception with Places, Objects, and Humans

abstract: We present a unified representation for actionable spatial perception: 3D Dynamic Scene Graphs. Scene graphs are directed graphs where nodes represent entities in the scene (e.g. objects, walls, rooms), and edges represent relations (e.g. inclusion, adjacency) among nodes. Dynamic scene graphs (DSGs) extend this notion to represent dynamic scenes with moving agents (e.g. humans, robots), and to include actionable information that supports planning and decision-making (e.g. spatio-temporal relations, topology at different levels of abstraction). Our second contribution is to provide the first fully automatic Spatial PerceptIon eNgine(SPIN) to build a DSG from visual-inertial data. We integrate state-of-the-art techniques for object and human detection and pose estimation, and we describe how to robustly infer object, robot, and human nodes in crowded scenes. To the best of our knowledge, this is the first paper that reconciles visual-inertial SLAM and dense human mesh tracking. Moreover, we provide algorithms to obtain hierarchical representations of indoor environments (e.g. places, structures, rooms) and their relations. Our third contribution is to demonstrate the proposed spatial perception engine in a photo-realistic Unity-based simulator, where we assess its robustness and expressiveness. Finally, we discuss the implications of our proposal on modern robotics applications. 3D Dynamic Scene Graphs can have a profound impact on planning and decision-making, human-robot interaction, long-term autonomy, and scene prediction. A video abstract is available at https://youtu.be/SWbofjhyPzI


title: Deep RL Agent for a Real-Time Action Strategy Game

abstract: We introduce a reinforcement learning environment based on Heroic - Magic Duel, a 1 v 1 action strategy game. This domain is non-trivial for several reasons: it is a real-time game, the state space is large, the information given to the player before and at each step of a match is imperfect, and distribution of actions is dynamic. Our main contribution is a deep reinforcement learning agent playing the game at a competitive level that we trained using PPO and self-play with multiple competing agents, employing only a simple reward of $\pm 1$ depending on the outcome of a single match. Our best self-play agent, obtains around $65\%$ win rate against the existing AI and over $50\%$ win rate against a top human player.


title: Reconstruction for Liquid Argon TPC Neutrino Detectors Using Parallel Architectures

abstract: Neutrinos are particles that interact rarely, so identifying them requires large detectors which produce lots of data. Processing this data with the computing power available is becoming more difficult as the detectors increase in size to reach their physics goals. In liquid argon time projection chambers (TPCs) the charged particles from neutrino interactions produce ionization electrons which drift in an electric field towards a series of collection wires, and the signal on the wires is used to reconstruct the interaction. The MicroBooNE detector currently collecting data at Fermilab has 8000 wires, and planned future experiments like DUNE will have 100 times more, which means that the time required to reconstruct an event will scale accordingly. Modernization of liquid argon TPC reconstruction code, including vectorization, parallelization and code portability to GPUs, will help to mitigate these challenges. The liquid argon TPC hit finding algorithm within the \texttt{LArSoft}\xspace framework used across multiple experiments has been vectorized and parallelized. This increases the speed of the algorithm on the order of ten times within a standalone version on Intel architectures. This new version has been incorporated back into \texttt{LArSoft}\xspace so that it can be generally used. These methods will also be applied to other low-level reconstruction algorithms of the wire signals such as the deconvolution. The applications and performance of this modernized liquid argon TPC wire reconstruction will be presented.


title: Disorder and magnetoconductivity in tilted Weyl semimetals

abstract: Gapless Weyl semimetals (WSMs) are a novel class of topological materials that host massless Weyl fermions as their low-energy excitations. When the Weyl cone is tilted, the Lorentz invariance is broken and the Lifshitz transition drives the system from type-I WSMs into type-II WSMs. Here, based on the lattice model, we perform a systematic numerical study of the effect of on-site disorder on the diagonal magnetoconductivity in tilted WSMs.We use the self-consistent Born approximation to calculate the disorder-induced self-energy and then apply the Kubo-Streda formula to calculate the diagonal magnetoconductivity. For the transverse magnetoconductivity \sigma_xx, the disorder is found to exhibit distinct effects in the quantum limit regime and in the quantum oscillation regime of type-I WSMs, which could be understood from Einstein's relationship.With strong disorder, \sigma_xx shows a linear relation with the inverse magnetic field 1/B , which exhibits certain robustness to both the Fermi energy and the Weyl cone tilting. For the longitudinal magnetoconductivity \sigma_zz , the strong disorder can break the positive magnetoconductivity as well as the Shubnikov-de Haas oscillations.By analyzing the spectral function, we find that the chiral anomaly is still preserved at strong disorder even when the Weyl cone is overtilted, as there is no gap opening around the Weyl nodes. The implications of our results for experiments are discussed.


title: Vanishing Viscosity Limit of the Three-Dimensional Barotropic Compressible Navier-Stokes Equations with Degenerate Viscosities and Far-Field Vacuum

abstract: We are concerned with the inviscid limit of the Navier-Stokes equations to the Euler equations for barotropic compressible fluids in $\mathbb{R}^3$. When the viscosity coefficients obey a lower power-law of the density (i.e., $\rho^\delta$ with $0<\delta<1$), we identify a quasi-symmetric hyperbolic--singular elliptic coupled structure of the Navier-Stokes equations to control the behavior of the velocity of the fluids near the vacuum. Then this structure is employed to prove that there exists a unique regular solution to the corresponding Cauchy problem with arbitrarily large initial data and far-field vacuum, whose life span is uniformly positive in the vanishing viscosity limit. Some uniform estimates on both the local sound speed and the velocity in $H^3(\mathbb{R}^3)$ with respect to the viscosity coefficients are also obtained, which lead to the strong convergence of the regular solutions of the Navier-Stokes equations with finite mass and energy to the corresponding regular solutions of the Euler equations in $L^{\infty}([0, T]; H^{s}_{\rm loc}(\mathbb{R}^3))$ for any $s\in [2, 3)$. As a consequence, we show that, for both viscous and inviscid flows, it is impossible that the $L^\infty$ norm of any global regular solution with vacuum decays to zero asymptotically, as $t$ tends to infinity. Our framework developed here is applicable to the same problem for the other physical dimensions via some minor modifications.


title: The gluon condensation effect in the cosmic hadron spectra

abstract: Hardening of cosmic proton- and nuclei-spectra is explained by using the gluon condensation (GC) model, which states that a large amount of gluons in proton may condense near the high energy threshold. The results present the GC-effect as common origin of a series of anomalous astrophysical phenomena including the broken power-law in gamma-ray spectra, the excess in positron- and electron-spectra and hardening of proton- and nuclei-spectra.


title: Reconstruction of Charged Particle Tracks in Realistic Detector Geometry Using a Vectorized and Parallelized Kalman Filter Algorithm

abstract: One of the most computationally challenging problems expected for the High-Luminosity Large Hadron Collider (HL-LHC) is finding and fitting particle tracks during event reconstruction. Algorithms used at the LHC today rely on Kalman filtering, which builds physical trajectories incrementally while incorporating material effects and error estimation. Recognizing the need for faster computational throughput, we have adapted Kalman-filter-based methods for highly parallel, many-core SIMD and SIMT architectures that are now prevalent in high-performance hardware. Previously we observed significant parallel speedups, with physics performance comparable to CMS standard tracking, on Intel Xeon, Intel Xeon Phi, and (to a limited extent) NVIDIA GPUs. While early tests were based on artificial events occurring inside an idealized barrel detector, we showed subsequently that our mkFit software builds tracks successfully from complex simulated events (including detector pileup) occurring inside a geometrically accurate representation of the CMS-2017 tracker. Here, we report on advances in both the computational and physics performance of mkFit, as well as progress toward integration with CMS production software. Recently we have improved the overall efficiency of the algorithm by preserving short track candidates at a relatively early stage rather than attempting to extend them over many layers. Moreover, mkFit formerly produced an excess of duplicate tracks; these are now explicitly removed in an additional processing step. We demonstrate that with these enhancements, mkFit becomes a suitable choice for the first iteration of CMS tracking, and eventually for later iterations as well. We plan to test this capability in the CMS High Level Trigger during Run 3 of the LHC, with an ultimate goal of using it in both the CMS HLT and offline reconstruction for the HL-LHC CMS tracker.


title: Sparse Coresets for SVD on Infinite Streams

abstract: In streaming Singular Value Decomposition (SVD), $d$-dimensional rows of a possibly infinite matrix arrive sequentially as points in $\mathbb{R}^d$. An $\epsilon$-coreset is a (much smaller) matrix whose sum of square distances of the rows to any hyperplane approximates that of the original matrix to a $1 \pm \epsilon$ factor. Our main result is that we can maintain a $\epsilon$-coreset while storing only $O(d \log^2 d / \epsilon^2)$ rows. Known lower bounds of $\Omega(d / \epsilon^2)$ rows show that this is nearly optimal. Moreover, each row of our coreset is a weighted subset of the input rows. This is highly desirable since it: (1) preserves sparsity; (2) is easily interpretable; (3) avoids precision errors; (4) applies to problems with constraints on the input. Previous streaming results for SVD that return a subset of the input required storing $\Omega(d \log^3 n / \epsilon^2)$ rows where $n$ is the number of rows seen so far. Our algorithm, with storage independent of $n$, is the first result that uses finite memory on infinite streams. We support our findings with experiments on the Wikipedia dataset benchmarked against state-of-the-art algorithms.


title: Characterizing X-ray properties of the gamma-ray pulsar PSR J1418$-$6058 in the Rabbit pulsar wind nebula

abstract: We report on X-ray studies of the gamma-ray pulsar PSR J1418$-$6058 in the Rabbit pulsar wind nebula (PWN) carried out using archival Chandra and XMM-Newton observations. A refined timing analysis performed with the 120-ks XMM-Newton data finds significant ($p\approx10^{-7}$) pulsation at $P\approx110$ ms which is consistent with that measured with the Fermi large area telescope (LAT). In the Chandra image, we find extended emission around the pulsar similar to those seen around other pulsars in young PWNe, which further argues for association between PSR J1418$-$6058 and the Rabbit PWN. The X-ray spectrum of the pulsar is hard and similar to those of soft-gamma pulsars. Hence PSR J1418$-$6058 may add to the list of soft-gamma pulsars.


title: Extreme Classification via Adversarial Softmax Approximation

abstract: Training a classifier over a large number of classes, known as 'extreme classification', has become a topic of major interest with applications in technology, science, and e-commerce. Traditional softmax regression induces a gradient cost proportional to the number of classes $C$, which often is prohibitively expensive. A popular scalable softmax approximation relies on uniform negative sampling, which suffers from slow convergence due a poor signal-to-noise ratio. In this paper, we propose a simple training method for drastically enhancing the gradient signal by drawing negative samples from an adversarial model that mimics the data distribution. Our contributions are three-fold: (i) an adversarial sampling mechanism that produces negative samples at a cost only logarithmic in $C$, thus still resulting in cheap gradient updates; (ii) a mathematical proof that this adversarial sampling minimizes the gradient variance while any bias due to non-uniform sampling can be removed; (iii) experimental results on large scale data sets that show a reduction of the training time by an order of magnitude relative to several competitive baselines.


title: Loop Estimator for Discounted Values in Markov Reward Processes

abstract: At the working heart of policy iteration algorithms commonly used and studied in the discounted setting of reinforcement learning, the policy evaluation step estimates the value of states with samples from a Markov reward process induced by following a Markov policy in a Markov decision process. We propose a simple and efficient estimator called loop estimator that exploits the regenerative structure of Markov reward processes without explicitly estimating a full model. Our method enjoys a space complexity of $O(1)$ when estimating the value of a single positive recurrent state $s$ unlike TD with $O(S)$ or model-based methods with $O\left(S^2\right)$. Moreover, the regenerative structure enables us to show, without relying on the generative model approach, that the estimator has an instance-dependent convergence rate of $\widetilde{O}\left(\sqrt{\tau_s/T}\right)$ over steps $T$ on a single sample path, where $\tau_s$ is the maximal expected hitting time to state $s$. In preliminary numerical experiments, the loop estimator outperforms model-free methods, such as TD(k), and is competitive with the model-based estimator.


title: Historical Document Processing: Historical Document Processing: A Survey of Techniques, Tools, and Trends

abstract: Historical Document Processing is the process of digitizing written material from the past for future use by historians and other scholars. It incorporates algorithms and software tools from various subfields of computer science, including computer vision, document analysis and recognition, natural language processing, and machine learning, to convert images of ancient manuscripts, letters, diaries, and early printed texts automatically into a digital format usable in data mining and information retrieval systems. Within the past twenty years, as libraries, museums, and other cultural heritage institutions have scanned an increasing volume of their historical document archives, the need to transcribe the full text from these collections has become acute. Since Historical Document Processing encompasses multiple sub-domains of computer science, knowledge relevant to its purpose is scattered across numerous journals and conference proceedings. This paper surveys the major phases of, standard algorithms, tools, and datasets in the field of Historical Document Processing, discusses the results of a literature review, and finally suggests directions for further research.


title: Optimal Participation of Price-Maker Battery Energy Storage Systems (BESSs) in Energy, Reserve and Pay as Performance Regulation Markets

abstract: Motivated by the need of assessing the optimal allocation of battery energy storage services across various markets and the corresponding impact on market operations, an optimization framework is proposed in this work to coordinate the operation of an independent utility-scale price-maker battery energy storage system (BESS) in the energy, spinning reserve and performance-based regulation markets. The entire problem is formulated as a bi-level optimization process, where the structure of all markets is modeled considering the joint operation limits. The strategic bidding behavior of a price-maker BESS in a pay as performance regulation market is investigated. Additionally, a specific approach is introduced for modeling automatic generation control (AGC) signals in the optimization. Although the formulated problem is non-linear, it is converted to mixed-integer linear programming (MILP) to find the optimum solution. The proposed framework is evaluated using test case scenarios created from real-world market data. Case study results show the impact of BESS's price-making behavior on the joint operation of energy, reserve, and regulation markets.


title: Applying Depth-Sensing to Automated Surgical Manipulation with a da Vinci Robot

abstract: Recent advances in depth-sensing have significantly increased accuracy, resolution, and frame rate, as shown in the 1920x1200 resolution and 13 frames per second Zivid RGBD camera. In this study, we explore the potential of depth sensing for efficient and reliable automation of surgical subtasks. We consider a monochrome (all red) version of the peg transfer task from the Fundamentals of Laparoscopic Surgery training suite implemented with the da Vinci Research Kit (dVRK). We use calibration techniques that allow the imprecise, cable-driven da Vinci to reduce error from 4-5 mm to 1-2 mm in the task space. We report experimental results for a handover-free version of the peg transfer task, performing 20 and 5 physical episodes with single- and bilateral-arm setups, respectively. Results over 236 and 49 total block transfer attempts for the single- and bilateral-arm peg transfer cases suggest that reliability can be attained with 86.9 % and 78.0 % for each individual block, with respective block transfer speeds of 10.02 and 5.72 seconds. Supplementary material is available at https://sites.google.com/view/peg-transfer.


title: Recognizing Families In the Wild: White Paper for the 4th Edition Data Challenge

abstract: Recognizing Families In the Wild (RFIW): an annual large-scale, multi-track automatic kinship recognition evaluation that supports various visual kin-based problems on scales much higher than ever before. Organized in conjunction with the 15th IEEE International Conference on Automatic Face and Gesture Recognition (FG) as a Challenge, RFIW provides a platform for publishing original work and the gathering of experts for a discussion of the next steps. This paper summarizes the supported tasks (i.e., kinship verification, tri-subject verification, and search & retrieval of missing children) in the evaluation protocols, which include the practical motivation, technical background, data splits, metrics, and benchmark results. Furthermore, top submissions (i.e., leader-board stats) are listed and reviewed as a high-level analysis on the state of the problem. In the end, the purpose of this paper is to describe the 2020 RFIW challenge, end-to-end, along with forecasts in promising future directions.


title: Optimization of Software on High Performance Computing Platforms for the LUX-ZEPLIN Dark Matter Experiment

abstract: High Energy Physics experiments like the LUX-ZEPLIN dark matter experiment face unique challenges when running their computation on High Performance Computing resources. In this paper, we describe some strategies to optimize memory usage of simulation codes with the help of profiling tools. We employed this approach and achieved memory reduction of 10-30\%. While this has been performed in the context of the LZ experiment, it has wider applicability to other HEP experimental codes that face these challenges on modern computer architectures.


title: Fine-Tuning Pretrained Language Models: Weight Initializations, Data Orders, and Early Stopping

abstract: Fine-tuning pretrained contextual word embedding models to supervised downstream tasks has become commonplace in natural language processing. This process, however, is often brittle: even with the same hyperparameter values, distinct random seeds can lead to substantially different results. To better understand this phenomenon, we experiment with four datasets from the GLUE benchmark, fine-tuning BERT hundreds of times on each while varying only the random seeds. We find substantial performance increases compared to previously reported results, and we quantify how the performance of the best-found model varies as a function of the number of fine-tuning trials. Further, we examine two factors influenced by the choice of random seed: weight initialization and training data order. We find that both contribute comparably to the variance of out-of-sample performance, and that some weight initializations perform well across all tasks explored. On small datasets, we observe that many fine-tuning trials diverge part of the way through training, and we offer best practices for practitioners to stop training less promising runs early. We publicly release all of our experimental data, including training and validation scores for 2,100 trials, to encourage further analysis of training dynamics during fine-tuning.


title: Jelly Bean World: A Testbed for Never-Ending Learning

abstract: Machine learning has shown growing success in recent years. However, current machine learning systems are highly specialized, trained for particular problems or domains, and typically on a single narrow dataset. Human learning, on the other hand, is highly general and adaptable. Never-ending learning is a machine learning paradigm that aims to bridge this gap, with the goal of encouraging researchers to design machine learning systems that can learn to perform a wider variety of inter-related tasks in more complex environments. To date, there is no environment or testbed to facilitate the development and evaluation of never-ending learning systems. To this end, we propose the Jelly Bean World testbed. The Jelly Bean World allows experimentation over two-dimensional grid worlds which are filled with items and in which agents can navigate. This testbed provides environments that are sufficiently complex and where more generally intelligent algorithms ought to perform better than current state-of-the-art reinforcement learning approaches. It does so by producing non-stationary environments and facilitating experimentation with multi-task, multi-agent, multi-modal, and curriculum learning settings. We hope that this new freely-available software will prompt new research and interest in the development and evaluation of never-ending learning systems and more broadly, general intelligence systems.


title: Uncertainties associated with GAN-generated datasets in high energy physics

abstract: Recently, Generative Adversarial Networks (GANs) trained on samples of traditionally simulated collider events have been proposed as a way of generating larger simulated datasets at a reduced computational cost. In this paper we point out that data generated by a GAN cannot statistically be better than the data it was trained on, and critically examine the applicability of GANs in various situations, including a) for replacing the entire Monte Carlo pipeline or parts of it, and b) to produce datasets for usage in highly sensitive analyses or sub-optimal ones. We present our arguments using information theoretic demonstrations, a toy example, as well as in the form of a formal statement, and identify some potential valid uses of GANs in collider simulations.

categories: hep-ph hep-ex physics.comp-ph physics.data-an


title: How to democratize Internet of Things devices. A participatory design research

abstract: The global introduction of affordable Internet of Things (IoT) devices offers an opportunity to empower a large variety of users with different needs. However, many off-the-shelf digital products are still not widely adopted by people who are hesitant technology users or by older adults, notwithstanding that the design and user-interaction of these devices is recognized to be user-friendly. In view of the potential of IoT-based devices, how can we reduce the obstacles of a cohort with low digital literacy and technology anxiety and enable them to be equal participants in the digitalized world? This article shows the method and results achieved in a community-stakeholder workshop, developed through the participatory design methodology, aiming at brainstorming problems and scenarios through a focus group and a structured survey. The research activity focused on understanding factors to increase the usability of off-the-shelf IoT devices for hesitant users and identify strategies for improving digital literacy and reducing technology anxiety. A notable result was a series of feedback items pointing to the importance of creating learning resources to support individuals with different abilities, age, gender expression, to better adopt off-the-shelf IoT-based solutions.


title: Stochastic optimization over proximally smooth sets

abstract: We introduce a class of stochastic algorithms for minimizing weakly convex functions over proximally smooth sets. As their main building blocks, the algorithms use simplified models of the objective function and the constraint set, along with a retraction operation to restore feasibility. All the proposed methods come equipped with a finite time efficiency guarantee in terms of a natural stationarity measure. We discuss consequences for nonsmooth optimization over smooth manifolds and over sets cut out by weakly-convex inequalities.


title: Odd-odd continued fraction algorithm

abstract: By using a jump transformation associated to the Romik map, we define a new continued fraction algorithm called odd-odd continued fraction, whose principal convergents are rational numbers of odd denominators and odd numerators. Among others, it is proved that all the best approximating rationals of odd denominators and odd numerators of an irrational number are given by the principal convergents of the odd-odd continued fraction algorithm and vice versa.


title: Legion: Best-First Concolic Testing

abstract: Concolic execution and fuzzing are two complementary coverage-based testing techniques. How to achieve the best of both remains an open challenge. To address this research problem, we propose and evaluate Legion. Legion re-engineers the Monte Carlo tree search (MCTS) framework from the AI literature to treat automated test generation as a problem of sequential decision-making under uncertainty. Its best-first search strategy provides a principled way to learn the most promising program states to investigate at each search iteration, based on observed rewards from previous iterations. Legion incorporates a form of directed fuzzing that we call approximate path-preserving fuzzing (APPFuzzing) to investigate program states selected by MCTS. APPFuzzing serves as the Monte Carlo simulation technique and is implemented by extending prior work on constrained sampling. We evaluate Legion against competitors on 2531 benchmarks from the coverage category of Test-Comp 2020, as well as measuring its sensitivity to hyperparameters, demonstrating its effectiveness on a wide variety of input programs.


title: Small energy masking for improved neural network training for end-to-end speech recognition

abstract: In this paper, we present a Small Energy Masking (SEM) algorithm, which masks inputs having values below a certain threshold. More specifically, a time-frequency bin is masked if the filterbank energy in this bin is less than a certain energy threshold. A uniform distribution is employed to randomly generate the ratio of this energy threshold to the peak filterbank energy of each utterance in decibels. The unmasked feature elements are scaled so that the total sum of the feature values remain the same through this masking procedure. This very simple algorithm shows relatively 11.2 % and 13.5 % Word Error Rate (WER) improvements on the standard LibriSpeech test-clean and test-other sets over the baseline end-to-end speech recognition system. Additionally, compared to the input dropout algorithm, SEM algorithm shows relatively 7.7 % and 11.6 % improvements on the same LibriSpeech test-clean and test-other sets. With a modified shallow-fusion technique with a Transformer LM, we obtained a 2.62 % WER on the LibriSpeech test-clean set and a 7.87 % WER on the LibriSpeech test-other set.


title: Minimisers of a fractional seminorm and nonlocal minimal surfaces

abstract: The recent literature has intensively studied two classes of nonlocal variational problems, namely the ones related to the minimisation of energy functionals that act on functions in suitable Sobolev-Gagliardo spaces, and the ones related to the minimisation of fractional perimeters that act on measurable sets of the Euclidean space. In this article, we relate these two types of variational problems. In particular, we investigate the connection between the nonlocal minimal surfaces and the minimisers of the $W^{s,1}$-seminorm. In particular, we show that a function is a minimiser for the fractional seminorm if and only if its level sets are minimisers for the fractional perimeter, and that the characteristic function of a nonlocal minimal surface is a minimiser for the fractional seminorm; we also provide an existence result for minimisers of the fractional seminorm, an explicit non-uniqueness example for nonlocal minimal surfaces, and a Yin-Yang result describing the full and void patterns of nonlocal minimal surfaces.


title: Tuning stoichiometry and its impact on superconductivity of monolayer and multilayer FeSe on SrTiO3

abstract: Synthesis of monolayer FeSe on SrTiO3, with greatly enhanced superconductivity compared to bulk FeSe, remains difficult. Lengthy annealing within a certain temperature window is always required to achieve superconducting samples as reported by different groups around the world, but the mechanism of annealing in inducing superconductivity has not been elucidated. We grow FeSe films on SrTiO3 by molecular beam epitaxy and adjust the stoichiometry by depositing additional small amounts of Fe atoms. The monolayer films become superconducting after the Fe deposition without any annealing, and show similar superconducting transition temperatures as those of the annealed films in transport measurements. We also demonstrate on the 5-unit-cell films that the FeSe multilayer can be reversibly tuned between the non-superconducting $\sqrt{5} \times \sqrt{5}$ phase with Fe-vacancies and superconducting $1 \times 1$ phase. Our results reveal that the traditional anneal process in essence removes Fe vacancies and the additional Fe deposition serves as a more efficient way to achieve superconductivity. This work highlights the significance of stoichiometry in the superconductivity of FeSe thin films and provides an easy path for superconducting samples.


title: Bregman Augmented Lagrangian and Its Acceleration

abstract: We study the Bregman Augmented Lagrangian method (BALM) for solving convex problems with linear constraints. For classical Augmented Lagrangian method, the convergence rate and its relation with the proximal point method is well-understood. However, the convergence rate for BALM has not yet been thoroughly studied in the literature. In this paper, we analyze the convergence rates of BALM in terms of the primal objective as well as the feasibility violation. We also develop, for the first time, an accelerated Bregman proximal point method, that improves the convergence rate from $O(1/\sum_{k=0}^{T-1}\eta_k)$ to $O(1/(\sum_{k=0}^{T-1}\sqrt{\eta_k})^2)$, where $\{\eta_k\}_{k=0}^{T-1}$ is the sequence of proximal parameters. When applied to the dual of linearly constrained convex programs, this leads to the construction of an accelerated BALM, that achieves the improved rates for both primal and dual convergences.


title: An Effective EMTR-Based High-Impedance Fault Location Method for Transmission Lines

abstract: This paper summarizes the electromagnetic time reversal (EMTR) technique for fault location, and further numerically validates its effectiveness when the fault impedance is negligible. In addition, a specific EMTR model considering the fault impedance is derived, and the correctness of the model derivation is verified by various calculation methods. Based on this, we found that when the fault impedance is large, the existing EMTR methods might fail to accurately locate the fault. We propose an EMTR method that improves the location effect of high-impedance faults by injecting double-ended signals simultaneously. Theoretical calculations show that this method can achieve accurate location for high-impedance faults. To further illustrate the effectiveness, the proposed method is compared with the existing EMTR methods and the most commonly used traveling wave-based method using wavelet transform. The simulation results show that the proposed double-ended EMTR method can effectively locate high-impedance faults, and it is more robust against synchronization errors compared to the traveling wave method. In addition, the proposed method does not require the knowledge or the a priori guess of the unknown fault impedance.


title: Double-dot interferometer for quantum measurement of Majorana qubits and stabilizers

abstract: Motivated by the need of quantum measurement of Majorana qubits and surface-code stabilizers, we analyze the performance of a double-dot interferometer under the influence of environment noise. The double-dot setup design allows accounting for the full multiple tunneling process between the dots through the Majorana island, within a master equation approach. In the co-tunneling regime, which results in a Majorana-mediated effective coupling between the dots, the master equation approach allows us to obtain analytic solutions for the measurement currents. The measurement quality, characterized by figures of merit such as the visibility of measurement signals, is carried out in regard to the unusual decoherence effect rather than `which-path' dephasing. The results obtained in this work are expected to be useful for future experiments of Majorana qubit and stabilizer measurements.


title: Quantum materials interfaces: graphene/Bismuth (111) heterostructures

abstract: Heterostructures involving graphene and bismuth, with their ability to absorb light over a very wide energy range, are of interest for engineering next-generation opto-electronics. Critical to the technological application of such heterostructures is an understanding of the underlying physics governing their properties. Here, using first-principles calculations, we study the interfacial interactions between graphene and bismuth thin-films. Our study reveals non-intuitive phenomena associated with the moir\'e-physics of these superlattices. We show a preservation of graphene-derived Dirac cones in spite of proximity to a substrate with large spin-orbit coupling, a greater influence of graphene on the electronic structure properties of bismuth, and the surprising presence of a magnetic solution, only slightly higher in energy (by several meV) than the non-magnetic structure, possibly validating experiments. Such subtle and unanticipated phenomena associated with the moir\'e-physics are expected to play key roles in the practical applications of heterogeneous assemblies of two-dimensional quantum systems.


title: Asymptotic profile and optimal decay of solutions of some wave equations with logarithmic damping

abstract: We introduce a new model of the nonlocal wave equations with a logarithmic damping mechanism. We consider the Cauchy poroblem for the new model in the whole space. We study the asymptotic profile and optimal decay and blowup rates of solutions as time goes to infinity. The damping terms considered in this paper is not studied so far, and in the low frequency parameters the damping is rather weakly effective than that of well-studied fractional type of nonlocal damping. In order to get the optimal estimates in time we meet the so-called hypergeometric functions with special parameters.


title: Dimension-variable Mapless Navigation with Deep Reinforcement Learning

abstract: Deep reinforcement learning (DRL) has exhibited considerable promise in the training of control agents for mapless robot navigation. However, DRL-trained agents are limited to the specific robot dimensions used during training, hindering their applicability when the robot's dimension changes for task-specific requirements. To overcome this limitation, we propose a dimension-variable robot navigation method based on DRL. Our approach involves training a meta agent in simulation and subsequently transferring the meta skill to a dimension-varied robot using a technique called dimension-variable skill transfer (DVST). During the training phase, the meta agent for the meta robot learns self-navigation skills with DRL. In the skill-transfer phase, observations from the dimension-varied robot are scaled and transferred to the meta agent, and the resulting control policy is scaled back to the dimension-varied robot. Through extensive simulated and real-world experiments, we demonstrated that the dimension-varied robots could successfully navigate in unknown and dynamic environments without any retraining. The results show that our work substantially expands the applicability of DRL-based navigation methods, enabling them to be used on robots with different dimensions without the limitation of a fixed dimension. The video of our experiments can be found in the supplementary file.


title: Cascade Model for Planetesimal Formation by Turbulent Clustering

abstract: We use a newly developed cascade model of turbulent concentration of particles in protoplanetary nebulae to calculate several properties of interest to the formation of primitive planetesimals and to the meteorite record. The model follows, and corrects, calculations of the primary planetesimal Initial Mass Function (IMF) by Cuzzi et al. (2010), in which an incorrect cascade model was used. Here we use the model of Hartlep et al. (2017), which has been validated against several published numerical simulations of particle concentration in turbulence. We find that, for a range of nebula and particle properties, planetesimals may be "born big", formed as sandpiles with diameters in the 10-100 km range, directly from freely floating particles. The IMFs have a modal nature, with a well-defined peak rather than a powerlaw size dependence. Predictions for the inner and outer nebula behave similarly in these regards, and observations of inner and outer nebula primitive bodies support such modal IMFs. Also, we present predictions of local particle concentrations on several lengthscales in which particles "commonly" find themselves, which have significance for meteoritical observations of the redox state and isotopic fractionation in regions of chondrule formation. An important difference between these results, and those of Cuzzi et al. (2010), is that particle growth-by-sticking must proceed to at least the 1-few cm radius range for the IMF and meteoritical properties to be most plausibly satisfied. That is, as far as the inner nebula goes, the predominant "particles" must be aggregates of chondrules (or chondrule-size precursors) rather than individual chondrules themselves.


title: A Robust Statistical method to Estimate the Intervention Effect with Longitudinal Data

abstract: Segmented regression is a standard statistical procedure used to estimate the effect of a policy intervention on time series outcomes. This statistical method assumes the normality of the outcome variable, a large sample size, no autocorrelation in the observations, and a linear trend over time. Also, segmented regression is very sensitive to outliers. In a small sample study, if the outcome variable does not follow a Gaussian distribution, then using segmented regression to estimate the intervention effect leads to incorrect inferences. To address the small sample problem and non-normality in the outcome variable, including outliers, we describe and develop a robust statistical method to estimate the policy intervention effect in a series of longitudinal data. A simulation study is conducted to demonstrate the effect of outliers and non-normality in the outcomes by calculating the power of the test statistics with the segmented regression and the proposed robust statistical methods. Moreover, since finding the sampling distribution of the proposed robust statistic is analytically difficult, we use a nonparametric bootstrap technique to study the properties of the sampling distribution and make statistical inferences. Simulation studies show that the proposed method has more power than the standard t-test used in segmented regression analysis under the non-normality error distribution. Finally, we use the developed technique to estimate the intervention effect of the Istanbul Declaration on illegal organ activities. The robust method detected more significant effects compared to the standard method and provided shorter confidence intervals.


title: Covert Surveillance via Proactive Eavesdropping Under Channel Uncertainty

abstract: Surveillance performance is studied for a wireless eavesdropping system, where a full-duplex legitimate monitor eavesdrops a suspicious link efficiently with the artificial noise (AN) assistance. Different from the existing work in the literature, the suspicious receiver in this paper is assumed to be capable of detecting the presence of AN. Once such receiver detects the AN, the suspicious user will stop transmission, which is harmful for the surveillance performance. Hence, to improve the surveillance performance, AN should be transmitted covertly with a low detection probability by the suspicious receiver. Under these assumptions, an optimization problem is formulated to maximize the eavesdropping non-outage probability under a covert constraint. Based on the detection ability at the suspicious receiver, a novel scheme is proposed to solve the optimization problem by iterative search. Moreover, we investigate the impact of both the suspicious link uncertainty and the jamming link uncertainty on the covert surveillance performance. Simulations are performed to verify the analyses. We show that the suspicious link uncertainty benefits the surveillance performance, while the jamming link uncertainty can degrade the surveillance performance.


title: Cooperative Jamming for Secure Transmission With Both Active and Passive Eavesdroppers

abstract: Secrecy transmission is investigated for a cooperative jamming scheme, where a multi-antenna jam-mer generates artificial noise (AN) to confuse eavesdroppers. Two kinds of eavesdroppers are considered: passive eavesdroppers who only overhear the legitimate information, and active eavesdroppers who not only overhear the legitimate information but also jam the legitimate signal. Existing works only treat the passive and active eavesdroppers separately. Different from the existing works, we investigate the achievable secrecy rate in presence of both active and passive eavesdroppers. For the considered system model, we assume that the instantaneous channel state information (CSI) of the active eavesdroppers is available at the jammer, while only partial CSI of the passive eavesdroppers is available at the jammer. A new zero-forcing beamforming scheme is proposed in the presence of both active and passive eavesdroppers. For both the perfect and imperfect CSI cases, the total transmission power allocation between the information and AN signals is optimized to maximize the achievable secrecy rate. Numerical results show that imperfect CSI between the jammer and the legitimate receiver will do more harm to the achievable secrecy rate than imperfect CSI between the jammer and the active eavesdropper.


title: Coupling between Exciton-Polariton Corner Modes through Edge States

abstract: Recently realized higher order topological insulators have taken a surge of interest among the theoretical and experimental condensed matter community. The two-dimensional second order topological insulators give rise to zero-dimensional localized corner modes that reside within the band gap of the system along with edge modes that inhabit a band edge next to bulk modes. Thanks to the topological nature, information can be trapped at the corners of these systems, which will be unhampered even in the presence of disorder. Being localized at the corners, the exchange of information among the corner states is an issue. Here we show that the nonlinearity in an exciton polariton system can allow the coupling between the different corners through the edge states based on optical parametric scattering, realizing a system of multiple connectible topological modes.


title: When to Limit Market Entry under Mandatory Purchase

abstract: We study a problem inspired by regulated health insurance markets, such as those created by the government in the Affordable Care Act Exchanges or by employers when they contract with private insurers to provide plans for their employees. The market regulator can choose to do nothing, running a Free Market, or can exercise her regulatory power by limiting the entry of providers (decreasing consumer welfare by limiting options, but also decreasing revenue via enhanced competition). We investigate whether limiting entry increases or decreases the utility (welfare minus revenue) of the consumers who purchase from the providers, specifically in settings where the outside option of "purchasing nothing" is prohibitively undesirable. We focus primarily on the case where providers are symmetric. We propose a sufficient condition on the distribution of consumer values for (a) a unique symmetric equilibrium to exist in both markets and (b) utility to be higher with limited entry. (We also establish that these conclusions do not necessarily hold for all distributions, and therefore some condition is necessary.) Our techniques are primarily based on tools from revenue maximization, and in particular Myerson's virtual value theory. We also consider extensions to settings where providers have identical costs for providing plans, and to two providers with an asymmetric distribution.


title: Blow-up criterion for the 2-D Prandtl equation

abstract: In this paper, we consider the 2-D Prandtl equation with constant outer flow and monotonic data. We prove that if the curvature of the velocity distribution(i.e., $\partial_y^2u$) is bounded near the boundary, then the solution can not develop the singularity.


title: Many-to-Many Voice Conversion using Conditional Cycle-Consistent Adversarial Networks

abstract: Voice conversion (VC) refers to transforming the speaker characteristics of an utterance without altering its linguistic contents. Many works on voice conversion require to have parallel training data that is highly expensive to acquire. Recently, the cycle-consistent adversarial network (CycleGAN), which does not require parallel training data, has been applied to voice conversion, showing the state-of-the-art performance. The CycleGAN based voice conversion, however, can be used only for a pair of speakers, i.e., one-to-one voice conversion between two speakers. In this paper, we extend the CycleGAN by conditioning the network on speakers. As a result, the proposed method can perform many-to-many voice conversion among multiple speakers using a single generative adversarial network (GAN). Compared to building multiple CycleGANs for each pair of speakers, the proposed method reduces the computational and spatial cost significantly without compromising the sound quality of the converted voice. Experimental results using the VCC2018 corpus confirm the efficiency of the proposed method.


title: Optimal Mechanism Design for Single-Minded Agents

abstract: We consider revenue-optimal mechanism design in the interdimensional setting, where one dimension is the 'value' of the buyer, and one is a 'type' that captures some auxiliary information. One setting is the FedEx Problem, for which FGKK [2016] characterize the optimal mechanism for a single agent. We ask: how far can such characterizations go? In particular, we consider single-minded agents. A seller has heterogenous items. A buyer has a value v for a specific subset of items S, and obtains value v iff he gets (at least) all the items in S. We show: 1. Deterministic mechanisms are optimal for distributions that satisfy the "declining marginal revenue" (DMR) property; we give an explicit construction of the optimal mechanism. 2. Without DMR, the result depends on the structure of the directed acyclic graph (DAG) representing the partial order among types. When the DAG has out-degree at most 1, we characterize the optimal mechanism a la FedEx. 3. Without DMR, when the DAG has some node with out-degree at least 2, we show that in this case the menu complexity is unbounded: for any M, there exist distributions over (v,S) pairs such that the menu complexity of the optimal mechanism is at least M. 4. For the case of 3 types, we show that for all distributions there exists an optimal mechanism of finite menu complexity. This is in contrast to 2 additive heterogenous items or which the menu complexity could be uncountable [MV07; DDT15]. In addition, we prove that optimal mechanisms for Multi-Unit Pricing (without DMR) can have unbounded menu complexity. We also propose an extension where the menu complexity of optimal mechanisms can be countable but not uncountable. Together these results establish that optimal mechanisms in interdimensional settings are both much richer than single-dimensional settings, yet also vastly more structured than multi-dimensional settings.