title: Fast and Robust Bio-inspired Teach and Repeat Navigation

abstract: Fully autonomous mobile robots have a multitude of potential applications, but guaranteeing robust navigation performance remains an open research problem. For many tasks such as repeated infrastructure inspection, item delivery, or inventory transport, a route repeating capability can be sufficient and offers potential practical advantages over a full navigation stack. Previous teach and repeat research has achieved high performance in difficult conditions predominantly by using sophisticated, expensive sensors, and has often had high computational requirements. Biological systems, such as small animals and insects like seeing ants, offer a proof of concept that robust and generalisable navigation can be achieved with extremely limited visual systems and computing power. In this work we create a novel asynchronous formulation for teach and repeat navigation that fully utilises odometry information, paired with a correction signal driven by much more computationally lightweight visual processing than is typically required. This correction signal is also decoupled from the robot's motor control, allowing its rate to be modulated by the available computing capacity. We evaluate this approach with extensive experimentation on two different robotic platforms, the Consequential Robotics Miro and the Clearpath Jackal robots, across navigation trials totalling more than 6000 metres in a range of challenging indoor and outdoor environments. Our approach continues to succeed when multiple state-of-the-art systems fail due to low resolution images, unreliable odometry, or lighting change, while requiring significantly less compute. We also - for the first time - demonstrate versatile cross-platform teach and repeat without changing parameters, in which we learn to navigate a route with one robot and repeat that route using a completely different robot.


title: Meta-Learning Guarantees for Online Receding Horizon Learning Control

abstract: In this paper we provide provable regret guarantees for an online meta-learning receding horizon control algorithm in an iterative control setting. We consider the setting where, in each iteration the system to be controlled is a linear deterministic system that is different and unknown, the cost for the controller in an iteration is a general additive cost function and there are affine control input constraints. By analysing conditions under which sub-linear regret is achievable, we prove that the meta-learning online receding horizon controller achieves an average of the dynamic regret for the controller cost that is $\tilde{O}((1+1/\sqrt{N})T^{3/4})$ with the number of iterations $N$. Thus, we show that the worst regret for learning within an iteration improves with experience of more iterations, with guarantee on rate of improvement.


title: Logic Guided Genetic Algorithms

abstract: We present a novel Auxiliary Truth enhanced Genetic Algorithm (GA) that uses logical or mathematical constraints as a means of data augmentation as well as to compute loss (in conjunction with the traditional MSE), with the aim of increasing both data efficiency and accuracy of symbolic regression (SR) algorithms. Our method, logic-guided genetic algorithm (LGGA), takes as input a set of labelled data points and auxiliary truths (ATs) (mathematical facts known a priori about the unknown function the regressor aims to learn) and outputs a specially generated and curated dataset that can be used with any SR method. Three key insights underpin our method: first, SR users often know simple ATs about the function they are trying to learn. Second, whenever an SR system produces a candidate equation inconsistent with these ATs, we can compute a counterexample to prove the inconsistency, and further, this counterexample may be used to augment the dataset and fed back to the SR system in a corrective feedback loop. Third, the value addition of these ATs is that their use in both the loss function and the data augmentation process leads to better rates of convergence, accuracy, and data efficiency. We evaluate LGGA against state-of-the-art SR tools, namely, Eureqa and TuringBot on 16 physics equations from "The Feynman Lectures on Physics" book. We find that using these SR tools in conjunction with LGGA results in them solving up to 30.0% more equations, needing only a fraction of the amount of data compared to the same tool without LGGA, i.e., resulting in up to a 61.9% improvement in data efficiency.


title: Development of a low flow vapor phase electrochemical reactor without catholyte reliance for CO2 electrolysis to high value carbon products

abstract: A continuous CO2 vapor-fed electrochemical cell prototype that performs CO2R with high faradaic efficiency for desired carbon products for up to 72 hours of operation is presented. The cell design facilitates a flow through configuration, capitalizing on gas diffusion electrode (GDE) and membrane electrode architecture (MEA) without requiring a catholyte. We demonstrate stable performance and design adaptability by incorporating various CO2R catalysts and membranes into the cell, investigating lifetime performance and selectivity under established experimental conditions. With an Ag foil and PPO anion exchange membrane, the design achieves an average current density of -30mA/cm2 and FE ~80% for CO obtained over a 12-hour duration. With a Cu-based catalyst, FE ~40% selectivity for ethylene was achieved. The unique geometry and flexibility of the cell provides an adaptive and dynamic GDE electrochemical cell framework, easing future research for novel electro-catalysts on GDE electrodes and MEA/GDE assemblies for enhanced (photo)electrochemical carbon dioxide reduction.


title: Integrated causal-predictive machine learning models for tropical cyclone epidemiology

abstract: Strategic preparedness has been shown to reduce the adverse health impacts of hurricanes and tropical storms, referred to collectively as tropical cyclones (TCs), but its protective impact could be enhanced by a more comprehensive and rigorous characterization of TC epidemiology. To generate the insights and tools necessary for high-precision TC preparedness, we develop and apply a novel Bayesian machine learning approach that standardizes estimation of historic TC health impacts, discovers common patterns and sources of heterogeneity in those health impacts, and enables identification of communities at highest health risk for future TCs. The model integrates (1) a causal inference component to quantify the immediate health impacts of recent historic TCs at high spatial resolution and (2) a predictive component that captures how TC meteorological features and socioeconomic/demographic characteristics of impacted communities are associated with health impacts. We apply it to a rich data platform containing detailed historic TC exposure information and Medicare claims data. The health outcomes used in our analyses are all-cause mortality and cardiovascular- and respiratory-related hospitalizations. We report a high degree of heterogeneity in the acute health impacts of historic TCs at both the TC level and the community level, with substantial increases in respiratory hospitalizations, on average, during a two-week period surrounding TCs. TC sustained windspeeds are found to be the primary driver of increased mortality and respiratory risk. Our modeling approach has broader utility for predicting the health impacts of many types of extreme climate events.


title: Geodesic tomography problems on Riemannian manifolds

abstract: This PhD dissertation is concerned with integral geometric inverse problems. The geodesic ray transform is an operator that encodes the line integrals of a function along geodesics. The dissertation establishes many conditions when such information determines a function uniquely and stably. A new numerical model for computed tomography imaging is created as a part of the dissertation. The introductory part of the dissertation contains an introduction to inverse problems and mathematical models associated to computed tomography. The main focus is in definitions of integral geometry problems, survey of the related literature, and introducing the main results of the dissertation. A list of important open problems in integral geometry is given. The four articles of the dissertation (arXiv:1705.10126, arXiv:1901.03525, arXiv:1906.05046, arXiv:1909.00495) are now published in various journals and the content of the document has not been updated since November 11, 2019. These four articles are omitted from this document which contains only the introductory part. Extended abstracts are given in the document in English and Finnish.


title: Efficient Balanced Treatment Assignments for Experimentation

abstract: In this work, we reframe the problem of balanced treatment assignment as optimization of a two-sample test between test and control units. Using this lens we provide an assignment algorithm that is optimal with respect to the minimum spanning tree test of Friedman and Rafsky (1979). This assignment to treatment groups may be performed exactly in polynomial time. We provide a probabilistic interpretation of this process in terms of the most probable element of designs drawn from a determinantal point process which admits a probabilistic interpretation of the design. We provide a novel formulation of estimation as transductive inference and show how the tree structures used in design can also be used in an adjustment estimator. We conclude with a simulation study demonstrating the improved efficacy of our method.


title: Linking Entities to Unseen Knowledge Bases with Arbitrary Schemas

abstract: In entity linking, mentions of named entities in raw text are disambiguated against a knowledge base (KB). This work focuses on linking to unseen KBs that do not have training data and whose schema is unknown during training. Our approach relies on methods to flexibly convert entities from arbitrary KBs with several attribute-value pairs into flat strings, which we use in conjunction with state-of-the-art models for zero-shot linking. To improve the generalization of our model, we use two regularization schemes based on shuffling of entity attributes and handling of unseen attributes. Experiments on English datasets where models are trained on the CoNLL dataset, and tested on the TAC-KBP 2010 dataset show that our models outperform baseline models by over 12 points of accuracy. Unlike prior work, our approach also allows for seamlessly combining multiple training datasets. We test this ability by adding both a completely different dataset (Wikia), as well as increasing amount of training data from the TAC-KBP 2010 training set. Our models perform favorably across the board.


title: NADI 2020: The First Nuanced Arabic Dialect Identification Shared Task

abstract: We present the results and findings of the First Nuanced Arabic Dialect Identification Shared Task (NADI). This Shared Task includes two subtasks: country-level dialect identification (Subtask 1) and province-level sub-dialect identification (Subtask 2). The data for the shared task covers a total of 100 provinces from 21 Arab countries and are collected from the Twitter domain. As such, NADI is the first shared task to target naturally-occurring fine-grained dialectal text at the sub-country level. A total of 61 teams from 25 countries registered to participate in the tasks, thus reflecting the interest of the community in this area. We received 47 submissions for Subtask 1 from 18 teams and 9 submissions for Subtask 2 from 9 teams.


title: Traveling wave solutions for two species competitive chemotaxis systems

abstract: In this paper, we consider two species chemotaxis systems with Lotka-Volterra competition reaction terms. Under appropriate conditions on the parameters in such a system, we establish the existence of traveling wave solutions of the system connecting two spatially homogeneous equilibrium solutions with wave speed greater than some critical number c*. We also show the non-existence of such traveling waves with speed less than some critical number c*_0, which is independent of the chemotaxis. Moreover, under suitable hypotheses on the coefficients of the reaction terms, we obtain explicit range for the chemotaxis sensitivity coefficients ensuring c*= c*_0, which implies that the minimum wave speed exists and is not affected by the chemoattractant.


title: A Virucidal Face Mask Based on the Reverse-flow Reactor Concept for Thermal Inactivation of SARS-CoV-2

abstract: While facial coverings over the nose and mouth reduce the spread of the virus SARS-CoV-2 by filtration, masks capable of viral inactivation by heating could provide a complementary method to limit viral transmission. In this work, we introduce a new virucidal face mask concept based on a reverse-flow reactor driven by the oscillatory flow of human breath. The governing heat and mass transport equation are formulated and solved to analyze designs that evaluate both viral and CO2 transport during inhalation and exhalation. Given limits imposed by the volume and frequency of human breath, the kinetics of SARS-CoV-2 thermal inactivation, and human safety and comfort, heated masks may inactivate SARS-CoV-2 in inflow and outflow to medical grade sterility. We detail one particular design, with a volume of 300 mL at 90 $^\circ$C, that achieves a 3-log reduction in viral load with minimal viral impedance within the mask mesh, with partition coefficient around 2. This study is the first quantitative analysis of virucidal thermal inactivation within a protective face mask and addresses a pressing need for new approaches for personal protective equipment during a global pandemic.


title: Ergodic decompositions of geometric measures on Anosov homogeneous spaces

abstract: Let $G$ be a connected semisimple real algebraic group and $\Gamma$ a Zariski dense Anosov subgroup of $G$ with respect to a minimal parabolic subgroup $P$. Let $N$ be the maximal horospherical subgroup of $G$ given by the unipotent radical of $P$. We describe the $N$-ergodic decompositions of all Burger-Roblin measures as well as the $A$-ergodic decompositions of all Bowen-Margulis-Sullivan measures on $\Gamma\backslash G$. As a consequence, we obtain the following refinement of the main result of [LO]: the space of all {\it non-trivial} $N$-invariant ergodic and $P^\circ$-quasi-invariant Radon measures on $\Gamma\backslash G$, up to constant multiples, is homeomorphic to ${\mathbb R}^{\text{rank}\,G-1}\times \{1, \cdots, k\}$ where $k$ is the number of $P^\circ$-minimal subsets in $\Gamma\backslash G$.


title: A General Multi-Task Learning Framework to Leverage Text Data for Speech to Text Tasks

abstract: Attention-based sequence-to-sequence modeling provides a powerful and elegant solution for applications that need to map one sequence to a different sequence. Its success heavily relies on the availability of large amounts of training data. This presents a challenge for speech applications where labelled speech data is very expensive to obtain, such as automatic speech recognition (ASR) and speech translation (ST). In this study, we propose a general multi-task learning framework to leverage text data for ASR and ST tasks. Two auxiliary tasks, a denoising autoencoder task and machine translation task, are proposed to be co-trained with ASR and ST tasks respectively. We demonstrate that representing text input as phoneme sequences can reduce the difference between speech and text inputs, and enhance the knowledge transfer from text corpora to the speech to text tasks. Our experiments show that the proposed method achieves a relative 10~15% word error rate reduction on the English Librispeech task compared with our baseline, and improves the speech translation quality on the MuST-C tasks by 3.6~9.2 BLEU.


title: Voronoi Convolutional Neural Networks

abstract: In this technical report, we investigate extending convolutional neural networks to the setting where functions are not sampled in a grid pattern. We show that by treating the samples as the average of a function within a cell, we can find a natural equivalent of most layers used in CNN. We also present an algorithm for running inference for these models exactly using standard convex geometry algorithms.


title: Photovoltaic (PV) Virtual Inertia and Fast Frequency Regulation in High PV Power Grids

abstract: This paper studies the frequency response using PV. Multiple control strategies are considered and simulated in the high PV ERCOT model, including inertia control, synthetic governor control, and AGC control. The impact of different parameters in PV inertia control and their correlation and impact on frequency response are analyzed. The simulation results show that PV farm has potential to provide multiple types of grid service to support system frequency. This paper also proposed a distributed fast frequency control approach that can better leverage the PV headroom reserve to improve the system frequency nadir after contingencies.


title: Density of States Graph Kernels

abstract: A fundamental problem on graph-structured data is that of quantifying similarity between graphs. Graph kernels are an established technique for such tasks; in particular, those based on random walks and return probabilities have proven to be effective in wide-ranging applications, from bioinformatics to social networks to computer vision. However, random walk kernels generally suffer from slowness and tottering, an effect which causes walks to overemphasize local graph topology, undercutting the importance of global structure. To correct for these issues, we recast return probability graph kernels under the more general framework of density of states -- a framework which uses the lens of spectral analysis to uncover graph motifs and properties hidden within the interior of the spectrum -- and use our interpretation to construct scalable, composite density of states based graph kernels which balance local and global information, leading to higher classification accuracies on a host of benchmark datasets.


title: Contextual Linear Types for Differential Privacy

abstract: Language support for differentially-private programming is both crucial and delicate. While elaborate program logics can be very expressive, type-system based approaches using linear types tend to be more lightweight and amenable to automatic checking and inference, and in particular in the presence of higher-order programming. Since the seminal design of Fuzz, which is restricted to $\epsilon$-differential privacy in its original design, significant progress has been made to support more advancedvariants of differential privacy, like($\epsilon$,$\delta$)-differential privacy. However, supporting these advanced privacy variants while also supporting higher-order programming in full has proven to be challenging. We present Jazz, a language and type system which uses linear types and latent contextual effects to support both advanced variants of differential privacy and higher-order programming. Latent contextual effects allow delaying the payment of effects for connectives such as products, sums and functions, yielding advantages in terms of precision of the analysis and annotation burden upon elimination, as well as modularity. We formalize the core of Jazz, prove it sound for privacy via a logical relation for metric preservation, and illustrate its expressive power through a number of case studies drawn from the recent differential privacy literature.


title: The role of liquid-liquid phase separation in regulating enzyme activity

abstract: Liquid-liquid phase separation is now recognized as a common mechanism for regulating enzyme activity in cells. Insights from studies in cells are complemented by in vitro studies aimed at developing better understanding of mechanisms underlying such control. These mechanisms are often based on the influence of LLPS on the physicochemical properties of the enzyme's environment. Biochemical mechanisms underlying such regulation include the potential for concentrating reactants together, tuning reaction rates, and controlling competing metabolic pathways. LLPS is thus a powerful tool with extensive utilities for the cell, e.g. for consolidating cell survival under stress or rerouting metabolic pathways in response to the energy state of the cell. By examining the evidence of how LLPS affects enzyme catalysis, we can begin to understand emerging concepts and expand our understanding of enzyme catalysis in living cells.


title: Trajectory Prediction using Equivariant Continuous Convolution

abstract: Trajectory prediction is a critical part of many AI applications, for example, the safe operation of autonomous vehicles. However, current methods are prone to making inconsistent and physically unrealistic predictions. We leverage insights from fluid dynamics to overcome this limitation by considering internal symmetry in real-world trajectories. We propose a novel model, Equivariant Continous COnvolution (ECCO) for improved trajectory prediction. ECCO uses rotationally-equivariant continuous convolutions to embed the symmetries of the system. On both vehicle and pedestrian trajectory datasets, ECCO attains competitive accuracy with significantly fewer parameters. It is also more sample efficient, generalizing automatically from few data points in any orientation. Lastly, ECCO improves generalization with equivariance, resulting in more physically consistent predictions. Our method provides a fresh perspective towards increasing trust and transparency in deep learning models.


title: Network topology change-point detection from graph signals with prior spectral signatures

abstract: We consider the problem of sequential graph topology change-point detection from graph signals. We assume that signals on the nodes of the graph are regularized by the underlying graph structure via a graph filtering model, which we then leverage to distill the graph topology change-point detection problem to a subspace detection problem. We demonstrate how prior information on the spectral signature of the post-change graph can be incorporated to implicitly denoise the observed sequential data, thus leading to a natural CUSUM-based algorithm for change-point detection. Numerical experiments illustrate the performance of our proposed approach, particularly underscoring the benefits of (potentially noisy) prior information.


title: Aspects of model dependence of eta'-eta complex treated by going beyond the isospin limit

abstract: Exploring the extent of model dependence, we study effects of certain Ansaetze for the T-dependence of the correction term in the QCD topological susceptibility. The one producing unwanted effects on results at T > 0 in the eta'-eta complex in the usual limit of isospin symmetry, is largely cured from its peculiar behavior and brought into agreement with the other, when breaking of isospin symmetry is allowed and the realistic quark mass ratio m_u/m_d = 0.50 is adopted.


title: Correlation-aware Cooperative Multigroup Broadcast 360{\deg} Video Delivery Network: A Hierarchical Deep Reinforcement Learning Approach

abstract: With the stringent requirement of receiving video from unmanned aerial vehicle (UAV) from anywhere in the stadium of sports events and the significant-high per-cell throughput for video transmission to virtual reality (VR) users, a promising solution is a cell-free multi-group broadcast (CF-MB) network with cooperative reception and broadcast access points (AP). To explore the benefit of broadcasting user-correlated decode-dependent video resources to spatially correlated VR users, the network should dynamically schedule the video and cluster APs into virtual cells for a different group of VR users with overlapped video requests. By decomposition the problem into scheduling and association sub-problems, we first introduce the conventional non-learning-based scheduling and association algorithms, and a centralized deep reinforcement learning (DRL) association approach based on the rainbow agent with a convolutional neural network (CNN) to generate decisions from observation. To reduce its complexity, we then decompose the association problem into multiple sub-problems, resulting in a networked-distributed Partially Observable Markov decision process (ND-POMDP). To solve it, we propose a multi-agent deep DRL algorithm. To jointly solve the coupled association and scheduling problems, we further develop a hierarchical federated DRL algorithm with scheduler as meta-controller, and association as the controller. Our simulation results shown that our CF-MB network can effectively handle real-time video transmission from UAVs to VR users. Our proposed learning architectures is effective and scalable for a high-dimensional cooperative association problem with increasing APs and VR users. Also, our proposed algorithms outperform non-learning based methods with significant performance improvement.


title: Deep Learning for Efficient Reconstruction of High-Resolution Turbulent DNS Data

abstract: Within the domain of Computational Fluid Dynamics, Direct Numerical Simulation (DNS) is used to obtain highly accurate numerical solutions for fluid flows. However, this approach for numerically solving the Navier-Stokes equations is extremely computationally expensive mostly due to the requirement of greatly refined grids. Large Eddy Simulation (LES) presents a more computationally efficient approach for solving fluid flows on lower-resolution (LR) grids but results in an overall reduction in solution fidelity. Through this paper, we introduce a novel deep learning framework SR-DNS Net, which aims to mitigate this inherent trade-off between solution fidelity and computational complexity by leveraging deep learning techniques used in image super-resolution. Using our model, we wish to learn the mapping from a coarser LR solution to a refined high-resolution (HR) DNS solution so as to eliminate the need for performing DNS on highly refined grids. Our model efficiently reconstructs the high-fidelity DNS data from the LES like low-resolution solutions while yielding good reconstruction metrics. Thus our implementation improves the solution accuracy of LR solutions while incurring only a marginal increase in computational cost required for deploying the trained deep learning model.


title: LSTM-LM with Long-Term History for First-Pass Decoding in Conversational Speech Recognition

abstract: LSTM language models (LSTM-LMs) have been proven to be powerful and yielded significant performance improvements over count based n-gram LMs in modern speech recognition systems. Due to its infinite history states and computational load, most previous studies focus on applying LSTM-LMs in the second-pass for rescoring purpose. Recent work shows that it is feasible and computationally affordable to adopt the LSTM-LMs in the first-pass decoding within a dynamic (or tree based) decoder framework. In this work, the LSTM-LM is composed with a WFST decoder on-the-fly for the first-pass decoding. Furthermore, motivated by the long-term history nature of LSTM-LMs, the use of context beyond the current utterance is explored for the first-pass decoding in conversational speech recognition. The context information is captured by the hidden states of LSTM-LMs across utterance and can be used to guide the first-pass search effectively. The experimental results in our internal meeting transcription system show that significant performance improvements can be obtained by incorporating the contextual information with LSTM-LMs in the first-pass decoding, compared to applying the contextual information in the second-pass rescoring.


title: Social Bubbles and Superspreaders: Source Identification for Contagion Processes on Hypertrees

abstract: Previous work has shown that for contagion processes on extended star networks (trees with exactly one node of degree > 2), there is a simple, closed-form expression for a highly accurate approximation to the maximum likelihood infection source. Here, we generalize that result to a class of hypertrees which, although somewhat structurally analogous, provides a much richer representation space. In particular, this approach can be used to estimate patient zero sources, even when the infection has been propagated via large group gatherings rather than person-to-person spread, and when it is spreading through interrelated social bubbles with varying degrees of overlap. In contact tracing contexts, this estimator may be used to identify the source of a local outbreak, which can then be used for forward tracing or for further backward tracing (by similar or other means) to an upstream source.


title: Latte-Mix: Measuring Sentence Semantic Similarity with Latent Categorical Mixtures

abstract: Measuring sentence semantic similarity using pre-trained language models such as BERT generally yields unsatisfactory zero-shot performance, and one main reason is ineffective token aggregation methods such as mean pooling. In this paper, we demonstrate under a Bayesian framework that distance between primitive statistics such as the mean of word embeddings are fundamentally flawed for capturing sentence-level semantic similarity. To remedy this issue, we propose to learn a categorical variational autoencoder (VAE) based on off-the-shelf pre-trained language models. We theoretically prove that measuring the distance between the latent categorical mixtures, namely Latte-Mix, can better reflect the true sentence semantic similarity. In addition, our Bayesian framework provides explanations for why models finetuned on labelled sentence pairs have better zero-shot performance. We also empirically demonstrate that these finetuned models could be further improved by Latte-Mix. Our method not only yields the state-of-the-art zero-shot performance on semantic similarity datasets such as STS, but also enjoy the benefits of fast training and having small memory footprints.


title: Class-Conditional Defense GAN Against End-to-End Speech Attacks

abstract: In this paper we propose a novel defense approach against end-to-end adversarial attacks developed to fool advanced speech-to-text systems such as DeepSpeech and Lingvo. Unlike conventional defense approaches, the proposed approach does not directly employ low-level transformations such as autoencoding a given input signal aiming at removing potential adversarial perturbation. Instead of that, we find an optimal input vector for a class conditional generative adversarial network through minimizing the relative chordal distance adjustment between a given test input and the generator network. Then, we reconstruct the 1D signal from the synthesized spectrogram and the original phase information derived from the given input signal. Hence, this reconstruction does not add any extra noise to the signal and according to our experimental results, our defense-GAN considerably outperforms conventional defense algorithms both in terms of word error rate and sentence level recognition accuracy.


title: Bandwidth-Adaptive Feature Sharing for Cooperative LIDAR Object Detection

abstract: Situational awareness as a necessity in the connected and autonomous vehicles (CAV) domain is the subject of a significant number of researches in recent years. The driver's safety is directly dependent on the robustness, reliability, and scalability of such systems. Cooperative mechanisms have provided a solution to improve situational awareness by utilizing high speed wireless vehicular networks. These mechanisms mitigate problems such as occlusion and sensor range limitation. However, the network capacity is a factor determining the maximum amount of information being shared among cooperative entities. The notion of feature sharing, proposed in our previous work, aims to address these challenges by maintaining a balance between computation and communication load. In this work, we propose a mechanism to add flexibility in adapting to communication channel capacity and a novel decentralized shared data alignment method to further improve cooperative object detection performance. The performance of the proposed framework is verified through experiments on Volony dataset. The results confirm that our proposed framework outperforms our previous cooperative object detection method (FS-COD) in terms of average precision.


title: PHEW: Constructing Sparse Networks that Learn Fast and Generalize Well without Training Data

abstract: Methods that sparsify a network at initialization are important in practice because they greatly improve the efficiency of both learning and inference. Our work is based on a recently proposed decomposition of the Neural Tangent Kernel (NTK) that has decoupled the dynamics of the training process into a data-dependent component and an architecture-dependent kernel - the latter referred to as Path Kernel. That work has shown how to design sparse neural networks for faster convergence, without any training data, using the Synflow-L2 algorithm. We first show that even though Synflow-L2 is optimal in terms of convergence, for a given network density, it results in sub-networks with "bottleneck" (narrow) layers - leading to poor performance as compared to other data-agnostic methods that use the same number of parameters. Then we propose a new method to construct sparse networks, without any training data, referred to as Paths with Higher-Edge Weights (PHEW). PHEW is a probabilistic network formation method based on biased random walks that only depends on the initial weights. It has similar path kernel properties as Synflow-L2 but it generates much wider layers, resulting in better generalization and performance. PHEW achieves significant improvements over the data-independent SynFlow and SynFlow-L2 methods at a wide range of network densities.


title: Hurwitz class numbers with level and modular correspondences

abstract: In this paper, we prove Hurwitz-Eichler type formulas for Hurwitz class numbers with each level $ M $ when the modular curve $ X_0(M) $ has genus zero. A key idea is to calculate intersection numbers of modular correspondences with the level in two different ways. A generalization of Atkin-Lehner involutions for $ \Gamma_0(M) $ and its subgroup $ \Gamma_0^{(M')}(M) $ is introduced to calculate intersection multiplicities of modular correspondences at cusps.


title: Beyond Lazy Training for Over-parameterized Tensor Decomposition

abstract: Over-parametrization is an important technique in training neural networks. In both theory and practice, training a larger network allows the optimization algorithm to avoid bad local optimal solutions. In this paper we study a closely related tensor decomposition problem: given an $l$-th order tensor in $(R^d)^{\otimes l}$ of rank $r$ (where $r\ll d$), can variants of gradient descent find a rank $m$ decomposition where $m > r$? We show that in a lazy training regime (similar to the NTK regime for neural networks) one needs at least $m = \Omega(d^{l-1})$, while a variant of gradient descent can find an approximate tensor when $m = O^*(r^{2.5l}\log d)$. Our results show that gradient descent on over-parametrized objective could go beyond the lazy training regime and utilize certain low-rank structure in the data.


title: Smooth locus of twisted affine Schubert varieties and twisted affine Demazure modules

abstract: Let $\mathscr{G}$ be a special parahoric group scheme of twisted type over the ring of formal power series over $\mathbb{C}$, excluding the absolutely special case of $A_{2\ell}^{(2)}$. Using the methods and results of Zhu, we prove a duality theorem for general $\mathscr{G}$ : there is a duality between the level one twisted affine Demazure modules and the function rings of certain torus fixed point subschemes in affine Schubert varieties for $\mathscr{G}$. Along the way, we also establish the duality theorem for $E_6$. As a consequence, we determine the smooth locus of any affine Schubert variety in the affine Grassmannian of $\mathscr{G}$. In particular, this confirms a conjecture of Haines and Richarz.


title: N-ODE Transformer: A Depth-Adaptive Variant of the Transformer Using Neural Ordinary Differential Equations

abstract: We use neural ordinary differential equations to formulate a variant of the Transformer that is depth-adaptive in the sense that an input-dependent number of time steps is taken by the ordinary differential equation solver. Our goal in proposing the N-ODE Transformer is to investigate whether its depth-adaptivity may aid in overcoming some specific known theoretical limitations of the Transformer in handling nonlocal effects. Specifically, we consider the simple problem of determining the parity of a binary sequence, for which the standard Transformer has known limitations that can only be overcome by using a sufficiently large number of layers or attention heads. We find, however, that the depth-adaptivity of the N-ODE Transformer does not provide a remedy for the inherently nonlocal nature of the parity problem, and provide explanations for why this is so. Next, we pursue regularization of the N-ODE Transformer by penalizing the arclength of the ODE trajectories, but find that this fails to improve the accuracy or efficiency of the N-ODE Transformer on the challenging parity problem. We suggest future avenues of research for modifications and extensions of the N-ODE Transformer that may lead to improved accuracy and efficiency for sequence modelling tasks such as neural machine translation.


title: Observation of unidirectional soliton-like edge states in nonlinear Floquet topological insulators

abstract: A salient feature of solid-state topological materials in two dimensions is the presence of conducting electronic edge states that are insensitive to scattering by disorder. Such unidirectional edge states have been explored in many experimental settings beyond solid-state electronic systems, including in photonic devices, mechanical and acoustic structures, and others. It is of great interest to understand how topological states behave in the presence of inter-particle interactions and nonlinearity. Here we experimentally demonstrate unidirectional soliton-like nonlinear states on the edge of photonic topological insulators consisting of laser-written waveguides. As a result of the optical Kerr nonlinearity of the ambient glass, the soliton-like wavepacket forms a non-diffracting coherent structure that slowly radiates power because of the intrinsic gaplessness of the system. The realization of soliton-like edge states paves the way to an understanding of topological phenomena in nonlinear systems and those with inter-particle interactions.

categories: physics.optics cond-mat.mes-hall cond-mat.quant-gas nlin.PS


title: Normal zeta functions of small $\mathfrak{T}_2$-groups and their behaviour on residue classes

abstract: Let $G$ be a finitely generate nilpotent class-2 torsion-free group. We study how the zeta function enumerating normal subgroups of G varies on residue classes. In particular, we show that for small such $G$ of Hirsch length less than or equal to 7, the normal zeta functions are generically always rational functions on residue classes. We then show that there are examples of groups with Hirsch length 8 whose normal zeta function is not a rational function on residue classes. We observe the connection to Higman's PORC conjecture.


title: New kind of asymmetric integration projection operators constructed by entangled state representations and parity measurement

abstract: By means of the technique of integration within an ordered product of operators and Dirac notation, we introduce a new kind of asymmetric integration projection operators in entangled state representations. These asymmetric projection operators are proved to be the Hermitian operator. Then, we rigorously demonstrate that they correspond to a parity measurement combined with a beam splitter when any two-mode quantum state passes through such device. Therefore we obtain a new relation between a Hermitian operator and the entangled state representation. As applications, we recover the previous results of the parity measurement in quantum metrology by our formalism.


title: NU-GAN: High resolution neural upsampling with GAN

abstract: In this paper, we propose NU-GAN, a new method for resampling audio from lower to higher sampling rates (upsampling). Audio upsampling is an important problem since productionizing generative speech technology requires operating at high sampling rates. Such applications use audio at a resolution of 44.1 kHz or 48 kHz, whereas current speech synthesis methods are equipped to handle a maximum of 24 kHz resolution. NU-GAN takes a leap towards solving audio upsampling as a separate component in the text-to-speech (TTS) pipeline by leveraging techniques for audio generation using GANs. ABX preference tests indicate that our NU-GAN resampler is capable of resampling 22 kHz to 44.1 kHz audio that is distinguishable from original audio only 7.4% higher than random chance for single speaker dataset, and 10.8% higher than chance for multi-speaker dataset.


title: QISTA-Net: DNN Architecture to Solve $\ell_q$-norm Minimization Problem and Image Compressed Sensing

abstract: In this paper, we reformulate the non-convex $\ell_q$-norm minimization problem with $q\in(0,1)$ into a 2-step problem, which consists of one convex and one non-convex subproblems, and propose a novel iterative algorithm called QISTA ($\ell_q$-ISTA) to solve the $\left(\ell_q\right)$-problem. By taking advantage of deep learning in accelerating optimization algorithms, together with the speedup strategy that using the momentum from all previous layers in the network, we propose a learning-based method, called QISTA-Net-s, to solve the sparse signal reconstruction problem. Extensive experimental comparisons demonstrate that the QISTA-Net-s yield better reconstruction qualities than state-of-the-art $\ell_1$-norm optimization (plus learning) algorithms even if the original sparse signal is noisy. On the other hand, based on the network architecture associated with QISTA, with considering the use of convolution layers, we proposed the QISTA-Net-n for solving the image CS problem, and the performance of the reconstruction still outperforms most of the state-of-the-art natural images reconstruction methods. QISTA-Net-n is designed in unfolding QISTA and adding the convolutional operator as the dictionary. This makes QISTA-Net-s interpretable. We provide complete experimental results that QISTA-Net-s and QISTA-Net-n contribute the better reconstruction performance than the competing.


title: Sample Efficient Reinforcement Learning with REINFORCE

abstract: Policy gradient methods are among the most effective methods for large-scale reinforcement learning, and their empirical success has prompted several works that develop the foundation of their global convergence theory. However, prior works have either required exact gradients or state-action visitation measure based mini-batch stochastic gradients with a diverging batch size, which limit their applicability in practical scenarios. In this paper, we consider classical policy gradient methods that compute an approximate gradient with a single trajectory or a fixed size mini-batch of trajectories under soft-max parametrization and log-barrier regularization, along with the widely-used REINFORCE gradient estimation procedure. By controlling the number of "bad" episodes and resorting to the classical doubling trick, we establish an anytime sub-linear high probability regret bound as well as almost sure global convergence of the average regret with an asymptotically sub-linear rate. These provide the first set of global convergence and sample efficiency results for the well-known REINFORCE algorithm and contribute to a better understanding of its performance in practice.


title: On a Guided Nonnegative Matrix Factorization

abstract: Fully unsupervised topic models have found fantastic success in document clustering and classification. However, these models often suffer from the tendency to learn less-than-meaningful or even redundant topics when the data is biased towards a set of features. For this reason, we propose an approach based upon the nonnegative matrix factorization (NMF) model, deemed \textit{Guided NMF}, that incorporates user-designed seed word supervision. Our experimental results demonstrate the promise of this model and illustrate that it is competitive with other methods of this ilk with only very little supervision information.


title: Random Coordinate Underdamped Langevin Monte Carlo

abstract: The Underdamped Langevin Monte Carlo (ULMC) is a popular Markov chain Monte Carlo sampling method. It requires the computation of the full gradient of the log-density at each iteration, an expensive operation if the dimension of the problem is high. We propose a sampling method called Random Coordinate ULMC (RC-ULMC), which selects a single coordinate at each iteration to be updated and leaves the other coordinates untouched. We investigate the computational complexity of RC-ULMC and compare it with the classical ULMC for strongly log-concave probability distributions. We show that RC-ULMC is always cheaper than the classical ULMC, with a significant cost reduction when the problem is highly skewed and high dimensional. Our complexity bound for RC-ULMC is also tight in terms of dimension dependence.


title: TeX-Graph: Coupled tensor-matrix knowledge-graph embedding for COVID-19 drug repurposing

abstract: Knowledge graphs (KGs) are powerful tools that codify relational behaviour between entities in knowledge bases. KGs can simultaneously model many different types of subject-predicate-object and higher-order relations. As such, they offer a flexible modeling framework that has been applied to many areas, including biology and pharmacology -- most recently, in the fight against COVID-19. The flexibility of KG modeling is both a blessing and a challenge from the learning point of view. In this paper we propose a novel coupled tensor-matrix framework for KG embedding. We leverage tensor factorization tools to learn concise representations of entities and relations in knowledge bases and employ these representations to perform drug repurposing for COVID-19. Our proposed framework is principled, elegant, and achieves 100% improvement over the best baseline in the COVID-19 drug repurposing task using a recently developed biological KG.


title: Robust estimation in beta regression via maximum Lq-likelihood

abstract: Beta regression models are widely used for modeling continuous data limited to the unit interval, such as proportions, fractions, and rates. The inference for the parameters of beta regression models is commonly based on maximum likelihood estimation. However, it is known to be sensitive to discrepant observations. In some cases, one atypical data point can lead to severe bias and erroneous conclusions about the features of interest. In this work, we develop a robust estimation procedure for beta regression models based on the maximization of a reparameterized Lq-likelihood. The new estimator offers a trade-off between robustness and efficiency through a tuning constant. To select the optimal value of the tuning constant, we propose a data-driven method which ensures full efficiency in the absence of outliers. We also improve on an alternative robust estimator by applying our data-driven method to select its optimum tuning constant. Monte Carlo simulations suggest marked robustness of the two robust estimators with little loss of efficiency. Applications to three datasets are presented and discussed. As a by-product of the proposed methodology, residual diagnostic plots based on robust fits highlight outliers that would be masked under maximum likelihood estimation.


title: Learning Graph-Based Priors for Generalized Zero-Shot Learning

abstract: The task of zero-shot learning (ZSL) requires correctly predicting the label of samples from classes which were unseen at training time. This is achieved by leveraging side information about class labels, such as label attributes or word embeddings. Recently, attention has shifted to the more realistic task of generalized ZSL (GZSL) where test sets consist of seen and unseen samples. Recent approaches to GZSL have shown the value of generative models, which are used to generate samples from unseen classes. In this work, we incorporate an additional source of side information in the form of a relation graph over labels. We leverage this graph in order to learn a set of prior distributions, which encourage an aligned variational autoencoder (VAE) model to learn embeddings which respect the graph structure. Using this approach we are able to achieve improved performance on the CUB and SUN benchmarks over a strong baseline.


title: A Multi-Componential Approach to Emotion Recognition and the Effect of Personality

abstract: Emotions are an inseparable part of human nature affecting our behavior in response to the outside world. Although most empirical studies have been dominated by two theoretical models including discrete categories of emotion and dichotomous dimensions, results from neuroscience approaches suggest a multi-processes mechanism underpinning emotional experience with a large overlap across different emotions. While these findings are consistent with the influential theories of emotion in psychology that emphasize a role for multiple component processes to generate emotion episodes, few studies have systematically investigated the relationship between discrete emotions and a full componential view. This paper applies a componential framework with a data-driven approach to characterize emotional experiences evoked during movie watching. The results suggest that differences between various emotions can be captured by a few (at least 6) latent dimensions, each defined by features associated with component processes, including appraisal, expression, physiology, motivation, and feeling. In addition, the link between discrete emotions and component model is explored and results show that a componential model with a limited number of descriptors is still able to predict the level of experienced discrete emotion(s) to a satisfactory level. Finally, as appraisals may vary according to individual dispositions and biases, we also study the relationship between personality traits and emotions in our computational framework and show that the role of personality on discrete emotion differences can be better justified using the component model.


title: Planck Galactic Cold Clumps in Two Regions: the First Quadrant and the Anti-Center Direction Region

abstract: Sixty five Planck Galactic cold clumps (PGCCs) from the first quadrant (IQuad) and thirty nine of PGCCs from the Anti-Center direction region (ACent) were observed in $^{12}$CO, $^{13}$CO and C$^{18}$O J=1-0 lines using the PMO 13.7-m telescope. All the targets were detected with all the three lines, except for 12 IQuad and 8 ACent PGCCs without C$^{18}$O detection. Seventy six and 49 velocity components were obtained in IQuad and ACent respectively. One-hundred and forty-six cores were extracted from 76 IQuad clumps and 100 cores from 49 ACent clumps. The average T$_{\mathrm{ex}}$ of IQuad cores and ACent cores are 12.4 K and 12.1 K, respectively. The average line width of $^{13}$CO of IQuad cores and ACent cores are 1.55 km s$^{-1}$ and 1.77 km s$^{-1}$, respectively. Among the detected cores, 24 in IQuad and 13 in ACent have asymmetric line profiles. The small blue excesses, $\sim$0.03 in IQuad and 0.01 in ACent, indicate that the star formation is not active in these PGCC cores. Power-law fittings of core mass function to the high mass end give indexes of -0.57 in IQuad and -1.02 in ACent which are flatter than the slope of initial mass function given by \citeauthor{1955ApJ...121..161S}. The large turnover masses with value of 28 M$_{\odot}$ for IQuad cores and 77 M$_{\odot}$ for ACent cores suggest low star formation efficiencies in PGCCs. The correlation between virial mass and gas mass indicates that most of PGCC cores in both regions are not likely pressure-confined.


title: Symmetrical Z-Complementary Code Sets (SZCCSs) for Optimal Training in Generalized Spatial Modulation

abstract: This paper introduces a novel class of code sets, called "symmetrical Z-complementary code sets (SZCCSs)" , whose aperiodic auto- and cross- correlation sums exhibit zero-correlation zones (ZCZs) at both the front-end and tail-end of the entire correlation window. Three constructions of (optimal) SZCCSs based on general Boolean functions are presented. As a second major contribution, we apply SZCCSs to design optimal training sequences for broadband generalized spatial modulation (GSM) systems over frequency-selective channels. Key words: Complementary code set, channel estimation, training sequence design, generalized spatial modulation, frequency-selective channels.


title: The Minkowski problem based on the (p,q)-mixed quermassintegrals

abstract: Lutwak, Yang and Zhang [23] introduced the concept of Lp dual curvature measure for convex bodies and star bodies, and studied the Minkowski problem. We in this paper establish a new unified concept, in briefly, the (p,q)-mixed quermassintegrals, via (p,q)-dual mixed curvature measure, and further have a deep discussion on Minkowski problem with respect to the (p,q)-dual mixed curvature measure. By the way, we derive at some important properties and geometric inequalities for (p,q)-mixed quermassintegrals.


title: Stronger Transformers for Neural Multi-Hop Question Generation

abstract: Prior work on automated question generation has almost exclusively focused on generating simple questions whose answers can be extracted from a single document. However, there is an increasing interest in developing systems that are capable of more complex multi-hop question generation, where answering the questions requires reasoning over multiple documents. In this work, we introduce a series of strong transformer models for multi-hop question generation, including a graph-augmented transformer that leverages relations between entities in the text. While prior work has emphasized the importance of graph-based models, we show that we can substantially outperform the state-of-the-art by 5 BLEU points using a standard transformer architecture. We further demonstrate that graph-based augmentations can provide complimentary improvements on top of this foundation. Interestingly, we find that several important factors--such as the inclusion of an auxiliary contrastive objective and data filtering could have larger impacts on performance. We hope that our stronger baselines and analysis provide a constructive foundation for future work in this area.


title: Deep Learning for Distinguishing Normal versus Abnormal Chest Radiographs and Generalization to Unseen Diseases

abstract: Chest radiography (CXR) is the most widely-used thoracic clinical imaging modality and is crucial for guiding the management of cardiothoracic conditions. The detection of specific CXR findings has been the main focus of several artificial intelligence (AI) systems. However, the wide range of possible CXR abnormalities makes it impractical to build specific systems to detect every possible condition. In this work, we developed and evaluated an AI system to classify CXRs as normal or abnormal. For development, we used a de-identified dataset of 248,445 patients from a multi-city hospital network in India. To assess generalizability, we evaluated our system using 6 international datasets from India, China, and the United States. Of these datasets, 4 focused on diseases that the AI was not trained to detect: 2 datasets with tuberculosis and 2 datasets with coronavirus disease 2019. Our results suggest that the AI system generalizes to new patient populations and abnormalities. In a simulated workflow where the AI system prioritized abnormal cases, the turnaround time for abnormal cases reduced by 7-28%. These results represent an important step towards evaluating whether AI can be safely used to flag cases in a general setting where previously unseen abnormalities exist.


title: Heterogeneous Vehicle Routing and Teaming with Gaussian Distributed Energy Uncertainty

abstract: For robot swarms operating on complex missions in an uncertain environment, it is important that the decision-making algorithm considers both heterogeneity and uncertainty. This paper presents a stochastic programming framework for the vehicle routing problem with stochastic travel energy costs and heterogeneous vehicles and tasks. We represent the heterogeneity as linear constraints, estimate the uncertain energy cost through Gaussian process regression, formulate this stochasticity as chance constraints or stochastic recourse costs, and then solve the stochastic programs using branch and cut algorithms to minimize the expected energy cost. The performance and practicality are demonstrated through extensive computational experiments and a practical test case.


title: A New Block Preconditioner for Implicit Runge-Kutta Methods for Parabolic PDE Problems

abstract: A new preconditioner based on a block $LDU$ factorization with algebraic multigrid subsolves for scalability is introduced for the large, structured systems appearing in implicit Runge-Kutta time integration of parabolic partial differential equations. This preconditioner is compared in condition number and eigenvalue distribution, and in numerical experiments with others in the literature: block Jacobi, block Gauss-Seidel, and the optimized block Gauss-Seidel method of Staff, Mardal, and Nilssen [{\em Modeling, Identification and Control}, 27 (2006), pp. 109-123]. Experiments are run on two test problems, a $2D$ heat equation and a model advection-diffusion problem, using implicit Runge-Kutta methods with two to seven stages. We find that the new preconditioner outperforms the others, with the improvement becoming more pronounced as spatial discretization is refined and as temporal order is increased.


title: Learning Occupancy Function from Point Clouds for Surface Reconstruction

abstract: Implicit function based surface reconstruction has been studied for a long time to recover 3D shapes from point clouds sampled from surfaces. Recently, Signed Distance Functions (SDFs) and Occupany Functions are adopted in learning-based shape reconstruction methods as implicit 3D shape representation. This paper proposes a novel method for learning occupancy functions from sparse point clouds and achieves better performance on challenging surface reconstruction tasks. Unlike the previous methods, which predict point occupancy with fully-connected multi-layer networks, we adapt the point cloud deep learning architecture, Point Convolution Neural Network (PCNN), to build our learning model. Specifically, we create a sampling operator and insert it into PCNN to continuously sample the feature space at the points where occupancy states need to be predicted. This method natively obtains point cloud data's geometric nature, and it's invariant to point permutation. Our occupancy function learning can be easily fit into procedures of point cloud up-sampling and surface reconstruction. Our experiments show state-of-the-art performance for reconstructing With ShapeNet dataset and demonstrate this method's well-generalization by testing it with McGill 3D dataset \cite{siddiqi2008retrieving}. Moreover, we find the learned occupancy function is relatively more rotation invariant than previous shape learning methods.


title: Local Convergence Analysis of Augmented Lagrangian Methods for Piecewise Linear-Quadratic Composite Optimization Problems

abstract: Second-order sufficient conditions for local optimality have been playing an important role in local convergence analysis of optimization algorithms. In this paper, we demonstrate that this condition alone suffices to justify the linear convergence of the primal-dual sequence, generated by the augmented Lagrangian method for piecewise linear-quadratic composite optimization problems, even when the Lagrange multiplier in this class of problems is not unique. Furthermore, we establish the equivalence between the second-order sufficient condition and the quadratic growth condition of the augmented Lagrangian problem for this class of composite optimization problems.


title: A Hybrid Approach to Coded Compressed Sensing where Coupling Takes Place via the Outer Code

abstract: This article seeks to advance coded compressed sensing (CCS) as a practical scheme for unsourced random access. The original CCS algorithm features a concatenated structure where an inner code is tasked with support recovery, and an outer tree code conducts message disambiguation. Recently, a link between CCS and sparse regression codes was established, leading to the application of approximate message passing (AMP) to CCS. This connection was subsequently strengthened by integrating AMP and belief propagation on the outer code through a dynamic denoiser. Along these lines, this work shows how block diagonal sensing matrices akin to those used in traditional CCS, together with the aforementioned dynamic denoiser, form an effective means to get good performance at low-complexity. This novel architecture can be used to scale this scheme to dimensions that were previously impractical. Findings are supported by numerical simulations.


title: Query strategies for priced information, revisited

abstract: We consider the problem of designing query strategies for priced information, introduced by Charikar et al. In this problem the algorithm designer is given a function $f : \{0,1\}^n \to \{-1,1\}$ and a price associated with each of the $n$ coordinates. The goal is to design a query strategy for determining $f$'s value on unknown inputs for minimum cost. Prior works on this problem have focused on specific classes of functions. We analyze a simple and natural strategy that applies to all functions $f$, and show that its performance relative to the optimal strategy can be expressed in terms of a basic complexity measure of $f$, its influence. For $\varepsilon \in (0,\frac1{2})$, writing $\mathsf{opt}$ to denote the expected cost of the optimal strategy that errs on at most an $\varepsilon$-fraction of inputs, our strategy has expected cost $\mathsf{opt} \cdot \mathrm{Inf}(f)/\varepsilon^2$ and also errs on at most an $O(\varepsilon)$-fraction of inputs. This connection yields new guarantees that complement existing ones for a number of function classes that have been studied in this context, as well as new guarantees for new classes. Finally, we show that improving on the parameters that we achieve will require making progress on the longstanding open problem of properly learning decision trees.


title: Elastic Graphs for Main Molecule Matings

abstract: Recent work of Dylan Thurston gives a condition for when a post-critically finite branched self-cover of the sphere is equivalent to a rational map. We apply D. Thurston's positive criterion for rationality to give a new proof of a theorem of Rees, Shishikura, and Tan about the mateability of quadratic polynomials when one polynomial is in the main molecule. These methods may be a step in understanding the mateability of higher degree post-critically finite polynomials and demonstrate how to apply the positive criterion to classical problems.


title: Exploit Multiple Reference Graphs for Semi-supervised Relation Extraction

abstract: Manual annotation of the labeled data for relation extraction is time-consuming and labor-intensive. Semi-supervised methods can offer helping hands for this problem and have aroused great research interests. Existing work focuses on mapping the unlabeled samples to the classes to augment the labeled dataset. However, it is hard to find an overall good mapping function, especially for the samples with complicated syntactic components in one sentence. To tackle this limitation, we propose to build the connection between the unlabeled data and the labeled ones rather than directly mapping the unlabeled samples to the classes. Specifically, we first use three kinds of information to construct reference graphs, including entity reference, verb reference, and semantics reference. The goal is to semantically or lexically connect the unlabeled sample(s) to the labeled one(s). Then, we develop a Multiple Reference Graph (MRefG) model to exploit the reference information for better recognizing high-quality unlabeled samples. The effectiveness of our method is demonstrated by extensive comparison experiments with the state-of-the-art baselines on two public datasets.


title: A Disentangled Adversarial Neural Topic Model for Separating Opinions from Plots in User Reviews

abstract: The flexibility of the inference process in Variational Autoencoders (VAEs) has recently led to revising traditional probabilistic topic models giving rise to Neural Topic Models (NTMs). Although these approaches have achieved significant results, surprisingly very little work has been done on how to disentangle the latent topics. Existing topic models when applied to reviews may extract topics associated with writers' subjective opinions mixed with those related to factual descriptions such as plot summaries in movie and book reviews. It is thus desirable to automatically separate opinion topics from plot/neutral ones enabling a better interpretability. In this paper, we propose a neural topic model combined with adversarial training to disentangle opinion topics from plot and neutral ones. We conduct an extensive experimental assessment introducing a new collection of movie and book reviews paired with their plots, namely MOBO dataset, showing an improved coherence and variety of topics, a consistent disentanglement rate, and sentiment classification performance superior to other supervised topic models.


title: Dirichlet Process Mixture Models with Shrinkage Prior

abstract: We propose Dirichlet Process Mixture (DPM) models for prediction and cluster-wise variable selection, based on two choices of shrinkage baseline prior distributions for the linear regression coefficients, namely the Horseshoe prior and Normal-Gamma prior. We show in a simulation study that each of the two proposed DPM models tend to outperform the standard DPM model based on the non-shrinkage normal prior, in terms of predictive, variable selection, and clustering accuracy. This is especially true for the Horseshoe model, and when the number of covariates exceeds the within-cluster sample size. A real data set is analyzed to illustrate the proposed modeling methodology, where both proposed DPM models again attained better predictive accuracy.


title: Distilling Dense Representations for Ranking using Tightly-Coupled Teachers

abstract: We present an approach to ranking with dense representations that applies knowledge distillation to improve the recently proposed late-interaction ColBERT model. Specifically, we distill the knowledge from ColBERT's expressive MaxSim operator for computing relevance scores into a simple dot product, thus enabling single-step ANN search. Our key insight is that during distillation, tight coupling between the teacher model and the student model enables more flexible distillation strategies and yields better learned representations. We empirically show that our approach improves query latency and greatly reduces the onerous storage requirements of ColBERT, while only making modest sacrifices in terms of effectiveness. By combining our dense representations with sparse representations derived from document expansion, we are able to approach the effectiveness of a standard cross-encoder reranker using BERT that is orders of magnitude slower.


title: Kwame: A Bilingual AI Teaching Assistant for Online SuaCode Courses

abstract: Introductory hands-on courses such as our smartphone-based coding course, SuaCode require a lot of support for students to accomplish learning goals. Online environments make it even more difficult to get assistance especially more recently because of COVID-19. Given the multilingual context of SuaCode students - learners across 42 African countries that are mostly Anglophone or Francophone - in this work, we developed a bilingual Artificial Intelligence (AI) Teaching Assistant (TA) - Kwame - that provides answers to students' coding questions from SuaCode courses in English and French. Kwame is a Sentence-BERT (SBERT)-based question-answering (QA) system that we trained and evaluated offline using question-answer pairs created from the course's quizzes, lesson notes and students' questions in past cohorts. Kwame finds the paragraph most semantically similar to the question via cosine similarity. We compared the system with TF-IDF and Universal Sentence Encoder. Our results showed that fine-tuning on the course data and returning the top 3 and 5 answers improved the accuracy results. Kwame will make it easy for students to get quick and accurate answers to questions in SuaCode courses.


title: Adversarial Attacks on Deep Algorithmic Trading Policies

abstract: Deep Reinforcement Learning (DRL) has become an appealing solution to algorithmic trading such as high frequency trading of stocks and cyptocurrencies. However, DRL have been shown to be susceptible to adversarial attacks. It follows that algorithmic trading DRL agents may also be compromised by such adversarial techniques, leading to policy manipulation. In this paper, we develop a threat model for deep trading policies, and propose two attack techniques for manipulating the performance of such policies at test-time. Furthermore, we demonstrate the effectiveness of the proposed attacks against benchmark and real-world DQN trading agents.


title: UNITE: Uncertainty-based Health Risk Prediction Leveraging Multi-sourced Data

abstract: Successful health risk prediction demands accuracy and reliability of the model. Existing predictive models mainly depend on mining electronic health records (EHR) with advanced deep learning techniques to improve model accuracy. However, they all ignore the importance of publicly available online health data, especially socioeconomic status, environmental factors, and detailed demographic information for each location, which are all strong predictive signals and can definitely augment precision medicine. To achieve model reliability, the model needs to provide accurate prediction and uncertainty score of the prediction. However, existing uncertainty estimation approaches often failed in handling high-dimensional data, which are present in multi-sourced data. To fill the gap, we propose UNcertaInTy-based hEalth risk prediction (UNITE) model. Building upon an adaptive multimodal deep kernel and a stochastic variational inference module, UNITE provides accurate disease risk prediction and uncertainty estimation leveraging multi-sourced health data including EHR data, patient demographics, and public health data collected from the web. We evaluate UNITE on real-world disease risk prediction tasks: nonalcoholic fatty liver disease (NASH) and Alzheimer's disease (AD). UNITE achieves up to 0.841 in F1 score for AD detection, up to 0.609 in PR-AUC for NASH detection, and outperforms various state-of-the-art baselines by up to $19\%$ over the best baseline. We also show UNITE can model meaningful uncertainties and can provide evidence-based clinical support by clustering similar patients.


title: New methods to reconstruct $X_{\rm max}$ and the energy of gamma-ray air showers with high accuracy in large wide-field observatories

abstract: Novel methods to reconstruct the slant depth of the maximum of the longitudinal profile (\Xmax) of high-energy showers initiated by gamma-rays as well as their energy ($E_0$) are presented. The methods were developed for gamma rays with energies ranging from a few hundred GeV to $\sim 10$ TeV. An estimator of \Xmax is obtained, event-by-event, from its correlation with the distribution of the arrival time of the particles at the ground, or the signal at the ground for lower energies. An estimator of $E_0$ is obtained, event-by-event, using a parametrization that has as inputs the total measured energy at the ground, the amount of energy contained in a region near to the shower core and the estimated \Xmax. Resolutions about $40 \, (20)\,{\rm g/cm^2}$ and about $30 \, (20)\%$ for, respectively, \Xmax and $E_0$ at $1 \, (10) \ \rm{TeV}$ energies are obtained, considering vertical showers. The obtained results are auspicious and can lead to the opening of new physics avenues for large wide field-of-view gamma-ray observatories. The dependence of the resolutions with experimental conditions is discussed.


title: Unfolding Neural Networks for Compressive Multichannel Blind Deconvolution

abstract: We propose a learned-structured unfolding neural network for the problem of compressive sparse multichannel blind-deconvolution. In this problem, each channel's measurements are given as convolution of a common source signal and sparse filter. Unlike prior works where the compression is achieved either through random projections or by applying a fixed structured compression matrix, this paper proposes to learn the compression matrix from data. Given the full measurements, the proposed network is trained in an unsupervised fashion to learn the source and estimate sparse filters. Then, given the estimated source, we learn a structured compression operator while optimizing for signal reconstruction and sparse filter recovery. The efficient structure of the compression allows its practical hardware implementation. The proposed neural network is an autoencoder constructed based on an unfolding approach: upon training, the encoder maps the compressed measurements into an estimate of sparse filters using the compression operator and the source, and the linear convolutional decoder reconstructs the full measurements. We demonstrate that our method is superior to classical structured compressive sparse multichannel blind-deconvolution methods in terms of accuracy and speed of sparse filter recovery.


title: Ground-state Pulsed Cavity Electro-optics for Microwave-to-optical Conversion

abstract: In the development of quantum microwave-to-optical (MO) converters, excessive noise induced by the parametric optical drive remains a major challenge at milli-Kelvin temperatures. Here we study the extraneous noise added to an electro-optic transducer in its quantum ground state under an intense pulsed optical excitation. The integrated electro-optical transducer leverages the inherent Pockels effect of aluminum nitride microrings, flip-chip bonded to a superconducting resonator. Applying a pulsed optical drive with peak power exceeding the cooling power of the dilution refrigerator at its base temperature, we observe efficient bi-directional MO conversion, with near-ground state microwave thermal excitation ($\bar{n}_\mathrm{e}=0.09\pm0.06$). Time evolution study reveals that the residual thermal excitation is dominated by the superconductor absorption of stray light scattered off the chip-fiber interface. Our results shed light on suppressing microwave noise in a cavity electro-optic system under intense optical drive, which is an essential step towards quantum state transduction between microwave and optical frequencies.


title: The Efficacy of the Flipped Classroom Technique in Undergraduate Mathematics Education: A Review of the Research

abstract: The flipped classroom technique has recently been a focus of attention for many math instructors and pedagogical researchers. Although research on the subject has greatly increased in recent years, it is still debated whether the flipped classroom technique can significantly increase the overall success of students in undergraduate math courses. While there have been meta-analyses that consider the efficacy of the technique across university disciplines and within other STEM fields, there has not yet been a systematic review within undergraduate math education. By analyzing the existing research and compiling the quantitative and qualitative data, this paper examines the efficacy of the flipped classroom technique in undergraduate math courses, ranging from introductory calculus to transition-to-proof courses, in regards to students' performance in the classes, perceptions of the technique, and associated self-efficacy. This paper also introduces the current use of the technique and covers successful implementation methods. Additionally, it highlights the flipped classroom technique's potential for improving retention of members of underrepresented groups in math by increasing their sense of belonging as well as discusses the efficacy of the method in early proof-based courses in regards to students' acquisition of sociomathematical norms.


title: Localizing fractional quasiparticles on graphene quantum hall antidots

abstract: We report localization of fractional quantum Hall (QH) quasiparticles on graphene antidots. By studying coherent tunneling through the localized QH edge modes on the antidot, we measured the QH quasiparticle charges to be approximately $\pm e/3$ at fractional fillings of $\nu = \pm 1/3$. The Dirac spectrum in graphene allows large energy scales and robust quasiparticle localization against thermal excitation. The capability of localizing fractional quasiparticles on QH antidots brings promising opportunities for realizing anyon braiding and novel quantum electronics.


title: Developing Real-time Streaming Transformer Transducer for Speech Recognition on Large-scale Dataset

abstract: Recently, Transformer based end-to-end models have achieved great success in many areas including speech recognition. However, compared to LSTM models, the heavy computational cost of the Transformer during inference is a key issue to prevent their applications. In this work, we explored the potential of Transformer Transducer (T-T) models for the fist pass decoding with low latency and fast speed on a large-scale dataset. We combine the idea of Transformer-XL and chunk-wise streaming processing to design a streamable Transformer Transducer model. We demonstrate that T-T outperforms the hybrid model, RNN Transducer (RNN-T), and streamable Transformer attention-based encoder-decoder model in the streaming scenario. Furthermore, the runtime cost and latency can be optimized with a relatively small look-ahead.


title: Quantum entanglement and modulation enhancement of free-electron-bound-electron interaction

abstract: The modulation and engineering of the free-electron wave function bring new ingredients to the electron-matter interaction. We study the dynamics of a free-electron passing by a two-level system fully quantum mechanically and emphasize the enhancement of interaction from the modulation of the free-electron wave function. In presence of modulation of the free-electron wave function, we show that the electron energy loss/gain spectrum is greatly enhanced for a coherent initial state of the two-level system, which can function as a probe of the atomic coherence. We further find that distantly separated two-level atoms can be entangled through interacting with the same free electron. For a dilute beam of modulated electrons interacting with the atom, our theory shows the enhanced interaction due to resonant modulation.


title: When Machine Learning Meets Congestion Control: A Survey and Comparison

abstract: Machine learning (ML) has seen a significant surge and uptake across many diverse applications. The high flexibility, adaptability and computing capabilities it provides extends traditional approaches used in multiple fields including network operation and management. Numerous surveys have explored ML in the context of networking, such as traffic engineering, performance optimization and network security. Many ML approaches focus on clustering, classification, regression and reinforcement learning (RL). The innovation of this research and contribution of this paper lies in the detailed summary and comparison of learning-based congestion control (CC) approaches. Compared with traditional CC algorithms which are typically rule-based, capabilities to learn from historical experience are highly desirable. From the literature, it is observed that RL is a crucial trend among learning-based CC algorithms. In this paper, we explore the performance of RL-based CC algorithms and present current problems with RL-based CC algorithms. We outline challenges and trends related to learning-based CC algorithms.


title: DPD-InfoGAN: Differentially Private Distributed InfoGAN

abstract: Generative Adversarial Networks (GANs) are deep learning architectures capable of generating synthetic datasets. Despite producing high-quality synthetic images, the default GAN has no control over the kinds of images it generates. The Information Maximizing GAN (InfoGAN) is a variant of the default GAN that introduces feature-control variables that are automatically learned by the framework, hence providing greater control over the different kinds of images produced. Due to the high model complexity of InfoGAN, the generative distribution tends to be concentrated around the training data points. This is a critical problem as the models may inadvertently expose the sensitive and private information present in the dataset. To address this problem, we propose a differentially private version of InfoGAN (DP-InfoGAN). We also extend our framework to a distributed setting (DPD-InfoGAN) to allow clients to learn different attributes present in other clients' datasets in a privacy-preserving manner. In our experiments, we show that both DP-InfoGAN and DPD-InfoGAN can synthesize high-quality images with flexible control over image attributes while preserving privacy.


title: Thermal activation of valley-orbit states of neutral magnesium in silicon

abstract: Interstitial magnesium acts as a moderately deep double donor in silicon, and is relatively easily introduced by diffusion. Unlike the case of the chalcogen double donors, the binding energies of the even-parity valley-orbit excited states 1sT$_2$ and 1sE have remained elusive. Here we report on temperature dependence absorption measurements focusing on the neutral charge species. Our results demonstrate thermal activation from the ground state 1sA to the valley-orbit states, as observed by transitions from the thermally populated levels to the odd-parity states 2p$_0$ and 2p$_{\pm}$


title: Energy-Efficient Node Deployment in Heterogeneous Two-Tier Wireless Sensor Networks with Limited Communication Range

abstract: We study a heterogeneous two-tier wireless sensor network in which N heterogeneous access points (APs) collect sensing data from densely distributed sensors and then forward the data to M heterogeneous fusion centers (FCs). This heterogeneous node deployment problem is modeled as an optimization problem with the total power consumption of the network as its cost function. The necessary conditions of the optimal AP and FC node deployment are explored in this paper. We provide a variation of Voronoi Diagram as the optimal cell partition for this network and show that each AP should be placed between its connected FC and the geometric center of its cell partition. In addition, we propose a heterogeneous two-tier Lloyd algorithm to optimize the node deployment. Furthermore, we study the sensor deployment when the communication range is limited for sensors and APs. Simulation results show that our proposed algorithms outperform the existing clustering methods like Minimum Energy Routing, Agglomerative Clustering, Divisive Clustering, Particle Swarm Optimization, Relay Node placement in Double-tiered Wireless Sensor Networks, and Improved Relay Node Placement, on average.


title: Learning Transferrable Parameters for Long-tailed Sequential User Behavior Modeling

abstract: Sequential user behavior modeling plays a crucial role in online user-oriented services, such as product purchasing, news feed consumption, and online advertising. The performance of sequential modeling heavily depends on the scale and quality of historical behaviors. However, the number of user behaviors inherently follows a long-tailed distribution, which has been seldom explored. In this work, we argue that focusing on tail users could bring more benefits and address the long tails issue by learning transferrable parameters from both optimization and feature perspectives. Specifically, we propose a gradient alignment optimizer and adopt an adversarial training scheme to facilitate knowledge transfer from the head to the tail. Such methods can also deal with the cold-start problem of new users. Moreover, it could be directly adaptive to various well-established sequential models. Extensive experiments on four real-world datasets verify the superiority of our framework compared with the state-of-the-art baselines.


title: On invariant tori in some reversible systems

abstract: In the present paper, we consider the following reversible system \begin{equation*} \begin{cases} \dot{x}=\omega_0+f(x,y),\\ \dot{y}=g(x,y), \end{cases} \end{equation*} where $x\in\mathbf{T}^{d}$, $y\backsim0\in \mathbf{R}^{d}$, $\omega_0$ is Diophantine, $f(x,y)=O(y)$, $g(x,y)=O(y^2)$ and $f$, $g$ are reversible with respect to the involution G: $(x,y)\mapsto(-x,y)$, that is, $f(-x,y)=f(x,y)$, $g(-x,y)=-g(x,y)$. We study the accumulation of an analytic invariant torus $\Gamma_0$ of the reversible system with Diophantine frequency $\omega_0$ by other invariant tori. We will prove that if the Birkhoff normal form around $\Gamma_0$ is 0-degenerate, then $\Gamma_0$ is accumulated by other analytic invariant tori, the Lebesgue measure of the union of these tori being positive and the density of the union of these tori at $\Gamma_0$ being one. We will also prove that if the Birkhoff normal form around $\Gamma_0$ is $j$-degenerate ($1\leq j\leq d-1$) and condition (1.6) is satisfied, then through $\Gamma_0$ there passes an analytic subvariety of dimension $d+j$ foliated into analytic invariant tori with frequency vector $\omega_0$. If the Birkhoff normal form around $\Gamma_0$ is $d-1$-degenerate, we will prove a stronger result, that is, a full neighborhood of $\Gamma_0$ is foliated into analytic invariant tori with frequency vectors proportional to $\omega_0$.


title: Do instabilities in high-multiplicity systems explain the existence of close-in white dwarf planets?

abstract: We investigate the origin of close-in planets and related phenomena orbiting white dwarfs (WDs), which are thought to originate from orbits more distant from the star. We use the planetary architectures of the 75 multiple-planet systems (four, five and six planets) detected orbiting main-sequence stars to build 750 dynamically analogous templates that we evolve to the WD phase. Our exploration of parameter space, although not exhaustive, is guided and restricted by observations and we find that the higher the multiplicity of the planetary system, the more likely it is to have a dynamical instability (losing planets, orbit crossing and scattering), that eventually will send a planet (or small object) through a close periastron passage. Indeed, the fraction of unstable four- to six-planet simulations is comparable to the 25-50$\%$ fraction of WDs having atmospheric pollution. Additionally, the onset of instability in the four- to six-planet configurations peaks in the first Gyr of the WD cooling time, decreasing thereafter. Planetary multiplicity is a natural condition to explain the presence of close-in planets to WDs, without having to invoke the specific architectures of the system or their migration through the von Zeipel-Lidov-Kozai (ZLK) effects from binary companions or their survival through the common envelope phase.


title: Electrical and Thermal Transport Properties of the beta-Pyrochlore Oxide CsW2O6

abstract: We report the electrical resistivity, thermoelectric power, and thermal conductivity of single-crystalline and sintered samples of the 5d pyrochlore oxide CsW2O6. The electrical resistivity of the single crystal is 3 mohm cm at 295 K and gradually increases with decreasing temperature above 215 K (Phase I). The thermoelectric power of the single-crystalline and sintered samples shows a constant value of approximately -60 uV K-1 in Phase I. These results reflect that the electron conduction by W 5d electrons in Phase I is incoherent and in the hopping regime, although a band gap does not open at the Fermi level. The thermal conductivity in Phase I of both samples is considerably low, which might be due to the rattling of Cs+ ions. In Phase II below 215 K, the electrical resistivity and the absolute value of thermoelectric power of both samples strongly increase with decreasing temperature, corresponding to a transition to a semiconducting state with a band gap open at the Fermi level, while the thermal conductivity in Phase II is smaller than that in Phase I.


title: A Systematic Approach to Surveillance and Detection of Hierarchical Healthcare Cost Drivers and Utilization Offsets

abstract: There is strong interest among healthcare payers to identify emerging healthcare cost drivers to support early intervention. However, many challenges arise in analyzing large, high dimensional, and noisy healthcare data. In this paper, we propose a systematic approach that utilizes hierarchical search strategies and enhanced statistical process control (SPC) algorithms to surface high impact cost drivers. Our approach aims to provide interpretable, detailed, and actionable insights of detected change patterns attributing to multiple clinical factors. We also proposed an algorithm to identify comparable treatment offsets at the population level and quantify the cost impact on their utilization changes. To illustrate our approach, we apply it to the IBM Watson Health MarketScan Commercial Database and organized the detected emerging drivers into 5 categories for reporting. We also discuss some findings in this analysis and potential actions in mitigating the impact of the drivers.


title: 1-norm minimization and minimum-rank structured sparsity for symmetric and ah-symmetric generalized inverses: rank one and two

abstract: Generalized inverses are important in statistics and other areas of applied matrix algebra. A \emph{generalized inverse} of a real matrix $A$ is a matrix $H$ that satisfies the Moore-Penrose (M-P) property $AHA=A$. If $H$ also satisfies the M-P property $HAH=H$, then it is called \emph{reflexive}. Reflexivity of a generalized inverse is equivalent to minimum rank, a highly desirable property. We consider aspects of symmetry related to the calculation of various \emph{sparse} reflexive generalized inverses of $A$. As is common, we use (vector) 1-norm minimization for both inducing sparsity and for keeping the magnitude of entries under control. When $A$ is symmetric, a symmetric $H$ is highly desirable, but generally such a restriction on $H$ will not lead to a 1-norm minimizing reflexive generalized inverse. We investigate a block construction method to produce a symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. Letting the rank of $A$ be $r$, we establish that the 1-norm minimizing generalized inverse of this type is a 1-norm minimizing symmetric generalized inverse when (i) $r=1$ and when (ii) $r=2$ and $A$ is nonnegative. Another aspect of symmetry that we consider relates to another M-P property: $H$ is \emph{ah-symmetric} if $AH$ is symmetric. The ah-symmetry property is sufficient for a generalized inverse to be used to solve the least-squares problem $\min\{\|Ax-b\|_2:~x\in\mathbb{R}^n\}$ using $H$, via $x:=Hb$. We investigate a column block construction method to produce an ah-symmetric reflexive generalized inverse that is structured and has guaranteed sparsity. We establish that the 1-norm minimizing ah-symmetric generalized inverse of this type is a 1-norm minimizing ah-symmetric generalized inverse when (i) $r=1$ and when (ii) $r=2$ and $A$ satisfies a technical condition.


title: On the mixed scalar curvature of almost multi-product manifolds

abstract: A pseudo-Riemannian manifold endowed with $k>2$ orthogonal complementary distributions (called a Riemannian almost multi-product structure) appears in such topics as multiply warped products, the webs composed of several foliations, Dupin hypersurfaces and in stu\-dies of the curvature and Einstein equations. In this article, we consider the following two problems on the mixed scalar curvature of a Riemannian almost multi-product manifold with a linear connection: a) integral formulas and applications to splitting of manifolds, b) variation formulas and applications to the mixed Einstein-Hilbert action, and we generalize certain results on the mixed scalar curvature of pseudo-Riemannian almost product manifolds.


title: Robust Text-Dependent Speaker Verification via Character-Level Information Preservation for the SdSV Challenge 2020

abstract: This paper describes our submission to Task 1 of the Short-duration Speaker Verification (SdSV) challenge 2020. Task 1 is a text-dependent speaker verification task, where both the speaker and phrase are required to be verified. The submitted systems were composed of TDNN-based and ResNet-based front-end architectures, in which the frame-level features were aggregated with various pooling methods (e.g., statistical, self-attentive, ghostVLAD pooling). Although the conventional pooling methods provide embeddings with a sufficient amount of speaker-dependent information, our experiments show that these embeddings often lack phrase-dependent information. To mitigate this problem, we propose a new pooling and score compensation methods that leverage a CTC-based automatic speech recognition (ASR) model for taking the lexical content into account. Both methods showed improvement over the conventional techniques, and the best performance was achieved by fusing all the experimented systems, which showed 0.0785% MinDCF and 2.23% EER on the challenge's evaluation subset.


title: Partial data inverse problems for quasilinear conductivity equations

abstract: We show that the knowledge of the Dirichlet-to-Neumann maps given on an arbitrary open non-empty portion of the boundary of a smooth domain in $\mathbb{R}^n$, $n\ge 2$, for classes of semilinear and quasilinear conductivity equations, determines the nonlinear conductivities uniquely. The main ingredient in the proof is a certain $L^1$-density result involving sums of products of gradients of harmonic functions which vanish on a closed proper subset of the boundary.


title: The approximate variation of univariate uniform space valued functions and pointwise selection principles

abstract: Let $T\subset\mathbb{R}$ and $(X,\mathcal{U})$ be a uniform space with an at most countable gage of pseudometrics $\{d_p:p\in\mathcal{P}\}$ of the uniformity $\mathcal{U}$. Given $f\in X^T$ (=the family of all functions from $T$ into $X$), the approximate variation of $f$ is the two-parameter family $\{V_{\varepsilon,p}(f):\varepsilon>0,p\in\mathcal{P}\}$, where $V_{\varepsilon,p}(f)$ is the greatest lower bound of Jordan's variations $V_p(g)$ on $T$ with respect to $d_p$ of all functions $g\in X^T$ such that $d_p(f(t),g(t))\le\varepsilon$ for all $t\in T$. We establish the following pointwise selection principle: If a pointwise relatively sequentially compact sequence of functions $\{f_j\}_{j=1}^\infty\subset X^T$ is such that $\limsup_{j\to\infty}V_{\varepsilon,p}(f_j)<\infty$ for all $\varepsilon>0$ and $p\in\mathcal{P}$, then it contains a subsequence which converges pointwise on $T$ to a bounded regulated function $f\in X^T$. We illustrate this result by appropriate examples, and present a characterization of regulated functions $f\in X^T$ in terms of the approximate variation.


title: Value Cards: An Educational Toolkit for Teaching Social Impacts of Machine Learning through Deliberation

abstract: Recently, there have been increasing calls for computer science curricula to complement existing technical training with topics related to Fairness, Accountability, Transparency, and Ethics. In this paper, we present Value Card, an educational toolkit to inform students and practitioners of the social impacts of different machine learning models via deliberation. This paper presents an early use of our approach in a college-level computer science course. Through an in-class activity, we report empirical data for the initial effectiveness of our approach. Our results suggest that the use of the Value Cards toolkit can improve students' understanding of both the technical definitions and trade-offs of performance metrics and apply them in real-world contexts, help them recognize the significance of considering diverse social values in the development of deployment of algorithmic systems, and enable them to communicate, negotiate and synthesize the perspectives of diverse stakeholders. Our study also demonstrates a number of caveats we need to consider when using the different variants of the Value Cards toolkit. Finally, we discuss the challenges as well as future applications of our approach.