title: PrivateFetch: Scalable Catalog Delivery in Privacy-Preserving Advertising

abstract: In order to preserve the possibility of an Internet that is free at the point of use, attention is turning to new solutions that would allow targeted advertisement delivery based on behavioral information such as user preferences, without compromising user privacy. Recently, explorations in devising such systems either take approaches that rely on semantic guarantees like $k$-anonymity -- which can be easily subverted when combining with alternative information, and do not take into account the possibility that even knowledge of such clusters is privacy-invasive in themselves. Other approaches provide full privacy by moving all data and processing logic to clients -- but which is prohibitively expensive for both clients and servers. In this work, we devise a new framework called PrivateFetch for building practical ad-delivery pipelines that rely on cryptographic hardness and best-case privacy, rather than syntactic privacy guarantees or reliance on real-world anonymization tools. PrivateFetch utilizes local computation of preferences followed by high-performance single-server private information retrieval (PIR) to ensure that clients can pre-fetch ad content from servers, without revealing any of their inherent characteristics to the content provider. When considering an database of $>1,000,000$ ads, we show that we can deliver $30$ ads to a client in 40 seconds, with total communication costs of 192KB. We also demonstrate the feasibility of PrivateFetch by showing that the monetary cost of running it is less than 1% of average ad revenue. As such, our system is capable of pre-fetching ads for clients based on behavioral and contextual user information, before displaying them during a typical browsing session. In addition, while we test PrivateFetch as a private ad-delivery, the generality of our approach means that it could also be used for other content types.


title: Knowing when to stop

abstract: When do we stop an ongoing science project to make room for something new? Decision-making is a complex process, ranging from budgetary considerations and tension between ongoing projects, to progress assessments and allowance for novel science developments.


title: Simple Post-Training Robustness Using Test Time Augmentations and Random Forest

abstract: Although Deep Neural Networks (DNNs) achieve excellent performance on many real-world tasks, they are highly vulnerable to adversarial attacks. A leading defense against such attacks is adversarial training, a technique in which a DNN is trained to be robust to adversarial attacks by introducing adversarial noise to its input. This procedure is effective but must be done during the training phase. In this work, we propose Augmented Random Forest (ARF), a simple and easy-to-use strategy for robustifying an existing pretrained DNN without modifying its weights. For every image, we generate randomized test time augmentations by applying diverse color, blur, noise, and geometric transforms. Then we use the DNN's logits output to train a simple random forest to predict the real class label. Our method achieves state-of-the-art adversarial robustness on a diversity of white and black box attacks with minimal compromise on the natural images' classification. We test ARF also against numerous adaptive white-box attacks and it shows excellent results when combined with adversarial training. Code is available at https://github.com/giladcohen/ARF.


title: BuDDI: A Declarative Bloom Language for CALM Programming

abstract: Coordination protocols help programmers of distributed systems reason about the effects of transactions on the state of the system, but they're not cheap. Coordination protocols may involve multiple rounds of communication, which can hurt system responsiveness. There exist many efforts in distributed computing for managing the coordination-performance trade-off. More recent is a line of work that characterizes the class of workloads for which coordination is not necessary for consistency: namely, logically monotonic programs. In this paper, we present a case study of logical monotonicity in workloads typical to computational biology. We leverage the Bloom language to write efficient distributed programs, and compare their performance to equivalent programs written in UPC++, a popular language for writing distributed programs. Additionally, we leverage Bloom's analysis tools to identify points-of-coordination, and use our own experience using Bloom to recommend some higher-level abstractions for users without strong distributed computing backgrounds.


title: Shadow of Hypergraphs with Bounded Degree

abstract: We study the size of the shadow of $k$-uniform hypergraphs with bounded degree. Lower bounds on the ratio of the size of the shadow and the size of the hypergraph are given as a function of the degree bound and $k$. We show that cliques are extremal for a long range of degree bounds, but not for every bound. We give a general, but not sharp lower bound on the shadow ratio and show, that sometimes we can get extremal hypergraphs by deleting disjoint maximal matchings from a clique.


title: Self-avoidant memory effects on enhanced diffusion in a stochastic model of environmentally responsive swimming droplets

abstract: Enhanced diffusion is an emergent property of many experimental microswimmer systems that usually arises from a combination of ballistic motion with random reorientations. A subset of these systems, autophoretic droplet swimmers that move as a result of Marangoni stresses, have additionally been shown to respond to local, self-produced chemical gradients that can mediate self-avoidance or self-attraction. Via this mechanism, we present a mathematical model constructed to encode experimentally observed self-avoidant memory and numerically study the effect of this particular memory on the enhanced diffusion of such swimming droplets. To disentangle the enhanced diffusion due to the random reorientations from the enhanced diffusion due to the self-avoidant memory, we compare to the widely-used active Brownian model. Paradoxically, we find that the enhanced diffusion is substantially suppressed by the self-avoidant memory relative to that predicted by only an equivalent reorientation persistence timescale in the active Brownian model. We attribute this to transient self-caging that we propose is novel for self-avoidant systems. Additionally, we further explore the model parameter space by computing emergent parameters that capture the velocity and reorientation persistence, thus finding a finite parameter domain in which enhanced diffusion is observable.


title: A Data-Driven Uncertainty Quantification Method for Stochastic Economic Dispatch

abstract: This letter proposes a data-driven sparse polynomial chaos expansion-based surrogate model for the stochastic economic dispatch problem considering uncertainty from wind power. The proposed method can provide accurate estimations for the statistical information (e.g., mean, variance, probability density function, and cumulative distribution function) for the stochastic economic dispatch solution efficiently without requiring the probability distributions of random inputs. Simulation studies on an integrated electricity and gas system (IEEE 118-bus system integrated with a 20-node gas system are presented, demonstrating the efficiency and accuracy of the proposed method compared to the Monte Carlo simulations.


title: MEAM parameterization for cyclic and tensile deformations of Gold-Silver core-shell systems

abstract: Gold-Silver (Au-Ag) core-shell nanostructures are gaining importance in stretchable electronics where high tensile and fatigue resistance is of paramount importance. This work proposes the parameterization of a modified embedded atomic model (MEAM) interatomic potential through density functional theory (DFT) calculations for investigating the role of dislocations and defect interaction governing the mechanical behavior of Au-Ag and Ag-Au Core-shell nanostructures under tensile and fatigue loading using molecular dynamics (MD) simulations. A comparative analysis between the Core-shell structures and their pristine counterparts is also conducted. Throughout this work, pseudo-potential and all-electron full potential DFT schemes are used for parameterizing MEAM by calculating cohesive energy, lattice parameter, and bulk modulus of pure Au, Ag and their alloy. Using the new force-field for MD simulations, the tensile behavior of pristine and core-shell nanowires is explored for temperatures between 300K to 600K. The fatigue properties of two pristine and two core-shell nanowires in a strain range of -15% to 15% for 10 cycles is also conducted. Our results suggest that Ag-Au Core-shell nanowire shows the best reversibility under fatigue loading among the structures examined. Moreover, Ag-Au exhibit the highest dislocation formation and complete annihilation of defects consistently. While, Au-Ag present improved fatigue properties than its pristine counterparts but have some residual defects leading to lower reversibility when compared to Ag-Au. For tensile loading, all four structures exhibited deterioration in strength with increasing temperature. Thermal softening is seen to be more prominent in Au-Ag core-shell nanowires compared to Ag-Au.


title: Strategies of Network Intervention: A Pragmatic Approach to Policy Implementation and Public Problem Resolution through Network Science

abstract: Public administration has yet to examine networks in terms of intervention, where network mechanisms are manipulated to promote behavioral change and improve social, organizational, and community outcomes. We argue that to fulfill the potential of network scholarship in public administration, the field requires a framework for intervention approaches tailored to the relational and interdependent context of public problems. Building on Valente's (2012) typology, we develop a framework for strategies of public sector network intervention. First, we describe the core concepts in the theory of network interventions found primarily in public health. Next, we expand the existing typology of interventions to include macro-institutional strategies suited to public administration settings. We then identify extant public sector literature that provides the building blocks for a framework for intervention. Finally, we classify the modes of intervention along three dimensions: (i) the processes targeted for change (network formation versus network effects), (ii) the types of nodes in the network (organizations versus individuals), and (iii) the level at which the intervention operates (macro versus micro). We provide scholars and practitioners with a useful way to conceptualize where, why, and how network interventions might be deployed.


title: Monte Carlo simulations of neutrino and charged lepton propagation in the Earth with nuPyProp

abstract: An accurate modeling of neutrino flux attenuation and the distribution of leptons they produce in transit through the Earth is an essential component to determine neutrino flux sensitivities of underground, sub-orbital and space-based detectors. Through neutrino oscillations over cosmic distances, astrophysical neutrino sources are expected to produce nearly equal fluxes of electron, muon and tau neutrinos. Of particular interest are tau neutrinos that interact in the Earth at modest slant depths to produce $\tau$-leptons. Some $\tau$-leptons emerge from the Earth and decay in the atmosphere to produce extensive air showers. Future balloon-borne and satellite-based optical Cherenkov neutrino telescopes will be sensitive to upward air showers from tau neutrino induced $\tau$-lepton decays. We present nuPyProp, a python code that is part of the nuSpaceSim package. nuPyProp generates look-up tables for exit probabilities and energy distributions for $\nu_\tau\to \tau$ and $\nu_\mu\to \mu$ propagation in the Earth. This flexible code runs with either stochastic or continuous electromagnetic energy losses for the lepton transit through the Earth. Current neutrino cross section models and energy loss models are included along with templates for user input of other models. Results from nuPyProp are compared with other recent simulation packages for neutrino and charged lepton propagation. Sources of modeling uncertainties are described and quantified.


title: Chemical bonding theories as guides for self-interaction corrected solutions: multiple local minima and symmetry breaking

abstract: Fermi--L\"owdin orbitals (FLO) are a special set of localized orbitals, which have become commonly used in combination with the Perdew--Zunger self-interaction correction (SIC) in the FLO-SIC method. The FLOs are obtained for a set of occupied orbitals by specifying a classical position for each electron. These positions are known as Fermi-orbital descriptors (FODs), and they have a clear relation to chemical bonding. In this study, we show how FLOs and FODs can be used to initialize, interpret and justify SIC solutions in a common chemical picture, both within FLO-SIC and in traditional variational SIC, and to locate distinct local minima in either of these approaches. We demonstrate that FLOs based on Lewis' theory lead to symmetry breaking for benzene -- the electron density is found to break symmetry already at the symmetric molecular structure -- while ones from Linnett's double-quartet theory reproduce symmetric electron densities and molecular geometries. Introducing a benchmark set of 16 planar, cyclic molecules, we show that using Lewis' theory as the starting point can lead to artifactual dipole moments of up to 1 Debye, while Linnett SIC dipole moments are in better agreement with experimental values. We suggest using the dipole moment as a diagnostic of symmetry breaking in SIC and monitoring it in all SIC calculations. We show that Linnett structures can often be seen as superpositions of Lewis structures and propose Linnett structures as a simple way to describe aromatic systems in SIC with reduced symmetry breaking. The role of hovering FODs is also briefly discussed.


title: Zero-energy Andreev bound states in iron-based superconductor Fe(Te,Se)

abstract: Majorana bound states have been predicted to exist in vortices of topological superconductors (SC). A realization of the Fu-Kane model, based on a three-dimensional topological insulator brought into proximity to an $s$-wave SC, in iron-based SC Fe(Te,Se) has attracted strong interest after pronounced zero-energy bias peaks were observed in several experiments. Here, we show that, by taking into account inhomogeneities of the chemical potential or the presence of potential impurities on the surface of Fe(Te,Se), the emergence of these zero-energy bias peaks can be explained by trivial Andreev bound states (ABSs) whose energies are close to zero. Our numerical simulations reveal that the ABSs behave similarly to Majorana bound states. ABSs are localized only on the, say, top surface and cannot be distinguished from their topological counterparts in transport experiments performed with STM tips. Thus, such ABSs deserve a careful investigation of their own.


title: Quantum fluctuations of baryon number density

abstract: Quantum fluctuation expression of the baryon number for a subsystem consisting of hot relativistic spin-$\frac{1}{2}$ particles are derived. These fluctuations seems to diverge in the limit where system size goes to zero. For a broad range of thermodynamic parameters numerical solutions are obtained which might be helpful to interpret the heavy-ion experimental data.

categories: nucl-th cond-mat.stat-mech hep-ph hep-th


title: Deterministic transformations between unitary operations: Exponential advantage with adaptive quantum circuits and the power of indefinite causality

abstract: This work analyses the performance of quantum circuits and general processes to transform $k$ uses of an arbitrary unitary operation $U$ into another unitary operation $f(U)$. When the desired function $f$ a homomorphism, i.e., $f(UV)=f(U)f(V)$, it is known that optimal average fidelity is attainable by parallel circuits and indefinite causality does not provide any advantage. Here we show that the situation changes dramatically when considering anti-homomorphisms, i.e., $f(UV)=f(V)f(U)$. In particular, we prove that when $f$ is an anti-homomorphism, sequential circuits could exponentially outperform parallel ones and processes with indefinite causal order could outperform sequential ones. We presented explicit constructions on how to obtain such advantages for the unitary inversion task $f(U)=U^{-1}$ and the unitary transposition task $f(U)=U^T$. We also stablish a one-to-one connection between the problem of unitary estimation and parallel unitary transposition, allowing one to easily translate results from one field to the other. Finally, we apply our results to several concrete problem instances and present a method based on computer-assisted proofs to show optimality.


title: Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer vision

abstract: In this paper I investigate the effect of random seed selection on the accuracy when using popular deep learning architectures for computer vision. I scan a large amount of seeds (up to $10^4$) on CIFAR 10 and I also scan fewer seeds on Imagenet using pre-trained models to investigate large scale datasets. The conclusions are that even if the variance is not very large, it is surprisingly easy to find an outlier that performs much better or much worse than the average.


title: Finite-temperature effects on D-meson properties

abstract: We study the spectroscopy and transport properties of charmed mesons in a thermal medium by applying an effective field theory based on chiral and heavy-quark symmetries in the imaginary time formalism. Relying on unitarity constraints and self-consistency we extract the in-medium properties (masses and widths) of $D$ and $D_s$ mesons and their interactions with light hadrons. We report our findings on 1) dynamically generated states, 2) thermal evolution of chiral partners, 3) in-medium scattering amplitudes, and 4) transport coefficients below the chiral restoration temperature.


title: Functionalized Tellurene; a candidate large-gap 2D Topological Insulator

abstract: The discovery of group IV and V elemental Xene's which exhibit topologically non-trivial characters natively in their honeycomb lattice structure (HLS) has led to extensive efforts in realising analogous behaviour in group VI elemental monolayers. Although; it was theoretically concluded that group VI elemental monolayers cannot exist as HLS but recent experimental evidence suggests otherwise. In this letter we report that, HLS of group VI elemental monolayer (such as, Tellurene) can be realised to be dynamically stable when functionzalised with Oxygen. The functionalization leads to, peculiar orbital filtering effects (OFE) and broken spatial inversion symmetry which gives rise to the non-trivial topological character. The exotic quantum behaviour of this system is characterized by, spin-orbit coupling induced large-gap $\approx$ 0.36 eV with isolated Dirac cone along the edges indicating perspective room temperature spin-transport applications. Further investigations of spin Hall conductivity and the Berry curvatures unravel high conductivity as compared to previously explored Xene's. The non-trivial topological character is quantified in terms of the $\mathbb{Z}_2$ invaraint as $\nu =$ 1 and Chern number $\mathit{C} =$ 1. Also, for practical purposes, we report that, \textit{h}BN/TeO/\textit{h}BN quantum-wells can be strain engineered to realize a sizable non-trivial gap ($\approx$ 0.11 eV). We finally conclude that, functionalization of group VI elemental monolayer with Oxygen gives rise to, exotic quantum properties which are robust against surface oxidation and degradations while providing viable electronic degrees of freedom for spintronic applications.


title: Towards the cellular-scale simulation of motor-driven cytoskeletal assemblies

abstract: The cytoskeleton -- a collection of polymeric filaments, molecular motors, and crosslinkers -- is a foundational example of active matter, and in the cell assembles into organelles that guide basic biological functions. Simulation of cytoskeletal assemblies is an important tool for modeling cellular processes and understanding their surprising material properties. Here we present aLENS, a novel computational framework to surmount the limits of conventional simulation methods. We model molecular motors with crosslinking kinetics that adhere to a thermodynamic energy landscape, and integrate the system dynamics while efficiently and stably enforcing hard-body repulsion between filaments -- molecular potentials are entirely avoided in imposing steric constraints. Utilizing parallel computing, we simulate different mixtures of tens to hundreds of thousands of cytoskeletal filaments and crosslinking motors, recapitulating self-emergent phenomena such as bundle formation and buckling, and elucidating how motor type, thermal fluctuations, internal stresses, and confinement determine the evolution of active matter aggregates.


title: Numerical reasoning in machine reading comprehension tasks: are we there yet?

abstract: Numerical reasoning based machine reading comprehension is a task that involves reading comprehension along with using arithmetic operations such as addition, subtraction, sorting, and counting. The DROP benchmark (Dua et al., 2019) is a recent dataset that has inspired the design of NLP models aimed at solving this task. The current standings of these models in the DROP leaderboard, over standard metrics, suggest that the models have achieved near-human performance. However, does this mean that these models have learned to reason? In this paper, we present a controlled study on some of the top-performing model architectures for the task of numerical reasoning. Our observations suggest that the standard metrics are incapable of measuring progress towards such tasks.


title: Some aspects of Ricci flow on the 4-sphere

abstract: In this paper, on 4-spheres equipped with Riemannian metrics we study some integral conformal invariants, the sign and size of which under Ricci flow characterize the standard 4-sphere. We obtain a conformal gap theorem, and for Yamabe metrics of positive scalar curvature with $L^2$ norm of the Weyl tensor of the metric suitably small, we establish the monotonic decay of the $L^p$ norm for certain $p>2$ of the reduced curvature tensor along the normalized Ricci flow, with the metric converging exponentially to the standard 4-sphere.


title: A pasting lemma for Lipschitz functions

abstract: We give a necessary and sufficient condition ensuring that any function which is separately Lipschitz on two fixed compact sets is Lipschitz on their union.


title: Saturated and linear isometric transfer systems for cyclic groups of order $p^mq^n$

abstract: Transfer systems are combinatorial objects which classify $N_\infty$ operads up to homotopy. By results of A. Blumberg and M. Hill, every transfer system associated to a linear isometries operad is also saturated (closed under a particular two-out-of-three property). We investigate saturated and linear isometric transfer systems with equivariance group $C_{p^mq^n}$, the cyclic group of order $p^mq^n$ for $p,q$ distinct primes and $m,n\ge 0$. We give a complete enumeration of saturated transfer systems for $C_{p^mq^n}$. We also prove J. Rubin's saturation conjecture for $C_{pq^n}$; this says that every saturated transfer system is realized by a linear isometries operad for $p,q$ sufficiently large (greater than $3$ in this case).


title: Transport of localized and extended excitations in one-dimensional electrical lattices

abstract: We study the scattering properties of a bi-inductive electrical lattice consisting of a one-dimensional array of coupled LC units. For an initially localized electrical excitation, and in the absence of any impurity, we compute in closed form the mean square displacement of an initially localized electrical excitation for the cases of an infinite and semi-infinite lattice, obtaining a ballistic propagation under very general conditions. For the transport of extended excitations, we compute in closed form the transmission coefficient of electro-inductive plane waves across an impurity region, containing a number of side-coupled units, or a single internal impurity with coupling to first-and second nearest neighbors, looking for the presence of Fano resonances (FRs). For all cases examined, we obtain a closed-form expression for the position of the FR in terms of the relative strengths of the inductive couplings involved. For the case of two, identical side-coupled impurities, the position of the single FR turns out to be independent of the relative distance between the two impurities.


title: Generalizations of harmonic functions in $\mathbb{R}^m$

abstract: In recent works, arbitrary structural sets in the non-commutative Clifford analysis context have been used to introduce non-trivial generalizations of harmonic Clifford algebra valued functions in $\mathbb{R}^m$. Being defined as the solutions of elliptic (generally non-strongly elliptic) partial differential equations, $(\varphi,\psi)$-inframonogenic and $(\varphi,\psi)$-harmonic functions do not share the good structure and properties of the harmonic ones. The aim of this paper it to show and clarified the relationship between these classes of functions.


title: Reliable Neural Networks for Regression Uncertainty Estimation

abstract: While deep neural networks are highly performant and successful in a wide range of real-world problems, estimating their predictive uncertainty remains a challenging task. To address this challenge, we propose and implement a loss function for regression uncertainty estimation based on the Bayesian Validation Metric (BVM) framework while using ensemble learning. The proposed loss reproduces maximum likelihood estimation in the limiting case. A series of experiments on in-distribution data show that the proposed method is competitive with existing state-of-the-art methods. Experiments on out-of-distribution data show that the proposed method is robust to statistical change and exhibits superior predictive capability.


title: Procedures as Programs: Hierarchical Control of Situated Agents through Natural Language

abstract: When humans conceive how to perform a particular task, they do so hierarchically: splitting higher-level tasks into smaller sub-tasks. However, in the literature on natural language (NL) command of situated agents, most works have treated the procedures to be executed as flat sequences of simple actions, or any hierarchies of procedures have been shallow at best. In this paper, we propose a formalism of procedures as programs, a powerful yet intuitive method of representing hierarchical procedural knowledge for agent command and control. We further propose a modeling paradigm of hierarchical modular networks, which consist of a planner and reactors that convert NL intents to predictions of executable programs and probe the environment for information necessary to complete the program execution. We instantiate this framework on the IQA and ALFRED datasets for NL instruction following. Our model outperforms reactive baselines by a large margin on both datasets. We also demonstrate that our framework is more data-efficient, and that it allows for fast iterative development.


title: Pre-trained Gaussian processes for Bayesian optimization

abstract: Bayesian optimization (BO) has become a popular strategy for global optimization of expensive real-world functions. Contrary to a common expectation that BO is suited to optimizing black-box functions, it actually requires domain knowledge about those functions to deploy BO successfully. Such domain knowledge often manifests in Gaussian process (GP) priors that specify initial beliefs on functions. However, even with expert knowledge, it is non-trivial to quantitatively define a prior. This is especially true for hyperparameter tuning problems on complex machine learning models, where landscapes of tuning objectives are often difficult to comprehend. We seek an alternative practice for setting these functional priors. In particular, we consider the scenario where we have data from similar functions that allow us to pre-train a tighter distribution a priori. In this work, we detail what pre-training entails for GPs using a KL divergence based loss function, and propose a new pre-training based BO framework named HyperBO. Theoretically, we show bounded posterior predictions and near-zero regrets for HyperBO without assuming the "ground truth" GP prior is known. To verify our approach in realistic model training setups, we collect a large multi-task hyperparameter tuning dataset by training tens of thousands of configurations of near-state-of-the-art deep learning models on popular image and text datasets, as well as a protein sequence dataset. Our results show that on average, HyperBO is able to locate good hyperparameters at least 3 times more efficiently than the best competing methods on both our new tuning dataset and classic multi-task BO benchmarks.


title: Beyond Average Performance -- exploring regions of deviating performance for black box classification models

abstract: Machine learning models are becoming increasingly popular in different types of settings. This is mainly caused by their ability to achieve a level of predictive performance that is hard to match by human experts in this new era of big data. With this usage growth comes an increase of the requirements for accountability and understanding of the models' predictions. However, the degree of sophistication of the most successful models (e.g. ensembles, deep learning) is becoming a large obstacle to this endeavour as these models are essentially black boxes. In this paper we describe two general approaches that can be used to provide interpretable descriptions of the expected performance of any black box classification model. These approaches are of high practical relevance as they provide means to uncover and describe in an interpretable way situations where the models are expected to have a performance that deviates significantly from their average behaviour. This may be of critical relevance for applications where costly decisions are driven by the predictions of the models, as it can be used to warn end users against the usage of the models in some specific cases.


title: Growth of Mahler measure and algebraic entropy of dynamics with the Laurent property

abstract: We consider the growth rate of the Mahler measure in discrete dynamical systems with the Laurent property, and in cluster algebras, and compare this with other measures of growth. In particular, we formulate the conjecture that the growth rate of the logarithmic Mahler measure coincides with the algebraic entropy, which is defined in terms of degree growth. Evidence for this conjecture is provided by exact and numerical calculations of the Mahler measure for a family of Laurent polynomials generated by rank 2 cluster algebras, for a recurrence of third order related to the Markoff numbers, and for the Somos-4 recurrence. Also, for the sequence of Laurent polynomials associated with the Kronecker quiver (the cluster algebra of affine type $\tilde{A}_1)$ we prove a precise formula for the leading order asymptotics of the logarithmic Mahler measure, which grows linearly.


title: SLAW: Scaled Loss Approximate Weighting for Efficient Multi-Task Learning

abstract: Multi-task learning (MTL) is a subfield of machine learning with important applications, but the multi-objective nature of optimization in MTL leads to difficulties in balancing training between tasks. The best MTL optimization methods require individually computing the gradient of each task's loss function, which impedes scalability to a large number of tasks. In this paper, we propose Scaled Loss Approximate Weighting (SLAW), a method for multi-task optimization that matches the performance of the best existing methods while being much more efficient. SLAW balances learning between tasks by estimating the magnitudes of each task's gradient without performing any extra backward passes. We provide theoretical and empirical justification for SLAW's estimation of gradient magnitudes. Experimental results on non-linear regression, multi-task computer vision, and virtual screening for drug discovery demonstrate that SLAW is significantly more efficient than strong baselines without sacrificing performance and applicable to a diverse range of domains.


title: Dr. Top-k: Delegate-Centric Top-k on GPUs

abstract: Recent top-$k$ computation efforts explore the possibility of revising various sorting algorithms to answer top-$k$ queries on GPUs. These endeavors, unfortunately, perform significantly more work than needed. This paper introduces Dr. Top-k, a Delegate-centric top-$k$ system on GPUs that can reduce the top-$k$ workloads significantly. Particularly, it contains three major contributions: First, we introduce a comprehensive design of the delegate-centric concept, including maximum delegate, delegate-based filtering, and $\beta$ delegate mechanisms to help reduce the workload for top-$k$ up to more than 99%. Second, due to the difficulty and importance of deriving a proper subrange size, we perform a rigorous theoretical analysis, coupled with thorough experimental validations to identify the desirable subrange size. Third, we introduce four key system optimizations to enable fast multi-GPU top-$k$ computation. Taken together, this work constantly outperforms the state-of-the-art.


title: Embedding Divisor and Semi-Prime Testability in f-vectors of polytopes

abstract: We obtain computational hardness results for f-vectors of polytopes by exhibiting reductions of the problems DIVISOR and SEMI-PRIME TESTABILITY to problems on f-vectors of polytopes. Further, we show that the corresponding problems for f-vectors of simplicial polytopes are polytime solvable. The regime where we prove this computational difference (conditioned on standard conjectures on the density of primes and on $P\neq NP$) is when the dimension $d$ tends to infinity and the number of facets is linear in $d$.


title: Utilizing machine learning to improve the precision of fluorescence imaging of cavity-generated spin squeezed states

abstract: We present a supervised learning model to calibrate the photon collection rate during the fluorescence imaging of cold atoms. The linear regression model finds the collection rate at each location on the sensor such that the atomic population difference equals that of a highly precise optical cavity measurement. This 192 variable regression results in a measurement variance 27% smaller than our previous single variable regression calibration. The measurement variance is now in agreement with the theoretical limit due to other known noise sources. This model efficiently trains in less than a minute on a standard personal computer's CPU, and requires less than 10 minutes of data collection. Furthermore, the model is applicable across a large changes in population difference and across data collected on different days.


title: Short and Simple Confidence Intervals when the Directions of Some Effects are Known

abstract: We provide adaptive confidence intervals on a parameter of interest in the presence of nuisance parameters when some of the nuisance parameters have known signs. The confidence intervals are adaptive in the sense that they tend to be short at and near the points where the nuisance parameters are equal to zero. We focus our results primarily on the practical problem of inference on a coefficient of interest in the linear regression model when it is unclear whether or not it is necessary to include a subset of control variables whose partial effects on the dependent variable have known directions (signs). Our confidence intervals are trivial to compute and can provide significant length reductions relative to standard confidence intervals in cases for which the control variables do not have large effects. At the same time, they entail minimal length increases at any parameter values. We prove that our confidence intervals are asymptotically valid uniformly over the parameter space and illustrate their length properties in an empirical application to a factorial design field experiment and a Monte Carlo study calibrated to the empirical application.


title: Forward doubly-virtual Compton scattering off an unpolarised deuteron in pionless effective field theory

abstract: We calculate the forward unpolarised doubly-virtual Compton scattering (VVCS) off the deuteron in the framework of pionless effective field theory, up to next-to-next-to-next-to-leading order (N3LO) for the longitudinal and next-to-leading order (NLO) for the transverse amplitude. The charge elastic form factor of the deuteron, obtained from the residue of the longitudinal VVCS amplitude, is used to extract the value of the single unknown two-nucleon one-photon contact coupling that enters the longitudinal amplitude at N3LO. We also study the lowest spin-independent generalised polarisabilities of the deuteron. The calculated unpolarised VVCS amplitude provides a high-precision model-independent input for a future calculation of the two-photon-exchange correction to the Lamb shift of muonic deuterium.


title: A Divide-and-Merge Point Cloud Clustering Algorithm for LiDAR Panoptic Segmentation

abstract: Clustering objects from the LiDAR point cloud is an important research problem with many applications such as autonomous driving. To meet the real-time requirement, existing research proposed to apply the connected-component-labeling (CCL) technique on LiDAR spherical range image with a heuristic condition to check if two neighbor points are connected. However, LiDAR range image is different from a binary image which has a deterministic condition to tell if two pixels belong to the same component. The heuristic condition used on the LiDAR range image only works empirically, which suggests the LiDAR clustering algorithm should be robust to potential failures of the empirical heuristic condition. To overcome this challenge, this paper proposes a divide-and-merge LiDAR clustering algorithm. This algorithm firstly conducts clustering in each evenly divided local region, then merges the local clustered small components by voting on edge point pairs. Assuming there are $N$ LiDAR points of objects in total with $m$ divided local regions, the time complexity of the proposed algorithm is $O(N)+O(m^2)$. A smaller $m$ means the voting will involve more neighbor points, but the time complexity will become larger. So the $m$ controls the trade-off between the time complexity and the clustering accuracy. A proper $m$ helps the proposed algorithm work in real-time as well as maintain good performance. We evaluate the divide-and-merge clustering algorithm on the SemanticKITTI panoptic segmentation benchmark by cascading it with a state-of-the-art semantic segmentation model. The final performance evaluated through the leaderboard achieves the best among all published methods. The proposed algorithm is implemented with C++ and wrapped as a python function. It can be easily used with the modern deep learning framework in python.


title: The Accuracy and Efficiency of Posit Arithmetic

abstract: Motivated by the increasing interest in the posit numeric format, in this paper we evaluate the accuracy and efficiency of posit arithmetic in contrast to the traditional IEEE 754 32-bit floating-point (FP32) arithmetic. We first design and implement a Posit Arithmetic Unit (PAU), called POSAR, with flexible bit-sized arithmetic suitable for applications that can trade accuracy for savings in chip area. Next, we analyze the accuracy and efficiency of POSAR with a series of benchmarks including mathematical computations, ML kernels, NAS Parallel Benchmarks (NPB), and Cifar-10 CNN. This analysis is done on our implementation of POSAR integrated into a RISC-V Rocket Chip core in comparison with the IEEE 754-based Floting Point Unit (FPU) of Rocket Chip. Our analysis shows that POSAR can outperform the FPU, but the results are not spectacular. For NPB, 32-bit posit achieves better accuracy than FP32 and improves the execution by up to 2%. However, POSAR with 32-bit posit needs 30% more FPGA resources compared to the FPU. For classic ML algorithms, we find that 8-bit posits are not suitable to replace FP32 because they exhibit low accuracy leading to wrong results. Instead, 16-bit posit offers the best option in terms of accuracy and efficiency. For example, 16-bit posit achieves the same Top-1 accuracy as FP32 on a Cifar-10 CNN with a speedup of 18%.


title: Inclusion and Exclusion Criteria in Software Engineering Tertiary Studies: A Systematic Mapping and Emerging Framework

abstract: Context: Tertiary studies in software engineering (TS@SE) are widely used to synthesise evidence on a research topic systematically. As part of their protocol, TS@SE define inclusion and exclusion criteria (IC/EC) aimed at selecting those secondary studies (SS) to be included in the analysis. Aims: To provide a state of the art on the definition and application of IC/EC in TS@SE, and from the results of this analysis, we outline an emerging framework, TSICEC, to be used by SE researchers. Method: To provide the state of the art, we conducted a systematic mapping (SM) combining automatic search and snowballing over the body of SE scientific literature, which led to 50 papers after application of our own IC/EC. The extracted data was synthesised using content analysis. The results were used to define a first version of TSICEC. Results: The SM resulted in a coding schema, and a thorough analysis of the selected papers on the basis of this coding. Our TSICEC framework includes guidelines for the definition of IC/EC in TS@SE. Conclusion: This paper is a step forward establishing a foundation for researchers in two ways. As authors, understanding the different possibilities to define IC/EC and apply them to select SS. As readers, having an instrument to understand the methodological rigor upon which TS@SE may claim their findings.


title: Stereo Video Reconstruction Without Explicit Depth Maps for Endoscopic Surgery

abstract: We introduce the task of stereo video reconstruction or, equivalently, 2D-to-3D video conversion for minimally invasive surgical video. We design and implement a series of end-to-end U-Net-based solutions for this task by varying the input (single frame vs. multiple consecutive frames), loss function (MSE, MAE, or perceptual losses), and network architecture. We evaluate these solutions by surveying ten experts - surgeons who routinely perform endoscopic surgery. We run two separate reader studies: one evaluating individual frames and the other evaluating fully reconstructed 3D video played on a VR headset. In the first reader study, a variant of the U-Net that takes as input multiple consecutive video frames and outputs the missing view performs best. We draw two conclusions from this outcome. First, motion information coming from multiple past frames is crucial in recreating stereo vision. Second, the proposed U-Net variant can indeed exploit such motion information for solving this task. The result from the second study further confirms the effectiveness of the proposed U-Net variant. The surgeons reported that they could successfully perceive depth from the reconstructed 3D video clips. They also expressed a clear preference for the reconstructed 3D video over the original 2D video. These two reader studies strongly support the usefulness of the proposed task of stereo reconstruction for minimally invasive surgical video and indicate that deep learning is a promising approach to this task. Finally, we identify two automatic metrics, LPIPS and DISTS, that are strongly correlated with expert judgement and that could serve as proxies for the latter in future studies.


title: ROOAD: RELLIS Off-road Odometry Analysis Dataset

abstract: The development and implementation of visual-inertial odometry (VIO) has focused on structured environments, but interest in localization in off-road environments is growing. In this paper, we present the RELLIS Off-road Odometry Analysis Dataset (ROOAD) which provides high-quality, time-synchronized off-road monocular visual-inertial data sequences to further the development of related research. We evaluated the dataset on two state-of-the-art VIO algorithms, (1) Open-VINS and (2) VINS-Fusion. Our findings indicate that both algorithms perform 2 to 30 times worse on the ROOAD dataset compared to their performance in structured environments. Furthermore, OpenVINS has better tracking stability and real-time performance than VINS-Fusion in the off-road environment, while VINS-Fusion outperformed OpenVINS in tracking accuracy in several data sequences. Since the camera-IMU calibration tool from Kalibr toolkit is used extensively in this work, we have included several calibration data sequences. Our hand measurements show Kalibr's tool achieved +/-1 degree for orientation error and +/-1 mm at best (x- and y-axis) and +/-10 mm (z-axis) at worse for position error in the camera frame between the camera and IMU. This novel dataset provides a new set of scenarios for researchers to design and test their localization algorithms on, as well as critical insights in the current performance of VIO in off-road environments. ROOAD Dataset: github.com/unmannedlab/ROOAD


title: Policy Choice and Best Arm Identification: Asymptotic Analysis of Exploration Sampling

abstract: We consider the "policy choice" problem -- otherwise known as best arm identification in the bandit literature -- proposed by Kasy and Sautmann (2021) for adaptive experimental design. Theorem 1 of Kasy and Sautmann (2021) provides three asymptotic results that give theoretical guarantees for exploration sampling developed for this setting. We first show that the proof of Theorem 1 (1) has technical issues, and the proof and statement of Theorem 1 (2) are incorrect. We then show, through a counterexample, that Theorem 1 (3) is false. For the former two, we correct the statements and provide rigorous proofs. For Theorem 1 (3), we propose an alternative objective function, which we call posterior weighted policy regret, and derive the asymptotic optimality of exploration sampling.


title: Extensions of characters in type D and the inductive McKay condition, I

abstract: This is a contribution to the study of $\operatorname {Irr}(G)$ as an $\operatorname {Aut}(G)$-set for $G$ a finite quasi-simple group. Focusing on the last open case of groups of Lie type $\mathrm D$ and $^2\mathrm D$, a crucial property is the so-called condition $A'(\infty)$ expressing that diagonal automorphisms and graph-field automorphisms of $G$ have transversal orbits in $\operatorname {Irr}(G)$. This is part of the stronger $A(\infty)$ condition introduced in the context of the reduction of the McKay conjecture to a question on quasi-simple groups. Our main theorem is that a minimal counter-example to condition $A(\infty)$ for groups of type $\mathrm D$ would still satisfy $A'(\infty)$. This will be used in a second paper to fully establish $A(\infty)$ for any type and rank. The present paper uses Harish-Chandra induction as a parametrization tool. We give a new, more effective proof of the theorem of Geck and Lusztig ensuring that cuspidal characters of arbitrary standard Levi subgroups of $G={\mathrm D}_{ l,\mathrm{sc}}(q)$ extend to their stabilizers in the normalizer of that Levi subgroup. This allows to control the action of automorphisms on these extensions. From there Harish Chandra theory leads naturally to a detailed study of associated relative Weyl groups and other extendibility problems in that context.


title: RAPID-RL: A Reconfigurable Architecture with Preemptive-Exits for Efficient Deep-Reinforcement Learning

abstract: Present-day Deep Reinforcement Learning (RL) systems show great promise towards building intelligent agents surpassing human-level performance. However, the computational complexity associated with the underlying deep neural networks (DNNs) leads to power-hungry implementations. This makes deep RL systems unsuitable for deployment on resource-constrained edge devices. To address this challenge, we propose a reconfigurable architecture with preemptive exits for efficient deep RL (RAPID-RL). RAPID-RL enables conditional activation of DNN layers based on the difficulty level of inputs. This allows to dynamically adjust the compute effort during inference while maintaining competitive performance. We achieve this by augmenting a deep Q-network (DQN) with side-branches capable of generating intermediate predictions along with an associated confidence score. We also propose a novel training methodology for learning the actions and branch confidence scores in a dynamic RL setting. Our experiments evaluate the proposed framework for Atari 2600 gaming tasks and a realistic Drone navigation task on an open-source drone simulator (PEDRA). We show that RAPID-RL incurs 0.34x (0.25x) number of operations (OPS) while maintaining performance above 0.88x (0.91x) on Atari (Drone navigation) tasks, compared to a baseline-DQN without any side-branches. The reduction in OPS leads to fast and efficient inference, proving to be highly beneficial for the resource-constrained edge where making quick decisions with minimal compute is essential.


title: A Bag of Tricks for Dialogue Summarization

abstract: Dialogue summarization comes with its own peculiar challenges as opposed to news or scientific articles summarization. In this work, we explore four different challenges of the task: handling and differentiating parts of the dialogue belonging to multiple speakers, negation understanding, reasoning about the situation, and informal language understanding. Using a pretrained sequence-to-sequence language model, we explore speaker name substitution, negation scope highlighting, multi-task learning with relevant tasks, and pretraining on in-domain data. Our experiments show that our proposed techniques indeed improve summarization performance, outperforming strong baselines.


title: A 15.5 GHz detection of the galaxy cluster minihalo in RXJ1720.1+2638

abstract: RXJ1720.1+2638 is a cool-core, 'relaxed-appearing' cluster with a minihalo previously detected up to 8.4 GHz, confined by X-ray-detected cold fronts. We present observations of the minihalo at 13 - 18 GHz with the Arcminute Microkelvin Imager telescope, simultaneously modelling the Sunyaev-Zel'dovich signal of the cluster in conjunction with Planck and Chandra data in order to disentangle the non-thermal emission of the minihalo. We show that the previously-reported steepening of the minihalo emission at 8.4 GHz is not supported by the AMI data and that the spectrum is consistent with a single power-law up to 18 GHz. We also show the presence of a larger-scale component of the minihalo extending beyond the cold fronts. Both of these observations could be explained by the 'hadronic' or 'secondary' mechanism for the production of relativistic electrons, rather than the currently-favoured 're-acceleration' mechanism and/or multiple episodes of jet activity from the active galactic nucleus in the brightest cluster galaxy.


title: Deep Spiking Neural Networks with Resonate-and-Fire Neurons

abstract: In this work, we explore a new Spiking Neural Network (SNN) formulation with Resonate-and-Fire (RAF) neurons (Izhikevich, 2001) trained with gradient descent via back-propagation. The RAF-SNN, while more biologically plausible, achieves performance comparable to or higher than conventional models in the Machine Learning literature across different network configurations, using similar or fewer parameters. Strikingly, the RAF-SNN proves robust against noise induced at testing/training time, under both static and dynamic conditions. Against CNN on MNIST, we show 25% higher absolute accuracy with N(0, 0.2) induced noise at testing time. Against LSTM on N-MNIST, we show 70% higher absolute accuracy with 20% induced noise at training time.


title: Integrating Flowsheet Data in OMOP Common Data Model for Clinical Research

abstract: Flowsheet data presents unique challenges and opportunities for integration into standardized Common Data Models (CDMs) such as the Observational Medical Outcomes Partnership (OMOP) CDM from the Observational Health Data Sciences and Informatics (OHDSI) program. These data are a potentially rich source of detailed curated health outcomes data such as pain scores, vital signs, lines drains and airways (LDA) and other measurements that can be invaluable in building a robust model of patient health journey during an inpatient stay. We present two approaches to integration of flowsheet measures into the OMOP CDM. One approach was computationally straightforward but of potentially limited research utility. The second approach was far more computationally and labor intensive and involved mapping to standardized terms in controlled clinical vocabularies such as Logical Observation Identifiers Names and Codes (LOINC), resulting in a research data set of higher utility to population health studies.


title: Reinforcement Learning on Encrypted Data

abstract: The growing number of applications of Reinforcement Learning (RL) in real-world domains has led to the development of privacy-preserving techniques due to the inherently sensitive nature of data. Most existing works focus on differential privacy, in which information is revealed in the clear to an agent whose learned model should be robust against information leakage to malicious third parties. Motivated by use cases in which only encrypted data might be shared, such as information from sensitive sites, in this work we consider scenarios in which the inputs themselves are sensitive and cannot be revealed. We develop a simple extension to the MDP framework which provides for the encryption of states. We present a preliminary, experimental study of how a DQN agent trained on encrypted states performs in environments with discrete and continuous state spaces. Our results highlight that the agent is still capable of learning in small state spaces even in presence of non-deterministic encryption, but performance collapses in more complex environments.


title: Subtle Data Crimes: Naively training machine learning algorithms could lead to overly-optimistic results

abstract: While open databases are an important resource in the Deep Learning (DL) era, they are sometimes used "off-label": data published for one task are used for training algorithms for a different one. This work aims to highlight that in some cases, this common practice may lead to biased, overly-optimistic results. We demonstrate this phenomenon for inverse problem solvers and show how their biased performance stems from hidden data preprocessing pipelines. We describe two preprocessing pipelines typical of open-access databases and study their effects on three well-established algorithms developed for Magnetic Resonance Imaging (MRI) reconstruction: Compressed Sensing (CS), Dictionary Learning (DictL), and DL. In this large-scale study we performed extensive computations. Our results demonstrate that the CS, DictL and DL algorithms yield systematically biased results when naively trained on seemingly-appropriate data: the Normalized Root Mean Square Error (NRMSE) improves consistently with the preprocessing extent, showing an artificial increase of 25%-48% in some cases. Since this phenomenon is generally unknown, biased results are sometimes published as state-of-the-art; we refer to that as subtle data crimes. This work hence raises a red flag regarding naive off-label usage of Big Data and reveals the vulnerability of modern inverse problem solvers to the resulting bias.


title: Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AI

abstract: We present the Habitat-Matterport 3D (HM3D) dataset. HM3D is a large-scale dataset of 1,000 building-scale 3D reconstructions from a diverse set of real-world locations. Each scene in the dataset consists of a textured 3D mesh reconstruction of interiors such as multi-floor residences, stores, and other private indoor spaces. HM3D surpasses existing datasets available for academic research in terms of physical scale, completeness of the reconstruction, and visual fidelity. HM3D contains 112.5k m^2 of navigable space, which is 1.4 - 3.7x larger than other building-scale datasets such as MP3D and Gibson. When compared to existing photorealistic 3D datasets such as Replica, MP3D, Gibson, and ScanNet, images rendered from HM3D have 20 - 85% higher visual fidelity w.r.t. counterpart images captured with real cameras, and HM3D meshes have 34 - 91% fewer artifacts due to incomplete surface reconstruction. The increased scale, fidelity, and diversity of HM3D directly impacts the performance of embodied AI agents trained using it. In fact, we find that HM3D is `pareto optimal' in the following sense -- agents trained to perform PointGoal navigation on HM3D achieve the highest performance regardless of whether they are evaluated on HM3D, Gibson, or MP3D. No similar claim can be made about training on other datasets. HM3D-trained PointNav agents achieve 100% performance on Gibson-test dataset, suggesting that it might be time to retire that episode dataset.


title: A computationally efficient framework for vector representation of persistence diagrams

abstract: In Topological Data Analysis, a common way of quantifying the shape of data is to use a persistence diagram (PD). PDs are multisets of points in $\mathbb{R}^2$ computed using tools of algebraic topology. However, this multi-set structure limits the utility of PDs in applications. Therefore, in recent years efforts have been directed towards extracting informative and efficient summaries from PDs to broaden the scope of their use for machine learning tasks. We propose a computationally efficient framework to convert a PD into a vector in $\mathbb{R}^n$, called a vectorized persistence block (VPB). We show that our representation possesses many of the desired properties of vector-based summaries such as stability with respect to input noise, low computational cost and flexibility. Through simulation studies, we demonstrate the effectiveness of VPBs in terms of performance and computational cost within various learning tasks, namely clustering, classification and change point detection.


title: Strategic Ranking

abstract: Strategic classification studies the design of a classifier robust to the manipulation of input by strategic individuals. However, the existing literature does not consider the effect of competition among individuals as induced by the algorithm design. Motivated by constrained allocation settings such as college admissions, we introduce strategic ranking, in which the (designed) individual reward depends on an applicant's post-effort rank in a measurement of interest. Our results illustrate how competition among applicants affects the resulting equilibria and model insights. We analyze how various ranking reward designs, belonging to a family of step functions, trade off applicant, school, and societal utility, as well as how ranking design counters inequities arising from disparate access to resources. In particular, we find that randomization in the reward design can mitigate two measures of disparate impact, welfare gap and access.


title: The enhanced derived-vector-space approach to domain decomposition methods

abstract: Standard approaches to domain decomposition methods (DDM) are uncapable of producing block-diagonal system matrices. The derived-vector-space (DVS), approach to DDM, introduced in 2013, overcomes this limitation. However, the DVS approach in its original form was applicable to a relatively narrow class of problems because it required building a special matrix, whose construction is frequently impossible. In this paper, an enhanced formulation of DVS is presented, which does not require the construction of a special matrix and is applicable to any linear problem. Keywords: domain decomposition, parallel processing, DVS, FETI, BDDC


title: Trading styles and long-run variance of asset prices

abstract: Trading styles can be classified into either trend-following or mean-reverting. If the net trading style is trend-following the traded asset is more likely to move in the same direction it moved previously (the opposite is true if the net style is mean-reverting). The result of this is to introduce positive (or negative) correlations into the time series. We here explore the effect of these correlations on the long-run variance of the series through probabilistic models designed to explicitly capture the direction of trading. Our theoretical insights suggests that relative to random walk models of asset prices the long-run variance is increased under trend-following strategies and can actually be reduced under mean-reversal conditions. We apply these models to some of the largest US stocks by market capitalisation as well as high-frequency EUR/USD data and show that in both these settings, the ability to predict the asset price is generally increased relative to a random walk.


title: Residue field domination in henselian valued fields of equicharacteristic zero

abstract: In this paper we study domination in an Ax-Kochen/Ershov style results for henselian valued fields of equicharacteristic zero for elements in the home sort.


title: The openVA Toolkit for Verbal Autopsies

abstract: Verbal autopsy (VA) is a survey-based tool widely used to infer cause of death (COD) in regions without complete-coverage civil registration and vital statistics systems. In such settings, many deaths happen outside of medical facilities and are not officially documented by a medical professional. VA surveys, consisting of signs and symptoms reported by a person close to the decedent, are used to infer the cause of death for an individual, and to estimate and monitor the cause of death distribution in the population. Several classification algorithms have been developed and widely used to assign cause of death using VA data. However, The incompatibility between different idiosyncratic model implementations and required data structure makes it difficult to systematically apply and compare different methods. The openVA package provides the first standardized framework for analyzing VA data that is compatible with all openly available methods and data structure. It provides an open-sourced, R implementation of several most widely used VA methods. It supports different data input and output formats, and customizable information about the associations between causes and symptoms. The paper discusses the relevant algorithms, their implementations in R packages under the openVA suite, and demonstrates the pipeline of model fitting, summary, comparison, and visualization in the R environment.


title: The 2021 RecSys Challenge Dataset: Fairness is not optional

abstract: After the success the RecSys 2020 Challenge, we are describing a novel and bigger dataset that was released in conjunction with the ACM RecSys Challenge 2021. This year's dataset is not only bigger (~ 1B data points, a 5 fold increase), but for the first time it take into consideration fairness aspects of the challenge. Unlike many static datsets, a lot of effort went into making sure that the dataset was synced with the Twitter platform: if a user deleted their content, the same content would be promptly removed from the dataset too. In this paper, we introduce the dataset and challenge, highlighting some of the issues that arise when creating recommender systems at Twitter scale.


title: DeepGhostBusters: Using Mask R-CNN to Detect and Mask Ghosting and Scattered-Light Artifacts from Optical Survey Images

abstract: Wide-field astronomical surveys are often affected by the presence of undesirable reflections (often known as "ghosting artifacts" or "ghosts") and scattered-light artifacts. The identification and mitigation of these artifacts is important for rigorous astronomical analyses of faint and low-surface-brightness systems. However, the identification of ghosts and scattered-light artifacts is challenging due to a) the complex morphology of these features and b) the large data volume of current and near-future surveys. In this work, we use images from the Dark Energy Survey (DES) to train, validate, and test a deep neural network (Mask R-CNN) to detect and localize ghosts and scattered-light artifacts. We find that the ability of the Mask R-CNN model to identify affected regions is superior to that of conventional algorithms and traditional convolutional neural networks methods. We propose that a multi-step pipeline combining Mask R-CNN segmentation with a classical CNN classifier provides a powerful technique for the automated detection of ghosting and scattered-light artifacts in current and near-future surveys.


title: Towards agricultural autonomy: crop row detection under varying field conditions using deep learning

abstract: This paper presents a novel metric to evaluate the robustness of deep learning based semantic segmentation approaches for crop row detection under different field conditions encountered by a field robot. A dataset with ten main categories encountered under various field conditions was used for testing. The effect on these conditions on the angular accuracy of crop row detection was compared. A deep convolutional encoder decoder network is implemented to predict crop row masks using RGB input images. The predicted mask is then sent to a post processing algorithm to extract the crop rows. The deep learning model was found to be robust against shadows and growth stages of the crop while the performance was reduced under direct sunlight, increasing weed density, tramlines and discontinuities in crop rows when evaluated with the novel metric.


title: Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

abstract: We use Gaussian stochastic weight averaging (SWAG) to assess the model-form uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the `mean estimation', whereas its standard deviation can be used to construct `confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of model-form uncertainty. This capability supports its use for a wide range of problems in science and engineering.

categories: physics.flu-dyn cs.LG physics.comp-ph physics.data-an


title: Regularized Training of Nearest Neighbor Language Models

abstract: Including memory banks in a natural language processing architecture increases model capacity by equipping it with additional data at inference time. In this paper, we build upon $k$NN-LM \citep{khandelwal20generalization}, which uses a pre-trained language model together with an exhaustive $k$NN search through the training data (memory bank) to achieve state-of-the-art results. We investigate whether we can improve the $k$NN-LM performance by instead training a LM with the knowledge that we will be using a $k$NN post-hoc. We achieved significant improvement using our method on language modeling tasks on \texttt{WIKI-2} and \texttt{WIKI-103}. The main phenomenon that we encounter is that adding a simple L2 regularization on the activations (not weights) of the model, a transformer, improves the post-hoc $k$NN classification performance. We explore some possible reasons for this improvement. In particular, we find that the added L2 regularization seems to improve the performance for high-frequency words without deteriorating the performance for low frequency ones.


title: Are we ready for beyond-application high-volume data? The Reeds robot perception benchmark dataset

abstract: This paper presents a dataset, called Reeds, for research on robot perception algorithms. The dataset aims to provide demanding benchmark opportunities for algorithms, rather than providing an environment for testing application-specific solutions. A boat was selected as a logging platform in order to provide highly dynamic kinematics. The sensor package includes six high-performance vision sensors, two long-range lidars, radar, as well as GNSS and an IMU. The spatiotemporal resolution of sensors were maximized in order to provide large variations and flexibility in the data, offering evaluation at a large number of different resolution presets based on the resolution found in other datasets. Reeds also provides means of a fair and reproducible comparison of algorithms, by running all evaluations on a common server backend. As the dataset contains massive-scale data, the evaluation principle also serves as a way to avoid moving data unnecessarily. It was also found that naive evaluation of algorithms, where each evaluation is computed sequentially, was not practical as the fetch and decode task of each frame would not scale well. Instead, each frame is only decoded once and then fed to all algorithms in parallel, including for GPU-based algorithms.


title: Crystal Pop-Stack Sorting and Type A Crystal Lattices

abstract: Given a complex simple Lie algebra $\mathfrak g$ and a dominant weight $\lambda$, let $\mathcal B_\lambda$ be the crystal poset associated to the irreducible representation of $\mathfrak g$ with highest weight $\lambda$. In the first part of the article, we introduce the \emph{crystal pop-stack sorting operator} $\mathsf{Pop}_{\lozenge}\colon\mathcal B_\lambda\to\mathcal B_\lambda$, a noninvertible operator whose definition extends that of the pop-stack sorting map and the recently-introduced Coxeter pop-stack sorting operators. Every forward orbit of $\mathsf{Pop}_{\lozenge}$ contains the minimal element of $\mathcal B_\lambda$, which is fixed by $\mathsf{Pop}_{\lozenge}$. We prove that the maximum size of a forward orbit of $\mathsf{Pop}_{\lozenge}$ is the Coxeter number of the Weyl group of $\mathfrak g$. In the second part of the article, we characterize exactly when a type $A$ crystal is a lattice.


title: Parameter estimation in an anisotropic expanding spacetime

abstract: In this work, we investigate how the anisotropy affects the cosmological parameters estimation. Here the anisotropy is incorporated as a small gravitational disturbance. We calculate the Fisher information for both cosmological parameters $\epsilon$ (expansion volume) and $\rho$ (expansion rate), and we show that the anisotropy introduces oscillations in the Fisher information spectrum. This implies that the estimation of the cosmological parameters is sensible to the direction of the momentum $k$ of particles. In addition, we observe that for small values of the momentum $k$ there is a substantial difference between the Fisher information spectrum for the minimum and conformal couplings.


title: Balancing out Bias: Achieving Fairness Through Balanced Training

abstract: Group bias in natural language processing tasks manifests as disparities in system error rates across texts authorized by different demographic groups, typically disadvantaging minority groups. Dataset balancing has been shown to be effective at mitigating bias, however existing approaches do not directly account for correlations between author demographics and linguistic variables, limiting their effectiveness. To achieve Equal Opportunity fairness, such as equal job opportunity without regard to demographics, this paper introduces a simple, but highly effective, objective for countering bias using balanced training. We extend the method in the form of a gated model, which incorporates protected attributes as input, and show that it is effective at reducing bias in predictions through demographic input perturbation, outperforming all other bias mitigation techniques when combined with balanced training.


title: OpenSesame tutorial

abstract: OpenSesame is a program for generating tabular equations of state (EOS), with capabilities for multiphase EOS construction. In this tutorial, we provide an overview of how to run OpenSesame to construct a multiphase EOS. We discuss some general features of OpenSesame, followed by a description of sample input files required for multiphase EOS construction. We also discuss how to extract data from EOS tables in order to compare to experimental data, with an example using the OpenSesame GUI. Lastly, we provide a description of how to generate ASCII-formatted EOS tables most often used by hydro code users.


title: Symmetry-broken Chern insulators in twisted double bilayer graphene

abstract: Twisted double bilayer graphene (tDBG) has emerged as an especially rich platform for studying strongly correlated and topological states of matter. The material features moir\'e bands that can be continuously deformed by both perpendicular displacement field and twist angle. Here, we construct a phase diagram representing of the correlated and topological states as a function of these parameters, based on measurements on over a dozen tDBG devices encompassing the two distinct stacking configurations in which the constituent Bernal bilayer graphene sheets are rotated either slightly away from 0{\deg} or 60{\deg}. We find a hierarchy of symmetry-broken states that emerge sequentially as the twist angle approaches an apparent optimal value of $\theta \approx$ 1.34{\deg}. Among them, we discover a sequence of symmetry-broken Chern insulator (SBCI) states that arise only within a narrow range of twist angles ($\approx$ 1.33{\deg} to 1.39{\deg}). We observe an associated anomalous Hall effect at zero field in all samples supporting SBCI states, indicating spontaneous time-reversal symmetry breaking and possible moir\'e unit cell enlargement at zero magnetic field.


title: Ethics Sheet for Automatic Emotion Recognition and Sentiment Analysis

abstract: The importance and pervasiveness of emotions in our lives makes affective computing a tremendously important and vibrant line of work. Systems for automatic emotion recognition (AER) and sentiment analysis can be facilitators of enormous progress (e.g., in improving public health and commerce) but also enablers of great harm (e.g., for suppressing dissidents and manipulating voters). Thus, it is imperative that the affective computing community actively engage with the ethical ramifications of their creations. In this paper, I have synthesized and organized information from AI Ethics and Emotion Recognition literature to present fifty ethical considerations relevant to AER. Notably, the sheet fleshes out assumptions hidden in how AER is commonly framed, and in the choices often made regarding the data, method, and evaluation. Special attention is paid to the implications of AER on privacy and social groups. Along the way, key recommendations are made for responsible AER. The objective of the sheet is to facilitate and encourage more thoughtfulness on why to automate, how to automate, and how to judge success well before the building of AER systems. Additionally, the sheet acts as a useful introductory document on emotion recognition (complementing survey articles).


title: Computing the Cassels-Tate Pairing in the Case of a Richelot Isogeny

abstract: In this paper, we study the Cassels-Tate pairing on Jacobians of genus two curves admitting a special type of isogenies called Richelot isogenies. Let $\phi: J \rightarrow \widehat{J}$ be a Richelot isogeny between two Jacobians of genus two curves. We give an explicit formula as well as a practical algorithm to compute the Cassels-Tate pairing on $\text{Sel}^{\widehat{\phi}}(\widehat{J}) \times \text{Sel}^{\widehat{\phi}}(\widehat{J})$ where $\widehat{\phi}$ is the dual isogeny of $\phi$. The formula and algorithm are under the simplifying assumption that all two torsion points on $J$ are defined over $K$. We also include a worked example demonstrating we can turn the descent by Richelot isogeny into a 2-descent via computing the Cassels-Tate pairing.


title: Computing the Cassels-Tate Pairing for Genus Two Jacobians with Rational Two Torsion Points

abstract: In this paper, we give an explicit formula as well as a practical algorithm for computing the Cassels-Tate pairing on $\text{Sel}^{2}(J) \times \text{Sel}^{2}(J)$ where $J$ is the Jacobian variety of a genus two curve under the assumption that all points in $J[2]$ are $K$-rational. We also give an explicit formula for the Obstruction map $\text{Ob}: H^1(G_K, J[2]) \rightarrow \text{Br}(K)$ under the same assumption. Finally, we include a worked example demonstrating we can indeed improve the rank bound given by a 2-descent via computing the Cassels-Tate pairing.


title: Self-training with Few-shot Rationalization: Teacher Explanations Aid Student in Few-shot NLU

abstract: While pre-trained language models have obtained state-of-the-art performance for several natural language understanding tasks, they are quite opaque in terms of their decision-making process. While some recent works focus on rationalizing neural predictions by highlighting salient concepts in the text as justifications or rationales, they rely on thousands of labeled training examples for both task labels as well as an-notated rationales for every instance. Such extensive large-scale annotations are infeasible to obtain for many tasks. To this end, we develop a multi-task teacher-student framework based on self-training language models with limited task-specific labels and rationales, and judicious sample selection to learn from informative pseudo-labeled examples1. We study several characteristics of what constitutes a good rationale and demonstrate that the neural model performance can be significantly improved by making it aware of its rationalized predictions, particularly in low-resource settings. Extensive experiments in several bench-mark datasets demonstrate the effectiveness of our approach.


title: Stochastic Optimal Control of a Sailboat

abstract: In match race sailing, competitors must steer their boats upwind in the presence of unpredictably evolving weather. Combined with the tacking motion necessary to make upwind progress, this makes it natural to model their path-planning as a hybrid stochastic optimal control problem. Dynamic programming provides the tools for solving these, but the computational cost can be significant. We greatly accelerate a semi-Lagrangian iterative approach of Ferretti and Festa (R. Ferretti and A. Festa, "Optimal Route Planning for Sailing Boats: A Hybrid Formulation", J Optim Theory Appl (2019)) by reducing the state space dimension and designing an adaptive timestep discretization that is very nearly causal. We also provide a more accurate tack-switching operator by integrating over potential wind states after the switch. The method is illustrated through a series of simulations with varying stochastic wind conditions.


title: Controlled Comparison of Simulated Hemodynamics across Tricuspid and Bicuspid Aortic Valves

abstract: Bicuspid aortic valve is the most common congenital heart defect, affecting 1-2% of the global population. Patients with bicuspid valves frequently develop dilation and aneurysms of the ascending aorta. Both hemodynamic and genetic factors are believed to contribute to dilation, yet the precise mechanism underlying this progression remains under debate. Controlled comparisons of hemodynamics in patients with different forms of bicuspid valve disease are challenging because of confounding factors, and simulations offer the opportunity for direct and systematic comparisons. Using fluid-structure interaction simulations, we simulate flows through multiple aortic valve models in a patient-specific geometry. The aortic geometry is based on a healthy patient with no known aortic or valvular disease, which allows us to isolate the hemodynamic consequences of changes to the valve alone. Four fully-passive, elastic model valves are studied: a tricuspid valve and bicuspid valves with fusion of the left- and right-, right- and non-, and non- and left-coronary cusps. The resulting tricuspid flow is relatively uniform, with little secondary or reverse flow, and little to no pressure gradient across the valve. The bicuspid cases show localized jets of forward flow, excess streamwise momentum, elevated secondary and reverse flow, and clinically significant levels of stenosis. Localized high flow rates correspond to locations of dilation observed in patients, with the location related to which valve cusps are fused. Thus, the simulations support the hypothesis that chronic exposure to high local flow contributes to localized dilation and aneurysm formation.


title: Robust Control Under Uncertainty via Bounded Rationality and Differential Privacy

abstract: The rapid development of affordable and compact high-fidelity sensors (e.g., cameras and LIDAR) allows robots to construct detailed estimates of their states and environments. However, the availability of such rich sensor information introduces two technical challenges: (i) the lack of analytic sensing models, which makes it difficult to design controllers that are robust to sensor failures, and (ii) the computational expense of processing the high-dimensional sensor information in real time. This paper addresses these challenges using the theory of differential privacy, which allows us to (i) design controllers with bounded sensitivity to errors in state estimates, and (ii) bound the amount of state information used for control (i.e., to impose bounded rationality). The resulting framework approximates the separation principle and allows us to derive an upper-bound on the cost incurred with a faulty state estimator in terms of three quantities: the cost incurred using a perfect state estimator, the magnitude of state estimation errors, and the level of differential privacy. We demonstrate the efficacy of our framework numerically on different robotics problems, including nonlinear system stabilization and motion planning.


title: Neural Network Based Lidar Gesture Recognition for Realtime Robot Teleoperation

abstract: We propose a novel low-complexity lidar gesture recognition system for mobile robot control robust to gesture variation. Our system uses a modular approach, consisting of a pose estimation module and a gesture classifier. Pose estimates are predicted from lidar scans using a Convolutional Neural Network trained using an existing stereo-based pose estimation system. Gesture classification is accomplished using a Long Short-Term Memory network and uses a sequence of estimated body poses as input to predict a gesture. Breaking down the pipeline into two modules reduces the dimensionality of the input, which could be lidar scans, stereo imagery, or any other modality from which body keypoints can be extracted, making our system lightweight and suitable for mobile robot control with limited computing power. The use of lidar contributes to the robustness of the system, allowing it to operate in most outdoor conditions, to be independent of lighting conditions, and for input to be detected 360 degrees around the robot. The lidar-based pose estimator and gesture classifier use data augmentation and automated labeling techniques, requiring a minimal amount of data collection and avoiding the need for manual labeling. We report experimental results for each module of our system and demonstrate its effectiveness by testing it in a real-world robot teleoperation setting.


title: Decentralized Secure State-Tracking in Multi-Agent Systems

abstract: This paper addresses the problem of decentralized state-tracking in the presence of sensor attacks. We consider a network of nodes where each node has the objective of tracking the state of a linear dynamical system based on its measurements and messages exchanged with neighboring nodes notwithstanding some measurements being spoofed by an adversary. We propose a novel decentralized attack-resilient state-tracking algorithm based on the simple observation that a compressed version of all the network measurements suffices to reconstruct the state. This motivates a 2-step solution to the decentralized secure state-tracking problem: (1) each node tracks the compressed version of all the network measurements, and (2) each node asymptotically reconstructs the state from the output of step (1). We prove that, under mild technical assumptions, our algorithm enables each node to track the state of the linear system and thus solves the decentralized secure state-tracking problem.


title: Stability Analysis of Planar Probabilistic Piecewise Constant Derivative Systems

abstract: In this paper, we study the probabilistic stability analysis of a subclass of stochastic hybrid systems, called the Planar Probabilistic Piecewise Constant Derivative Systems (Planar PPCD), where the continuous dynamics is deterministic, constant rate and planar, the discrete switching between the modes is probabilistic and happens at boundary of the invariant regions, and the continuous states are not reset during switching. These aptly model piecewise linear behaviors of planar robots. Our main result is an exact algorithm for deciding absolute and almost sure stability of Planar PPCD under some mild assumptions on mutual reachability between the states and the presence of non-zero probability self-loops. Our main idea is to reduce the stability problems on planar PPCD into corresponding problems on Discrete Time Markov Chains with edge weights.


title: Hard to Forget: Poisoning Attacks on Certified Machine Unlearning

abstract: The right to erasure requires removal of a user's information from data held by organizations, with rigorous interpretations extending to downstream products such as learned models. Retraining from scratch with the particular user's data omitted fully removes its influence on the resulting model, but comes with a high computational cost. Machine "unlearning" mitigates the cost incurred by full retraining: instead, models are updated incrementally, possibly only requiring retraining when approximation errors accumulate. Rapid progress has been made towards privacy guarantees on the indistinguishability of unlearned and retrained models, but current formalisms do not place practical bounds on computation. In this paper we demonstrate how an attacker can exploit this oversight, highlighting a novel attack surface introduced by machine unlearning. We consider an attacker aiming to increase the computational cost of data removal. We derive and empirically investigate a poisoning attack on certified machine unlearning where strategically designed training data triggers complete retraining when removed.


title: CompilerGym: Robust, Performant Compiler Optimization Environments for AI Research

abstract: Interest in applying Artificial Intelligence (AI) techniques to compiler optimizations is increasing rapidly, but compiler research has a high entry barrier. Unlike in other domains, compiler and AI researchers do not have access to the datasets and frameworks that enable fast iteration and development of ideas, and getting started requires a significant engineering investment. What is needed is an easy, reusable experimental infrastructure for real world compiler optimization tasks that can serve as a common benchmark for comparing techniques, and as a platform to accelerate progress in the field. We introduce CompilerGym, a set of environments for real world compiler optimization tasks, and a toolkit for exposing new optimization tasks to compiler researchers. CompilerGym enables anyone to experiment on production compiler optimization problems through an easy-to-use package, regardless of their experience with compilers. We build upon the popular OpenAI Gym interface enabling researchers to interact with compilers using Python and a familiar API. We describe the CompilerGym architecture and implementation, characterize the optimization spaces and computational efficiencies of three included compiler environments, and provide extensive empirical evaluations. Compared to prior works, CompilerGym offers larger datasets and optimization spaces, is 27x more computationally efficient, is fault-tolerant, and capable of detecting reproducibility bugs in the underlying compilers. In making it easy for anyone to experiment with compilers - irrespective of their background - we aim to accelerate progress in the AI and compiler research domains.


title: Search for heavy resonances decaying to Z($\nu\bar{\nu}$)V(qq') in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search is presented for heavy bosons decaying to Z($\nu\bar{\nu}$)V(qq'), where V can be a W or a Z boson. A sample of proton-proton collision data at $\sqrt{s} =$ 13 TeV was collected by the CMS experiment during 2016-2018. The data correspond to an integrated luminosity of 137 fb$^{-1}$. The event categorization is based on the presence of high-momentum jets in the forward region to identify production through weak vector boson fusion. Additional categorization uses jet substructure techniques and the presence of large missing transverse momentum to identify W and Z bosons decaying to quarks and neutrinos, respectively. The dominant standard model backgrounds are estimated using data taken from control regions. The results are interpreted in terms of radion, W' boson, and graviton models, under the assumption that these bosons are produced via gluon-gluon fusion, Drell-Yan, or weak vector boson fusion processes. No evidence is found for physics beyond the standard model. Upper limits are set at 95% confidence level on various types of hypothetical new bosons. Observed (expected) exclusion limits on the masses of these bosons range from 1.2 to 4.0 (1.1 to 3.7) TeV.


title: Bragg scattering from a random potential

abstract: A potential for propagation of a wave in two dimensions is constructed from a random superposition of plane waves around all propagation angles. Surprisingly, despite the lack of periodic structure, sharp Bragg diffraction of the wave is observed, analogous to a powder diffraction pattern. The scattering is partially resonant, so Fermi's golden rule does not apply. This phenomenon would be experimentally observable by sending an atomic beam into a chaotic cavity populated by a single mode laser.


title: Language Models as a Knowledge Source for Cognitive Agents

abstract: Language models (LMs) are sentence-completion engines trained on massive corpora. LMs have emerged as a significant breakthrough in natural-language processing, providing capabilities that go far beyond sentence completion including question answering, summarization, and natural-language inference. While many of these capabilities have potential application to cognitive systems, exploiting language models as a source of task knowledge, especially for task learning, offers significant, near-term benefits. We introduce language models and the various tasks to which they have been applied and then review methods of knowledge extraction from language models. The resulting analysis outlines both the challenges and opportunities for using language models as a new knowledge source for cognitive systems. It also identifies possible ways to improve knowledge extraction from language models using the capabilities provided by cognitive systems. Central to success will be the ability of a cognitive agent to itself learn an abstract model of the knowledge implicit in the LM as well as methods to extract high-quality knowledge effectively and efficiently. To illustrate, we introduce a hypothetical robot agent and describe how language models could extend its task knowledge and improve its performance and the kinds of knowledge and methods the agent can use to exploit the knowledge within a language model.


title: High-Q slow light and its localization in a photonic crystal microring

abstract: We introduce a photonic crystal ring cavity that resembles an internal gear and unites photonic crystal (PhC) and whispering gallery mode (WGM) concepts. This `microgear' photonic crystal ring (MPhCR) is created by applying a periodic modulation to the inside boundary of a microring resonator to open a large bandgap, as in a PhC cavity, while maintaining the ring's circularly symmetric outside boundary and high quality factor ($Q$), as in a WGM cavity. The MPhCR targets a specific WGM to open a large PhC bandgap up to tens of free spectral ranges, compressing the mode spectrum while maintaining the high-$Q$, angular momenta, and waveguide coupling properties of the WGM modes. In particular, near the dielectric band-edge, we observe modes whose group velocity is slowed down by 10 times relative to conventional microring modes while supporting $Q~=~(1.1\pm0.1)\times10^6$. This $Q$ is $\approx$50$\times$ that of the previous record in slow light devices. Using the slow light design as a starting point, we further demonstrate the ability to localize WGMs into photonic crystal defect (dPhC) modes for the first time, enabling a more than 10$\times$ reduction of mode volume compared to conventional WGMs while maintaining high-$Q$ up to (5.6$\pm$0.1)$\times$10$^5$. Importantly, this additional dPhC localization is achievable without requiring detailed electromagnetic design. Moreover, controlling their frequencies and waveguide coupling is straightforward in the MPhCR, thanks to its WGM heritage. By using a PhC to strongly modify fundamental properties of WGMs, such as group velocity and localization, the MPhCR provides an exciting platform for a broad range of photonics applications, including sensing/metrology, nonlinear optics, and cavity quantum electrodynamics.


title: Maximum principle preserving space and time flux limiting for Diagonally Implicit Runge-Kutta discretizations of scalar convection-diffusion equations

abstract: We provide a framework for high-order discretizations of nonlinear scalar convection-diffusion equations that satisfy a discrete maximum principle. The resulting schemes can have arbitrarily high order accuracy in time and space, and can be stable and maximum-principle-preserving (MPP) with no step size restriction. The schemes are based on a two-tiered limiting strategy, starting with a high-order limiter-based method that may have small oscillations or maximum-principle violations, followed by an additional limiting step that removes these violations while preserving high order accuracy. The desirable properties of the resulting schemes are demonstrated through several numerical examples.


title: ThriftyDAgger: Budget-Aware Novelty and Risk Gating for Interactive Imitation Learning

abstract: Effective robot learning often requires online human feedback and interventions that can cost significant human time, giving rise to the central challenge in interactive imitation learning: is it possible to control the timing and length of interventions to both facilitate learning and limit burden on the human supervisor? This paper presents ThriftyDAgger, an algorithm for actively querying a human supervisor given a desired budget of human interventions. ThriftyDAgger uses a learned switching policy to solicit interventions only at states that are sufficiently (1) novel, where the robot policy has no reference behavior to imitate, or (2) risky, where the robot has low confidence in task completion. To detect the latter, we introduce a novel metric for estimating risk under the current robot policy. Experiments in simulation and on a physical cable routing experiment suggest that ThriftyDAgger's intervention criteria balances task performance and supervisor burden more effectively than prior algorithms. ThriftyDAgger can also be applied at execution time, where it achieves a 100% success rate on both the simulation and physical tasks. A user study (N=10) in which users control a three-robot fleet while also performing a concentration task suggests that ThriftyDAgger increases human and robot performance by 58% and 80% respectively compared to the next best algorithm while reducing supervisor burden.


title: Comments on the Atiyah-Patodi-Singer index theorem, domain wall, and Berry phase

abstract: It is known that the Atiyah-Patodi-Singer index can be reformulated as the eta invariant of the Dirac operators with a domain wall mass which plays a key role in the anomaly inflow of the topological insulator with boundary. In this paper, we give a conjecture that the reformulated version of the Atiyah-Patodi-Singer index can be given simply from the Berry phase associated with domain wall Dirac operators when adiabatic approximation is valid. We explicitly confirm this conjecture for a special case in two dimensions where analytic calculation is possible. The Berry phase is divided into the bulk and the boundary contributions, each of which gives the bulk integration of the Chern character and the eta-invariant.