title: DeBERTa: Decoding-enhanced BERT with Disentangled Attention

abstract: Recent progress in pre-trained neural language models has significantly improved the performance of many natural language processing (NLP) tasks. In this paper we propose a new model architecture DeBERTa (Decoding-enhanced BERT with disentangled attention) that improves the BERT and RoBERTa models using two novel techniques. The first is the disentangled attention mechanism, where each word is represented using two vectors that encode its content and position, respectively, and the attention weights among words are computed using disentangled matrices on their contents and relative positions, respectively. Second, an enhanced mask decoder is used to incorporate absolute positions in the decoding layer to predict the masked tokens in model pre-training. In addition, a new virtual adversarial training method is used for fine-tuning to improve models' generalization. We show that these techniques significantly improve the efficiency of model pre-training and the performance of both natural language understanding (NLU) and natural langauge generation (NLG) downstream tasks. Compared to RoBERTa-Large, a DeBERTa model trained on half of the training data performs consistently better on a wide range of NLP tasks, achieving improvements on MNLI by +0.9% (90.2% vs. 91.1%), on SQuAD v2.0 by +2.3% (88.4% vs. 90.7%) and RACE by +3.6% (83.2% vs. 86.8%). Notably, we scale up DeBERTa by training a larger version that consists of 48 Transform layers with 1.5 billion parameters. The significant performance boost makes the single DeBERTa model surpass the human performance on the SuperGLUE benchmark (Wang et al., 2019a) for the first time in terms of macro-average score (89.9 versus 89.8), and the ensemble DeBERTa model sits atop the SuperGLUE leaderboard as of January 6, 2021, out performing the human baseline by a decent margin (90.3 versus 89.8).


title: Combining Resurrection and Maximality

abstract: It is shown that the resurrection axiom and the maximality principle may be consistently combined for various iterable forcing classes. The extent to which resurrection and maximality overlap is explored via the local maximality principle.


title: AutoHAS: Efficient Hyperparameter and Architecture Search

abstract: Efficient hyperparameter or architecture search methods have shown remarkable results, but each of them is only applicable to searching for either hyperparameters (HPs) or architectures. In this work, we propose a unified pipeline, AutoHAS, to efficiently search for both architectures and hyperparameters. AutoHAS learns to alternately update the shared network weights and a reinforcement learning (RL) controller, which learns the probability distribution for the architecture candidates and HP candidates. A temporary weight is introduced to store the updated weight from the selected HPs (by the controller), and a validation accuracy based on this temporary weight serves as a reward to update the controller. In experiments, we show AutoHAS is efficient and generalizable to different search spaces, baselines and datasets. In particular, AutoHAS can improve the accuracy over popular network architectures, such as ResNet and EfficientNet, on CIFAR-10/100, ImageNet, and four more other datasets.


title: Sgr A* near-infrared flares from reconnection events in a magnetically arrested disc

abstract: Large-amplitude Sgr A* near-infrared flares result from energy injection into electrons near the black hole event horizon. Astrometry data show continuous rotation of the emission region during bright flares, and corresponding rotation of the linear polarization angle. One broad class of physical flare models invokes magnetic reconnection. Here we show that such a scenario can arise in a general relativistic magnetohydrodynamic simulation of a magnetically arrested disc. Saturation of magnetic flux triggers eruption events, where magnetically dominated plasma is expelled from near the horizon and forms a rotating, spiral structure. Dissipation occurs via reconnection at the interface of the magnetically dominated plasma and surrounding fluid. This dissipation is associated with large increases in near-infrared emission in models of Sgr A*, with durations and amplitudes consistent with the observed flares. Such events occur at roughly the timescale to re-accumulate the magnetic flux from the inner accretion disc, 10h for Sgr A*. We study near-infrared observables from one sample event to show that the emission morphology tracks the boundary of the magnetically dominated region. As the region rotates around the black hole, the near-infrared centroid and linear polarization angle both undergo continuous rotation, similar to the behavior seen in Sgr A* flares.


title: Flares in the Galactic center I: orbiting flux tubes in Magnetically Arrested Black Hole Accretion Disks

abstract: Recent observations of SgrA* by the GRAVITY instrument have astrometrically tracked infrared flares (IR) at distances of $\sim 10$ gravitational radii ($r_g$). In this paper, we study a model for the flares based on 3D general relativistic magnetohydrodynamic (GRMHD) simulations of magnetically arrested accretion disks (MADs) which exhibit violent episodes of flux escape from the black hole magnetosphere. These events are attractive for flare modeling for several reasons: i) the magnetically dominant regions can resist being disrupted via magneto-rotational turbulence and shear, ii) the orientation of the magnetic field is predominantly vertical as suggested by the GRAVITY data, iii) magnetic reconnection associated with the flux eruptions could yield a self-consistent means of particle heating/acceleration during the flare events. In this analysis we track erupted flux bundles and provide distributions of sizes, energies and plasma parameter. In our simulations, the orbits tend to circularize at a range of radii from $\sim 5-40 r_g$. The magnetic energy contained within the flux bundles ranges up to $\sim10^{40}$ erg, enough to power IR and X-ray flares. We find that the motion within the magnetically supported flow is substantially sub-Keplerian, in tension with the inferred period-radius relation of the three GRAVITY flares.


abstract: Sentence embeddings are an important component of many natural language processing (NLP) systems. Like word embeddings, sentence embeddings are typically learned on large text corpora and then transferred to various downstream tasks, such as clustering and retrieval. Unlike word embeddings, the highest performing solutions for learning sentence embeddings require labelled data, limiting their usefulness to languages and domains where labelled data is abundant. In this paper, we present DeCLUTR: Deep Contrastive Learning for Unsupervised Textual Representations. Inspired by recent advances in deep metric learning (DML), we carefully design a self-supervised objective for learning universal sentence embeddings that does not require labelled training data. When used to extend the pretraining of transformer-based language models, our approach closes the performance gap between unsupervised and supervised pretraining for universal sentence encoders. Importantly, our experiments suggest that the quality of the learned embeddings scale with both the number of trainable parameters and the amount of unlabelled training data. Our code and pretrained models are publicly available and can be easily adapted to new domains or used to embed unseen text.


title: Cycle integrals of meromorphic modular forms and coefficients of harmonic Maass forms

abstract: In this paper, we investigate traces of cycle integrals of certain meromorphic modular forms. By relating them to regularised theta lifts we provide explicit formulae for them in terms of coefficients of harmonic Maass forms.


title: Speckle illumination SFDI for projector-free optical property mapping

abstract: Spatial Frequency Domain Imaging can map tissue scattering and absorption properties over a wide field of view, making it useful for clinical applications such as wound assessment and surgical guidance. This technique has previously required the projection of fully-characterized illumination patterns. Here, we show that random and unknown speckle illumination can be used to sample the modulation transfer function of tissues at known spatial frequencies, allowing the quantitative mapping of optical properties with simple laser diode illumination. We compute low- and high-spatial frequency response parameters from the local power spectral density for each pixel and use a look-up-table to accurately estimate absorption and scattering coefficients in tissue phantoms, in vivo human hand, and ex vivo swine esophagus. Because speckle patterns can be generated over a large depth of field and field of view with simple coherent illumination, this approach may enable optical property mapping in new form-factors and applications, including endoscopy.


title: Rapid Task-Solving in Novel Environments

abstract: We propose the challenge of rapid task-solving in novel environments (RTS), wherein an agent must solve a series of tasks as rapidly as possible in an unfamiliar environment. An effective RTS agent must balance between exploring the unfamiliar environment and solving its current task, all while building a model of the new environment over which it can plan when faced with later tasks. While modern deep RL agents exhibit some of these abilities in isolation, none are suitable for the full RTS challenge. To enable progress toward RTS, we introduce two challenge domains: (1) a minimal RTS challenge called the Memory&Planning Game and (2) One-Shot StreetLearn Navigation, which introduces scale and complexity from real-world data. We demonstrate that state-of-the-art deep RL agents fail at RTS in both domains, and that this failure is due to an inability to plan over gathered knowledge. We develop Episodic Planning Networks (EPNs) and show that deep-RL agents with EPNs excel at RTS, outperforming the nearest baseline by factors of 2-3 and learning to navigate held-out StreetLearn maps within a single episode. We show that EPNs learn to execute a value iteration-like planning algorithm and that they generalize to situations beyond their training experience. algorithm and that they generalize to situations beyond their training experience.


title: Generalized Chain Surgeries and Applications

abstract: We describe the Stein handlebody diagrams of Milnor fibers of Brieskorn singularities $x^p + y^q + z^r = 0$. We also study the natural symplectic operation by exchanging two Stein fillings of the canonical contact structure on the links in the case $p = q = r$, where one of the fillings comes from the minimal resolution and the other is the Milnor fiber. We give two different interpretations of this operation, one as a symplectic sum and the other as a monodromy substitution in a Lefschetz fibration.


title: Low-Complexity System and Algorithm for an Emergency Ventilator Sensor and Alarm

abstract: In response to the shortage of ventilators caused by the COVID-19 pandemic, many organizations have designed low-cost emergency ventilators. Many of these devices are pressure-cycled pneumatic ventilators, which are easy to produce but often do not include the sensing or alarm features found on commercial ventilators. This work reports a low-cost, easy-to-produce electronic sensor and alarm system for pressure-cycled ventilators that estimates clinically useful metrics such as pressure and respiratory rate and sounds an alarm when the ventilator malfunctions. A low-complexity signal processing algorithm uses a pair of nonlinear recursive envelope trackers to monitor the signal from an electronic pressure sensor connected to the patient airway. The algorithm, inspired by those used in hearing aids, requires little memory and performs only a few calculations on each sample so that it can run on nearly any microcontroller.


title: Differential topological aspects in octonionic monogenic function theory

abstract: In this paper we apply a homologous version of the Cauchy integral formula for octonionic monogenic functions to introduce for this class of functions the notion of multiplicity of zeroes and $a$-points in the sense of the topological mapping degree. As a big novelty we also address the case of zeroes lying on certain classes of compact zero varieties. This case has not even been studied in the associative Clifford analysis setting so far. We also prove an argument principle for octonionic monogenic functions for isolated zeroes and for non-isolated compact zero sets. In the isolated case we can use this tool to prove a generalized octonionic Rouch\'e's theorem by a homotopic argument. As an application we set up a generalized version of Hurwitz theorem which is also a novelty even for the Clifford analysis case.


title: VectorTSP: A Traveling Salesperson Problem with Racetrack-like acceleration constraints

abstract: We study a new version of the Euclidean TSP called VectorTSP (VTSP for short) where a mobile entity is allowed to move according to a set of physical constraints inspired from the pen-and-pencil game Racetrack (also known as Vector Racer ). In contrast to other versions of TSP accounting for physical constraints, such as Dubins TSP, the spirit of this model is that (1) no speed limitations apply, and (2) inertia depends on the current velocity. As such, this model is closer to typical models considered in path planning problems, although applied here to the visit of n cities in a non-predetermined order. We motivate and introduce the VectorTSP problem, discussing fundamental differences with previous versions of TSP. In particular, an optimal visit order for ETSP may not be optimal for VTSP. We show that VectorTSP is NP-hard, and in the other direction, that VectorTSP reduces to GroupTSP in polynomial time (although with a significant blow-up in size). On the algorithmic side, we formulate the search for a solution as an interactive scheme between a high-level algorithm and a trajectory oracle, the former being responsible for computing the visit order and the latter for computing the cost (or the trajectory) for a given visit order. We present algorithms for both, and we demonstrate and quantify through experiments that this approach frequently finds a better solution than the optimal trajectory realizing an optimal ETSP tour, which legitimates the problem itself and (we hope) motivates further algorithmic developments.


title: On maps with continuous path lifting

abstract: We study a natural generalization of covering projections defined in terms of unique lifting properties. A map $p:E\to X$ has the "continuous path-covering property" if all paths in $X$ lift uniquely and continuously (rel. basepoint) with respect to the compact-open topology. We show that maps with this property are closely related to fibrations with totally path-disconnected fibers and to the natural quotient topology on the homotopy groups. In particular, the class of maps with the continuous path-covering property lies properly between Hurewicz fibrations and Serre fibrations with totally path-disconnected fibers. We extend the usual classification of covering projections to a classification of maps with the continuous path-covering property in terms of topological $\pi_1$: for any path-connected Hausdorff space $X$, maps $E\to X$ with the continuous path-covering property are classified up to weak equivalence by subgroups $H\leq \pi_1(X,x_0)$ with totally path-disconnected coset space $\pi_1(X,x_0)/H$. Here, "weak equivalence" refers to an equivalence relation generated by formally inverting bijective weak homotopy equivalences.


title: Volume and symplectic structure for l-adic local systems

abstract: We introduce a notion of volume for an l-adic local system over an algebraic curve and, under some conditions, give a symplectic form on the rigid analytic deformation space of the corresponding geometric local system. These constructions can be viewed as arithmetic analogues of the volume and the Chern-Simons invariants of a representation of the fundamental group of a 3-manifold which fibers over the circle and of the symplectic form on the character varieties of a Riemann surface. We show that the absolute Galois group acts on the deformation space by conformal symplectomorphisms which extend to an l-adic analytic flow. We also prove that the locus of the deformation space over which the local system suitably descends is the critical set of a collection of rigid analytic functions. The vanishing cycles of these functions give additional invariants.


title: An Overview of Neural Network Compression

abstract: Overparameterized networks trained to convergence have shown impressive performance in domains such as computer vision and natural language processing. Pushing state of the art on salient tasks within these domains corresponds to these models becoming larger and more difficult for machine learning practitioners to use given the increasing memory and storage requirements, not to mention the larger carbon footprint. Thus, in recent years there has been a resurgence in model compression techniques, particularly for deep convolutional neural networks and self-attention based networks such as the Transformer. Hence, this paper provides a timely overview of both old and current compression techniques for deep neural networks, including pruning, quantization, tensor decomposition, knowledge distillation and combinations thereof. We assume a basic familiarity with deep learning architectures\footnote{For an introduction to deep learning, see ~\citet{goodfellow2016deep}}, namely, Recurrent Neural Networks~\citep[(RNNs)][]{rumelhart1985learning,hochreiter1997long}, Convolutional Neural Networks~\citep{fukushima1980neocognitron}~\footnote{For an up to date overview see~\citet{khan2019survey}} and Self-Attention based networks~\citep{vaswani2017attention}\footnote{For a general overview of self-attention networks, see ~\citet{chaudhari2019attentive}.},\footnote{For more detail and their use in natural language processing, see~\citet{hu2019introductory}}. Most of the papers discussed are proposed in the context of at least one of these DNN architectures.


title: Hybrid Position/Force Control for Hydraulic Actuators

abstract: In this paper a novel hybrid position/force control with autonomous switching between both control modes is introduced for hydraulic actuators. A hybrid position/force control structure with feed-forwarding, full-state feedback, including integral control error, pre-compensator of the deadzone, and low-pass filtering of the control value is designed. Controller gains are obtained via local linearization and pole placement accomplished separately for the position and force control. A hysteresis-based autonomous switching is integrated into the closed control loop, while multiple Lyapunov function based approach is applied for stability analysis of the entire hybrid control system. Experimental evaluation is shown on the developed test setup with the standard industrial hydraulic cylinders, and that for different motion and load profiles.


title: Characterizing the accuracy of ALMA linear-polarization mosaics

abstract: We characterize the accuracy of linear-polarization mosaics made using the Atacama Large Millimeter/submillimeter Array (ALMA). First, we observed the bright, highly linearly polarized blazar 3C 279 at Bands 3, 5, 6, and 7 (3 mm, 1.6 mm, 1.3 mm, and 0.87 mm, respectively). At each band, we measured the blazar's polarization on an 11$\times$11 grid of evenly-spaced offset pointings covering the full-width at half-maximum (FWHM) area of the primary beam. After applying calibration solutions derived from the on-axis pointing of 3C 279 to all of the on- and off-axis data, we find that the residual polarization errors across the primary beam are similar at all frequencies: the residual errors in linear polarization fraction $P_\textrm{frac}$ and polarization position angle $\chi$ are $\lesssim$0.001 ($\lesssim$0.1% of Stokes $I$) and $\lesssim$1$^\circ$ near the center of the primary beam; the errors increase to $\sim$0.003-0.005 ($\sim$0.3-0.5% of Stokes $I$) and $\sim$1-5$^\circ$ near the FWHM as a result of the asymmetric beam patterns in the (linearly polarized) $Q$ and $U$ maps. We see the expected double-lobed "beam squint" pattern in the circular polarization (Stokes $V$) maps. Second, to test the polarization accuracy in a typical ALMA project, we performed observations of continuum linear polarization toward the Kleinmann-Low nebula in Orion (Orion-KL) using several mosaic patterns at Bands 3 and 6. We show that after mosaicking, the residual off-axis errors decrease as a result of overlapping multiple pointings. Finally, we compare the ALMA mosaics with an archival 1.3 mm CARMA polarization mosaic of Orion-KL and find good consistency in the polarization patterns.

categories: astro-ph.IM astro-ph.GA astro-ph.HE astro-ph.SR


title: Planning of School Teaching during COVID-19

abstract: More than one billion students are out of school because of Covid-19, forced to a remote learning that has several drawbacks and has been hurriedly arranged; in addition, most countries are currently uncertain on how to plan school activities for the 2020-2021 school year; all of this makes learning and education some of the biggest world issues of the current pandemic. Unfortunately, due to the length of the incubation period of Covid-19, full opening of schools seems to be impractical till a vaccine is available. In order to support the possibility of some in-person learning, we study a mathematical model of the diffusion of the epidemic due to school opening, and evaluate plans aimed at containing the extra Covid-19 cases due to school activities while ensuring an adequate number of in-class learning periods. We consider a SEAIR model with an external source of infection and a suitable loss function; after a realistic parameter selection, we numerically determine optimal school opening strategies by simulated annealing. It turns out that blended models, with almost periodic alternations of in-class and remote teaching days or weeks, are generally optimal. Besides containing Covid-19 diffusion, these solutions could be pedagogically acceptable, and could also become a driving model for the society at large. In a prototypical example, the optimal strategy results in the school opening 90 days out of 200 with the number of Covid-19 cases among the individuals related to the school increasing by about 66%, instead of the about 250% increase that would have been a consequence of full opening.


title: Sparse Gaussian Processes via Parametric Families of Compactly-supported Kernels

abstract: Gaussian processes are powerful models for probabilistic machine learning, but are limited in application by their $O(N^3)$ inference complexity. We propose a method for deriving parametric families of kernel functions with compact spatial support, which yield naturally sparse kernel matrices and enable fast Gaussian process inference via sparse linear algebra. These families generalize known compactly-supported kernel functions, such as the Wendland polynomials. The parameters of this family of kernels can be learned from data using maximum likelihood estimation. Alternatively, we can quickly compute compact approximations of a target kernel using convex optimization. We demonstrate that these approximations incur minimal error over the exact models when modeling data drawn directly from a target GP, and can out-perform the traditional GP kernels on real-world signal reconstruction tasks, while exhibiting sub-quadratic inference complexity.


title: Active Learning A Neural Network Model For Gold Clusters \& Bulk From Sparse First Principles Training Data

abstract: Small metal clusters are of fundamental scientific interest and of tremendous significance in catalysis. These nanoscale clusters display diverse geometries and structural motifs depending on the cluster size; a knowledge of this size-dependent structural motifs and their dynamical evolution has been of longstanding interest. Classical MD typically employ predefined functional forms which limits their ability to capture such complex size-dependent structural and dynamical transformation. Neural Network (NN) based potentials represent flexible alternatives and in principle, well-trained NN potentials can provide high level of flexibility, transferability and accuracy on-par with the reference model used for training. A major challenge, however, is that NN models are interpolative and requires large quantities of training data to ensure that the model adequately samples the energy landscape both near and far-from-equilibrium. Here, we introduce an active learning (AL) scheme that trains a NN model on-the-fly with minimal amount of first-principles based training data. Our AL workflow is initiated with a sparse training dataset (1 to 5 data points) and is updated on-the-fly via a Nested Ensemble Monte Carlo scheme that iteratively queries the energy landscape in regions of failure and updates the training pool to improve the network performance. Using a representative system of gold clusters, we demonstrate that our AL workflow can train a NN with ~500 total reference calculations. Our NN predictions are within 30 meV/atom and 40 meV/\AA of the reference DFT calculations. Moreover, our AL-NN model also adequately captures the various size-dependent structural and dynamical properties of gold clusters in excellent agreement with DFT calculations and available experiments.


title: Publish, subscribe, and federate!

abstract: Connecting usual things/objects to the Internet allows the monitoring and control of such things from anywhere, which is usually referred to as the Internet of Things (IoT). Things communicate among themselves or with other entities (e.g., a server) so that information can be gathered from things whilst proper actions can be taken upon them. A prominent communication approach adopted by many IoT applications is related to the Publish/Subscribe (P/S) paradigm. Any communication entity willing to provide some data announces its intention to a server (broker), establishing itself as a publisher for such data/topic. Entities that are willing to receive any published data, register themselves to the broker as subscribers. While employing just one broker might lead to a bottleneck and a single point of failure, when having multiple brokers one could end up having difficulties with their management. This work presents a scalable and efficient proposal for the federation of independent brokers, by allowing subscribers to get all their publications no matter to which broker publishers and subscribers are associated with.


title: Studying the parameters of the extended $\sigma$-$\omega$ model for neutron star matter

abstract: In this work we study the parameters of the extended $\sigma$-$\omega$ model for neutron star matter by a Bayesian analysis on state-of-the-art multi-messenger astronomy observations, namely mass, radius and tidal deformabilities. We have considered three parameters of the model, the Landau mass $m_L$, the nuclear compressibility $K_0$, and the value of the symmetry energy $S_0$, all at saturation density $n_0$. As a result, we are able to estimate the values of the Landau mass of f $m_L = 739\pm17$ MeV, whereas the values of $K_0$ and $S_0$ fall within already known empirical values. Furthermore, for neutron stars we find the most probable value of 13 km $<R_{1.4}<$ 13.5 km and the upper mass limit of $M_{max} \approx 2.2$ M$_{\odot}$.


title: Visual Transformers: Token-based Image Representation and Processing for Computer Vision

abstract: Computer vision has achieved remarkable success by (a) representing images as uniformly-arranged pixel arrays and (b) convolving highly-localized features. However, convolutions treat all image pixels equally regardless of importance; explicitly model all concepts across all images, regardless of content; and struggle to relate spatially-distant concepts. In this work, we challenge this paradigm by (a) representing images as semantic visual tokens and (b) running transformers to densely model token relationships. Critically, our Visual Transformer operates in a semantic token space, judiciously attending to different image parts based on context. This is in sharp contrast to pixel-space transformers that require orders-of-magnitude more compute. Using an advanced training recipe, our VTs significantly outperform their convolutional counterparts, raising ResNet accuracy on ImageNet top-1 by 4.6 to 7 points while using fewer FLOPs and parameters. For semantic segmentation on LIP and COCO-stuff, VT-based feature pyramid networks (FPN) achieve 0.35 points higher mIoU while reducing the FPN module's FLOPs by 6.5x.


title: Cosmological constraints on late-universe decaying dark matter as a solution to the $H_0$ tension

abstract: It has been suggested that late-universe dark matter decays can alleviate the tension between measurements of $H_0$ in the local universe and its value inferred from cosmic microwave background fluctuations. It has been suggested that decaying dark matter can potentially account for this discrepancy as it reshuffles the energy density between matter and radiation and as a result allows dark energy to become dominant at earlier times. In this work, we show that the low multipole amplitude of the cosmic microwave background anisotropy power spectrum severely constrains the feasibility of late-time decays as a solution to the $H_0$ tension.


title: Prague Dependency Treebank -- Consolidated 1.0

abstract: We present a richly annotated and genre-diversified language resource, the Prague Dependency Treebank-Consolidated 1.0 (PDT-C 1.0), the purpose of which is - as it always been the case for the family of the Prague Dependency Treebanks - to serve both as a training data for various types of NLP tasks as well as for linguistically-oriented research. PDT-C 1.0 contains four different datasets of Czech, uniformly annotated using the standard PDT scheme (albeit not everything is annotated manually, as we describe in detail here). The texts come from different sources: daily newspaper articles, Czech translation of the Wall Street Journal, transcribed dialogs and a small amount of user-generated, short, often non-standard language segments typed into a web translator. Altogether, the treebank contains around 180,000 sentences with their morphological, surface and deep syntactic annotation. The diversity of the texts and annotations should serve well the NLP applications as well as it is an invaluable resource for linguistic research, including comparative studies regarding texts of different genres. The corpus is publicly and freely available.


title: Evaluating the Disentanglement of Deep Generative Models through Manifold Topology

abstract: Learning disentangled representations is regarded as a fundamental task for improving the generalization, robustness, and interpretability of generative models. However, measuring disentanglement has been challenging and inconsistent, often dependent on an ad-hoc external model or specific to a certain dataset. To address this, we present a method for quantifying disentanglement that only uses the generative model, by measuring the topological similarity of conditional submanifolds in the learned representation. This method showcases both unsupervised and supervised variants. To illustrate the effectiveness and applicability of our method, we empirically evaluate several state-of-the-art models across multiple datasets. We find that our method ranks models similarly to existing methods. We make ourcode publicly available at https://github.com/stanfordmlgroup/disentanglement.


title: An Accurate Current Model for III-V Field Effect Transistors Using a Novel Concept of Effective Transmission Coefficient

abstract: In this work, we investigate the transport phenomena in compound semiconductor material based buried channel Quantum Well MOSFET with a view to developing a simple and effective model for the device current. Device simulation has been performed in quantum ballistic regime using non-equilibrium Greens function (NEGF) formalism. The simulated current voltage characteristics using a novel concept of effective transmission coefficient has been found to define the reported experimental data with high accuracy. The proposed model has also been effective to capture the transport characteristics reported for other compound semiconductor material based field effect transistors. The concept of the proposed effective transmission coefficient and hence the model lends itself to be a simple and powerful device analysis tool which can be extensively used to predict the performance of a wide variety of compound semiconductor devices in the pre fabrication stage. It has also demonstrated consistency with device characteristics for doping concentration and channel length scaling. Thus the model can help the device or process engineers to tune the devices for the best possible performance.


title: The Barrier Surface in the Cooperative Football Differential Game

abstract: This paper considers the blocking or football pursuit-evasion differential game. Two pursuers cooperate and try to capture the ball carrying evader as far as possible from the goal line. The evader wishes to be as close as possible to the goal line at the time of capture and, if possible, reach the line. In this paper the solution of the game of kind is provided: The Barrier surface that partitions the state space into two winning sets, one for the pursuer team and one for the evader, is constructed. Under optimal play, the winning team is determined by evaluating the associated Barrier function.


title: Sign Problems in Quantum Field Theory: Classical and Quantum Approaches

abstract: Monte Carlo calculations in the framework of lattice field theory provide non-perturbative access to the equilibrium physics of quantum fields. When applied to certain fermionic systems, or to the calculation of out-of-equilibrium physics, these methods encounter the so-called sign problem, and computational resource requirements become impractically large. These difficulties prevent the calculation from first principles of the equation of state of quantum chromodynamics, as well as the computation of transport coefficients in quantum field theories, among other things. This thesis details two methods for mitigating or avoiding the sign problem. First, via the complexification of the field variables and the application of Cauchy's integral theorem, the difficulty of the sign problem can be changed. This requires searching for a suitable contour of integration. Several methods of finding such a contour are discussed, as well as the procedure for integrating on it. Two notable examples are highlighted: in one case, a contour exists which entirely removes the sign problem, and in another, there is provably no contour available to improve the sign problem by more than a (parametrically) small amount. As an alternative, physical simulations can be performed with the aid of a quantum computer. The formal elements underlying a quantum computation - that is, a Hilbert space, unitary operators acting on it, and Hermitian observables to be measured - can be matched to those of a quantum field theory. In this way an error-corrected quantum computer may be made to serve as a well controlled laboratory. Precise algorithms for this task are presented, specifically in the context of quantum chromodynamics.


title: Differentially private partition selection

abstract: Many data analysis operations can be expressed as a GROUP BY query on an unbounded set of partitions, followed by a per-partition aggregation. To make such a query differentially private, adding noise to each aggregation is not enough: we also need to make sure that the set of partitions released is also differentially private. This problem is not new, and it was recently formally introduced as differentially private set union. In this work, we continue this area of study, and focus on the common setting where each user is associated with a single partition. In this setting, we propose a simple, optimal differentially private mechanism that maximizes the number of released partitions. We discuss implementation considerations, as well as the possible extension of this approach to the setting where each user contributes to a fixed, small number of partitions.


title: BERT-XML: Large Scale Automated ICD Coding Using BERT Pretraining

abstract: Clinical interactions are initially recorded and documented in free text medical notes. ICD coding is the task of classifying and coding all diagnoses, symptoms and procedures associated with a patient's visit. The process is often manual and extremely time-consuming and expensive for hospitals. In this paper, we propose a machine learning model, BERT-XML, for large scale automated ICD coding from EHR notes, utilizing recently developed unsupervised pretraining that have achieved state of the art performance on a variety of NLP tasks. We train a BERT model from scratch on EHR notes, learning with vocabulary better suited for EHR tasks and thus outperform off-the-shelf models. We adapt the BERT architecture for ICD coding with multi-label attention. While other works focus on small public medical datasets, we have produced the first large scale ICD-10 classification model using millions of EHR notes to predict thousands of unique ICD codes.


title: Adversarial Robustness of Deep Convolutional Candlestick Learner

abstract: Deep learning (DL) has been applied extensively in a wide range of fields. However, it has been shown that DL models are susceptible to a certain kinds of perturbations called \emph{adversarial attacks}. To fully unlock the power of DL in critical fields such as financial trading, it is necessary to address such issues. In this paper, we present a method of constructing perturbed examples and use these examples to boost the robustness of the model. Our algorithm increases the stability of DL models for candlestick classification with respect to perturbations in the input data.


title: UDPipe at EvaLatin 2020: Contextualized Embeddings and Treebank Embeddings

abstract: We present our contribution to the EvaLatin shared task, which is the first evaluation campaign devoted to the evaluation of NLP tools for Latin. We submitted a system based on UDPipe 2.0, one of the winners of the CoNLL 2018 Shared Task, The 2018 Shared Task on Extrinsic Parser Evaluation and SIGMORPHON 2019 Shared Task. Our system places first by a wide margin both in lemmatization and POS tagging in the open modality, where additional supervised data is allowed, in which case we utilize all Universal Dependency Latin treebanks. In the closed modality, where only the EvaLatin training data is allowed, our system achieves the best performance in lemmatization and in classical subtask of POS tagging, while reaching second place in cross-genre and cross-time settings. In the ablation experiments, we also evaluate the influence of BERT and XLM-RoBERTa contextualized embeddings, and the treebank encodings of the different flavors of Latin treebanks.


title: Harvesting Solar Thermal Energy With a Micro-gap Thermionic-Thermoelectric Hybrid Energy Converter: Model Development, Energy Exchange Analysis, and Performance Optimization

abstract: We present a comprehensive analysis of a dual, micro-gap thermionic-thermoelectric hybrid energy converter by developing a detailed theoretical model of the system. The Space-charge and near-field effects in thermionic conversion and the temperature-dependent effects in thermoelectric conversion are considered while studying the energy flow through the cascade system. The temperatures and energy exchange channels in the different parts of the system are quantified with a self-consistent iterative algorithm considering the energy balance condition. The model is deployed to simulate the hybrid system performance when energized by a constant heat flux source which could, for example, be concentrated solar irradiance. The effect of solar radiation intensity on the combined system efficiency, and the dependence of the thermoelectric generator performance on the waste heat released from the thermionic top stage, are illustrated with several examples. Based on these analyses, the performance optimization of the hybrid system is carried out. The findings presented in this work offer useful insights into the hybrid generator operation. Moreover, the model developed can be used as a design tool for the practical implementation of such a hybrid system, or for extracting material- and device-related parameters from experimental data by solving the reverse problem.


title: Anomaly Detection with Domain Adaptation

abstract: We study the problem of semi-supervised anomaly detection with domain adaptation. Given a set of normal data from a source domain and a limited amount of normal examples from a target domain, the goal is to have a well-performing anomaly detector in the target domain. We propose the Invariant Representation Anomaly Detection (IRAD) to solve this problem where we first learn to extract a domain-invariant representation. The extraction is achieved by an across-domain encoder trained together with source-specific encoders and generators by adversarial learning. An anomaly detector is then trained using the learnt representations. We evaluate IRAD extensively on digits images datasets (MNIST, USPS and SVHN) and object recognition datasets (Office-Home). Experimental results show that IRAD outperforms baseline models by a wide margin across different datasets. We derive a theoretical lower bound for the joint error that explains the performance decay from overtraining and also an upper bound for the generalization error.


title: DFT Modelling of Explicit Solid-Solid Interfaces in Batteries: Methods and Challenges

abstract: Density Functional Theory (DFT) calculations of electrode material properties in high energy density storage devices like lithium batteries have been standard practice for decades. In contrast, DFT modelling of explicit interfaces in batteries arguably lacks universally adopted methodology and needs further conceptual development. In this paper, we focus on solid-solid interfaces, which are ubiquitous not just in all-solid state batteries; liquid-electrolyte-based batteries often rely on thin, solid passivating films on electrode surfaces to function. We use metal anode calculations to illustrate that explicit interface models are critical for elucidating contact potentials, electric fields at interfaces, and kinetic stability with respect to parasitic reactions. The examples emphasize three key challenges: (1) the "dirty" nature of most battery electrode surfaces; (2) voltage calibration and control; and (3) the fact that interfacial structures are governed by kinetics, not thermodynamics. To meet these challenges, developing new computational techniques and importing insights from other electrochemical disciplines will be beneficial.


title: $H$-kernels in $H$-colored digraphs without $(\xi_{1}, \xi, \xi_{2})$-$H$-subdivisions of $\overrightarrow{C_{3}}$

abstract: Let $H$ be a digraph possibly with loops and $D$ a digraph without loops with a coloring of its arcs $c:A(D) \rightarrow V(H)$ ($D$ is said to be an $H$-colored digraph). A directed path $W$ in $D$ is said to be an $H$-path if and only if the consecutive colors encountered on $W$ form a directed walk in $H$. A subset $N$ of vertices of $D$ is said to be an $H$-kernel if (1) for every pair of different vertices in $N$ there is no $H$-path between them and (2) for every vertex $u$ in V($D$)$\setminus$$N$ there exists an $H$-path in $D$ from $u$ to $N$. Under this definition an $H$-kernel is a kernel whenever $A(H)=\emptyset$. The color-class digraph $\mathscr{C}_C$($D$) of $D$ is the digraph whose vertices are the colors represented in the arcs of $D$ and ($i$,$j$) $\in$ $A$($\mathscr{C}_C$($D$)) if and only if there exist two arcs, namely ($u$,$v$) and ($v$,$w$) in $D$, such that ($u$,$v$) has color $i$ and ($v$,$w$) has color $j$. Since not every $H$-colored digraph has an $H$-kernel and $V(\mathscr{C}_C(D))= V(H)$, the natural question is: what structural properties of $\mathscr{C}_C(D)$, with respect to the $H$-coloring, imply that $D$ has an $H$-kernel? In this paper we investigate the problem of the existence of an $H$-kernel by means of a partition $\xi$ of $V(H)$ and a partition \{$\xi_1$, $\xi_2$\} of $\xi$. We establish conditions on the directed cycles and the directed paths of the digraph $D$, with respect to the partition \{$\xi_1$, $\xi_2$\}. In particular we pay attention to some subestructures produced by the partitions $\xi$ and \{$\xi_1$, $\xi_2$\}, namely $(\xi_{1}, \xi, \xi_{2})$-$H$-subdivisions of $\overrightarrow{C_{3}}$ and $(\xi_{1}, \xi, \xi_{2})$-$H$-subdivisions of $\overrightarrow{P_{3}}$. We give some examples which show that each hypothesis in the main result is tight.


title: Hodge-Iwasawa Theory I

abstract: In this paper, we are going to establish a simultaneous generalization of the relative Iwasawa theory proposed by Kedlaya-Pottharst and the relative $p$-adic Hodge theory after Kedlaya-Liu. We call this Hodge-Iwasawa theory in the sense that one could apply the theory to study noncommutative Iwasawa cohomology and noncommutative Iwasawa theories in families and meanwhile one could apply the theory to study the deformation theory of \'etale local systems or families of representations of fundamental groups or the equivariant constructible $p$-adic sheaves, with more sophisticated point of view coming from Kato, Fukaya-Kato. We follow closely the approach of Kedlaya-Liu to study the corresponding modules and sheaves over the corresponding deformed version of the period rings and period sheaves.


title: Future Simulations of Tidal Disruption Events

abstract: Tidal disruption events involve numerous physical processes (fluid dynamics, magnetohydrodynamics, radiation transport, self-gravity, general relativistic dynamics) in highly nonlinear ways, and, because TDEs are transients by definition, frequently in non-equilibrium states. For these reasons, numerical solution of the relevant equations can be an essential tool for studying these events. In this chapter, we present a summary of the key problems of the field for which simulations offer the greatest promise and identify the capabilities required to make progress on them. We then discuss what has been---and what cannot be---done with existing numerical methods. We close with an overview of what methods now under development may do to expand our ability to understand these events.


title: DINO: Distributed Newton-Type Optimization Method

abstract: We present a novel communication-efficient Newton-type algorithm for finite-sum optimization over a distributed computing environment. Our method, named DINO, overcomes both theoretical and practical shortcomings of similar existing methods. Under minimal assumptions, we guarantee global sub-linear convergence of DINO to a first-order stationary point for general non-convex functions and arbitrary data distribution over the network. Furthermore, for functions satisfying Polyak-Lojasiewicz (PL) inequality, we show that DINO enjoys a linear convergence rate. Our proposed algorithm is practically parameter free, in that it will converge regardless of the selected hyper-parameters, which are easy to tune. Additionally, its sub-problems are simple linear least-squares, for which efficient solvers exist. Numerical simulations demonstrate the efficiency of DINO as compared with similar alternatives.


title: Physical-Layer Authentication Using Channel State Information and Machine Learning

abstract: Strong authentication in an interconnected wireless environment continues to be an important, but sometimes elusive goal. Research in physical-layer authentication using channel features holds promise as a technique to improve network security for a variety of devices. We propose the use of machine learning and measured multiple-input multiple-output communications channel information to make a decision on whether or not to authenticate a particular device. This work analyzes the use of received channel state information from the wireless environment and demonstrates the employment of a generative adversarial neural network (GAN) trained with received channel data to authenticate a transmitting device. We compared a variety of machine learning techniques and found that the local outlier factor (LOF) algorithm reached 100% accuracy at lower signal to noise ratios (SNR) than other algorithms. However, before LOF reached 100%, we also show that the GAN was more accurate at lower SNR levels.


title: High-Dimensional Non-Parametric Density Estimation in Mixed Smooth Sobolev Spaces

abstract: Density estimation plays a key role in many tasks in machine learning, statistical inference, and visualization. The main bottleneck in high-dimensional density estimation is the prohibitive computational cost and the slow convergence rate. In this paper, we propose novel estimators for high-dimensional non-parametric density estimation called the adaptive hyperbolic cross density estimators, which enjoys nice convergence properties in the mixed smooth Sobolev spaces. As modifications of the usual Sobolev spaces, the mixed smooth Sobolev spaces are more suitable for describing high-dimensional density functions in some applications. We prove that, unlike other existing approaches, the proposed estimator does not suffer the curse of dimensionality under Integral Probability Metric, including H\"older Integral Probability Metric, where Total Variation Metric and Wasserstein Distance are special cases. Applications of the proposed estimators to generative adversarial networks (GANs) and goodness of fit test for high-dimensional data are discussed to illustrate the proposed estimator's good performance in high-dimensional problems. Numerical experiments are conducted and illustrate the efficiency of our proposed method.


title: Real-space formulation of the stress tensor for $\mathcal{O}(N)$ density functional theory: application to high temperature calculations

abstract: We present an accurate and efficient real-space formulation of the Hellmann-Feynman stress tensor for $\mathcal{O}(N)$ Kohn-Sham density functional theory (DFT). While applicable at any temperature, the formulation is most efficient at high temperature where the Fermi-Dirac distribution becomes smoother and density matrix becomes correspondingly more localized. We first rewrite the orbital-dependent stress tensor for real-space DFT in terms of the density matrix, thereby making it amenable to $\mathcal{O}(N)$ methods. We then describe its evaluation within the $\mathcal{O}(N)$ infinite-cell Clenshaw-Curtis Spectral Quadrature (SQ) method, a technique that is applicable to metallic as well as insulating systems, is highly parallelizable, becomes increasingly efficient with increasing temperature, and provides results corresponding to the infinite crystal without the need of Brillouin zone integration. We demonstrate systematic convergence of the resulting formulation with respect to SQ parameters to exact diagonalization results, and show convergence with respect to mesh size to established planewave results. We employ the new formulation to compute the viscosity of hydrogen at a million kelvin from Kohn-Sham quantum molecular dynamics, where we find agreement with previous more approximate orbital-free density functional methods.


title: Texture Interpolation for Probing Visual Perception

abstract: Texture synthesis models are important tools for understanding visual processing. In particular, statistical approaches based on neurally relevant features have been instrumental in understanding aspects of visual perception and of neural coding. New deep learning-based approaches further improve the quality of synthetic textures. Yet, it is still unclear why deep texture synthesis performs so well, and applications of this new framework to probe visual perception are scarce. Here, we show that distributions of deep convolutional neural network (CNN) activations of a texture are well described by elliptical distributions and therefore, following optimal transport theory, constraining their mean and covariance is sufficient to generate new texture samples. Then, we propose the natural geodesics (ie the shortest path between two points) arising with the optimal transport metric to interpolate between arbitrary textures. Compared to other CNN-based approaches, our interpolation method appears to match more closely the geometry of texture perception, and our mathematical framework is better suited to study its statistical nature. We apply our method by measuring the perceptual scale associated to the interpolation parameter in human observers, and the neural sensitivity of different areas of visual cortex in macaque monkeys.


title: Capturing Broadband Light in a Compact Bound State in the Continuum

abstract: Trapping and storing light for arbitrary time lengths in open cavities is a major goal of nanophotonics, with potential applications ranging from energy harvesting to optical information processing. Unfortunately, however, the resonance lifetime of conventional open resonators remains finite even in the limit of vanishing material absorption, as a result of radiation loss. In this context, bound states in the continuum (BiCs) have provided a unique way to achieve unbounded resonance lifetimes despite the presence of compatible radiation channels. However, physical constraints such as reciprocity, linearity, and delay-bandwidth limits prevent the possibility to externally excite such ideal bound states and make them interact with broadband sources. Here, we overcome these limitations and theoretically demonstrate that subwavelength open resonators undergoing a suitable temporal modulation can efficiently capture a broadband incident wave into a nonradiating eigenmode of the structure, leading to the first example of a BiC that is accessible to broadband light. Our findings unveil the dynamic capabilities of bound states in the continuum and extend their reach and potential impact for different applications.


title: Leadership emergence in walking groups

abstract: Understanding the mechanisms underlying the emergence of leadership in multi-agent systems is still under investigation in many areas of research where group coordination is involved. While leadership has been mostly investigated in the case of animal groups, only a few works address the problem of leadership emergence in human ensembles, e.g. pedestrian walking, group dance. In this paper we study the emergence of leadership in the specific scenario of a small walking group. Our aim is to unveil the main mechanisms emerging in a human group when leader or follower roles are not designated a priori. Two groups of participants were asked to walk together and turn or change speed at self-selected times. Data were analysed using time-dependent cross correlation to infer leader-follower interactions between each pair of group members. The results indicate that leadership emergence is due both to contextual factors, such as an individual's position in the group, and to personal factors, such as an individual's characteristic locomotor behaviour. Our approach can easily be extended to larger groups and other scenarios such as team sports and emergency evacuations.


title: Accelerating Natural Language Understanding in Task-Oriented Dialog

abstract: Task-oriented dialog models typically leverage complex neural architectures and large-scale, pre-trained Transformers to achieve state-of-the-art performance on popular natural language understanding benchmarks. However, these models frequently have in excess of tens of millions of parameters, making them impossible to deploy on-device where resource-efficiency is a major concern. In this work, we show that a simple convolutional model compressed with structured pruning achieves largely comparable results to BERT on ATIS and Snips, with under 100K parameters. Moreover, we perform acceleration experiments on CPUs, where we observe our multi-task model predicts intents and slots nearly 63x faster than even DistilBERT.


title: Histopathological imaging features- versus molecular measurements-based cancer prognosis modeling

abstract: For most if not all cancers, prognosis is of significant importance, and extensive modeling research has been conducted. With the genetic nature of cancer, in the past two decades, multiple types of molecular data (such as gene expressions and DNA mutations) have been explored. More recently, histopathological imaging data, which is routinely collected in biopsy, has been shown as informative for modeling prognosis. In this study, using the TCGA LUAD and LUSC data as a showcase, we examine and compare modeling lung cancer overall survival using gene expressions versus histopathological imaging features. High-dimensional regularization methods are adopted for estimation and selection. Our analysis shows that gene expressions have slightly better prognostic performance. In addition, most of the gene expressions are found to be weakly correlated imaging features. It is expected that this study can provide some insight into utilizing the two types of important data in cancer prognosis modeling and into lung cancer overall survival.


title: A Strengthening of the Erd\H{o}s-Szekeres Theorem

abstract: The Erd\H{o}s-Szekeres Theorem stated in terms of graphs says that any red-blue coloring of the edges of the ordered complete graph $K_{rs+1}$ contains a red copy of the monotone increasing path with $r$ edges or a blue copy of the monotone increasing path with $s$ edges. Although $rs + 1$ is the minimum number of vertices needed for this result, not all edges of $K_{rs+1}$ are necessary. We characterize the subgraphs of $K_{rs+1}$ with this coloring property as follows: they are exactly the subgraphs that contain all the edges of a graph we call the circus tent graph $CT(r,s)$. Additionally, we use similar proof techniques to improve upon some of the bounds on the online ordered size Ramsey number of a path given by P\'erez-Gim\'enez, Pralat, and West.


title: Data-driven Energy Management Strategy for Plug-in Hybrid Electric Vehicles with Real-World Trip Information

abstract: This paper presents a data-driven supervisory energy management strategy (EMS) for plug-in hybrid electric vehicles which leverages Vehicle-to-Cloud connectivity to increase energy efficiency by learning control policies from completed trips. The proposed EMS consists of two layers, a cloud layer and an on-board layer. The cloud layer has two main tasks: the first task is to learn EMS policy parameters from historical trip data, and the second task is to provide the policy parameters along a certain route requested from the vehicle. The on-board layer receives the learned policy parameters from the cloud layer and computes a real-time solution to the powertrain energy management problem, using a model predictive control scheme. The proposed EMS is evaluated on more than 3000 miles (48 independent driving cycles) of real-world trip data, collected along three commuting routes in California. For the routes, the proposed algorithm shows 3.3%, 7.3%, and 6.5% improvement in average MPGe when compared to a baseline EMS.


title: Conjunctive Join Semi-Lattices

abstract: A join-semilattice $L$ is said to be conjunctive if it has a top element $1$ and it satisfies the following first-order condition: for any two distinct $a,b\in L$, there is $c\in L$ such that either $a\vee c\not=1=b\vee c$ or $a\vee c=1\not=b\vee c$. Equivalently, a join-semilattice is conjunctive if every principal ideal is an intersection of maximal ideals. We present simple examples showing that a conjunctive join-semilattice may fail to have any prime ideals. (Maximal ideals of a join-semilattice need not be prime.) We show that every conjunctive join-semilattice is isomorphic to a join-closed subbase for a compact $T_1$-topology on $\mathrm{Max} L$, the set of maximal ideals of $L$. The representation is canonical in that when applied to a join-closed subbase for a compact $T_1$-space $X$, the space produced by the representation is homeomorphic with $X$. We say a join-semilattice morphism $\phi:L\to M$ is conjunctive if $\phi^{-1}(w)$ is an intersection of maximal ideals of $L$ whenever $w$ is a maximal ideal of $M$. We show that every conjunctive morphism between conjunctive join-semilattices is induced by a multi-valued function from $\mathrm{Max} M$ to $\mathrm{Max} L$. A base for a topological space is said to be annular if it is a lattice, and Wallman if it is annular and for any point $u$ in any basic open $U$, there a basic open $V$ that misses $u$ and together with $U$ covers $X$. It is easy to show that every Wallman base is conjunctive. We give an example of a conjunctive annular base that is not Wallman. Finally, we examine the free distributive lattice $dL$ over a conjunctive join semilattice $L$. In general, it is not conjunctive, but we show that a certain canonical, algebraically-defined quotient of $dL$ is isomorphic to the sub-lattice of the topology of the representation space that is generated by $L$. We describe numerous applications.


title: Learning from Non-Random Data in Hilbert Spaces: An Optimal Recovery Perspective

abstract: The notion of generalization in classical Statistical Learning is often attached to the postulate that data points are independent and identically distributed (IID) random variables. While relevant in many applications, this postulate may not hold in general, encouraging the development of learning frameworks that are robust to non-IID data. In this work, we consider the regression problem from an Optimal Recovery perspective. Relying on a model assumption comparable to choosing a hypothesis class, a learner aims at minimizing the worst-case error, without recourse to any probabilistic assumption on the data. We first develop a semidefinite program for calculating the worst-case error of any recovery map in finite-dimensional Hilbert spaces. Then, for any Hilbert space, we show that Optimal Recovery provides a formula which is user-friendly from an algorithmic point-of-view, as long as the hypothesis class is linear. Interestingly, this formula coincides with kernel ridgeless regression in some cases, proving that minimizing the average error and worst-case error can yield the same solution. We provide numerical experiments in support of our theoretical findings.


title: Scientific Calculator for Designing Trojan Detectors in Neural Networks

abstract: This work presents a web-based interactive neural network (NN) calculator and a NN inefficiency measurement that has been investigated for the purpose of detecting trojans embedded in NN models. This NN Calculator is designed on top of TensorFlow Playground with in-memory storage of data and NN graphs plus coefficients. It is "like a scientific calculator" with analytical, visualization, and output operations performed on training datasets and NN architectures. The prototype is aaccessible at https://pages.nist.gov/nn-calculator. The analytical capabilities include a novel measurement of NN inefficiency using modified Kullback-Liebler (KL) divergence applied to histograms of NN model states, as well as a quantification of the sensitivity to variables related to data and NNs. Both NN Calculator and KL divergence are used to devise a trojan detector approach for a variety of trojan embeddings. Experimental results document desirable properties of the KL divergence measurement with respect to NN architectures and dataset perturbations, as well as inferences about embedded trojans.


title: Dilated Convolutions with Lateral Inhibitions for Semantic Image Segmentation

abstract: Dilated convolutions are widely used in deep semantic segmentation models as they can enlarge the filters' receptive field without adding additional weights nor sacrificing spatial resolution. However, as dilated convolutional filters do not possess positional knowledge about the pixels on semantically meaningful contours, they could lead to ambiguous predictions on object boundaries. In addition, although dilating the filter can expand its receptive field, the total number of sampled pixels remains unchanged, which usually comprises a small fraction of the receptive field's total area. Inspired by the Lateral Inhibition (LI) mechanisms in human visual systems, we propose the dilated convolution with lateral inhibitions (LI-Convs) to overcome these limitations. Introducing LI mechanisms improves the convolutional filter's sensitivity to semantic object boundaries. Moreover, since LI-Convs also implicitly take the pixels from the laterally inhibited zones into consideration, they can also extract features at a denser scale. By integrating LI-Convs into the Deeplabv3+ architecture, we propose the Lateral Inhibited Atrous Spatial Pyramid Pooling (LI-ASPP), the Lateral Inhibited MobileNet-V2 (LI-MNV2) and the Lateral Inhibited ResNet (LI-ResNet). Experimental results on three benchmark datasets (PASCAL VOC 2012, CelebAMask-HQ and ADE20K) show that our LI-based segmentation models outperform the baseline on all of them, thus verify the effectiveness and generality of the proposed LI-Convs.


title: A free convection heat transfer correlation for very thin horizontal wires in rarefied atmospheres

abstract: Mars and upper Earth atmosphere missions are booming in recent years increasing the interest in heat transfer in rarefied gases. At these low pressures, the heat transfer problems involving small geometries whose characteristic length is of the order of the mean free path of the gas molecules, raises new difficulties. This being especially severe in the case of free convection, where the velocity of the gas is closely linked to the heat transfer problem. Experiments with horizontal wires with diameters of $12.7\ \mu\mathrm{m}$ and $25\ \mu\mathrm{m}$ were conducted in a tailored vacuum chamber with pressures from $0.03$ milibar to ambient pressure, reaching temperature differences of up to $80$ K between the wire and the air. Experimental data is comprised of Rayleigh numbers from $10^{-13}$ to $10^{-5}$ that cover a wide range from free molecular flow to continuum regime. Particularly for the transition regime, with Knudsen numbers ranging between 0.1 and 10, the experimental data shows that the free convection heat transfer cannot be represented solely as a function of the Rayleigh number, but a dependence on Knudsen number must be introduced into the correlation as well. The presented results for the Nusselt number below Rayleigh numbers of $10^{-8}$ exhibit a clear departure from the available correlations in the literature. A new empirical correlation for free convection from horizontal thin wires from the transition to continuum regime is presented. The present work sheds light on current thermal engineering problems which involves very thin wires in their systems which interact with a surrounding environment with a significant level of rarefaction.


title: Estimating Compressibility from Maximal-mass Compact Star Observations

abstract: We investigated recent observation data of pulsar masses of PSR J0740$+$6620, PSR J0348$+$0432, and PSR J1614$-$2230 based on the extended $\sigma$-$\omega$ model. We assumed that these pulsars are maximal mass compact star, which suggest that the core approximation can be applied. Using the linear relations between the microscopic and macroscopic parameters of neutron stars suggested by this model, we estimated the values of the nucleon Landau mass and nuclear compressibility $m_{L} = 776.0^{+38.5}_{-84.9}$~MeV and $K=242.7^{+57.2 }_{-28.0}$, respectively.


title: Curved fronts of bistable reaction-diffusion equations in spatially periodic media

abstract: In this paper, curved fronts are constructed for spatially periodic bistable reaction-diffusion equations under the a priori assumption that there exist pulsating fronts in every direction. Some sufficient and some necessary conditions of the existence of curved fronts are given. Furthermore, the curved front is proved to be unique and stable. Finally, a curved front with varying interfaces is also constructed. Despite the effect of the spatial heterogeneity, the result shows the existence of curved fronts for spatially periodic bistable reaction-diffusion equations which is known for the homogeneous case.


title: Lipschitz Bounds and Provably Robust Training by Laplacian Smoothing

abstract: In this work we propose a graph-based learning framework to train models with provable robustness to adversarial perturbations. In contrast to regularization-based approaches, we formulate the adversarially robust learning problem as one of loss minimization with a Lipschitz constraint, and show that the saddle point of the associated Lagrangian is characterized by a Poisson equation with weighted Laplace operator. Further, the weighting for the Laplace operator is given by the Lagrange multiplier for the Lipschitz constraint, which modulates the sensitivity of the minimizer to perturbations. We then design a provably robust training scheme using graph-based discretization of the input space and a primal-dual algorithm to converge to the Lagrangian's saddle point. Our analysis establishes a novel connection between elliptic operators with constraint-enforced weighting and adversarial learning. We also study the complementary problem of improving the robustness of minimizers with a margin on their loss, formulated as a loss-constrained minimization problem of the Lipschitz constant. We propose a technique to obtain robustified minimizers, and evaluate fundamental Lipschitz lower bounds by approaching Lipschitz constant minimization via a sequence of gradient $p$-norm minimization problems. Ultimately, our results show that, for a desired nominal performance, there exists a fundamental lower bound on the sensitivity to adversarial perturbations that depends only on the loss function and the data distribution, and that improvements in robustness beyond this bound can only be made at the expense of nominal performance. Our training schemes provably achieve these bounds both under constraints on performance and~robustness.


abstract: Reinforcement Learning (RL) based methods have seen their paramount successes in solving serial decision-making and control problems in recent years. For conventional RL formulations, Markov Decision Process (MDP) and state-action-value function are the basis for the problem modeling and policy evaluation. However, several challenging issues still remain. Among most cited issues, the enormity of state/action space is an important factor that causes inefficiency in accurately approximating the state-action-value function. We observe that although actions directly define the agents' behaviors, for many problems the next state after a state transition matters more than the action taken, in determining the return of such a state transition. In this regard, we propose a new learning paradigm, State Action Separable Reinforcement Learning (sasRL), wherein the action space is decoupled from the value function learning process for higher efficiency. Then, a light-weight transition model is learned to assist the agent to determine the action that triggers the associated state transition. In addition, our convergence analysis reveals that under certain conditions, the convergence time of sasRL is $O(T^{1/k})$, where $T$ is the convergence time for updating the value function in the MDP-based formulation and $k$ is a weighting factor. Experiments on several gaming scenarios show that sasRL outperforms state-of-the-art MDP-based RL algorithms by up to $75\%$.


title: Improving PSNR-based Quality Metrics Performance For Point Cloud Geometry

abstract: An increased interest in immersive applications has drawn attention to emerging 3D imaging representation formats, notably light fields and point clouds (PCs). Nowadays, PCs are one of the most popular 3D media formats, due to recent developments in PC acquisition, namely with new depth sensors and signal processing algorithms. To obtain high fidelity 3D representations of visual scenes a huge amount of PC data is typically acquired, which demands efficient compression solutions. As in 2D media formats, the final perceived PC quality plays an important role in the overall user experience and, thus, objective metrics capable to measure the PC quality in a reliable way are essential. In this context, this paper proposes and evaluates a set of objective quality metrics for the geometry component of PC data, which plays a very important role in the final perceived quality. Based on the popular PSNR PC geometry quality metric, the novel improved PSNR-based metrics are proposed by exploiting the intrinsic PC characteristics and the rendering process that must occur before visualization. The experimental results show the superiority of the best-proposed metrics over the state-of-the-art, obtaining an improvement of up to 32% in the Pearson correlation coefficient.


title: Using Stable Matching to Optimize the Balance between Accuracy and Diversity in Recommendation

abstract: Increasing aggregate diversity (or catalog coverage) is an important system-level objective in many recommendation domains where it may be desirable to mitigate the popularity bias and to improve the coverage of long-tail items in recommendations given to users. This is especially important in multistakeholder recommendation scenarios where it may be important to optimize utilities not just for the end user, but also for other stakeholders such as item sellers or producers who desire a fair representation of their items across recommendation lists produced by the system. Unfortunately, attempts to increase aggregate diversity often result in lower recommendation accuracy for end users. Thus, addressing this problem requires an approach that can effectively manage the trade-offs between accuracy and aggregate diversity. In this work, we propose a two-sided post-processing approach in which both user and item utilities are considered. Our goal is to maximize aggregate diversity while minimizing loss in recommendation accuracy. Our solution is a generalization of the Deferred Acceptance algorithm which was proposed as an efficient algorithm to solve the well-known stable matching problem. We prove that our algorithm results in a unique user-optimal stable match between items and users. Using three recommendation datasets, we empirically demonstrate the effectiveness of our approach in comparison to several baselines. In particular, our results show that the proposed solution is quite effective in increasing aggregate diversity and item-side utility while optimizing recommendation accuracy for end users.


title: Quarantine Fatigue: first-ever decrease in social distancing measures after the COVID-19 outbreak before reopening United States

abstract: By the emergence of the novel coronavirus disease (COVID-19) in Wuhan, China, and its rapid outbreak worldwide, the infectious illness has changed our everyday travel patterns. In this research, our team investigated the changes in the daily mobility pattern of people during the pandemic by utilizing an integrated data panel. To incorporate various aspects of human mobility, the team focused on the Social Distancing Index (SDI) which was calculated based on five basic mobility measures. The SDI patterns showed a plateau stage in the beginning of April that lasted for about two weeks. This phenomenon then followed by a universal decline of SDI, increased number of trips and reduction in percentage of people staying at home. We called the observation Quarantine Fatigue. The Rate of Change (ROC) method was employed to trace back the start date of quarantine fatigue which was indicated to be April 15th. Our analysis showed that despite the existence of state-to-state variations, most states started experiencing a quarantine fatigue phenomenon during the same period. This observation became more important by knowing that none of the states had officially announced the reopening until late April showing that people decided to loosen up their social distancing practices before the official reopening announcement. Moreover, our analysis indicated that official reopening led to a rapid decline in SDI, raising the concern of a second wave of outbreak. The synchronized trend among states also emphasizes the importance of a more nationwide decision-making attitude for the future as the condition of each state depends on the nationwide behavior.


title: Chandra View of the LINER-type Nucleus in the Radio-Loud Galaxy CGCG 292-057: Ionized Iron Line and Jet-ISM Interactions

abstract: We present an analysis of the new, deep (94\,ksec) {\it Chandra} ACIS-S observation of radio-loud active galaxy CGCG\,292$-$057, characterized by a LINER-type nucleus and a complex radio structure that indicates intermittent jet activity. On the scale of the host galaxy bulge, we detected excess X-ray emission with a spectrum best fit by a thermal plasma model with a temperature of $\sim 0.8$\,keV. We argue that this excess emission results from compression and heating of the hot diffuse fraction of the interstellar medium displaced by the expanding inner, $\sim 20$\, kpc-scale lobes observed in this restarted radio galaxy. The nuclear X-ray spectrum of the target clearly displays an ionized iron line at $\sim 6.7$\,keV, and is best fitted with a phenomenological model consisting of a power-law (photon index $\simeq 1.8$) continuum absorbed by a relatively large amount of cold matter (hydrogen column density $\simeq 0.7 \times 10^{23}$\,cm$^{-2}$), and partly scattered (fraction $\sim 3\%$) by ionized gas, giving rise to a soft excess component and K$\alpha$ line from iron ions. We demonstrate that the observed X-ray spectrum, particularly the equivalent width of Fe\,\texttt{XXV} K$\alpha$ (of order $0.3$\,keV) can in principle, be explained in a scenario involving a Compton-thin gas located at the scale of the broad-lined region in this source and photoionized by nuclear illumination. We compare the general spectral properties of the CGCG\,292$-$057 nucleus, with those of other nearby LINERs studied in X-rays.


title: Past production constrains current energy demands: persistent scaling in global energy consumption and implications for climate change mitigation

abstract: Climate change has become intertwined with the global economy. Here, we describe the importance of inertia to continued growth in energy consumption. Drawing from thermodynamic arguments, and using 38 years of available statistics between 1980 to 2017, we find a persistent time-independent scaling between the historical time integral $W$ of world inflation-adjusted economic production $Y$, or $W\left(t\right) = \int_0^t Y\left(t'\right)dt'$, and current rates of world primary energy consumption $\mathcal E$, such that $\lambda = \mathcal{E}/W = 5.9\pm0.1$ Gigawatts per trillion 2010 US dollars. This empirical result implies that population expansion is a symptom rather than a cause of the current exponential rise in $\mathcal E$ and carbon dioxide emissions $C$, and that it is past innovation of economic production efficiency $Y/\mathcal{E}$ that has been the primary driver of growth, at predicted rates that agree well with data. Options for stabilizing $C$ are then limited to rapid decarbonization of $\mathcal E$ through sustained implementation of over one Gigawatt of renewable or nuclear power capacity per day. Alternatively, assuming continued reliance on fossil fuels, civilization could shift to a steady-state economy that devotes economic production exclusively to maintenance rather than expansion. If this were instituted immediately, continual energy consumption would still be required, so atmospheric carbon dioxide concentrations would not balance natural sinks until concentrations exceeded 500 ppmv, and double pre-industrial levels if the steady-state was attained by 2030.


title: Relation of the Relations: A New Paradigm of the Relation Extraction Problem

abstract: In natural language, often multiple entities appear in the same text. However, most previous works in Relation Extraction (RE) limit the scope to identifying the relation between two entities at a time. Such an approach induces a quadratic computation time, and also overlooks the interdependency between multiple relations, namely the relation of relations (RoR). Due to the significance of RoR in existing datasets, we propose a new paradigm of RE that considers as a whole the predictions of all relations in the same context. Accordingly, we develop a data-driven approach that does not require hand-crafted rules but learns by itself the RoR, using Graph Neural Networks and a relation matrix transformer. Experiments show that our model outperforms the state-of-the-art approaches by +1.12\% on the ACE05 dataset and +2.55\% on SemEval 2018 Task 7.2, which is a substantial improvement on the two competitive benchmarks.


title: Skedulix: Hybrid Cloud Scheduling for Cost-Efficient Execution of Serverless Applications

abstract: We present a framework for scheduling multifunction serverless applications over a hybrid public-private cloud. A set of serverless jobs is input as a batch, and the objective is to schedule function executions over the hybrid platform to minimize the cost of public cloud use, while completing all jobs by a specified deadline. As this scheduling problem is NP-Hard, we propose a greedy algorithm that dynamically determines both the order and placement of each function execution using predictive models of function execution time and network latencies. We present a prototype implementation of our framework that uses AWS Lambda and OpenFaaS, for the public and private cloud, respectively. We evaluate our prototype in live experiments using a mixture of compute and I/O heavy serverless applications. Our results show that our framework can achieve a speedup in batch processing of up to 1.92 times that of an approach that uses only the private cloud, at 40.5% the cost of an approach that uses only the public cloud.


title: Surveying the Local Supercluster Plane

abstract: We investigate the distribution and velocity field of galaxies situated in a band of 100 by 20 degrees centered on M87 and oriented along the Local supercluster plane. Our sample amounts 2158 galaxies with radial velocities less than 2000 km/s. Of them, 1119 galaxies (52%) have distance and peculiar velocity estimates. About 3/4 of early-type galaxies are concentrated within the Virgo cluster core, most of the late-type galaxies in the band locate outside the virial radius. Distribution of gas-rich dwarfs with $M_{\rm H\,I} > M_*$ looks to be insensitive to the Virgo cluster presence. Among 50 galaxy groups in the equatorial supercluster band 6 groups have peculiar velocities about 500-1000 km/s comparable with virial motions in rich clusters. The most cryptic case is a flock of nearly 30 galaxies around NGC4278 (Coma I cloud), moving to us with the mean peculiar velocity of $-$840 km/s. This cloud (or filament?) resides at a distance of 16.1 Mpc from us and approximately 5 Mpc away from the Virgo center. Galaxies around Virgo cluster exhibit Virgocentric infall with an amplitude of about 500 km/s. Assuming the spherically symmetric radial infall, we estimate the radius of the zero-velocity surface to be $R_0 = (7.0\pm0.3)$ Mpc that yields the total mass of Virgo cluster to be $(7.4\pm0.9)\times 10^{14} M_{\odot}$ in tight agreement with its virial mass estimates. We conclude that the Virgo outskirts does not contain significant amounts of dark mater beyond its virial core.


title: MMSE Bounds Under Kullback-Leibler Divergence Constraints on the Joint Input-Output Distribution

abstract: This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in a Kullback-Leibler divergence ball centered at some Gaussian reference distribution. Both bounds are tight and are attained by Gaussian distributions whose mean is identical to that of the reference distribution and whose covariance matrix is determined by a scalar parameter that can be obtained by finding the root of a monotonic function. The upper bound corresponds to a minimax optimal estimator and provides performance guarantees under distributional uncertainty. The lower bound provides an alternative to well-known inequalities in estimation theory, such as the Cram\'er-Rao bound, that is potentially tighter and defined for a larger class of distributions. Examples of applications in signal processing and information theory illustrate the usefulness of the proposed bounds in practice.


title: What Factors Drive Individual Misperceptions of the Returns to Schooling in Tanzania? Some Lessons for Education Policy

abstract: Evidence on educational returns and the factors that determine the demand for schooling in developing countries is extremely scarce. Building on previous studies that show individuals underestimating the returns to schooling, we use two surveys from Tanzania to estimate both the actual and perceived schooling returns and subsequently examine what factors drive individual misperceptions regarding actual returns. Using ordinary least squares and instrumental variable methods, we find that each additional year of schooling in Tanzania increases earnings, on average, by 9 to 11 percent. We find that on average individuals underestimate returns to schooling by 74 to 79 percent and three factors are associated with these misperceptions: income, asset poverty and educational attainment. Shedding light on what factors relate to individual beliefs about educational returns can inform policy on how to structure effective interventions in order to correct individual misperceptions.


title: Competing Antiferromagnetic-Ferromagnetic States in $\it{d^7}$ Kitaev Honeycomb Magnet

abstract: The Kitaev model is a rare example of an analytically solvable and physically instantiable Hamiltonian yielding a topological quantum spin liquid ground state. Here we report signatures of Kitaev spin liquid physics in the honeycomb magnet $Li_3Co_2SbO_6$, built of high-spin $\it{d^7}$ ($Co^{2+}$) ions, in contrast to the more typical low-spin $\it{d^5}$ electron configurations in the presence of large spin-orbit coupling. Neutron powder diffraction measurements, heat capacity, and magnetization studies support the development of a long-range antiferromagnetic order space group of $\it{C_C}2/\it{m}$, below $\it{T_N}$ = 11 K at $\it{\mu_0H}$ = 0 T. The magnetic entropy recovered between $\it{T}$ = 2 K and 50 K is estimated to be 0.6Rln2, in good agreement with the value expected for systems close to a Kitaev quantum spin liquid state. The temperature-dependent magnetic order parameter demonstrates a $\beta$ value of 0.19(3), consistent with XY anisotropy and in-plane ordering, with Ising-like interactions between layers. Further, we observe a spin-flop driven crossover to ferromagnetic order with space group of $\it{C}2/\it{m}$ under an applied magnetic field of $\it{\mu_0H}$ $\approx$ 0.7 T at $\it{T}$ = 2 K. Magnetic structure analysis demonstrates these magnetic states are competing at finite applied magnetic fields even below the spin-flop transition. Both the $\it{d^7}$ compass model, a quantitative comparison of the specific heat of $Li_3Co_2SbO_6$, and related honeycomb cobaltates to the anisotropic Kitaev model further support proximity to a Kitaev spin liquid state. This material demonstrates the rich playground of high-spin $\it{d^7}$ systems for spin liquid candidates, and complements known $\it{d^5}$ Ir- and Ru-based materials.


title: Applied Awareness: Test-Driven GUI Development using Computer Vision and Cryptography

abstract: Graphical user interface testing is significantly challenging, and automating it even more so. Test-driven development is impractical: it generally requires an initial implementation of the GUI to generate golden images or to construct interactive test scenarios, and subsequent maintenance is costly. While computer vision has been applied to several aspects of GUI testing, we demonstrate a novel and immediately applicable approach of interpreting GUI presentation in terms of backend communications, modeling "awareness" in the fashion employed by cryptographic proofs of security. This focus on backend communication circumvents deficiencies in typical testing methodologies that rely on platform-dependent UI affordances or accessibility features. Our interdisciplinary work is ready for off-the-shelf practice: we report self-contained, practical implementation with both online and offline validation, using simple designer specifications at the outset and specifically avoiding any requirements for a bootstrap implementation or golden images. In addition to practical implementation, ties to formal verification methods in cryptography are explored and explained, providing fertile perspectives on assurance in UI and interpretability in AI.


title: Assessing energy dependence of the transport of relativistic electrons in perturbed magnetic fields with orbit-following simulations

abstract: Experimental observations, as well as theoretical predictions, indicate that the transport of energetic electrons decreases with energy. This reduction in transport is attributed to finite orbit width (FOW) effects. Using orbit-following simulations in perturbed tokamak magnetic fields that have an ideal homogeneous stochastic layer at the edge, we quantify the energy dependence of energetic electrons transport and confirm previous theoretical estimates. However, using magnetic configurations characteristic of JET disruptions, we find no reduction in RE transport at higher energies, which we attribute to the mode widths being comparable to the minor radius, making the FOW effects negligible. Instead, the presence of islands and nonuniform magnetic perturbations are found to be more important. The diffusive-advective transport coefficients calculated in this work, based on simulations for electron energies 10 keV -- 100 MeV, can be used in reduced kinetic models to account for the transport due to the magnetic field perturbations.


title: Construction of Banach frames and atomic decompositions of anisotropic Besov spaces

abstract: We construct generalised shift-invariant systems of functions of several real variables for anisotropic Besov spaces that can be generated by the decomposition method using any given expansive matrix and establish the conditions on those systems under which they will constitute Banach frames or sets of atoms for the anisotropic homo- or inhomogeneous Besov spaces.


title: Electric field imaging using polarized neutrons

abstract: We experimentally demonstrate that electrically neutral particles, neutrons, can be used to directly visualize the electrostatic field inside a target volume that can be isolated or occupied. Electric-field images were obtained using a polychromatic, spin-polarized neutron beam with a sensitive polarimetry scheme. This work may enable new diagnostic power of the structure of electric potential, electric polarization, charge distribution, and dielectric constant by imaging spatially dependent electric fields in objects that cannot be accessed by other conventional probes.


title: Health Indicator Forecasting for Improving Remaining Useful Life Estimation

abstract: Prognostics is concerned with predicting the future health of the equipment and any potential failures. With the advances in the Internet of Things (IoT), data-driven approaches for prognostics that leverage the power of machine learning models are gaining popularity. One of the most important categories of data-driven approaches relies on a predefined or learned health indicator to characterize the equipment condition up to the present time and make inference on how it is likely to evolve in the future. In these approaches, health indicator forecasting that constructs the health indicator curve over the lifespan using partially observed measurements (i.e., health indicator values within an initial period) plays a key role. Existing health indicator forecasting algorithms, such as the functional Empirical Bayesian approach, the regression-based formulation, a naive scenario matching based on the nearest neighbor, have certain limitations. In this paper, we propose a new `generative + scenario matching' algorithm for health indicator forecasting. The key idea behind the proposed approach is to first non-parametrically fit the underlying health indicator curve with a continuous Gaussian Process using a sample of run-to-failure health indicator curves. The proposed approach then generates a rich set of random curves from the learned distribution, attempting to obtain all possible variations of the target health condition evolution process over the system's lifespan. The health indicator extrapolation for a piece of functioning equipment is inferred as the generated curve that has the highest matching level within the observed period. Our experimental results show the superiority of our algorithm over the other state-of-the-art methods.


title: Blended Learning Content Generation: A Guide for Busy Academics

abstract: A practical guide for university academics who need to create learning materials that support flexible delivery methods. Examples from the Computer Science domain are used to illustrate innovative approaches to engaging students with online and blended teaching resources.


title: Cross-sectional performance of hollow square prisms with rounded edges

abstract: Hollow-section columns are one of the mechanically superior structures with high buckling resistance and high bending stiffness. The mechanical properties of the column are strongly influenced by the cross-sectional shape. Therefore, when evaluating the stability of a column against external forces, it is necessary to accurately reproduce the cross-sectional shape. In this study, we propose a mathematical method to describe a polygonal section with rounded edges and vertices. This mathematical model would be quite useful for analyzing the mechanical properties of plants and designing plant-mimicking functional structures, since the cross-sections of the actual plant culms and stems often show rounded polygons.


title: WOAD: Weakly Supervised Online Action Detection in Untrimmed Videos

abstract: Online action detection in untrimmed videos aims to identify an action as it happens, which makes it very important for real-time applications. Previous methods rely on tedious annotations of temporal action boundaries for training, which hinders the scalability of online action detection systems. We propose WOAD, a weakly supervised framework that can be trained using only video-class labels. WOAD contains two jointly-trained modules, i.e., temporal proposal generator (TPG) and online action recognizer (OAR). Supervised by video-class labels, TPG works offline and targets at accurately mining pseudo frame-level labels for OAR. With the supervisory signals from TPG, OAR learns to conduct action detection in an online fashion. Experimental results on THUMOS'14, ActivityNet1.2 and ActivityNet1.3 show that our weakly-supervised method largely outperforms weakly-supervised baselines and achieves comparable performance to the previous strongly-supervised methods. Beyond that, WOAD is flexible to leverage strong supervision when it is available. When strongly supervised, our method obtains the state-of-the-art results in the tasks of both online per-frame action recognition and online detection of action start.


title: Unsupervised Abnormality Detection Using Heterogeneous Autonomous Systems

abstract: Anomaly detection (AD) in a surveillance scenario is an emerging and challenging field of research. For autonomous vehicles like drones or cars, it is immensely important to distinguish between normal and abnormal states in real-time. Additionally, we also need to detect any device malfunction. But the nature and degree of abnormality may vary depending upon the actual environment and adversary. As a result, it is impractical to model all cases a-priori and use supervised methods to classify. Also, an autonomous vehicle provides various data types like images and other analog or digital sensor data, all of which can be useful in anomaly detection if leveraged fruitfully. To that effect, in this paper, a heterogeneous system is proposed which estimates the degree of abnormality of an unmanned surveillance drone, analyzing real-time image and IMU (Inertial Measurement Unit) sensor data in an unsupervised manner. Here, we have demonstrated a Convolutional Neural Network (CNN) architecture, named AngleNet to estimate the angle between a normal image and another image under consideration, which provides us with a measure of anomaly of the device. Moreover, the IMU data are used in autoencoder to predict abnormality. Finally, the results from these two algorithms are ensembled to estimate the final degree of abnormality. The proposed method performs satisfactorily on the IEEE SP Cup-2020 dataset with an accuracy of 97.3%. Additionally, we have also tested this approach on an in-house dataset to validate its robustness.