title: Switching off: the phenotypic transition to the uninduced state of the lactose uptake pathway

abstract: The lactose uptake-pathway of E. coli is a paradigmatic example of multistability in gene-regulatory circuits. In the induced state of the lac-pathway, the genes comprising the lac-operon are transcribed, leading to the production of proteins which import and metabolize lactose. In the uninduced state, a stable repressor-DNA loop frequently blocks the transcription of the lac-genes. Transitions from one phenotypic state to the other are driven by fluctuations, which arise from the random timing of the binding of ligands and proteins. This stochasticity affects transcription and translation, and ultimately molecular copy numbers. Our aim is to understand the transition from the induced to the uninduced state of the lac-operon. We use a detailed computational model to show that repressor-operator binding/unbinding, fluctuations in the total number of repressors, and inducer-repressor binding/unbinding all play a role in this transition. Based on the timescales on which these processes operate, we construct a minimal model of the transition to the uninduced state and compare the results with simulations and experimental observations. The induced state turns out to be very stable, with a transition rate to the uninduced state lower than $2 \times 10^{-9}$ per minute. In contrast to the transition to the induced state, the transition to the uninduced state is well described in terms of a 2D diffusive system crossing a barrier, with the diffusion rates emerging from a model of repressor unbinding.


title: Surface morphing for aerodynamic flows at low and stalled angles of attack

abstract: In the current work we numerically study the effect of traveling-wave surface morphing actuation on the suction surface of NACA0012 at Re = 1,000. Although this actuation strategy has been studied at higher Reynolds numbers for an airfoil and a rectangular flat plate, its effects at low Reynolds numbers have not yet been investigated. The kinematics of actuation are defined by wavenumber and wavespeed, both of which are varied over a wide range of values to include parameters that considerably change the lift dynamics as well as those that do not. We first study the effect of actuation at an angle of attack of $\alpha$=5{\deg}, where the unactuated flow is steady. The lift dynamics are found to align with the surface morphing kinematics, and there is a low-pressure minimum shown to be introduced into the flow-field by morphing that advects at a speed agnostic to the morphing parameters. Lift benefits are found to be maximal when the morphing kinematics align with this intrinsic flow speed. We then investigate the role of morphing in the presence of an unsteady, separated baseline flow (with intrinsic vortex-shedding processes) at $\alpha$=15{\deg}. At this higher angle of attack, we identify three distinct behavioral regimes based on the relationship between morphing and the underlying shedding frequency. Of these regimes, the most beneficial to mean lift is the lock-on regime, where the vortex-shedding dynamics align with the morphing kinematics. We also identify other regimes where morphing can become out of phase with the vortex-shedding dynamics, termed here the interactive regime, and where morphing leaves the unactuated dynamics unaltered, termed here the superposition regime. At the higher angle of attack, parameters leading to lift benefits/detriments are explained in terms of the effect of morphing on the leading and trailing-edge vortex.


title: Quantum RNG Integration in an NG-PON2 Transceiver

abstract: We propose a minimally invasive optical overlay for time-interleaved QRNG operation in NG-PON2 transceivers. We experimentally demonstrate that random numbers can be generated at a 0.5 Gb/s rate and validate the randomness through statistical tests.


title: Entropy Regularized Reinforcement Learning Using Large Deviation Theory

abstract: Reinforcement learning (RL) is an important field of research in machine learning that is increasingly being applied to complex optimization problems in physics. In parallel, concepts from physics have contributed to important advances in RL with developments such as entropy-regularized RL. While these developments have led to advances in both fields, obtaining analytical solutions for optimization in entropy-regularized RL is currently an open problem. In this paper, we establish a mapping between entropy-regularized RL and research in non-equilibrium statistical mechanics focusing on Markovian processes conditioned on rare events. In the long-time limit, we apply approaches from large deviation theory to derive exact analytical results for the optimal policy and optimal dynamics in Markov Decision Process (MDP) models of reinforcement learning. The results obtained lead to a novel analytical and computational framework for entropy-regularized RL which is validated by simulations. The mapping established in this work connects current research in reinforcement learning and non-equilibrium statistical mechanics, thereby opening new avenues for the application of analytical and computational approaches from one field to cutting-edge problems in the other.


title: How to Design a Three-Stage Architecture for Audio-Visual Active Speaker Detection in the Wild

abstract: Successful active speaker detection requires a three-stage pipeline: (i) audio-visual encoding for all speakers in the clip, (ii) inter-speaker relation modeling between a reference speaker and the background speakers within each frame, and (iii) temporal modeling for the reference speaker. Each stage of this pipeline plays an important role for the final performance of the created architecture. Based on a series of controlled experiments, this work presents several practical guidelines for audio-visual active speaker detection. Correspondingly, we present a new architecture called ASDNet, which achieves a new state-of-the-art on the AVA-ActiveSpeaker dataset with a mAP of 93.5% outperforming the second best with a large margin of 4.7%. Our code and pretrained models are publicly available.


title: Relative Rank and Regularization

abstract: We introduce a new concept of rank - relative rank associated to a filtered collection of polynomials. When the filtration is trivial our relative rank coincides with Schmidt rank (also called strength). We also introduce the notion of relative bias. The main result of the paper is a relation between these two quantities over finite fields (as a special case we obtain a new proof of the results in arXiv:1902.09830). This relation allows us to get an accurate estimate for the number of points on an affine variety given by a collection of polynomials which is high relative rank (Lemma 3.2). The key advantage of relative rank is that it allows one to perform an efficient regularization procedure which is polynomial in the initial number of polynomials (the regularization process with Schmidt rank is far worse than tower exponential). The main result allows us to replace Schmidt rank with relative rank in many key applications in combinatorics, algebraic geometry and algebra. For example, we prove that any collection of polynomials $\mathcal{P}=(P_i)_{i=1}^c$ of degrees $\le d$ in a polynomial ring over an algebraically closed field of characteristic $>d$ is contained in an ideal $\mathcal{I}(\mathcal{Q})$, generated by a collection $\mathcal{Q}$ of polynomials of degrees $\le d$ which form a regular sequence, and $\mathcal{Q}$ is of size $\le A c^{A}$, where $A=A(d)$ is independent of the number of variables.


title: Offline Policy Comparison under Limited Historical Agent-Environment Interactions

abstract: We address the challenge of policy evaluation in real-world applications of reinforcement learning systems where the available historical data is limited due to ethical, practical, or security considerations. This constrained distribution of data samples often leads to biased policy evaluation estimates. To remedy this, we propose that instead of policy evaluation, one should perform policy comparison, i.e. to rank the policies of interest in terms of their value based on available historical data. In addition we present the Limited Data Estimator (LDE) as a simple method for evaluating and comparing policies from a small number of interactions with the environment. According to our theoretical analysis, the LDE is shown to be statistically reliable on policy comparison tasks under mild assumptions on the distribution of the historical data. Additionally, our numerical experiments compare the LDE to other policy evaluation methods on the task of policy ranking and demonstrate its advantage in various settings.


title: A Family of Bounded and Analytic Hyper-Operators

abstract: This is a summation of research done in the author's second and third year of undergraduate mathematics at The University of Toronto. As the previous details were largely scattered and disorganized; the author decided to rewrite the cumulative research. The goal of this paper is to construct a family of analytic functions $\alpha \uparrow^n z : (1,e^{1/e}) \times \mathbb{C}_{\Re(z) > 0} \to \mathbb{C}_{\Re(z) > 0}$ using methods from fractional calculus. This family satisfies the hyper-operator chain, $\alpha \uparrow^{n-1} \alpha \uparrow^n z = \alpha \uparrow^n (z+1)$; with the initial condition $\alpha \uparrow^0 z = \alpha \cdot z$.


title: Partial Optimal Transport for a Constant-Volume Lagrangian Mesh with Free Boundaries

abstract: This article introduces a representation of dynamic meshes, adapted to some numerical simulations that require controlling the volume of objects with free boundaries, such as incompressible fluid simulation, some astrophysical simulations at cosmological scale, and shape/topology optimization. The algorithm decomposes the simulated object into a set of convex cells called a Laguerre diagram, parameterized by the position of $N$ points in 3D and $N$ additional parameters that control the volumes of the cells. These parameters are found as the (unique) solution of a convex optimization problem -- semi-discrete Monge-Amp\`ere equation -- stemming from optimal transport theory. In this article, this setting is extended to objects with free boundaries and arbitrary topology, evolving in a domain of arbitrary shape, by solving a partial optimal transport problem. The resulting Lagrangian scheme makes it possible to accurately control the volume of the object, while precisely tracking interfaces, interactions, collisions, and topology changes.


title: Byakto Speech: Real-time long speech synthesis with convolutional neural network: Transfer learning from English to Bangla

abstract: Speech synthesis is one of the challenging tasks to automate by deep learning, also being a low-resource language there are very few attempts at Bangla speech synthesis. Most of the existing works can't work with anything other than simple Bangla characters script, very short sentences, etc. This work attempts to solve these problems by introducing Byakta, the first-ever open-source deep learning-based bilingual (Bangla and English) text to a speech synthesis system. A speech recognition model-based automated scoring metric was also proposed to evaluate the performance of a TTS model. We also introduce a test benchmark dataset for Bangla speech synthesis models for evaluating speech quality. The TTS is available at https://github.com/zabir-nabil/bangla-tts


title: $L^2$ estimate for polynomials of the Laplace operator with Gaussian measure

abstract: Let $P(\Delta)$ be a polynomial of the Laplace operator $\Delta=\sum_{j=1}^n\frac{\partial^2}{\partial x^2_j}$ on $\mathbb{R}^n$. We prove the existence of weak solutions of the equation $P(\Delta)u=f$ and the existence of a bounded right inverse of the differential operator $P(\Delta)$ in the weighted Hilbert space with Gaussian measure, i.e., $L^2(\mathbb{R}^n,e^{-|x|^2})$.


title: Dark Sound

abstract: We discuss the axion dark matter (DM) condensate and the consequences the interactions of dark matter would have on the spectrum of collective modes. We find that DM self-interactions change the spectrum of excitations from a quadratic to a linear-like dispersion with velocity $v_s$ which is set by the interactions, but dominated by gravity. For typical DM densities and interactions we find $v_s \sim 10^{-12}c$. This sound-like mode corresponds to DM density oscillations just like in any other Bose liquid, hence we call it {\em Dark Sound} (DS). The DS mode is well defined and describes stable density oscillations at intermediate length scales $k \geq k_{\text{min}} \sim 10^{4}\mathrm{lyr^{-1}}$. In the extreme long wavelength limit gravity dominates and leads to Jeans instability of the sound mode at the scale of clump formation $ k \leq k_{\text{min}}$. We also discuss the possible observable consequences of the DS, including quantized DS modes inside clumps, their characteristic energy, and noise features that might facilitate the observation of DM.


title: B2 0003+38A: a classical flat-spectrum radio quasar hosted by a rotation-dominated galaxy with a peculiar massive outflow

abstract: We present a detailed analysis of the single-slit optical spectrum of the Flat-Spectrum Radio Quasar (FSRQ) B2 0003+38A, taken by the Echellette Spectrograph and Imager (ESI) on the Keck II telescope. This classical low-redshift FSRQ ($z=0.22911$, as measured from the stellar absorption lines) remains underexplored in its emission lines, though its broad-band continuum properties from radio to X-ray is well-studied. After removing the unresolved quasar nucleus and the starlight from the host galaxy, we obtain a spatially-resolved 2-D spectrum, which clearly shows three components, indicating a rotating disk, an extended emission line region (EELR) and an outflow. The bulk of the EELR, with a characteristic mass $M_{\rm EELR}\sim 10^{7}~\rm M_{\odot}$, and redshifted by $v_{\rm EELR}\approx 120$ km s$^{-1}$ with respect to the quasar systemic velocity, shows a one-sided structure stretching to a projected distance of $r_{\rm EELR}\sim 20$ kpc from the nucleus. The rotation curve of the rotating disk is well consistent with that of a typical galactic disk, suggesting that the FSRQ is hosted by a disk galaxy. This conclusion is in accordance with the facts that strong absorption in the HI 21-cm line was previously observed, and that Na I$\lambda\lambda5891,5897$ and Ca II$\lambda\lambda3934,3969$ doublets are detected in the optical ESI spectrum. B2 0003+38A will become the first FSRQ discovered to be hosted by a gas-rich disk galaxy, if this is confirmed by follow-up deep imaging and/or IFU mapping with high spatial resolution. These observations will also help unravel the origin of the EELR.


title: Progressive Multi-scale Fusion Network for RGB-D Salient Object Detection

abstract: Salient object detection(SOD) aims at locating the most significant object within a given image. In recent years, great progress has been made in applying SOD on many vision tasks. The depth map could provide additional spatial prior and boundary cues to boost the performance. Combining the depth information with image data obtained from standard visual cameras has been widely used in recent SOD works, however, introducing depth information in a suboptimal fusion strategy may have negative influence in the performance of SOD. In this paper, we discuss about the advantages of the so-called progressive multi-scale fusion method and propose a mask-guided feature aggregation module(MGFA). The proposed framework can effectively combine the two features of different modalities and, furthermore, alleviate the impact of erroneous depth features, which are inevitably caused by the variation of depth quality. We further introduce a mask-guided refinement module(MGRM) to complement the high-level semantic features and reduce the irrelevant features from multi-scale fusion, leading to an overall refinement of detection. Experiments on five challenging benchmarks demonstrate that the proposed method outperforms 11 state-of-the-art methods under different evaluation metrics.


title: Inverted state sums, inverted Habiro series, and indefinite theta functions

abstract: S. Gukov and C. Manolescu conjectured that the Melvin-Morton-Rozansky expansion of the colored Jones polynomials can be re-summed into a two-variable series $F_K(x,q)$, which is the knot complement version of the 3-manifold invariant $\hat{Z}$ whose existence was predicted earlier by S. Gukov, P. Putrov and C. Vafa. In this paper we use an inverted version of the R-matrix state sum to prove this conjecture for a big class of links that includes all homogeneous braid links as well as all fibered knots up to 10 crossings. We also study an inverted version of Habiro's cyclotomic series that leads to a new perspective on $F_K$ and discovery of some regularized surgery formulas relating $F_K$ with $\hat{Z}$. These regularized surgery formulas are then used to deduce expressions of $\hat{Z}$ for some plumbed 3-manifolds in terms of indefinite theta functions.


title: Near-Optimal Dispersion on Arbitrary Anonymous Graphs

abstract: Given an undirected, anonymous, port-labeled graph of $n$ memory-less nodes, $m$ edges, and degree $\Delta$, we consider the problem of dispersing $k\leq n$ robots (or tokens) positioned initially arbitrarily on one or more nodes of the graph to exactly $k$ different nodes of the graph, one on each node. The objective is to simultaneously minimize time to achieve dispersion and memory requirement at each robot. If all $k$ robots are positioned initially on a single node, depth first search (DFS) traversal solves this problem in $O(\min\{m,k\Delta\})$ time with $\Theta(\log(k+\Delta))$ bits at each robot. However, if robots are positioned initially on multiple nodes, the best previously known algorithm solves this problem in $O(\min\{m,k\Delta\}\cdot \log \ell)$ time storing $\Theta(\log(k+\Delta))$ bits at each robot, where $\ell\leq k/2$ is the number of multiplicity nodes in the initial configuration. In this paper, we present a novel multi-source DFS traversal algorithm solving this problem in $O(\min\{m,k\Delta\})$ time with $\Theta(\log(k+\Delta))$ bits at each robot, improving the time bound of the best previously known algorithm by $O(\log \ell)$ and matching asymptotically the single-source DFS traversal bounds. This is the first algorithm for dispersion that is optimal in both time and memory in arbitrary anonymous graphs of constant degree, $\Delta=O(1)$. Furthermore, the result holds in both synchronous and asynchronous settings.


title: Manifestations of metastable criticality in the long-range structure of model water glasses

abstract: Much attention has been devoted to water's metastable phase behavior, including polyamorphism (multiple amorphous solid phases), and the hypothesized liquid-liquid transition and associated critical point. However, the possible relationship between these phenomena remains incompletely understood. Using molecular dynamics simulations of the realistic TIP4P/2005 model, we found a striking signature of the liquid-liquid critical point in the structure of water glasses, manifested as a pronounced increase in long-range density fluctuations at pressures proximate to the critical pressure. By contrast, these signatures were absent in glasses of two model systems that lack a critical point. We also characterized the departure from equilibrium upon vitrification via the non-equilibrium index; water-like systems exhibited a strong pressure dependence in this metric, whereas simple liquids did not. These results reflect a surprising relationship between the metastable equilibrium phenomenon of liquid-liquid criticality and the non-equilibrium structure of glassy water, with implications for our understanding of water phase behavior and glass physics. Our calculations suggest a possible experimental route to probing the existence of the liquid-liquid transition in water and other fluids.


title: Electric field noise in a high-temperature superconducting surface ion trap

abstract: Scaling up trapped-ion quantum computers requires new trap materials to be explored. Here, we present experiments with a surface ion trap made from the high-temperature superconductor YBCO, a promising material for future trap designs. We show that voltage noise from superconducting electrode leads is negligible within the sensitivity $S_V=9\times 10^{-20}\,\mathrm{V}^2\mathrm{Hz}^{-1}$ of our setup, and for lead dimensions typical for advanced trap designs. Furthermore, we investigate the frequency and temperature dependence of electric field noise above a YBCO surface. We find a $1/f$ spectral dependence of the noise and a non-trivial temperature dependence, with a plateau in the noise stretching over roughly $60\,\mathrm{K}$. The onset of the plateau coincides with the superconducting transition, indicating a connection between the dominant noise and the YBCO trap material. We exclude the YBCO bulk as origin of the noise and suggest further experiments to decide between the two remaining options explaining the observed temperature dependence: noise screening within the superconducting phase, or surface noise activated by the YBCO bulk through some unknown mechanism.


title: Long-term spectra of the blazars Mrk 421 and Mrk 501 at TeV energies seen by HAWC

abstract: The High Altitude Water Cherenkov (HAWC) Gamma-Ray Observatory surveys the very high energy sky in the 300 GeV to $>100$ TeV energy range. HAWC has detected two blazars above $11\sigma$, Markarian 421 (Mrk 421) and Markarian 501 (Mrk 501). The observations are comprised of data taken in the period between June 2015 and July 2018, resulting in a $\sim 1038$ days of exposure. In this work we report the time-averaged spectral analysis for both sources above 0.5 TeV. Taking into account the flux attenuation due to the extragalactic background light (EBL), the intrinsic spectrum of Mrk 421 is described by a power law with an exponential energy cut-off with index $\alpha=2.26\pm(0.12)_{stat}(_{-0.2}^{+0.17})_{sys}$ and energy cut-off $E_c=5.1\pm(1.6)_{stat}(_{-2.5}^{+1.4})_{sys}$ TeV, while the intrinsic spectrum of Mrk 501 is better described by a simple power law with index $\alpha=2.61\pm(0.11)_{stat}(_{-0.07}^{+0.01})_{sys}$. The maximum energies at which the Mrk 421 and Mrk 501 signals are detected are 9 and 12 TeV, respectively. This makes these some of the highest energy detections to date for spectra averaged over years-long timescales. Since the observation of gamma radiation from blazars provides information about the physical processes that take place in their relativistic jets, it is important to study the broad-band spectral energy distribution (SED) of these objects. To this purpose, contemporaneous data in the gamma-ray band to X-ray range, and literature data in the radio to UV range, were used to build time-averaged SEDs that were modeled within a synchrotron self-Compton leptonic scenario.


title: TENGraD: Time-Efficient Natural Gradient Descent with Exact Fisher-Block Inversion

abstract: This work proposes a time-efficient Natural Gradient Descent method, called TENGraD, with linear convergence guarantees. Computing the inverse of the neural network's Fisher information matrix is expensive in NGD because the Fisher matrix is large. Approximate NGD methods such as KFAC attempt to improve NGD's running time and practical application by reducing the Fisher matrix inversion cost with approximation. However, the approximations do not reduce the overall time significantly and lead to less accurate parameter updates and loss of curvature information. TENGraD improves the time efficiency of NGD by computing Fisher block inverses with a computationally efficient covariance factorization and reuse method. It computes the inverse of each block exactly using the Woodbury matrix identity to preserve curvature information while admitting (linear) fast convergence rates. Our experiments on image classification tasks for state-of-the-art deep neural architecture on CIFAR-10, CIFAR-100, and Fashion-MNIST show that TENGraD significantly outperforms state-of-the-art NGD methods and often stochastic gradient descent in wall-clock time.


title: Nonequilibrium Thermodynamics in Measuring Carbon Footprints: Disentangling Structure and Artifact in Input-Output Accounting

abstract: Multiregional input-output (MRIO) tables, in conjunction with Leontief analysis, are widely-used to assess the geographical distribution of carbon emissions and the economic activities that cause them. Majorization, a tool originating in economics that has found utility in statistical mechanics, can provide insight into how Leontief analysis links disparities in emissions with global income inequality. We examine Leontief analysis as a model, drawing out similarities with modern nonequilibrium statistical mechanics. Paralleling the physical concept of thermo-majorization, we define the concept of eco-majorization and show it is a sufficient condition to determine the directionality of embodied emission flows. Surprisingly, relatively small trade deficits and a geographically heterogeneous emissions-per-dollar ratio greatly increases the appearance of eco-majorization, regardless of any further content in the MRIO tables used. Our results are bolstered by a statistical analysis of null models of MRIO tables, based on data provided by the Global Trade Aggregation Project9

categories: physics.soc-ph cond-mat.stat-mech cs.IT math.IT quant-ph


title: Mechanical metamaterials: does toughness characterize fracture?

abstract: Rapid progress in additive manufacturing methods has created a new class of ultralight and strong architected metamaterials that resemble periodic truss structures. The mechanical performance of these metamaterials with a very large number of unit cells is ultimately limited by their tolerance to damage and defects, but an understanding of this sensitivity has remained elusive. Using a stretching-dominated micro-architecture and metamaterial specimens comprising millions of unit-cells we show that not only is the stress intensity factor, as used in conventional elastic fracture mechanics, insufficient to characterize fracture but also that conventional fracture testing protocols are inadequate. Via a combination of numerical calculations and asymptotic analyses, we extend the ideas of fracture mechanics and develop a general test and design protocol for the failure of metamaterials.


title: Polynomial Inflation and Dark Matter

abstract: We present a minimal UV complete framework to embed inflation and dark matter by extending the standard model with a singlet real scalar field (the inflaton) and a singlet fermonic field acting as dark matter. The inflaton features the most general renormalizable polynomial up to quartic order, which is flat due to the existence of a perturbed inflection-point, comfortably fitting CMB measurements. We also analyze (p)reheating by considering the Higgs production via inflaton decay. In the early universe, dark matter can be generated by the mediation of gravitons or inflatons. However, the production via the direct decay of the inflatons dominates, making viable a large range of dark matter masses, from $\mathcal{O}(10^{-5})$ GeV to $\mathcal{O}(10^{11})$ GeV.


title: Optical calibration of the SNO+ detector in the water phase with deployed sources

abstract: SNO+ is a large-scale liquid scintillator experiment with the primary goal of searching for neutrinoless double beta decay, and is located approximately 2 km underground in SNOLAB, Sudbury, Canada. The detector acquired data for two years as a pure water Cherenkov detector, starting in May 2017. During this period, the optical properties of the detector were measured in situ using a deployed light diffusing sphere, with the goal of improving the detector model and the energy response systematic uncertainties. The measured parameters included the water attenuation coefficients, effective attenuation coefficients for the acrylic vessel, and the angular response of the photomultiplier tubes and their surrounding light concentrators, all across different wavelengths. The calibrated detector model was validated using a deployed tagged gamma source, which showed a 0.6% variation in energy scale across the primary target volume.


title: Predicting Different Types of Subtle Toxicity in Unhealthy Online Conversations

abstract: This paper investigates the use of machine learning models for the classification of unhealthy online conversations containing one or more forms of subtler abuse, such as hostility, sarcasm, and generalization. We leveraged a public dataset of 44K online comments containing healthy and unhealthy comments labeled with seven forms of subtle toxicity. We were able to distinguish between these comments with a top micro F1-score, macro F1-score, and ROC-AUC of 88.76%, 67.98%, and 0.71, respectively. Hostile comments were easier to detect than other types of unhealthy comments. We also conducted a sentiment analysis which revealed that most types of unhealthy comments were associated with a slight negative sentiment, with hostile comments being the most negative ones.


title: Neural Abstractive Unsupervised Summarization of Online News Discussions

abstract: Summarization has usually relied on gold standard summaries to train extractive or abstractive models. Social media brings a hurdle to summarization techniques since it requires addressing a multi-document multi-author approach. We address this challenging task by introducing a novel method that generates abstractive summaries of online news discussions. Our method extends a BERT-based architecture, including an attention encoding that fed comments' likes during the training stage. To train our model, we define a task which consists of reconstructing high impact comments based on popularity (likes). Accordingly, our model learns to summarize online discussions based on their most relevant comments. Our novel approach provides a summary that represents the most relevant aspects of a news item that users comment on, incorporating the social context as a source of information to summarize texts in online social networks. Our model is evaluated using ROUGE scores between the generated summary and each comment on the thread. Our model, including the social attention encoding, significantly outperforms both extractive and abstractive summarization methods based on such evaluation.


title: Evaluating Meta-Feature Selection for the Algorithm Recommendation Problem

abstract: With the popularity of Machine Learning (ML) solutions, algorithms and data have been released faster than the capacity of processing them. In this context, the problem of Algorithm Recommendation (AR) is receiving a significant deal of attention recently. This problem has been addressed in the literature as a learning task, often as a Meta-Learning problem where the aim is to recommend the best alternative for a specific dataset. For such, datasets encoded by meta-features are explored by ML algorithms that try to learn the mapping between meta-representations and the best technique to be used. One of the challenges for the successful use of ML is to define which features are the most valuable for a specific dataset since several meta-features can be used, which increases the meta-feature dimension. This paper presents an empirical analysis of Feature Selection and Feature Extraction in the meta-level for the AR problem. The present study was focused on three criteria: predictive performance, dimensionality reduction, and pipeline runtime. As we verified, applying Dimensionality Reduction (DR) methods did not improve predictive performances in general. However, DR solutions reduced about 80% of the meta-features, obtaining pretty much the same performance as the original setup but with lower runtimes. The only exception was PCA, which presented about the same runtime as the original meta-features. Experimental results also showed that various datasets have many non-informative meta-features and that it is possible to obtain high predictive performance using around 20% of the original meta-features. Therefore, due to their natural trend for high dimensionality, DR methods should be used for Meta-Feature Selection and Meta-Feature Extraction.


title: Correcting Momentum in Temporal Difference Learning

abstract: A common optimization tool used in deep reinforcement learning is momentum, which consists in accumulating and discounting past gradients, reapplying them at each iteration. We argue that, unlike in supervised learning, momentum in Temporal Difference (TD) learning accumulates gradients that become doubly stale: not only does the gradient of the loss change due to parameter updates, the loss itself changes due to bootstrapping. We first show that this phenomenon exists, and then propose a first-order correction term to momentum. We show that this correction term improves sample efficiency in policy evaluation by correcting target value drift. An important insight of this work is that deep RL methods are not always best served by directly importing techniques from the supervised setting.


title: Novel View Video Prediction Using a Dual Representation

abstract: We address the problem of novel view video prediction; given a set of input video clips from a single/multiple views, our network is able to predict the video from a novel view. The proposed approach does not require any priors and is able to predict the video from wider angular distances, upto 45 degree, as compared to the recent studies predicting small variations in viewpoint. Moreover, our method relies only onRGB frames to learn a dual representation which is used to generate the video from a novel viewpoint. The dual representation encompasses a view-dependent and a global representation which incorporates complementary details to enable novel view video prediction. We demonstrate the effectiveness of our framework on two real world datasets: NTU-RGB+D and CMU Panoptic. A comparison with the State-of-the-art novel view video prediction methods shows an improvement of 26.1% in SSIM, 13.6% in PSNR, and 60% inFVD scores without using explicit priors from target views.


title: Simulating terahertz field-induced ferroelectricity in quantum paraelectric SrTiO$_3$

abstract: Recent experiments have demonstrated that light can induce a transition from the quantum paraelectric to the ferroelectric phase of SrTiO$_3$. Here, we investigate this terahertz field-induced ferroelectric phase transition by solving the time-dependent lattice Schr\"odinger equation based on first-principles calculations. We find that ferroelectricity originates from a light-induced mixing between ground and first excited lattice states in the quantum paraelectric phase. In agreement with the experimental findings, our study shows that the non-oscillatory second harmonic generation signal can be evidence of ferroelectricity in SrTiO$_3$. We reveal the microscopic details of this exotic phase transition and highlight that this phenomenon is a unique behavior of the quantum paraelectric phase.


title: Exploiting Language Relatedness for Low Web-Resource Language Model Adaptation: An Indic Languages Study

abstract: Recent research in multilingual language models (LM) has demonstrated their ability to effectively handle multiple languages in a single model. This holds promise for low web-resource languages (LRL) as multilingual models can enable transfer of supervision from high resource languages to LRLs. However, incorporating a new language in an LM still remains a challenge, particularly for languages with limited corpora and in unseen scripts. In this paper we argue that relatedness among languages in a language family may be exploited to overcome some of the corpora limitations of LRLs, and propose RelateLM. We focus on Indian languages, and exploit relatedness along two dimensions: (1) script (since many Indic scripts originated from the Brahmic script), and (2) sentence structure. RelateLM uses transliteration to convert the unseen script of limited LRL text into the script of a Related Prominent Language (RPL) (Hindi in our case). While exploiting similar sentence structures, RelateLM utilizes readily available bilingual dictionaries to pseudo translate RPL text into LRL corpora. Experiments on multiple real-world benchmark datasets provide validation to our hypothesis that using a related language as pivot, along with transliteration and pseudo translation based data augmentation, can be an effective way to adapt LMs for LRLs, rather than direct training or pivoting through English.


title: Generative Flows with Invertible Attentions

abstract: Flow-based generative models have shown an excellent ability to explicitly learn the probability density function of data via a sequence of invertible transformations. Yet, learning attentions in generative flows remains understudied, while it has made breakthroughs in other domains. To fill the gap, this paper introduces two types of invertible attention mechanisms, i.e., map-based and transformer-based attentions, for both unconditional and conditional generative flows. The key idea is to exploit a masked scheme of these two attentions to learn long-range data dependencies in the context of generative flows. The masked scheme allows for invertible attention modules with tractable Jacobian determinants, enabling its seamless integration at any positions of the flow-based models. The proposed attention mechanisms lead to more efficient generative flows, due to their capability of modeling the long-term data dependencies. Evaluation on multiple image synthesis tasks shows that the proposed attention flows result in efficient models and compare favorably against the state-of-the-art unconditional and conditional generative flows.


title: Analogue models for Schwarzschild and Reissner-Nordstr\"om spacetimes

abstract: We present analogue models for the Schwarzschild and Reissner-Nordstr\"om (RN) spacetimes based on unidirectional hydrodynamic flows. We show that, with appropriate coordinate transformations, sound waves in a moving fluid propagate as scalar fields at the equatorial sections of Schwarzschild and RN black holes. The coordinate associated with the direction of the flow plays the role of the radial coordinate in standard Schwarzschild/RN coordinates, while the transversal spatial coordinate is related to the angular coordinate on each equatorial slice. The magnitude of the flow velocity is related to the mass and charge of the analogue black hole. Physical quantities like pressure and density remain finite at the analogue horizon, thereby resulting in sound waves that are well defined almost everywhere, except possibly at the analogue black hole singularity.


title: Background estimation in the search for single production of vector-like quarks decaying into $Wb$ in $pp$ collisions using a data-driven method at $\sqrt{s} = 13$ TeV with the ATLAS detector

abstract: A search for singly produced vector-like $T/Y$ quark is performed in proton-proton collision data at a centre-of-mass energy of $13$ TeV corresponding to an integrated luminosity of $139.1 fb^{-1}$, recorded with the ATLAS detector at the LHC from 2015-18. The analysis focused on the hadronic channel of $T/Y \rightarrow Wb$ decay mode. The hadronic channel is not a clean channel, unlike the leptonic channel, because of the contribution coming from the QCD processes, which accounts for a significant background. The modelling of QCD processes is challenging due to their theoretical prediction and experimental challenges. Due to this, it is observed that the Monte Carlo simulation of the QCD multijet is mismodelled in this analysis. In this thesis, a data-driven method called the ABCD method is presented to estimate the QCD multijet background. The method uses the background events from all the control regions to estimate the multijets in the signal region. However, a correlation among different control regions is observed, which is further accounted by introducing a correlation factor. The correlation factor is calculated by performing likelihood fit to the MC simulated backgrounds. Some additional studies, including uncertainty estimation on the method and the performance of the method with different jet collections and taggers, are also performed.


title: Amortized Generation of Sequential Algorithmic Recourses for Black-box Models

abstract: Explainable machine learning (ML) has gained traction in recent years due to the increasing adoption of ML-based systems in many sectors. Algorithmic Recourses (ARs) provide "what if" feedback of the form "if an input datapoint were x' instead of x, then an ML-based system's output would be y' instead of y." ARs are attractive due to their actionable feedback, amenability to existing legal frameworks, and fidelity to the underlying ML model. Yet, current AR approaches are single shot -- that is, they assume x can change to x' in a single time period. We propose a novel stochastic-control-based approach that generates sequential ARs, that is, ARs that allow x to move stochastically and sequentially across intermediate states to a final state x'. Our approach is model agnostic and black box. Furthermore, the calculation of ARs is amortized such that once trained, it applies to multiple datapoints without the need for re-optimization. In addition to these primary characteristics, our approach admits optional desiderata such as adherence to the data manifold, respect for causal relations, and sparsity -- identified by past research as desirable properties of ARs. We evaluate our approach using three real-world datasets and show successful generation of sequential ARs that respect other recourse desiderata.


title: Electronic structure of superconducting nickelates probed by resonant photoemission spectroscopy

abstract: The discovery of infinite-layer nickelate superconductors has spurred enormous interest. While the Ni$^{1+}$ cations possess nominally the same 3$d^9$ configuration as Cu$^{2+}$ in cuprates, the electronic structure variances remain elusive. Here, we present a soft x-ray photoemission spectroscopy study on parent and doped infinite-layer Pr-nickelate thin films with a doped perovskite reference. By identifying the Ni character with resonant photoemission and comparison to density functional theory + U (on-site Coulomb repulsion energy) calculations, we estimate U ~5 eV, smaller than the charge transfer energy $\Delta$ ~8 eV, confirming the Mott-Hubbard electronic structure in contrast to charge-transfer cuprates. Near the Fermi level ($E_F$), we observe a signature of occupied rare-earth states in the parent compound, which is consistent with a self-doping picture. Our results demonstrate a correlation between the superconducting transition temperature and the oxygen 2$p$ hybridization near $E_F$ when comparing hole-doped nickelates and cuprates.


title: De Sitter Holography: Fluctuations, Anomalous Symmetry, and Wormholes

abstract: The Goheer-Kleban-Susskind no-go theorem says that the symmetry of de Sitter space is incompatible with finite entropy. The meaning and consequences of the theorem are discussed in the light of recent developments in holography and gravitational path integrals. The relation between the GKS theorem, Boltzmann fluctuations, wormholes, and exponentially suppressed non-perturbative phenomena suggests: the classical symmetry between different static patches is broken; and that eternal de Sitter space -- if it exists at all -- is an ensemble average.


title: A highly scalable repository of waveform and vital signs data from bedside monitoring devices

abstract: The advent of cost effective cloud computing over the past decade and ever-growing accumulation of high-fidelity clinical data in a modern hospital setting is leading to new opportunities for translational medicine. Machine learning is driving the appetite of the research community for various types of signal data such as patient vitals. Health care systems, however, are ill suited for massive processing of large volumes of data. In addition, due to the sheer magnitude of the data being collected, it is not feasible to retain all of the data in health care systems in perpetuity. This gold mine of information gets purged periodically thereby losing invaluable future research opportunities. We have developed a highly scalable solution that: a) siphons off patient vital data on a nightly basis from on-premises bio-medical systems to a cloud storage location as a permanent archive, b) reconstructs the database in the cloud, c) generates waveforms, alarms and numeric data in a research-ready format, and d) uploads the processed data to a storage location in the cloud ready for research. The data is de-identified and catalogued such that it can be joined with Electronic Medical Records (EMR) and other ancillary data types such as electroencephalogram (EEG), radiology, video monitoring etc. This technique eliminates the research burden from health care systems. This highly scalable solution is used to process high density patient monitoring data aggregated by the Philips Patient Information Center iX (PIC iX) hospital surveillance system for archival storage in the Philips Data Warehouse Connect enterprise-level database. The solution is part of a broader platform that supports a secure high performance clinical data science platform.


title: Future $T^2$ symmetry Einstein-Vlasov-Scalar field system

abstract: We prove local existence of solutions in the case of cosmological models for the Einstein-Vlasov-scalar field system with $T^2$ symmetry in expanding direction. This proof is based on short-time existence theorems for the partial differential equations resulting from the Einstein-Vlasov-Scalar Field system in areal coordinates. The sources of equations are generated by a distribution function and a scalar field, subject to Vlasov and a nonlinear wave equations respectively.


title: Examples of Ricci limit spaces with non-integer Hausdorff dimension

abstract: We give the first examples of collapsing Ricci limit spaces on which the Hausdorff dimension of the singular set exceeds that of the regular set; moreover, the Hausdorff dimension of these spaces can be non-integers. This answers a question of Cheeger-Colding about collapsing Ricci limit spaces.


title: Superstring loop amplitudes from the field theory limit

abstract: We propose a procedure to determine the moduli-space integrands of loop-level superstring amplitudes for massless external states in terms of the field theory limit. We focus on the type II superstring. The procedure is to: (i) take a supergravity loop integrand written in a BCJ double-copy representation, (ii) use the loop-level scattering equations to translate that integrand into the ambitwistor string moduli-space integrand, localised on the nodal Riemann sphere, and (iii) uplift that formula to one on the higher-genus surface valid for the superstring, guided by modular invariance. We show how this works for the four-point amplitude at two loops, where we reproduce the known answer, and at three loops, where we present a conjecture that is consistent with a previous proposal for the chiral measure. Useful supergravity results are currently known up to five loops.


title: Chow-Liu++: Optimal Prediction-Centric Learning of Tree Ising Models

abstract: We consider the problem of learning a tree-structured Ising model from data, such that subsequent predictions computed using the model are accurate. Concretely, we aim to learn a model such that posteriors $P(X_i|X_S)$ for small sets of variables $S$ are accurate. Since its introduction more than 50 years ago, the Chow-Liu algorithm, which efficiently computes the maximum likelihood tree, has been the benchmark algorithm for learning tree-structured graphical models. A bound on the sample complexity of the Chow-Liu algorithm with respect to the prediction-centric local total variation loss was shown in [BK19]. While those results demonstrated that it is possible to learn a useful model even when recovering the true underlying graph is impossible, their bound depends on the maximum strength of interactions and thus does not achieve the information-theoretic optimum. In this paper, we introduce a new algorithm that carefully combines elements of the Chow-Liu algorithm with tree metric reconstruction methods to efficiently and optimally learn tree Ising models under a prediction-centric loss. Our algorithm is robust to model misspecification and adversarial corruptions. In contrast, we show that the celebrated Chow-Liu algorithm can be arbitrarily suboptimal.

categories: cs.LG cs.DS cs.IT math.IT math.ST stat.TH


title: Batch Normalization Orthogonalizes Representations in Deep Random Networks

abstract: This paper underlines a subtle property of batch-normalization (BN): Successive batch normalizations with random linear transformations make hidden representations increasingly orthogonal across layers of a deep neural network. We establish a non-asymptotic characterization of the interplay between depth, width, and the orthogonality of deep representations. More precisely, under a mild assumption, we prove that the deviation of the representations from orthogonality rapidly decays with depth up to a term inversely proportional to the network width. This result has two main implications: 1) Theoretically, as the depth grows, the distribution of the representation -- after the linear layers -- contracts to a Wasserstein-2 ball around an isotropic Gaussian distribution. Furthermore, the radius of this Wasserstein ball shrinks with the width of the network. 2) In practice, the orthogonality of the representations directly influences the performance of stochastic gradient descent (SGD). When representations are initially aligned, we observe SGD wastes many iterations to orthogonalize representations before the classification. Nevertheless, we experimentally show that starting optimization from orthogonal representations is sufficient to accelerate SGD, with no need for BN.


title: Detection of Rossby modes with even azimuthal orders using helioseismic normal-mode coupling

abstract: Retrograde Rossby waves, measured to have significant amplitudes in the Sun, likely have notable implications for various solar phenomena. Rossby waves create small-amplitude, very-low frequency motions (on the order of the rotation rate and lower), which in turn shift the resonant frequencies and eigenfunctions of the acoustic modes of the Sun. The detection of even azimuthal orders Rossby modes using mode coupling presents additional challenges and prior work therefore only focused on odd orders. Here, we successfully extend the methodology to measure even azimuthal orders as well. We analyze 4 and 8 years of Helioseismic and Magnetic Imager (HMI) data and consider coupling between different-degree acoustic modes (of separations 1 and 3 in harmonic degree). The technique uses couplings between different frequency bins to capture the temporal variability of the Rossby modes. We observe significant power close to the theoretical dispersion relation for sectoral Rossby modes (where the azimuthal order is same as harmonic degree, s = |t|). Our results are consistent with prior measurements of Rossby modes with azimuthal orders over the range t = 4 to 16 with maximum power occurring at mode t = 8. The amplitudes of these modes vary from 1 to 2 m/s. We place an upper bound of 0.2 m/s on the sectoral t = 2 mode, which we do not detect in our measurements. This effort adds credence to the mode-coupling methodology in helioseismology


title: Urban hierarchy and spatial diffusion over the innovation life cycle

abstract: Successful innovations achieve large geographical coverage by spreading across settlements and distances. For decades, spatial diffusion has been argued to take place along the urban hierarchy such that the innovation first spreads from large to medium cities then later from medium to small cities. Yet, the role of geographical distance, the other major factor of spatial diffusion, was difficult to identify in hierarchical diffusion due to missing data on spreading events. In this paper, we exploit spatial patterns of individual invitations on a social media platform sent from registered users to new users over the entire life cycle of the platform. This enables us to disentangle the role of urban hierarchy and the role of distance by observing the source and target locations of flows over an unprecedented timescale. We demonstrate that hierarchical diffusion greatly overlaps with diffusion to close distances and these factors co-evolve over the life cycle; thus, their joint analysis is necessary. Then, a regression framework is applied to estimate the number of invitations sent between pairs of towns by years in the life cycle with the population sizes of the source and target towns, their combinations, and the distance between them. We confirm that hierarchical diffusion prevails initially across large towns only but emerges in the full spectrum of settlements in the middle of the life cycle when adoption accelerates. Unlike in previous gravity estimations, we find that after an intensifying role of distance in the middle of the life cycle a surprisingly weak distance effect characterizes the last years of diffusion. Our results stress the dominance of urban hierarchy in spatial diffusion and inform future predictions of innovation adoption at local scales.


title: Generating Hypothetical Events for Abductive Inference

abstract: Abductive reasoning starts from some observations and aims at finding the most plausible explanation for these observations. To perform abduction, humans often make use of temporal and causal inferences, and knowledge about how some hypothetical situation can result in different outcomes. This work offers the first study of how such knowledge impacts the Abductive NLI task -- which consists in choosing the more likely explanation for given observations. We train a specialized language model LMI that is tasked to generate what could happen next from a hypothetical scenario that evolves from a given event. We then propose a multi-task model MTL to solve the Abductive NLI task, which predicts a plausible explanation by a) considering different possible events emerging from candidate hypotheses -- events generated by LMI -- and b) selecting the one that is most similar to the observed outcome. We show that our MTL model improves over prior vanilla pre-trained LMs fine-tuned on Abductive NLI. Our manual evaluation and analysis suggest that learning about possible next events from different hypothetical scenarios supports abductive inference.


title: A Nonlinear Observability Analysis of Ambient Wind Estimation with Uncalibrated Sensors, Inspired by Insect Neural Encoding

abstract: Estimating the direction of ambient fluid flow is key for many flying or swimming animals and robots, but can only be accomplished through indirect measurements and active control. Recent work with tethered flying insects indicates that their sensory representation of orientation, apparent flow, direction of movement, and control is represented by a 2-dimensional angular encoding in the central brain. This representation simplifies sensory integration by projecting the direction (but not scale) of measurements with different units onto a universal polar coordinate frame. To align these angular measurements with one another and the motor system does, however, require a calibration of angular gain and offset for each sensor. This calibration could change with time due to changes in the environment or physical structure. The circumstances under which small robots and animals with angular sensors and changing calibrations could self-calibrate and estimate the direction of ambient fluid flow while moving remains an open question. Here, a methodical nonlinear observability analysis is presented to address this. The analysis shows that it is mathematically feasible to continuously estimate flow direction and perform regular self-calibrations by adopting frequent changes in course (or active prevention thereof) and orientation, and requires fusion and temporal differentiation of three sensory measurements: apparent flow, orientation (or its derivative), and direction of motion (or its derivative). These conclusions are consistent with the zigzagging trajectories exhibited by many plume tracking organisms, suggesting that perhaps flow estimation is a secondary driver of their trajectory structure.


title: Equilibria in Repeated Games with Countably Many Players and Tail-Measurable Payoffs

abstract: We prove that every repeated game with countably many players, finite action sets, and tail-measurable payoffs admits an $\epsilon$-equilibrium, for every $\epsilon > 0$.


title: On the matrix formulation of time-delay interferometry

abstract: Time-delay interferometry (TDI) is a processing step essential for the scientific exploitation of LISA, as it reduces the otherwise overwhelming laser noise in the interferometric measurements. The fundamental idea is to define new laser-noise-free observables by combining appropriately time-shifted measurements. First- and second-generation TDI combinations cancel laser noise under the assumption that the LISA armlengths are constant or evolve linearly with time, respectively. We recently extended TDI by solving for the laser-noise-free combinations implicitly, writing the likelihood of the data directly in terms of the basic measurements, and using a discretized representation of the delays that can accommodate any time dependence of the armlengths. We named the resulting formalism "TDI-infinity'' [PRD 103, 082001 (2021)]. According to Tinto, Dhurandhar, and Joshi [arXiv/2105.02054], our matrix-based approach is invalidated by the simplified start-up conditions assumed for the design matrix that connects the time series of laser-noise fluctuations to the time series of interferometric measurements along the LISA arms. Here we respond that, if those boundary conditions are indeed unrealistic, they do not invalidate the algorithm, since one can simply truncate the design matrix to exclude "incomplete'' measurements, or set them to zero. Our formalism then proceeds unmodified, except that the length of the laser-noise canceling time series is reduced by the number of excluded measurements. Tinto and colleagues further claim that the matrix formulation is merely a finite representation of the polynomial ring of delay operators introduced by Dhurandar, Nayak, and Vinet to formalize TDI. We show that this is only true if all interferometric delays are exact multiples of the sampling interval, which will not be possible in practical contexts such as LISA.


title: Free versus Bound Entanglement: Machine learning tackling a NP-hard problem

abstract: Entanglement detection in high dimensional systems is a NP-hard problem since it is lacking an efficient way. Given a bipartite quantum state of interest free entanglement can be detected efficiently by the PPT-criterion (Peres-Horodecki criterion), in contrast to detecting bound entanglement, i.e. a curious form of entanglement that can also not be distilled into maximally (free) entangled states. Only a few bound entangled states have been found, typically by constructing dedicated entanglement witnesses, so naturally the question arises how large is the volume of those states. We define a large family of magically symmetric states of bipartite qutrits for which we find $82\%$ to be free entangled, $2\%$ to be certainly separable and as much as $10\%$ to be bound entangled, which shows that this kind of entanglement is not rare. Via various machine learning algorithms we can confirm that the remaining $6\%$ of states are more likely to belonging to the set of separable states than bound entangled states. Most important we find via dimension reduction algorithms that there is a strong $2$-dimensional (linear) sub-structure in the set of bound entangled states. This revealed structure opens a novel path to find and characterize bound entanglement towards solving the long-standing problem of what the existence of bound entanglement is implying.


title: Doping-controlled surface conduction in topological insulators with warping effects

abstract: Based on a self-consistent $t$-matrix approximation, we explore the influence of magnetic and nonmagnetic doping on the surface electronic states and conductivity of topological insulators. We show that warping parameter has a crucial impact on the density of states and dc conductivity of the doped surfaces. As the warping strength is increased, the surface density of states at high energies is suppressed and the resonant states induced by impurities in the vicinity of the Dirac point gradually disappear. It is found that nonmagnetic impurities break electron-hole symmetry at low warping strength, while the symmetry remains unchanged when the surface is magnetically doped. Our findings reveal that surface conductivity can be controlled by tuning the doping, the direction of external magnetic field and that of impurity magnetic moments. Also, the surface conductivity features in topological insulators with warped energy dispersions are not significantly affected by the presence of impurities compared to that of materials with circular energy contour.


title: Scalar on time-by-distribution regression and its application for modelling associations between daily-living physical activity and cognitive functions in Alzheimer's Disease

abstract: Wearable data is a rich source of information that can provide deeper understanding of links between human behaviours and human health. Existing modelling approaches use wearable data summarized at subject level via scalar summaries using regression techniques, temporal (time-of-day) curves using functional data analysis (FDA), and distributions using distributional data analysis (DDA). We propose to capture temporally local distributional information in wearable data using subject-specific time-by-distribution (TD) data objects. Specifically, we propose scalar on time-by-distribution regression (SOTDR) to model associations between scalar response of interest such as health outcomes or disease status and TD predictors. We show that TD data objects can be parsimoniously represented via a collection of time-varying L-moments that capture distributional changes over the time-of-day. The proposed method is applied to the accelerometry study of mild Alzheimer's disease (AD). Mild AD is found to be significantly associated with reduced maximal level of physical activity, particularly during morning hours. It is also demonstrated that TD predictors attain much stronger associations with clinical cognitive scales of attention, verbal memory, and executive function when compared to predictors summarized via scalar total activity counts, temporal functional curves, and quantile functions. Taken together, the present results suggest that the SOTDR analysis provides novel insights into cognitive function and AD.


title: Local regularity conditions on initial data for local energy solutions of the Navier-Stokes equations

abstract: We study the regular sets of local energy solutions to the Navier-Stokes equations in terms of conditions on the initial data. It is shown that if a weighted $L^2$ norm of the initial data is finite, then all local energy solutions are regular in a region confined by space-time hypersurfaces determined by the weight. This result refines and generalizes Theorems C and D of Caffarelli, Kohn and Nirenberg (Comm. Pure Appl. Math. 35; 1982) and our recent paper [15] as well.


title: A method to determine wall shear stress from mean profiles in turbulent boundary layers

abstract: The direct measurement of wall shear stress in turbulent boundary layers (TBL) is challenging, therefore requiring it to be indirectly determined from mean profile measurements. Most popular methods assume the mean streamwise velocity to satisfy either a logarithmic law in the inner layer or a composite velocity profile with many tuned constants for the entire TBL, both of which require reliable data from the inner layer. The presence of roughness and pressure gradient brings additional complications where most existing methods either fail or require significant modification. A novel method is proposed to determine the wall shear stress in zero pressure gradient TBL from measured mean profiles, without requiring near-wall data. The method is based on the stress model of Kumar and Mahesh [Phys. Rev. Fluids 6, 024603 (2021)], who developed accurate models for mean stress and wall-normal velocity in zero pressure gradient TBL. The proposed method requires a single point measurement of mean streamwise velocity and mean shear stress in the outer layer, preferably between $20$ to $50 \%$ of the TBL, and an estimate of boundary layer thickness and shape factor. The method can handle wall roughness without modification and is shown to predict friction velocities to within $3 \%$ over a range of Reynolds number for both smooth and rough wall zero pressure gradient TBL. In order to include the pressure gradients effects, the work of Kumar and Mahesh [Phys. Rev. Fluids 6, 024603 (2021)] is revisited to derive a novel model for both mean stress and wall-normal velocity in pressure gradient TBL, which is then used to formulate a method to obtain the wall shear stress from the profile data. Overall, the proposed method is shown to be robust and accurate for a variety of pressure gradient TBL.


title: Expressivity of Emergent Language is a Trade-off between Contextual Complexity and Unpredictability

abstract: Researchers are using deep learning models to explore the emergence of language in various language games, where agents interact and develop an emergent language to solve tasks. We focus on the factors that determine the expressivity of emergent languages, which reflects the amount of information about input spaces those languages are capable of encoding. We measure the expressivity of emergent languages based on the generalisation performance across different games, and demonstrate that the expressivity of emergent languages is a trade-off between the complexity and unpredictability of the context those languages emerged from. Another contribution of this work is the discovery of message type collapse, i.e. the number of unique messages is lower than that of inputs. We also show that using the contrastive loss proposed by Chen et al. (2020) can alleviate this problem.


title: Investigating Transfer Learning in Multilingual Pre-trained Language Models through Chinese Natural Language Inference

abstract: Multilingual transformers (XLM, mT5) have been shown to have remarkable transfer skills in zero-shot settings. Most transfer studies, however, rely on automatically translated resources (XNLI, XQuAD), making it hard to discern the particular linguistic knowledge that is being transferred, and the role of expert annotated monolingual datasets when developing task-specific models. We investigate the cross-lingual transfer abilities of XLM-R for Chinese and English natural language inference (NLI), with a focus on the recent large-scale Chinese dataset OCNLI. To better understand linguistic transfer, we created 4 categories of challenge and adversarial tasks (totaling 17 new datasets) for Chinese that build on several well-known resources for English (e.g., HANS, NLI stress-tests). We find that cross-lingual models trained on English NLI do transfer well across our Chinese tasks (e.g., in 3/4 of our challenge categories, they perform as well/better than the best monolingual models, even on 3/5 uniquely Chinese linguistic phenomena such as idioms, pro drop). These results, however, come with important caveats: cross-lingual models often perform best when trained on a mixture of English and high-quality monolingual NLI data (OCNLI), and are often hindered by automatically translated resources (XNLI-zh). For many phenomena, all models continue to struggle, highlighting the need for our new diagnostics to help benchmark Chinese and cross-lingual models. All new datasets/code are released at https://github.com/huhailinguist/ChineseNLIProbing.


title: MAHGIC: A Model Adapter for the Halo-Galaxy Inter-Connection

abstract: We develop a model to establish the interconnection between galaxies and their dark matter halos. We use Principal Component Analysis (PCA) to reduce the dimensionality of both the mass assembly histories of halos/subhalos and the star formation histories of galaxies, and Gradient Boosted Decision Trees (GBDT) to transform halo/subhalo properties into galaxy properties. We use two sets of hydrodynamic simulations to motivate our model architecture and to train the transformation. We then apply the two sets of trained models to dark matter only (DMO) simulations to show that the transformation is reliable and statistically accurate. The model trained by a high-resolution hydrodynamic simulation, or by a set of such simulations implementing the same physics of galaxy formation, can thus be applied to large DMO simulations to make "mock" copies of the hydrodynamic simulation. The model is both flexible and interpretable, which paves the way for future applications in which we will constrain the model using observations at different redshifts simultaneously and explore how galaxies form and evolve in dark matter halos empirically.


title: Evaluating low-depth quantum algorithms for time evolution on fermion-boson systems

abstract: Simulating time evolution of quantum systems is one of the most promising applications of quantum computing and also appears as a subroutine in many applications such as Green's function methods. In the current era of NISQ machines we assess the state of algorithms for simulating time dynamics with limited resources. We propose the Jaynes-Cummings model and extensions to it as useful toy models to investigate time evolution algorithms on near-term quantum computers. Using these simple models, direct Trotterisation of the time evolution operator produces deep circuits, requiring coherence times out of reach on current NISQ hardware. Therefore we test two alternative responses to this problem: variational compilation of the time evolution operator, and variational quantum simulation of the wavefunction ansatz. We demonstrate numerically to what extent these methods are successful in time evolving this system. The costs in terms of circuit depth and number of measurements are compared quantitatively, along with other drawbacks and advantages of each method. We find that computational requirements for both methods make them suitable for performing time evolution simulations of our models on NISQ hardware. Our results also indicate that variational quantum compilation produces more accurate results than variational quantum simulation, at the cost of a larger number of measurements.


title: A paucity problem for certain triples of diagonal equations

abstract: We consider certain systems of three linked simultaneous diagonal equations in ten variables with total degree exceeding five. By means of a complification argument, we obtain an asymptotic formula for the number of integral solutions of this system of bounded height that resolves the associated paucity problem.


title: Weakly Supervised Volumetric Image Segmentation with Deformed Templates

abstract: There are many approaches to weakly-supervised training of networks to segment 2D images. By contrast, existing approaches to segmenting volumetric images rely on full-supervision of a subset of 2D slices of the 3D volume. We propose an approach to volume segmentation that is truly weakly-supervised in the sense that we only need to provide a sparse set of 3D points on the surface of target objects instead of detailed 2D masks. We use the 3D points to deform a 3D template so that it roughly matches the target object outlines and we introduce an architecture that exploits the supervision it provides to train a network to find accurate boundaries. We evaluate our approach on Computed Tomography (CT), Magnetic Resonance Imagery (MRI) and Electron Microscopy (EM) image datasets and show that it substantially reduces the required amount of effort.


title: Towards Learning Geometric Transformations through Play: An AR-powered approach

abstract: Despite the excessive developments of architectural parametric platforms, parametric design is often interpreted as an architectural style rather than a computational method. Also, the problem is still a lack of knowledge and skill about the technical application of parametric design in architectural modelling. Students often dive into utilizing complex digital modelling without having a competent pedagogical context to learn algorithmic thinking and the corresponding logic behind digital and parametric modelling. The insufficient skills and superficial knowledge often result in utilizing the modelling software through trial and error, not taking full advantage of what it has to offer. Geometric transformations as the fundamental functions of parametric modelling is explored in this study to anchor learning essential components in parametric modelling. Students need to understand the differences between variables, parameters, functions and their relations. Fologram, an Augmented Reality tool, is utilized in this study to learn geometric transformation and its components in an intuitive way. A LEGO set is used as an editable physical model to improve spatial skill through hand movement beside an instant feedback in the physical environment.


title: A fast multi-dimensional magnetohydrodynamic formulation of the transition region adaptive conduction (TRAC) method

abstract: We have demonstrated that the Transition Region Adaptive Conduction (TRAC) method permits fast and accurate numerical solutions of the field-aligned hydrodynamic equations, successfully removing the influence of numerical resolution on the coronal density response to impulsive heating. This is achieved by adjusting the parallel thermal conductivity, radiative loss, and heating rates to broaden the transition region (TR), below a global cutoff temperature, so that the steep gradients are spatially resolved even when using coarse numerical grids. Implementing the original 1D formulation of TRAC in multi-dimensional magnetohydrodynamic (MHD) models would require tracing a large number of magnetic field lines at every time step in order to prescribe a global cutoff temperature to each field line. In this paper, we present a highly efficient formulation of the TRAC method for use in multi-dimensional MHD simulations, which does not rely on field line tracing. In the TR, adaptive local cutoff temperatures are used instead of global cutoff temperatures to broaden any unresolved parts of the atmosphere. These local cutoff temperatures are calculated using only local grid cell quantities, enabling the MHD extension of TRAC to efficiently account for the magnetic field evolution, without tracing field lines. Consistent with analytical predictions, we show that this approach successfully preserves the properties of the original TRAC method. In particular, the total radiative losses and heating remain conserved under the MHD formulation. Results from 2D MHD simulations of impulsive heating in unsheared and sheared arcades of coronal loops are also presented. These simulations benchmark the MHD TRAC method against a series of 1D models and demonstrate the versatility and robustness of the method in multi-dimensional magnetic fields. We show, for the first time, that pressure differences, ...


title: Granger causality in the frequency domain: derivation and applications

abstract: Physicists are starting to work in areas where noisy signal analysis is required. In these fields, such as Economics, Neuroscience, and Physics, the notion of causality should be interpreted as a statistical measure. We introduce to the lay reader the Granger causality between two time series and illustrate ways of calculating it: a signal $X$ ``Granger-causes'' a signal $Y$ if the observation of the past of $X$ increases the predictability of the future of $Y$ when compared to the same prediction done with the past of $Y$ alone. In other words, for Granger causality between two quantities it suffices that information extracted from the past of one of them improves the forecast of the future of the other, even in the absence of any physical mechanism of interaction. We present derivations of the Granger causality measure in the time and frequency domains and give numerical examples using a non-parametric estimation method in the frequency domain. Parametric methods are addressed in the Appendix. We discuss the limitations and applications of this method and other alternatives to measure causality.

categories: physics.data-an physics.bio-ph q-bio.QM stat.ME


title: Quantum Computers Can Find Quadratic Nonresidues in Deterministic Polynomial Time

abstract: An integer $a$ is a quadratic nonresidue for a prime $p$ if $x^2 \equiv a \bmod p$ has no solution. Quadratic nonresidues may be found by probabilistic methods in polynomial time. However, without assuming the Generalized Riemann Hypothesis, no deterministic polynomial-time algorithm is known. We present a quantum algorithm which generates a random quadratic nonresidue in deterministic polynomial time.


title: Embodied engagement with scientific concepts: An exploration into emergent learning

abstract: In response to an invitation to integrate science and art pedagogy, science and dance students, enrolled in specific discipline courses, collaboratively produced choreography based on scientific principles. This paper reports students experience of this process. Science students reported an increased understanding of concepts, while dance students found inspiration for choreography within scientific concepts. Tensions and misconceptions were evident in the process with respect to disciplinary language, the notion of scientific thought, and the level of physical awareness. The relationship between movement and forms of knowledge production in science is investigated as well. The paper ends with recommendations for future classes.


title: Lexicon Learning for Few-Shot Neural Sequence Modeling

abstract: Sequence-to-sequence transduction is the core problem in language processing applications as diverse as semantic parsing, machine translation, and instruction following. The neural network models that provide the dominant solution to these problems are brittle, especially in low-resource settings: they fail to generalize correctly or systematically from small datasets. Past work has shown that many failures of systematic generalization arise from neural models' inability to disentangle lexical phenomena from syntactic ones. To address this, we augment neural decoders with a lexical translation mechanism that generalizes existing copy mechanisms to incorporate learned, decontextualized, token-level translation rules. We describe how to initialize this mechanism using a variety of lexicon learning algorithms, and show that it improves systematic generalization on a diverse set of sequence modeling tasks drawn from cognitive science, formal semantics, and machine translation.


title: Nonlinear Hall effect as a local probe of plasmonic magnetic hot spots

abstract: Recently developed plasmonic nanostructures are able to generate intense and localized magnetic hot spots in a large spectral range from the terahertz to the visible. However, a direct measurement of the magnetic field at the hot spot has not been performed yet, due to the absence of magnetic field detectors that work at those high frequencies and that fit the hot-spot area. We propose to place a graphene ribbon in the hot spot of a plasmonic nanostructure driven by a laser beam, such that a current is generated due to both the magnetic field at the hot spot and the electric field of the laser. We demonstrate that a nonlinear Hall voltage, which can be measured by standard electrical means, builds up across the ribbon, making it possible to directly probe the magnetic field at the hot spot.


title: Building a model of the brain: from detailed connectivity maps to network organization

abstract: The field of computational modeling of the brain is advancing so rapidly that now it is possible to model large scale networks representing different brain regions with a high level of biological detail in terms of numbers and synapses. For a theoretician approaching a neurobiological question, it is important to analyze the pros and cons of each of the models available. Here, we provide a tutorial review on recent models for different brain circuits, which are based on experimentally obtained connectivity maps. We discuss particularities that may be relevant to the modeler when choosing one of the reviewed models. The objective of this review is to give the reader a fair notion of the computational models covered, with emphasis on the corresponding connectivity maps, and how to use them.

categories: physics.bio-ph cond-mat.dis-nn nlin.AO q-bio.NC


title: Lessons learned developing and using a machine learning model to automatically transcribe 2.3 million handwritten occupation codes

abstract: Machine learning approaches achieve high accuracy for text recognition and are therefore increasingly used for the transcription of handwritten historical sources. However, using machine learning in production requires a streamlined end-to-end pipeline that scales to the dataset size and a model that achieves high accuracy with few manual transcriptions. The correctness of the model results must also be verified. This paper describes our lessons learned developing, tuning and using the Occode end-to-end machine learning pipeline for transcribing 2.3 million handwritten occupation codes from the Norwegian 1950 population census. We achieve an accuracy of 97% for the automatically transcribed codes, and we send 3% of the codes for manual verification. We verify that the occupation code distribution found in our results matches the distribution found in our training data, which should be representative for the census as a whole. We believe our approach and lessons learned may be useful for other transcription projects that plan to use machine learning in production. The source code is available at: https://github.com/uit-hdl/rhd-codes


title: What the foundations of quantum computer science teach us about chemistry

abstract: With the rapid development of quantum technology, one of the leading applications is the simulation of chemistry. Interestingly, even before full scale quantum computers are available, quantum computer science has exhibited a remarkable string of results that directly impact what is possible in chemical simulation with any computer. Some of these results even impact our understanding of chemistry in the real world. In this perspective, we take the position that direct chemical simulation is best understood as a digital experiment. While on one hand this clarifies the power of quantum computers to extend our reach, it also shows us the limitations of taking such an approach too directly. Leveraging results that quantum computers cannot outpace the physical world, we build to the controversial stance that some chemical problems are best viewed as problems for which no algorithm can deliver their solution in general, known in computer science as undecidable problems. This has implications for the predictive power of thermodynamic models and topics like the ergodic hypothesis. However, we argue that this perspective is not defeatist, but rather helps shed light on the success of existing chemical models like transition state theory, molecular orbital theory, and thermodynamics as models that benefit from data. We contextualize recent results showing that data-augmented models are more powerful rote simulation. These results help us appreciate the success of traditional chemical theory and anticipate new models learned from experimental data. Not only can quantum computers provide data for such models, but they can extend the class and power of models that utilize data in fundamental ways. These discussions culminate in speculation on new ways for quantum computing and chemistry to interact and our perspective on the eventual roles of quantum computers in the future of chemistry.


title: Asynchronous Distributed Optimization with Redundancy in Cost Functions

abstract: This paper considers the problem of asynchronous distributed multi-agent optimization on server-based system architecture. In this problem, each agent has a local cost, and the goal for the agents is to collectively find a minimum of their aggregate cost. A standard algorithm to solve this problem is the iterative distributed gradient-descent (DGD) method being implemented collaboratively by the server and the agents. In the synchronous setting, the algorithm proceeds from one iteration to the next only after all the agents complete their expected communication with the server. However, such synchrony can be expensive and even infeasible in real-world applications. We show that waiting for all the agents is unnecessary in many applications of distributed optimization, including distributed machine learning, due to redundancy in the cost functions (or {\em data}). Specifically, we consider a generic notion of redundancy named $(r,\epsilon)$-redundancy implying solvability of the original multi-agent optimization problem with $\epsilon$ accuracy, despite the removal of up to $r$ (out of total $n$) agents from the system. We present an asynchronous DGD algorithm where in each iteration the server only waits for (any) $n-r$ agents, instead of all the $n$ agents. Assuming $(r,\epsilon)$-redundancy, we show that our asynchronous algorithm converges to an approximate solution with error that is linear in $\epsilon$ and $r$. Moreover, we also present a generalization of our algorithm to tolerate some Byzantine faulty agents in the system. Finally, we demonstrate the improved communication efficiency of our algorithm through experiments on MNIST and Fashion-MNIST using the benchmark neural network LeNet.


title: How much water was delivered from the asteroid belt to the Earth after its formation?

abstract: The Earth contains between one and ten oceans of water, including water within the mantle, where one ocean is the mass of water on the Earth's surface today. With $n$-body simulations we consider how much water could have been delivered from the asteroid belt to the Earth after its formation. Asteroids are delivered from unstable regions near resonances with the giant planets. We compare the relative impact efficiencies from the $\nu_6$ resonance, the 2:1 mean motion resonance with Jupiter and the outer asteroid belt. The $\nu_6$ resonance provides the largest supply of asteroids to the Earth, with about $2\%$ of asteroids from that region colliding with the Earth. Asteroids located in mean motion resonances with Jupiter and in the outer asteroid belt have negligible Earth-collision probabilities. The maximum number of Earth collisions occurs if the asteroids in the primordial asteroid belt are first moved into the $\nu_6$ resonance location (through asteroid-asteroid interactions or otherwise) before their eccentricity is excited sufficiently for Earth collision. A maximum of about eight oceans of water may be delivered to the Earth. Thus, if the Earth contains ten or more oceans of water, the Earth likely formed with a significant fraction of this water.


title: Discrete analytic Schur functions

abstract: We introduce the Schur class of functions, discrete analytic on the integer lattice in the complex plane. As a special case, we derive the explicit form of discrete analytic Blaschke factors and solve the related basic interpolation problem.


title: Optimized Data Rate Allocation for Dynamic Sensor Fusion over Resource Constrained Communication Networks

abstract: This paper presents a new method to solve a dynamic sensor fusion problem. We consider a large number of remote sensors which measure a common Gauss-Markov process and encoders that transmit the measurements to a data fusion center through the resource restricted communication network. The proposed approach heuristically minimizes a weighted sum of communication costs subject to a constraint on the state estimation error at the fusion center. The communication costs are quantified as the expected bitrates from the sensors to the fusion center. We show that the problem as formulated is a difference-of-convex program and apply the convex-concave procedure (CCP) to obtain a heuristic solution. We consider a 1D heat transfer model and 2D target tracking by a drone swarm model for numerical studies. Through these simulations, we observe that our proposed approach has a tendency to assign zero data rate to unnecessary sensors indicating that our approach is sparsity promoting, and an effective sensor selection heuristic.


title: Universal Radial Approximation in Spaces of Analytic Functions

abstract: Recently, Charpentier showed that there exist holomorphic functions $f$ in the unit disk such that, for any proper compact subset $K$ of the unit circle, any continuous function $\phi$ on $K$ and any compact subset $L$ of the unit disk, there exists an increasing sequence $(r_n)_{n\in\mathbb{N}}\subseteq[0,1)$ converging to 1 such that $|f(r_n(\zeta-z)+z)-\phi(\zeta)|\to0$ as $n\to\infty$ uniformly for $\zeta\in K$ and $z\in L$. In this paper, we give analogues of this result for the Hardy spaces $H^p(\mathbb{D}),1\leq p<\infty$. In particular, our main result implies that, if we fix a compact subset $K$ of the unit circle with zero arc length measure, then there exist functions in $H^p(\mathbb{D})$ whose radial limits can approximate every continuous function on $K$. We give similar results for the Bergman and Dirichlet spaces.


title: Double Descent and Other Interpolation Phenomena in GANs

abstract: We study overparameterization in generative adversarial networks (GANs) that can interpolate the training data. We show that overparameterization can improve generalization performance and accelerate the training process. We study the generalization error as a function of latent space dimension and identify two main behaviors, depending on the learning setting. First, we show that overparameterized generative models that learn distributions by minimizing a metric or $f$-divergence do not exhibit double descent in generalization errors; specifically, all the interpolating solutions achieve the same generalization error. Second, we develop a novel pseudo-supervised learning approach for GANs where the training utilizes pairs of fabricated (noise) inputs in conjunction with real output samples. Our pseudo-supervised setting exhibits double descent (and in some cases, triple descent) of generalization errors. We combine pseudo-supervision with overparameterization (i.e., overly large latent space dimension) to accelerate training while matching or even surpassing generalization performance without pseudo-supervision. While our analysis focuses mostly on linear models, we also apply important insights for improving generalization of nonlinear, multilayer GANs.


title: Task-Generic Hierarchical Human Motion Prior using VAEs

abstract: A deep generative model that describes human motions can benefit a wide range of fundamental computer vision and graphics tasks, such as providing robustness to video-based human pose estimation, predicting complete body movements for motion capture systems during occlusions, and assisting key frame animation with plausible movements. In this paper, we present a method for learning complex human motions independent of specific tasks using a combined global and local latent space to facilitate coarse and fine-grained modeling. Specifically, we propose a hierarchical motion variational autoencoder (HM-VAE) that consists of a 2-level hierarchical latent space. While the global latent space captures the overall global body motion, the local latent space enables to capture the refined poses of the different body parts. We demonstrate the effectiveness of our hierarchical motion variational autoencoder in a variety of tasks including video-based human pose estimation, motion completion from partial observations, and motion synthesis from sparse key-frames. Even though, our model has not been trained for any of these tasks specifically, it provides superior performance than task-specific alternatives. Our general-purpose human motion prior model can fix corrupted human body animations and generate complete movements from incomplete observations.


title: Forecasting Avalanches in Branched Actomyosin Networks with Network Science and Machine Learning

abstract: We explored the dynamical and structural effects of actin-related proteins 2/3 (Arp2/3) on actomyosin networks using mechanochemical simulations of active matter networks. At a nanoscale, the Arp2/3 complex alters the topology of actomyosin by nucleating a daughter filament at an angle to a mother filament. At a subcellular scale, they orchestrate the formation of branched actomyosin network. Using a coarse-grained approach, we sought to understand how an actomyosin network temporally and spatially reorganizes itself by varying the concentration of the Arp2/3 complexes. Driven by the motor dynamics, the network stalls at a high concentration of Arp2/3 and contracts at a low Arp2/3 concentration. At an intermediate Arp2/3 concentration, however, the actomyosin network is formed by loosely connected clusters that may collapse suddenly when driven by motors. This physical phenomenon is called an "avalanche" largely due to the marginal instability inherent from the morphology of a branched actomyosin network when the Arp2/3 complex is present. While embracing the data science approaches, we unveiled the higher-order patterns in the branched actomyosin networks and discovered a sudden change in the "social" network topology of the actomyosin. This is a new type of avalanches in addition to the two types of avalanches associated with a sudden change in the size or the shape of the whole actomyosin network as shown in the previous investigation. Our new finding promotes the importance of using network theory and machine learning models to forecast avalanches in actomyosin networks. The mechanisms of the Arp2/3 complexes in shaping the architecture of branched actomyosin networks obtained in this paper will help us better understand the emergent reorganization of the topology in dense actomyosin networks that are difficult to detect in experiments.


title: On a Set-Valued Young Integral with Applications to Differential Inclusions

abstract: We present a new Aumann-like integral for a H\"older multifunction with respect to a H\"older signal, based on the Young integral of a particular set of H\"older selections. This restricted Aumann integral has continuity properties that allow for numerical approximation as well as an existence theorem for an abstract stochastic differential inclusion. This is applied to concrete examples of first order and second order stochastic differential inclusions directed by fractional Brownian motion.


title: On the Coupling of Depth and Egomotion Networks for Self-Supervised Structure from Motion

abstract: Structure from motion (SfM) has recently been formulated as a self-supervised learning problem, where neural network models of depth and egomotion are learned jointly through view synthesis. Herein, we address the open problem of how to best couple, or link, the depth and egomotion network components, so that information such as a common scale factor can be shared between the networks. Towards this end, we introduce several notions of coupling, categorize existing approaches, and present a novel tightly-coupled approach that leverages the interdependence of depth and egomotion at training time and at test time. Our approach uses iterative view synthesis to recursively update the egomotion network input, permitting contextual information to be passed between the components. We demonstrate through substantial experiments that our approach promotes consistency between the depth and egomotion predictions at test time, improves generalization, and leads to state-of-the-art accuracy on indoor and outdoor depth and egomotion evaluation benchmarks.


title: Widening Access to Applied Machine Learning with TinyML

abstract: Broadening access to both computational and educational resources is critical to diffusing machine-learning (ML) innovation. However, today, most ML resources and experts are siloed in a few countries and organizations. In this paper, we describe our pedagogical approach to increasing access to applied ML through a massive open online course (MOOC) on Tiny Machine Learning (TinyML). We suggest that TinyML, ML on resource-constrained embedded devices, is an attractive means to widen access because TinyML both leverages low-cost and globally accessible hardware, and encourages the development of complete, self-contained applications, from data collection to deployment. To this end, a collaboration between academia (Harvard University) and industry (Google) produced a four-part MOOC that provides application-oriented instruction on how to develop solutions using TinyML. The series is openly available on the edX MOOC platform, has no prerequisites beyond basic programming, and is designed for learners from a global variety of backgrounds. It introduces pupils to real-world applications, ML algorithms, data-set engineering, and the ethical considerations of these technologies via hands-on programming and deployment of TinyML applications in both the cloud and their own microcontrollers. To facilitate continued learning, community building, and collaboration beyond the courses, we launched a standalone website, a forum, a chat, and an optional course-project competition. We also released the course materials publicly, hoping they will inspire the next generation of ML practitioners and educators and further broaden access to cutting-edge ML technologies.