title: The Geometry of Discotopes

abstract: We study a class of semialgebraic convex bodies called discotopes. These are instances of zonoids, objects of interest in real algebraic geometry and random geometry. We focus on the face structure and on the boundary hypersurface of discotopes, highlighting interesting birational properties which may be investigated using tools from algebraic geometry. When a discotope is the Minkowski sum of two-dimensional discs, the Zariski closure of its set of extreme points is an irreducible hypersurface. In this case, we provide an upper bound for the degree of the hypersurface, drawing connections to the theory of classical determinantal varieties.


title: Supercurrent Diode Effect, Spin Torques, and Robust Zero-Energy Peak in Planar Half-Metallic Trilayers

abstract: We consider a Josephson junction with ${\rm F_1 F_2 F_3}$ ferromagnetic trilayers in the ballistic regime, where the magnetization in each ferromagnet ${\rm F}_i (i=1,2,3)$, can have arbitrary orientations and magnetization strengths. The trilayers are sandwiched between two $s$-wave superconductors with a macroscopic phase difference $\Delta \varphi$. A broad range of magnetization strengths of the central $\rm F_2$ layer are considered, from an unpolarized normal metal (N) to a half-metallic phase, supporting only one spin species. Our results reveal that when the magnetization configuration in ${\rm F_1 F_2 F_3}$ has three orthogonal components, a supercurrent can flow at $\Delta \varphi=0$, and a strong second harmonic in the current-phase relation appears. Upon increasing the magnetization strength in the central ferromagnet layer up to the half-metallic limit, the self-biased current and second harmonic component become dramatically enhanced, and the critical supercurrent reaches its maximum value. The higher harmonics in the current-phase relations can be controlled by the relative magnetization orientations, with negligible current damping compared to the corresponding ${\rm F_1 N F_3}$ counterparts. For a broad range of exchange field strengths in the central ferromagnet ${\rm F}_2$, the ground state of the system can be tuned to an arbitrary phase difference $\varphi_0$ by rotating the magnetization in the outer ferromagnet $\rm F_3$. For intermediate exchange field strengths in ${\rm F}_2$, a $\varphi_0$ state can arise that creates a superconducting diode effect, whereby $\Delta\varphi$ can be tuned to create a one-way dissipationless current flow. The density of states demonstrates the emergence of zero energy peaks for the mutually orthogonal magnetization configurations, which is strongest in the half-metallic phase.


title: Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey

abstract: Large, pre-trained transformer-based language models such as BERT have drastically changed the Natural Language Processing (NLP) field. We present a survey of recent work that uses these large language models to solve NLP tasks via pre-training then fine-tuning, prompting, or text generation approaches. We also present approaches that use pre-trained language models to generate data for training augmentation or other purposes. We conclude with discussions on limitations and suggested directions for future research.


title: Holographic entanglement entropy, deformed black branes, and deconfinement in AdS/QCD

abstract: A family of deformed black branes is employed to examine the confinement/deconfinement phase transition in AdS/QCD. The holographic entanglement entropy (HEE) plays the role of the order parameter driving the confinement/deconfinement phase transition. The binding energy of quark-antiquark bound states and the critical length that makes a null variation of the HEE, together with the critical temperature separating the deconfined quark-gluon plasma to the confined hadronic phase, are discussed in the deformed black brane background, matching current experimental hadronic data.


title: Learning Eye-in-Hand Camera Calibration from a Single Image

abstract: Eye-in-hand camera calibration is a fundamental and long-studied problem in robotics. We present a study on using learning-based methods for solving this problem online from a single RGB image, whilst training our models with entirely synthetic data. We study three main approaches: one direct regression model that directly predicts the extrinsic matrix from an image, one sparse correspondence model that regresses 2D keypoints and then uses PnP, and one dense correspondence model that uses regressed depth and segmentation maps to enable ICP pose estimation. In our experiments, we benchmark these methods against each other and against well-established classical methods, to find the surprising result that direct regression outperforms other approaches, and we perform noise-sensitivity analysis to gain further insights into these results.


title: Beyond Point Clouds: A Knowledge-Aided High Resolution Imaging Radar Deep Detector for Autonomous Driving

abstract: The potentials of automotive radar for autonomous driving have not been fully exploited. We present a multi-input multi-output (MIMO) radar transmit and receive signal processing chain, a knowledge-aided approach exploiting the radar domain knowledge and signal structure, to generate high resolution radar range-azimuth spectra for object detection and classification using deep neural networks. To achieve waveform orthogonality among a large number of transmit antennas cascaded by four automotive radar transceivers, we propose a staggered time division multiplexing (TDM) scheme and velocity unfolding algorithm using both Chinese remainder theorem and overlapped array. Field experiments with multi-modal sensors were conducted at The University of Alabama. High resolution radar spectra were obtained and labeled using the camera and LiDAR recordings. Initial experiments show promising performance of object detection using an image-oriented deep neural network with an average precision of 96.1% at an intersection of union (IoU) of typically 0.5 on 2,000 radar frames.


title: LaIr3Ga2: A Superconductor based on a Kagome Lattice of Ir

abstract: New materials based on Kagome lattices, predicted to host exotic quantum physics because they can display flat electronic bands, Dirac cones and topologically nontrivial surface states, are strongly desired. Here we report the crystal structure and superconducting properties of LaIr3Ga2, a previously unreported material that is based on a Kagome lattice of the heavy atom Ir. LaIr3Ga2 is a type II superconductor with Tc ~ 5.2 K, mu0Hc1 (0) ~ 7.1 mT and mu0Hc2 (0) ~ 4.7 T. The normalized heat capacity jump at the superconducting transition, (deltaC/gammaTc), 1.41, is within error of the value expected for a weak coupling BCS superconductor (1.43). Strong electron-electron correlation is inferred from the superconducting coherence length. Calculations show that the influence of spin orbit coupling on the electronic structure is significant, that the 5d states of the Ir in the Kagome planes are dominant near the Fermi energy (EF), that a nearly flat band is calculated to occur at about 100 meV below EF, and that two Dirac points are close to EF. This material is of interest for investigating the coupling between topological physics and superconductivity in a system with significant spin orbit coupling.


title: A General Revealed Preference Test for Quasilinear Preferences: Theory and Experiments

abstract: We provide a generalized revealed preference test for quasilinear preferences. The test applies to nonlinear budget sets and non-convex preferences as those found in taxation and nonlinear pricing contexts. We study the prevalence of quasilinear preferences in a laboratory real-effort task experiment with nonlinear wages. The experiment demonstrates the empirical relevance of our test. We find support for either convex (non-separable) preferences or quasilinear preferences but weak support for the hypothesis of both quasilinear and convex preferences.


title: Solution of Large-Scale Supply Chain Models using Graph Sampling & Coarsening

abstract: We present a graph sampling and coarsening scheme (gSC) for computing lower and upper bounds for large-scale supply chain models. An edge sampling scheme is used to build a low-complexity problem that is used to finding an approximate (but feasible) solution for the original model and to compute a lower bound (for a maximization problem). This scheme is similar in spirit to the so-called sample average approximation scheme, which is widely used for the solution of stochastic programs. A graph coarsening (aggregation) scheme is used to compute an upper bound and to estimate the optimality gap of the approximate solution. The coarsening scheme uses node sampling to select a small set of support nodes that are used to guide node/edge aggregation and we show that the coarsened model provides a relaxation of the original model and a valid upper bound. We provide numerical evidence that gSC can yield significant improvements in solution time and memory usage over state-of-the-art solvers. Specifically, we study a supply chain design model (a mixed-integer linear program) that contains over 38 million variables and show that gSC finds a solution with an optimality gap of <0.5% in less than 22 minutes.


title: Probability monads as codensity monads

abstract: We show from a categorical point of view that probability measures on certain measurable or topological spaces arise canonically as the extension of probability distributions on countable sets. We do this by constructing probability monads as the codensity monads of functors that send a countable set to the space of probability distributions on that set. On (pre)measurable spaces we discuss monads of probability (pre)measures and their finitely additive analogues. We also give codensity constructions for monads of Radon measures on compact Hausdorff spaces and compact metric spaces and for the monad of Baire measures on Hausdorff spaces. A crucial role in these constructions is given by integral representation theorems, which we derive from a generalized Daniell-Stone theorem.


title: Calcium fluctuations drive morphological patterning at the onset of Hydra morphogenesis

abstract: Morphogenesis in animal development involves significant morphological transitions leading to the emerging body plan of a mature animal. Understanding how the collective physical processes drive robust morphological patterning requires a coarse-grained description of the dynamics and the characterization of the underlying fields. Here I show that calcium spatial fluctuations serve as an integrator field of the electrical-mechanical processes of morphogenesis in whole-body Hydra regeneration and drive the morphological dynamics. We utilize external electric fields to control the developmental process and study a critical transition in morphogenesis, from the initial spheroidal shape of the tissue to an elongated cylindrical shape defining the body plan of a mature animal. Morphogenesis paused under external voltage is associated with a significant increase of the calcium activity compared with the activity supporting normal development. The enhanced calcium activity is characterized by intensified spatial fluctuations, extended spatial correlations across the tissue and faster temporal fluctuations. In contrast, the normal morphogenesis process is characterized by relatively moderate calcium fluctuation activity and restrained spatial correlations. Our methodology of controlling morphogenesis by a physical electric field allows us to gain a global statistical view of the dynamics. It shows that the normalized calcium spatial fluctuations exhibit a universal shape distribution, across tissue samples and conditions, suggesting the existence of a global constrain over these fluctuations. Studying the correlations in space and time of the calcium fluctuation field at the onset of morphogenesis opens a new vista on this process and paints a picture of development analogous to a dynamical phase transition.


title: Photon emission correlation spectroscopy as an analytical tool for quantum defects

abstract: Photon emission correlation spectroscopy is an indispensable tool for the study of atoms, molecules, and, more recently, solid-state quantum defects. In solid-state systems, its most common use is as an indicator of single-photon emission, a key property for quantum technology. Beyond an emitter's single-photon purity, however, photon correlation measurements can provide a wealth of information that can reveal details about its electronic structure and optical dynamics that are hidden by other spectroscopy techniques. This tutorial presents a standardized framework for using photon emission correlation spectroscopy to study quantum emitters, including discussion of theoretical background, considerations for data acquisition and statistical analysis, and interpretation. We highlight important nuances and best practices regarding the commonly-used $g^{(2)}(\tau=0)<0.5$ test for single-photon emission. Finally, we illustrate how this experimental technique can be paired with optical dynamics simulations to formulate an electronic model for unknown quantum emitters, enabling the design of quantum control protocols and assessment of their suitability for quantum information science applications.


title: Neural Scene Flow Prior

abstract: Before the deep learning revolution, many perception algorithms were based on runtime optimization in conjunction with a strong prior/regularization penalty. A prime example of this in computer vision is optical and scene flow. Supervised learning has largely displaced the need for explicit regularization. Instead, they rely on large amounts of labeled data to capture prior statistics, which are not always readily available for many problems. Although optimization is employed to learn the neural network, the weights of this network are frozen at runtime. As a result, these learning solutions are domain-specific and do not generalize well to other statistically different scenarios. This paper revisits the scene flow problem that relies predominantly on runtime optimization and strong regularization. A central innovation here is the inclusion of a neural scene flow prior, which uses the architecture of neural networks as a new type of implicit regularizer. Unlike learning-based scene flow methods, optimization occurs at runtime, and our approach needs no offline datasets -- making it ideal for deployment in new environments such as autonomous driving. We show that an architecture based exclusively on multilayer perceptrons (MLPs) can be used as a scene flow prior. Our method attains competitive -- if not better -- results on scene flow benchmarks. Also, our neural prior's implicit and continuous scene flow representation allows us to estimate dense long-term correspondences across a sequence of point clouds. The dense motion information is represented by scene flow fields where points can be propagated through time by integrating motion vectors. We demonstrate such a capability by accumulating a sequence of lidar point clouds.


title: Unique Games hardness of Quantum Max-Cut, and a conjectured vector-valued Borell's inequality

abstract: The Gaussian noise stability of a function $f:\mathbb{R}^n \to \{-1, 1\}$ is the expected value of $f(\boldsymbol{x}) \cdot f(\boldsymbol{y})$ over $\rho$-correlated Gaussian random variables $\boldsymbol{x}$ and $\boldsymbol{y}$. Borell's inequality states that for $-1 \leq \rho \leq 0$, this is minimized by the halfspace $f(x) = \mathrm{sign}(x_1)$. In this work, we generalize this result to hold for functions $f:\mathbb{R}^n \to S^{k-1}$ which output $k$-dimensional unit vectors. Our main conjecture, which we call the $\textit{vector-valued Borell's inequality}$, asserts that the expected value of $\langle f(\boldsymbol{x}), f(\boldsymbol{y})\rangle$ is minimized by the function $f(x) = x_{\leq k} / \Vert x_{\leq k} \Vert$, where $x_{\leq k} = (x_1, \ldots, x_k)$. We give several pieces of evidence in favor of this conjecture, including a proof that it does indeed hold in the special case of $n = k$. As an application of this conjecture, we show that it implies several hardness of approximation results for a special case of the local Hamiltonian problem related to the anti-ferromagnetic Heisenberg model known as Quantum Max-Cut. This can be viewed as a natural quantum analogue of the classical Max-Cut problem and has been proposed as a useful testbed for developing algorithms. We show the following, assuming our conjecture: (1) The integrality gap of the basic SDP is $0.498$, matching an existing rounding algorithm. Combined with existing results, this shows that the basic SDP does not achieve the optimal approximation ratio. (2) It is Unique Games-hard (UG-hard) to compute a $(0.956+\varepsilon)$-approximation to the value of the best product state, matching an existing approximation algorithm. (3) It is UG-hard to compute a $(0.956+\varepsilon)$-approximation to the value of the best (possibly entangled) state.


title: New lower bounds on kissing numbers and spherical codes in high dimensions

abstract: Let the kissing number $K(d)$ be the maximum number of non-overlapping unit balls in $\mathbb R^d$ that can touch a given unit ball. Determining or estimating the number $K(d)$ has a long history, with the value of $K(3)$ being the subject of a famous discussion between Gregory and Newton in 1694. We prove that, as the dimension $d$ goes to infinity, $$ K(d)\ge (1+o(1)){\frac{\sqrt{3\pi}}{4\sqrt2}}\,\log\frac{3}{2}\cdot d^{3/2}\cdot \Big(\frac{2}{\sqrt{3}}\Big)^{d}, $$ thus improving the previously best known bound of Jenssen, Joos and Perkins by a factor of $\log(3/2)/\log(9/8)+o(1)=3.442...$. Our proof is based on the novel approach from Jenssen, Joos and Perkins that uses the hard core sphere model of an appropriate fugacity. Similar constant-factor improvements in lower bounds are also obtained for general spherical codes, as well as for the expected density of random sphere packings in the Euclidean space $\mathbb R^d$.


title: Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systems

abstract: Recurrent neural networks (RNNs) are powerful models for processing time-series data, but it remains challenging to understand how they function. Improving this understanding is of substantial interest to both the machine learning and neuroscience communities. The framework of reverse engineering a trained RNN by linearizing around its fixed points has provided insight, but the approach has significant challenges. These include difficulty choosing which fixed point to expand around when studying RNN dynamics and error accumulation when reconstructing the nonlinear dynamics with the linearized dynamics. We present a new model that overcomes these limitations by co-training an RNN with a novel switching linear dynamical system (SLDS) formulation. A first-order Taylor series expansion of the co-trained RNN and an auxiliary function trained to pick out the RNN's fixed points govern the SLDS dynamics. The results are a trained SLDS variant that closely approximates the RNN, an auxiliary function that can produce a fixed point for each point in state-space, and a trained nonlinear RNN whose dynamics have been regularized such that its first-order terms perform the computation, if possible. This model removes the post-training fixed point optimization and allows us to unambiguously study the learned dynamics of the SLDS at any point in state-space. It also generalizes SLDS models to continuous manifolds of switching points while sharing parameters across switches. We validate the utility of the model on two synthetic tasks relevant to previous work reverse engineering RNNs. We then show that our model can be used as a drop-in in more complex architectures, such as LFADS, and apply this LFADS hybrid to analyze single-trial spiking activity from the motor system of a non-human primate.


title: Implicit Model Specialization through DAG-based Decentralized Federated Learning

abstract: Federated learning allows a group of distributed clients to train a common machine learning model on private data. The exchange of model updates is managed either by a central entity or in a decentralized way, e.g. by a blockchain. However, the strong generalization across all clients makes these approaches unsuited for non-independent and identically distributed (non-IID) data. We propose a unified approach to decentralization and personalization in federated learning that is based on a directed acyclic graph (DAG) of model updates. Instead of training a single global model, clients specialize on their local data while using the model updates from other clients dependent on the similarity of their respective data. This specialization implicitly emerges from the DAG-based communication and selection of model updates. Thus, we enable the evolution of specialized models, which focus on a subset of the data and therefore cover non-IID data better than federated learning in a centralized or blockchain-based setup. To the best of our knowledge, the proposed solution is the first to unite personalization and poisoning robustness in fully decentralized federated learning. Our evaluation shows that the specialization of models emerges directly from the DAG-based communication of model updates on three different datasets. Furthermore, we show stable model accuracy and less variance across clients when compared to federated averaging.


abstract: Smooth behaviors are preferable for many contact-rich manipulation tasks. Impedance control arises as an effective way to regulate robot movements by mimicking a mass-spring-damping system. Consequently, the robot behavior can be determined by the impedance gains. However, tuning the impedance gains for different tasks is tricky, especially for unstructured environments. Moreover, online adapting the optimal gains to meet the time-varying performance index is even more challenging. In this paper, we present Safe Online Gain Optimization for Variable Impedance Control (Safe OnGO-VIC). By reformulating the dynamics of impedance control as a control-affine system, in which the impedance gains are the inputs, we provide a novel perspective to understand variable impedance control. Additionally, we innovatively formulate an optimization problem with online collected force information to obtain the optimal impedance gains in real-time. Safety constraints are also embedded in the proposed framework to avoid unwanted collisions. We experimentally validated the proposed algorithm on three manipulation tasks. Comparison results with a constant gain baseline and an adaptive control method prove that the proposed algorithm is effective and generalizable to different scenarios.


title: Verifying Contracts for Perturbed Control Systems using Linear Programming

abstract: Verifying specifications for large-scale control systems is of utmost importance, but can be hard in practice as most formal verification methods can not handle high-dimensional dynamics. Contract theory has been proposed as a modular alternative to formal verification in which specifications are defined by assumptions on the inputs to a component and guarantees on its outputs. In this paper, we present linear-programming-based tools for verifying contracts for control systems. We first consider the problem of verifying contracts defined by time-invariant inequalities for unperturbed systems. We use $k$-induction to show that contract verification can be achieved by considering a collection of implications between inequalities, which are then recast as linear programs. We then move our attention to perturbed systems. We present a comparison-based framework, verifying that a perturbed system satisfies a contract by checking that the corresponding unperturbed system satisfies a robustified (and $\epsilon$-approximated) contract. In both cases, we present explicit algorithms for contract verification, proving their correctness and analyzing their complexity. We also demonstrate the verification process for two case studies, one considering a two-vehicle autonomous driving scenario, and one considering formation control of a multi-agent system.


title: SCORPIO, a package for the visualization of galaxy pairs

abstract: We present the description of the project \texttt{SCORPIO}, a Python package for retrieving images and associated data of galaxy pairs based on their position, facilitating visual analysis and data collation of multiple archetypal systems. The code ingests information from SDSS, 2MASS, and WISE surveys based on the available bands and is designed for studies of galaxy pairs as natural laboratories of multiple astrophysical phenomena such as tidal force deformation of galaxies, pressure gradient induced star formation regions, morphological transformation, to name a few.


title: Joint Detection of Motion Boundaries and Occlusions

abstract: We propose MONet, a convolutional neural network that jointly detects motion boundaries (MBs) and occlusion regions (Occs) in video both forward and backward in time. Detection is difficult because optical flow is discontinuous along MBs and undefined in Occs, while many flow estimators assume smoothness and a flow defined everywhere. To reason in the two time directions simultaneously, we direct-warp the estimated maps between the two frames. Since appearance mismatches between frames often signal vicinity to MBs or Occs, we construct a cost block that for each feature in one frame records the lowest discrepancy with matching features in a search range. This cost block is two-dimensional, and much less expensive than the four-dimensional cost volumes used in flow analysis. Cost-block features are computed by an encoder, and MB and Occ estimates are computed by a decoder. We found that arranging decoder layers fine-to-coarse, rather than coarse-to-fine, improves performance. MONet outperforms the prior state of the art for both tasks on the Sintel and FlyingChairsOcc benchmarks without any fine-tuning on them.


title: Minimax Optimization: The Case of Convex-Submodular

abstract: Minimax optimization has been central in addressing various applications in machine learning, game theory, and control theory. Prior literature has thus far mainly focused on studying such problems in the continuous domain, e.g., convex-concave minimax optimization is now understood to a significant extent. Nevertheless, minimax problems extend far beyond the continuous domain to mixed continuous-discrete domains or even fully discrete domains. In this paper, we study mixed continuous-discrete minimax problems where the minimization is over a continuous variable belonging to Euclidean space and the maximization is over subsets of a given ground set. We introduce the class of convex-submodular minimax problems, where the objective is convex with respect to the continuous variable and submodular with respect to the discrete variable. Even though such problems appear frequently in machine learning applications, little is known about how to address them from algorithmic and theoretical perspectives. For such problems, we first show that obtaining saddle points are hard up to any approximation, and thus introduce new notions of (near-) optimality. We then provide several algorithmic procedures for solving convex and monotone-submodular minimax problems and characterize their convergence rates, computational complexity, and quality of the final solution according to our notions of optimally. Our proposed algorithms are iterative and combine tools from both discrete and continuous optimization. Finally, we provide numerical experiments to showcase the effectiveness of our purposed methods.

categories: math.OC cs.DS cs.LG cs.SY eess.SY stat.ML


title: Optimized Passive Optical Networks with Cascaded-AWGRs for Data Centers

abstract: The use of Passive Optical Networks (PONs) in modern and future data centers can provide energy efficiency, high capacity, low cost, scalability, and elasticity. This paper introduces a passive optical network design with 2-tier cascaded Arrayed Waveguide Grating Routers (AWGRs) to connect groups of racks (i.e. cells) within a data center. This design employs a Software-Defined Networking (SDN) controller to manage the routing and assignment of the networking resource while introducing multiple paths between any two cells to improve routing, load balancing and resilience. We provide benchmarking results for the power consumption to compare the energy efficiency of this design to state-of-the-art data centers. The results indicate that the cascaded AWGRs architecture can achieve up to 43% saving in the networking power consumption compared to Fat-Tree data center architecture.


title: Human-Level Control without Server-Grade Hardware

abstract: Deep Q-Network (DQN) marked a major milestone for reinforcement learning, demonstrating for the first time that human-level control policies could be learned directly from raw visual inputs via reward maximization. Even years after its introduction, DQN remains highly relevant to the research community since many of its innovations have been adopted by successor methods. Nevertheless, despite significant hardware advances in the interim, DQN's original Atari 2600 experiments remain costly to replicate in full. This poses an immense barrier to researchers who cannot afford state-of-the-art hardware or lack access to large-scale cloud computing resources. To facilitate improved access to deep reinforcement learning research, we introduce a DQN implementation that leverages a novel concurrent and synchronized execution framework designed to maximally utilize a heterogeneous CPU-GPU desktop system. With just one NVIDIA GeForce GTX 1080 GPU, our implementation reduces the training time of a 200-million-frame Atari experiment from 25 hours to just 9 hours. The ideas introduced in our paper should be generalizable to a large number of off-policy deep reinforcement learning methods.


title: Strong Cospectrality and Twin Vertices in Weighted Graphs

abstract: We explore algebraic and spectral properties of weighted graphs containing twin vertices that are useful in quantum state transfer. We extend the notion of adjacency strong cospectrality to arbitrary Hermitian matrices, with focus on the generalized adjacency matrix and the generalized normalized adjacency matrix. We then determine necessary and sufficient conditions such that a pair of twin vertices in a weighted graph exhibits strong cospectrality with respect to the above-mentioned matrices. We also generalize known results about equitable and almost equitable partitions, and use these to determine which joins of the form $X\vee H$, where $X$ is either the complete or empty graph, exhibit strong cospectrality.


title: Metrics for Quantifying Shareability in Transportation Networks: The Maximum Network Flow Overlap Problem

abstract: Cities around the world vary in terms of their transportation networks and travel demand patterns; these variations affect the viability of shared mobility services. This study proposes metrics to quantify the shareability of person-trips in a city, as a function of two inputs--the road network structure and origin-destination (OD) travel demand. The study first conceptualizes a fundamental shareability unit, 'flow overlap'. Flow overlap denotes, for a person-trip traversing a given path, the weighted (by link distance) average number of other trips sharing the links along the original person's path. The study extends this concept to the network level and formulates the Maximum Network Flow Overlap Problem (MNFLOP) to assign all OD trips to paths that maximize network-wide flow overlap. The study utilizes the MNFLOP output to calculate metrics of shareability at various levels of aggregation: person-trip level, OD level, origin or destination level, network level, and link level. The study applies the MNFLOP and associated shareability metrics to different OD demand scenarios in the Sioux Falls network. The computational results verify that (i) MNFLOP assigns person-trips to paths such that flow overlaps significantly increase relative to shortest path assignment, (ii) MNFLOP and its associated shareability metrics can meaningfully differentiate between different OD trip matrices in terms of shareability, and (iii) an MNFLOP-based metric can quantify demand dispersion--a metric of the directionality of demand--in addition to the magnitude of demand, for trips originating or terminating from a single node in the network. The paper also includes an extensive discussion of potential future uses of the MNFLOP and its associated shareability metrics.


title: Revisiting Dark Matter Freeze-in and Freeze-out through Phase-Space Distribution

abstract: We revisit dark-matter production through freeze-in and freeze-out by solving the Boltzmann equations at the level of the phase-space distribution $f(p,t)$. Using the $2\to2$ annihilation and the $1\to2$ decay processes for illustration, we compare the resulting dark-matter relic abundance with that from the number-density approach. In the transition regime between freeze-in and freeze-out, we find the difference can be quite significant, or even by orders of magnitude if the annihilation of dark-matter particles or the decaying mediator is neglected. The freeze-in production in the $2\to2$ and the $1\to 2$ processes can also result in non-thermal phase-space distributions, or even multi-modal ones with out-of-equilibrium decay, which can potentially affect structure formation at late times. We also investigate how elastic scatterings can distort such non-thermal distributions.


title: Background evolution and growth of structures in interacting dark energy through dynamical system analysis

abstract: We apply the formalism of dynamical system analysis to investigate the evolution of interacting dark energy scenarios at the background and perturbation levels in a unified way. Since the resulting dynamical system contains the extra perturbation variable related to the matter overdensity, the critical points of the background analysis split, corresponding to different behavior of matter perturbations, and hence to stability properties. From the combined analysis, we find critical points that describe the non-accelerating matter-dominated epoch with the correct growth of matter structure, and the fact that they are saddle provides the natural exit from this phase. Furthermore, we find stable attractors at late times corresponding to a dark energy-dominated accelerated solution with constant matter perturbations, as required by observations. Thus, interacting cosmology can describe the matter and dark energy epochs correctly, both at the background and perturbation levels, which reveals the capabilities of the interaction.


title: Odd Radio Circles and their Environment

abstract: Odd Radio Circles (ORCs) are unexpected faint circles of diffuse radio emission discovered in recent wide deep radio surveys. They are typically about one arcmin in diameter, and may be spherical shells of synchrotron emission about a million light years in diameter, surrounding galaxies at a redshift of ~0.2-0.6. Here we study the properties and environment of the known ORCs. All three known single ORCs either lie in a significant overdensity or have a close companion. If the ORC is caused by an event in the host galaxy, then the fact that they tend to be in an overdensity, or have a close companion, may indicate that the environment is important in creating the ORC phenomenon, possibly because of an increased ambient density or magnetic field.


title: Deep learning of multi-resolution X-Ray micro-CT images for multi-scale modelling

abstract: Field-of-view and resolution trade-offs in X-Ray micro-computed tomography (micro-CT) imaging limit the characterization, analysis and model development of multi-scale porous systems. To this end, we developed an applied methodology utilising deep learning to enhance low resolution images over large sample sizes and create multi-scale models capable of accurately simulating experimental fluid dynamics from the pore (microns) to continuum (centimetres) scale. We develop a 3D Enhanced Deep Super Resolution (EDSR) convolutional neural network to create super resolution (SR) images from low resolution images, which alleviates common micro-CT hardware/reconstruction defects in high-resolution (HR) images. When paired with pore-network simulations and parallel computation, we can create large 3D continuum-scale models with spatially varying flow & material properties. We quantitatively validate the workflow at various scales using direct HR/SR image similarity, pore-scale material/flow simulations and continuum scale multiphase flow experiments (drainage immiscible flow pressures and 3D fluid volume fractions). The SR images and models are comparable to the HR ground truth, and generally accurate to within experimental uncertainty at the continuum scale across a range of flow rates. They are found to be significantly more accurate than their LR counterparts, especially in cases where a wide distribution of pore-sizes are encountered. The applied methodology opens up the possibility to image, model and analyse truly multi-scale heterogeneous systems that are otherwise intractable.


title: Brain dynamics via Cumulative Auto-Regressive Self-Attention

abstract: Multivariate dynamical processes can often be intuitively described by a weighted connectivity graph between components representing each individual time-series. Even a simple representation of this graph as a Pearson correlation matrix may be informative and predictive as demonstrated in the brain imaging literature. However, there is a consensus expectation that powerful graph neural networks (GNNs) should perform better in similar settings. In this work, we present a model that is considerably shallow than deep GNNs, yet outperforms them in predictive accuracy in a brain imaging application. Our model learns the autoregressive structure of individual time series and estimates directed connectivity graphs between the learned representations via a self-attention mechanism in an end-to-end fashion. The supervised training of the model as a classifier between patients and controls results in a model that generates directed connectivity graphs and highlights the components of the time-series that are predictive for each subject. We demonstrate our results on a functional neuroimaging dataset classifying schizophrenia patients and controls.


title: Sequence Transduction with Graph-based Supervision

abstract: The recurrent neural network transducer (RNN-T) objective plays a major role in building today's best automatic speech recognition (ASR) systems for production. Similarly to the connectionist temporal classification (CTC) objective, the RNN-T loss uses specific rules that define how a set of alignments is generated to form a lattice for the full-sum training. However, it is yet largely unknown if these rules are optimal and do lead to the best possible ASR results. In this work, we present a new transducer objective function that generalizes the RNN-T loss to accept a graph representation of the labels, thus providing a flexible and efficient framework to manipulate training lattices, e.g., for studying different transition rules, implementing different transducer losses, or restricting alignments. We demonstrate that transducer-based ASR with CTC-like lattice achieves better results compared to standard RNN-T, while also ensuring a strictly monotonic alignment, which will allow better optimization of the decoding procedure. For example, the proposed CTC-like transducer achieves an improvement of 4.8% on the test-other condition of LibriSpeech relative to an equivalent RNN-T based system.


title: Network Clustering for Latent State and Changepoint Detection

abstract: Network models provide a powerful and flexible framework for analyzing a wide range of structured data sources. In many situations of interest, however, multiple networks can be constructed to capture different aspects of an underlying phenomenon or to capture changing behavior over time. In such settings, it is often useful to cluster together related networks in attempt to identify patterns of common structure. In this paper, we propose a convex approach for the task of network clustering. Our approach uses a convex fusion penalty to induce a smoothly-varying tree-like cluster structure, eliminating the need to select the number of clusters a priori. We provide an efficient algorithm for convex network clustering and demonstrate its effectiveness on synthetic examples.


title: Non-local dispersal equations with almost periodic dependence. II. Asymptotic dynamics of Fisher-KPP equations

abstract: This series of two papers is devoted to the study of the principal spectral theory of nonlocal dispersal operators with almost periodic dependence and the study of the asymptotic dynamics of nonlinear nonlocal dispersal equations with almost periodic dependence. In the first part of the series, we investigated the principal spectral theory of nonlocal dispersal operators from two aspects: top Lyapunov exponents and generalized principal eigenvalues. Among others, we provided various characterizations of the top Lyapunov exponents and generalized principal eigenvalues, established the relations between them, and studied the effect of time and space variations on them. In this second part of the series, we study the asymptotic dynamics of nonlinear nonlocal dispersal equations with almost periodic dependence applying the principal spectral theory developed in the first part. In particular, we study the existence, uniqueness, and stability of almost periodic solutions of Fisher KPP equations with nonlocal dispersal and almost periodic dependence. By the properties of the asymptotic dynamics of nonlocal dispersal Fisher-KPP equations, we also establish a new property of the generalized principal eigenvalues of nonlocal dispersal operators in this second part of the series.


title: Recurrent neural network models for working memory of continuous variables: activity manifolds, connectivity patterns, and dynamic codes

abstract: Many daily activities and psychophysical experiments involve keeping multiple items in working memory. When items take continuous values (e.g., orientation, contrast, length, loudness) they must be stored in a continuous structure of appropriate dimensions. We investigate how this structure is represented in neural circuits by training recurrent networks to report two previously shown stimulus orientations. We find the activity manifold for the two orientations resembles a Clifford torus. Although a Clifford and standard torus (the surface of a donut) are topologically equivalent, they have important functional differences. A Clifford torus treats the two orientations equally and keeps them in orthogonal subspaces, as demanded by the task, whereas a standard torus does not. We find and characterize the connectivity patterns that support the Clifford torus. Moreover, in addition to attractors that store information via persistent activity, our networks also use a dynamic code where units change their tuning to prevent new sensory input from overwriting the previously stored one. We argue that such dynamic codes are generally required whenever multiple inputs enter a memory system via shared connections. Finally, we apply our framework to a human psychophysics experiment in which subjects reported two remembered orientations. By varying the training conditions of the RNNs, we test and support the hypothesis that human behavior is a product of both neural noise and reliance on the more stable and behaviorally relevant memory of the ordinal relationship between the two orientations. This suggests that suitable inductive biases in RNNs are important for uncovering how the human brain implements working memory. Together, these results offer an understanding of the neural computations underlying a class of visual decoding tasks, bridging the scales from human behavior to synaptic connectivity.


title: Multi network InfoMax: A pre-training method involving graph convolutional networks

abstract: Discovering distinct features and their relations from data can help us uncover valuable knowledge crucial for various tasks, e.g., classification. In neuroimaging, these features could help to understand, classify, and possibly prevent brain disorders. Model introspection of highly performant overparameterized deep learning (DL) models could help find these features and relations. However, to achieve high-performance level DL models require numerous labeled training samples ($n$) rarely available in many fields. This paper presents a pre-training method involving graph convolutional/neural networks (GCNs/GNNs), based on maximizing mutual information between two high-level embeddings of an input sample. Many of the recently proposed pre-training methods pre-train one of many possible networks of an architecture. Since almost every DL model is an ensemble of multiple networks, we take our high-level embeddings from two different networks of a model --a convolutional and a graph network--. The learned high-level graph latent representations help increase performance for downstream graph classification tasks and bypass the need for a high number of labeled data samples. We apply our method to a neuroimaging dataset for classifying subjects into healthy control (HC) and schizophrenia (SZ) groups. Our experiments show that the pre-trained model significantly outperforms the non-pre-trained model and requires $50\%$ less data for similar performance.


title: IR-Improved Amplitude-Based Resummation in Quantum Field Theory: New Results and New Issues

abstract: With the advancement of strategies for the precision physics programs for the HL-LHC, FCC-ee, FCC-hh, ILC, CLIC, CEPC, and CPPC, the need for proper control of the attendant theoretical precision tags is manifest. We discuss the role that amplitude-based resummation may play in this regard with examples from the LHC, the proposed new colliders and quantum gravity.


title: Baryon Asymmetry and Minimum Length

abstract: We study Quantum Gravity effects in cosmology, and in particular that of the Generalized Uncertainty Principle on the Friedmann equations. We show that the Quantum Gravity induced variations of the energy density and pressure in the radiation dominated era provide a viable explanation of the observed baryon asymmetry in the Universe.


title: Pattern-avoiding ascent sequences of length 3

abstract: Pattern-avoiding ascent sequences have recently been related to set-partition problems and stack-sorting problems. While the generating functions for several length-3 pattern-avoiding ascent sequences are known, those avoiding 000, 100, 110, 120 are not known. We have generated extensive series expansions for these four cases, and analysed them in order to conjecture the asymptotic behaviour. We provide polynomial time algorithms for the 000 and 110 cases, and exponential time algorithms for the 100 and 120 cases. We also describe how the 000 polynomial time algorithm was detected somewhat mechanically given an exponential time algorithm. For 120-avoiding ascent sequences we find that the generating function has stretched-exponential behaviour and prove that the growth constant is the same as that for 201-avoiding ascent sequences, which is known. The other three generating functions have zero radius of convergence, which we also prove. For 000-avoiding ascent sequences we give what we believe to be the exact growth constant. We give the conjectured asymptotic behaviour for all four cases.


title: Boundary value problems on non-Lipschitz uniform domains: Stability, compactness and the existence of optimal shapes

abstract: We study boundary value problems for bounded uniform domains in $\mathbb{R}^n$, $n\geq 2$, with non-Lipschitz (and possibly fractal) boundaries. We prove Poincar\'e inequalities with trace terms and uniform constants for uniform $(\varepsilon,\infty)$-domains within bounded common confinements. We then introduce generalized Dirichlet, Robin and Neumann problems for Poisson type equations and prove the Mosco convergence of the associated energy functionals along sequences of suitably converging domains. This implies a stability result for weak solutions, and this also implies the norm convergence of the associated resolvents and the convergence of the corresponding eigenvalues and eigenfunctions. Based on our earlier work, we prove compactness results for parametrized classes of admissible domains, energy functionals and weak solutions. Using these results, we can verify the existence of optimal shapes in these classes.


title: Non-extensive super-cluster states in aggregation with fragmentation

abstract: Systems evolving through aggregation and fragmentation may possess an intriguing super-cluster state (SCS). Clusters constituting this state are mostly large, so the SCS resembles a gelling state. The formation of the SCS is controlled by fluctuations and in this aspect, it is similar to a critical state. The SCS is non-extensive as the number of clusters varies sub-linearly with the system size. In the parameter space, the SCS separates equilibrium and jamming (extensive) states. The conventional methods such as the van Kampen expansion fail to describe the SCS. To characterize the SCS, we propose a scaling approach with a set of critical exponents. Our theoretical findings are in good agreement with numerical results.


title: An immunological autobiography: my year as a COVID-19 vaccine trial participant

abstract: I present here longitudinal evaluation of T and B cell immunity to SARS-CoV2 and variants of concern (VOC) from a single subject (me) over an entire year post vaccination. After enrolling in the Moderna phase III clinical trial, I collected my own biological samples pre- and post-immunization in the event of being a recipient of the experimental vaccine. The evidence strongly supports the conclusion that I did not receive the placebo. The analysis is admittedly limited to an n of 1, but the results fit well with data taken from published works and represent one of the more comprehensive longitudinal evaluations of vaccine-elicited immunity within a single individual yet to be undertaken. Though the data amount to a well-documented anecdote, given its granularity, it is not without its insights and may be of further use in directing future longitudinal studies that have actual statistical significance.


title: Petrov type I spacetime curvature: principal null vector spanning dimension

abstract: The class of Petrov type I curvature tensors is further divided into those for which the span of the set of distinct principal null directions has dimension four (maximally spanning type I) or dimension three (nonmaximally spanning type I). Explicit examples are provided for both vacuum and nonvacuum spacetimes.


title: Centralizers of torsion in 3-manifold groups

abstract: We show that if $P$ is a $PD_3$-complex and $g\in\pi_1(P)$ has finite order $>1$ and infinite centraliser then $\pi_1(P)$ retracts onto $Z/2Z\oplus\mathbb{Z}$. If $P$ is an irreducible closed 3-manifold then it follows from the Projective Plane Theorem that $P\cong{RP^2}\times{S^1}$.


title: Computing with R-INLA: Accuracy and reproducibility with implications for the analysis of COVID-19 data

abstract: The statistical methods used to analyze medical data are becoming increasingly complex. Novel statistical methods increasingly rely on simulation studies to assess their validity. Such assessments typically appear in statistical or computational journals, and the methodology is later introduced to the medical community through tutorials. This can be problematic if applied researchers use the methodologies in settings that have not been evaluated. In this paper, we explore a case study of one such method that has become popular in the analysis of coronavirus disease 2019 (COVID-19) data. The integrated nested Laplace approximations (INLA), as implemented in the R-INLA package, approximates the marginal posterior distributions of target parameters that would have been obtained from a fully Bayesian analysis. We seek to answer an important question: Does existing research on the accuracy of INLA's approximations support how researchers are currently using it to analyze COVID-19 data? We identify three limitations to work assessing INLA's accuracy: 1) inconsistent definitions of accuracy, 2) a lack of studies validating how researchers are actually using INLA, and 3) a lack of research into the reproducibility of INLA's output. We explore the practical impact of each limitation with simulation studies based on models and data used in COVID-19 research. Our results suggest existing methods of assessing the accuracy of the INLA technique may not support how COVID-19 researchers are using it. Guided in part by our results, we offer a proposed set of minimum guidelines for researchers using statistical methodologies primarily validated through simulation studies.


title: Gamma rays from reaccelerated cosmic rays in high velocity clouds colliding with the Galactic disk

abstract: High velocity clouds moving toward the disk will reach the Galactic plane and will inevitably collide with the disk. In these collisions a system of two shocks is produced, one propagating through the disk and the other develops within the cloud. The shocks produced within the clouds in these interactions have velocities of hundreds of kilometers per second. When these shocks are radiative they may be inefficient in accelerating fresh particles, however they can reaccelerate and compress Galactic cosmic rays from the background. In this work we investigate the interactions of Galactic cosmic rays within a shocked high velocity cloud, when the shock is induced by the collision with the disk. This study is focused in the case of radiative shocks. We aim to establish under which conditions these interactions lead to significant nonthermal emission, especially gamma rays. We model the interaction of cosmic ray protons and electrons reaccelerated and further energized by compression in shocks within the clouds, under very general assumptions. We also consider secondary electron-positron pairs produced by the cosmic ray protons when colliding with the material of the cloud. We conclude that nearby clouds reaccelerating Galactic cosmic rays in local shocks can produce high-energy radiation that might be detectable with existing and future gamma-ray detectors. The emission produced by electrons and secondary pairs is important at radio wavelengths, and in some cases it may be relevant at hard X-rays. Concerning higher energies, the leptonic contribution to the spectral energy distribution is significant at soft gamma rays.


title: A Semi-Supervised Approach for Automatic Crystal Structure Classification

abstract: The structural solution problem can be a daunting and time consuming task. Especially in the presence of impurity phases, current methods such as indexing become more unstable. In this work, we apply the novel approach of semi-supervised learning towards the problem of identifying the Bravais lattice and the space group of inorganic crystals. Our semi-supervised generative deep learning model can train on both labeled data -- diffraction patterns with the associated crystal structure -- and unlabeled data, diffraction patterns that lack this information. This approach allows our models to take advantage of the troves of unlabeled data that current supervised learning approaches cannot, which should result in models that can more accurately generalize to real data. In this work, we classify powder diffraction patterns into all 14 Bravais lattices and 144 space groups (we limit the number due to sparse coverage in crystal structure databases), which covers more crystal classes than other studies. Our models also drastically outperform current deep learning approaches for both space group and Bravais Lattice classification using less training data.


title: Effects of particle shape and size distribution on hydraulic properties of grain packs: An experimental study

abstract: Uniform and multi-dispersed grain packs have been frequently used to conceptually study flow in porous media. Numerical simulations were previously used to address the effect of particle shape on characteristics, such as pore space fractal dimension, moisture characteristic curve (MCC) and saturated hydraulic conductivity (SHC) of grain packs. However, experimental observations are still required since fractal-based approaches have been extensively proposed to model various properties in porous media. In this study, 16 angular sand and 16 spherical glass bead samples with different particle size distributions (PSDs) from well- to poorly-sorted were packed. The MCC was measured using the combination of sandbox and pressure plates methods. The pore space fractal dimension (DMCC), calculated from the measured MCC, ranged from 0.80 to 2.86 in sand and from -0.18 to 2.81 in glass bead packs, which indicated that DMCC may be negative in homogenous media (e.g., glass bead packs) consistent with several studies in the literature. Results showed greater DMCC for the sand packs than the glass bead packs with the same geometric mean diameter values and PSDs. This clearly demonstrated the effect of particle shape on DMCC in the studied packs. The critical path analysis (CPA) approach was used to estimate the SHC measured using the constant-head method. We found that the CPA estimated the SHC accurately, within a factor of four of the measurements on average. Although the CPA is theoretically known to be accurate in media with broad pore size distributions, we experimentally found that it estimated the SHC in various types of grain packs reasonably well.


title: Acceleration and clustering of cosmic dust in a gravoturbulent gas -- I. Numerical simulation of the nearly Jeans-unstable case

abstract: We investigate the dynamics of interstellar dust particles in moderately high resolution ($512^3$ grid points) simulations of forced compressible transonic turbulence including self-gravity of the gas. Turbulence is induced by stochastic compressive forcing which is delta-correlated in time. By considering the nearly Jeans-unstable case, where the scaling of the simulation is such that a statistical steady state without any irreversible collapses is obtained, we obtain a randomly varying potential, acting as a second stochastic forcing. We show that, in this setting, low-inertia grains follow the gas flow and cluster in much the same way as in a case of statistical steady-state turbulence without self-gravity. Large, high-inertia grains, however, are accelerated to much higher mean velocities in the presence of self-gravity. Grains of intermediate size also show an increased degree of clustering. We conclude that self-gravity effects can play an important role for aggregation/coagulation of dust even in a turbulent system which is not Jeans-unstable. In particular, the collision rate of large grains in the interstellar medium can be much higher than predicted by previous work.


title: A boosted DC algorithm for non-differentiable DC components with non-monotone line search

abstract: We introduce a new approach to apply the boosted difference of convex functions algorithm (BDCA) for solving non-convex and non-differentiable problems involving difference of two convex functions (DC functions). Supposing the first DC component differentiable and the second one possibly non-differentiable, the main idea of BDCA is to use the point computed by the DC algorithm (DCA) to define a descent direction and perform a monotone line search to improve the decreasing the objetive function accelerating the convergence of the DCA. However, if the first DC component is non-differentiable, then the direction computed by BDCA can be an ascent direction and a monotone line search cannot be performed. Our approach uses a non-monotone line search in the BDCA (nmBDCA) to enable a possible growth in the objective function values controlled by a parameter. Under suitable assumptions, we show that any cluster point of the sequence generated by the nmBDCA is a critical point of the problem under consideration and provide some iteration-complexity bounds. Furthermore, if the first DC component is differentiable, we present different iteration-complexity bounds and prove the full convergence of the sequence under the Kurdyka-\L{}ojasiewicz property of the objective function. Some numerical experiments show that the nmBDCA outperforms the DCA such as its monotone version.


title: Floquet Edge Multicolor Solitons

abstract: Topological insulators are unique physical structures that are insulators in their bulk, but support currents at their edges which can be unidirectional and topologically protected from scattering on disorder and inhomogeneities. Photonic topological insulators can be crafted in materials that exhibit a strong nonlinear response, thus opening the door to the exploration of the interplay between nonlinearity and topological effects. Among the fascinating new phenomena arising from this interplay is the formation of topological edge solitons -- hybrid asymmetric states localized across and along the interface due to different physical mechanisms. Such solitons have so far been studied only in materials with Kerr-type, or cubic, nonlinearity. Here the first example of the topological edge soliton supported by parametric interactions in $\chi^{(2)}$ nonlinear media is presented. Such solitons exist in Floquet topological insulators realized in arrays of helical waveguides made of a phase-matchable $\chi^{(2)}$ material. Floquet edge solitons bifurcate from topological edge states in the spectrum of the fundamental frequency wave and remain localized over propagation distances drastically exceeding the helix period, while travelling along the edge of the structure. A theory of such states is developed. It is shown that multicolor solitons in a Floquet system exists in the vicinity of (formally infinite) set of linear resonances determined by the Floquet phase matching conditions. Away from resonance, soliton envelopes can be described by a period-averaged single nonlinear Schr\"odinger equation with an effective cubic nonlinear coefficient whose magnitude and sign depend on the overall phase-mismatch between the fundamental frequency and second harmonic waves.


title: Free energy calculation of crystalline solids using normalizing flow

abstract: Taking advantage of the advances in generative deep learning, particularly normalizing flow, a framework, called Boltzmann Generator, has recently been proposed for the purpose of generating equilibrium atomic configurations from the canonical ensemble and determining the associated free energy. In this work, we revisit Boltzmann Generator to motivate the construction of the loss function from the statistical mechanical point of view, and to cast the training of the neural networks in a purely unsupervised manner that requires no samples of the atomic configurations from the equilibrium ensemble. We further show that the normalizing flow framework furnishes a reference thermodynamic system, very close to the real thermodynamic system under consideration, that is suitable for the well-established free energy perturbation methods to determine accurate free energy of solids. We then apply the normalizing flow to two problems: temperature-dependent Gibbs free energy of perfect crystal and formation free energy of monovacancy defect in a model system of diamond cubic Si. The results obtained from the normalizing flow are shown to be in good agreement with that obtained from independent well-established free energy methods.


title: Four-wave mixing Floquet topological soliton

abstract: We consider a topological Floquet insulator realized as a honeycomb array of helical waveguides imprinted in weakly birefringent medium. The system accounts for four-wave mixing occurring at a series of resonances arising due to Floquet phase matching. Under these resonant conditions, the system sustains stable linearly polarized and metastable elliptically polarized two-component edge solitons. Coupled nonlinear equations describing evolution of the envelopes of such solitons are derived.


title: Learning to Operate an Electric Vehicle Charging Station Considering Vehicle-grid Integration

abstract: The rapid adoption of electric vehicles (EVs) calls for the widespread installation of EV charging stations. To maximize the profitability of charging stations, intelligent controllers that provide both charging and electric grid services are in great need. However, it is challenging to determine the optimal charging schedule due to the uncertain arrival time and charging demands of EVs. In this paper, we propose a novel centralized allocation and decentralized execution (CADE) reinforcement learning (RL) framework to maximize the charging station's profit. In the centralized allocation process, EVs are allocated to either the waiting or charging spots. In the decentralized execution process, each charger makes its own charging/discharging decision while learning the action-value functions from a shared replay memory. This CADE framework significantly improves the scalability and sample efficiency of the RL algorithm. Numerical results show that the proposed CADE framework is both computationally efficient and scalable, and significantly outperforms the baseline model predictive control (MPC). We also provide an in-depth analysis of the learned action-value function to explain the inner working of the reinforcement learning agent.


title: The Warm Neptune GJ 3470b has a Polar Orbit

abstract: The warm Neptune GJ 3470b transits a nearby ($d=29$pc) bright slowly rotating M1.5-dwarf star. Using spectroscopic observations during two transits with the newly commissioned NEID spectrometer on the WIYN 3.5m Telescope at Kitt Peak Observatory, we model the classical Rossiter-Mclaughlin effect yielding a sky-projected obliquity of $\lambda=98_{-12}^{+15\:\circ}$ and a $v \sin i = 0.85_{-0.33}^{+0.27}$km/s. Leveraging information about the rotation period and size of the host star, our analysis yields a true obliquity of $\psi=95_{-8}^{+9\:\circ}$, revealing that GJ 3470b is on a polar orbit. Using radial velocities from HIRES, HARPS and the Habitable-zone Planet Finder, we show that the data are compatible with a long-term RV slope of $\dot{\gamma} = -0.0022 \pm 0.0011$m/s/day over a baseline of 12.9 years. If the RV slope is due to acceleration from another companion in the system, we show that such a companion is capable of explaining the polar and mildly eccentric orbit of GJ 3470b using two different secular excitation models. The existence of an outer companion can be further constrained with additional RV observations, Gaia astrometry, and future high-contrast imaging observations. Lastly, we show that tidal heating from GJ 3470b's mild eccentricity has most likely inflated the radius of GJ 3470b by a factor of $\sim$1.5-1.7, which could help account for its evaporating atmosphere.


title: Low Valence Nickelates: Launching the Nickel Age of Superconductivity

abstract: The discovery of superconductivity in thin films ($\sim$10 nm) of infinite-layer hole-doped NdNiO$_2$ has invigorated the field of high-temperature superconductivity research, reviving the debate over contrasting views that nickelates that are isostructural with cuprates are either (1) sisters of the high-temperature superconductors, or (2) that differences between nickel and copper at equal band filling should be the focus of attention. Each viewpoint has its merits, and each has its limitations, suggesting that such a simple picture must be superseded by a more holistic comparison of the two classes. Several recent studies have begun this generalization, raising a number of questions without suggesting any consensus. In this paper, we organize the findings of the electronic structures of $n$-layered NiO$_2$ materials ($n$= 1 to $\infty$) to outline (ir)regularities and to make comparisons with cuprates, with the hope that important directions of future research will emerge.


title: Deep neural networks as nested dynamical systems

abstract: There is an analogy that is often made between deep neural networks and actual brains, suggested by the nomenclature itself: the "neurons" in deep neural networks should correspond to neurons (or nerve cells, to avoid confusion) in the brain. We claim, however, that this analogy doesn't even type check: it is structurally flawed. In agreement with the slightly glib summary of Hebbian learning as "cells that fire together wire together", this article makes the case that the analogy should be different. Since the "neurons" in deep neural networks are managing the changing weights, they are more akin to the synapses in the brain; instead, it is the wires in deep neural networks that are more like nerve cells, in that they are what cause the information to flow. An intuition that nerve cells seem like more than mere wires is exactly right, and is justified by a precise category-theoretic analogy which we will explore in this article. Throughout, we will continue to highlight the error in equating artificial neurons with nerve cells by leaving "neuron" in quotes or by calling them artificial neurons. We will first explain how to view deep neural networks as nested dynamical systems with a very restricted sort of interaction pattern, and then explain a more general sort of interaction for dynamical systems that is useful throughout engineering, but which fails to adapt to changing circumstances. As mentioned, an analogy is then forced upon us by the mathematical formalism in which they are both embedded. We call the resulting encompassing generalization deeply interacting learning systems: they have complex interaction as in control theory, but adaptation to circumstances as in deep neural networks.


title: Warp drive dynamic solutions considering different fluid sources

abstract: Alcubierre proposed in 1994 that the well known special relativistic limitation that particles cannot travel with velocities bigger than the light speed can be bypassed when such trips are considered globally within specific general relativistic frameworks. Although initial results indicated this scenario as being unphysical, since it would seem to require negative mass-energy density, recent theoretical analyses suggest that such an unphysical situation may not always be necessarily true. In this paper we review some solutions of the Einstein equations using the original Alcubierre warp drive metric endowed with various matter-energy sources, namely dust, perfect fluid, anisotropic fluid, and perfect fluid with a cosmological constant. A connection of some of these solutions featuring shock waves described by the Burgers equation is also shown.


title: Search for low-mass dilepton resonances in Higgs boson decays to four-lepton final states in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: A search for low-mass dilepton resonances in Higgs boson decays is conducted in the four-lepton final state. The decay is assumed to proceed via a pair of beyond the standard model particles, or one such particle and a Z boson. The search uses proton-proton collision data collected with the CMS detector at the CERN LHC, corresponding to an integrated luminosity of 137 fb$^{-1}$, at a center-of-mass energy $\sqrt{s} =$ 13 TeV. No significant deviation from the standard model expectation is observed. Upper limits at 95% confidence level are set on model-independent Higgs boson decay branching fractions. Additionally, limits on dark photon and axion-like particle production, based on two specific models, are reported.


title: Masking Modalities for Cross-modal Video Retrieval

abstract: Pre-training on large scale unlabelled datasets has shown impressive performance improvements in the fields of computer vision and natural language processing. Given the advent of large-scale instructional video datasets, a common strategy for pre-training video encoders is to use the accompanying speech as weak supervision. However, as speech is used to supervise the pre-training, it is never seen by the video encoder, which does not learn to process that modality. We address this drawback of current pre-training methods, which fail to exploit the rich cues in spoken language. Our proposal is to pre-train a video encoder using all the available video modalities as supervision, namely, appearance, sound, and transcribed speech. We mask an entire modality in the input and predict it using the other two modalities. This encourages each modality to collaborate with the others, and our video encoder learns to process appearance and audio as well as speech. We show the superior performance of our "modality masking" pre-training approach for video retrieval on the How2R, YouCook2 and Condensed Movies datasets.


title: Asymptotic in a class of network models with an increasing sub-Gamma degree sequence

abstract: For the differential privacy under the sub-Gamma noise, we derive the asymptotic properties of a class of network models with binary values with a general link function. In this paper, we release the degree sequences of the binary networks under a general noisy mechanism with the discrete Laplace mechanism as a special case. We establish the asymptotic result including both consistency and asymptotically normality of the parameter estimator when the number of parameters goes to infinity in a class of network models. Simulations and a real data example are provided to illustrate asymptotic results.


title: Differential Flatness and Flatness Inspired Control of Aerial Manipulators based on Lagrangian Reduction

abstract: This paper shows that the dynamics of a general class of aerial manipulators, consist of an underactuated multi-rotor base with an arbitrary k-linked articulated manipulator, are differentially flat. Methods of Lagrangian Reduction under broken symmetries produce reduced equations of motion whose key variables: center-of-mass linear momentum, vehicle yaw angle, and manipulator relative joint angles become the flat outputs. Utilizing flatness theory and a second-order dynamic extension of the thrust input, we transform the mechanics of aerial manipulators to their equivalent trivial form with a valid relative degree. Using this flatness transformation, a quadratic programming-based controller is proposed within a Control Lyapunov Function (CLF-QP) framework, and its performance is verified in simulation.


title: Towards Generation of Indistinguishable Coherent States

abstract: We have addressed the characteristic distinguishability of coherent states in the temporal domain from a directly modulated quantum well-based gain-switched laser diode. Using small-signal and large-signal models, we identify tunable parameters to generate indistinguishable coherent states from an electrically pumped semiconductor laser. The experiment confirms the generation of indistinguishable signal and decoy coherent states as predicted by the numerical simulation.


title: ASASSN-19ax: SU UMa-type dwarf nova with a long superhump period and post-superoutburst rebrightenings

abstract: We observed ASASSN-19ax during the long outburst in 2021 September-October. The object has been confirmed to be an SU UMa-type dwarf nova with a superhump period of 0.1000-0.1001 d. This object showed two post-superoutburst rebrightenings both in the 2019 and 2021 superoutbursts. These observations have established that ASASSN-19ax belongs to a group of long-period SU UMa-type dwarf novae which show multiple rebrightenings. This phenomenon probably arises from premature quenching of the superoutburst due to the weak 3:1 resonance near the stability border of the resonance, resulting in a considerable amount of disk mass after the superoutburst. We noted that ASASSN-19ax is very similar to QZ Ser, an SU UMa-type dwarf nova with an orbital period of 0.08316 d and an anomalously hot, bright secondary star, in that both objects showed multiple post-superoutburst rebrightenings at least once and that they are bright in quiescence. We expect that the core of the secondary in ASASSN-19ax may be evolved as in QZ Ser.


title: Structure and motifs of iron oxides from 1 to 3 TPa

abstract: Iron oxides are fundamental components of planet-forming materials. Understanding the Fe-O system's behavior and properties under high pressure can help us identify many new phases and states possible in exoplanetary interiors, especially terrestrial ones. Using the adaptive genetic algorithm (AGA), we investigate the structure of iron oxides for a wide range of stoichiometries ($0.25\leq x_O \leq 0.8$) at 1, 2, and 3 TPa. Five unreported ground-state structures with Fe$_2$O, FeO, Fe$_3$O$_5$, FeO$_2$, and FeO$_4$ compositions are identified. The calculated density of states (DOS) suggests that, except for FeO$_4$, all phases are metallic, but their carrier densities decrease with increasing pressure and oxygen content. The cluster alignment analysis of stable and metastable phases shows that several motifs may co-exist in a structure of iron oxides with low O content. In contrast, most iron oxides with high O content adopt a simple BCC motif at TPa pressures. Our results provide a crystal structure database of iron oxides for modeling and understanding the interiors of exoplanets.


title: On the Current and Emerging Challenges of Developing Fair and Ethical AI Solutions in Financial Services

abstract: Artificial intelligence (AI) continues to find more numerous and more critical applications in the financial services industry, giving rise to fair and ethical AI as an industry-wide objective. While many ethical principles and guidelines have been published in recent years, they fall short of addressing the serious challenges that model developers face when building ethical AI solutions. We survey the practical and overarching issues surrounding model development, from design and implementation complexities, to the shortage of tools, and the lack of organizational constructs. We show how practical considerations reveal the gaps between high-level principles and concrete, deployed AI applications, with the aim of starting industry-wide conversations toward solution approaches.


title: Warm Spitzer IRAC Photometry: dependencies on observing mode and exposure time

abstract: We investigate differences in Spitzer/IRAC 3.6 and 4.5micron photometry that depend on observing strategy. Using archival calibration data we perform an in-depth examination of the measured flux densities ("fluxes") of ten calibration stars, observed with all the possible observing strategies. We then quantify differences in the measured fluxes as a function of 1) array mode (full or subarray), 2) exposure time, and 3) dithering versus staring observations. We find that the median fluxes measured for sources observed using the full array are 1.6% and 1% lower than those observed with the subarray at [3.6] and [4.5], respectively. Additionally, we found a dependence on the exposure time such that for [3.6] observations the long frame times are measured to be lower than the short frame times by a median value of 3.4% in full array and 2.9% in subarray. For [4.5] observations the longer frame times are 0.6% and 1.5% in full and subarray respectively. These very small variations will likely only affect science users who require high-precision photometry from multiple different observing modes. We find no statistically significant difference for fluxes obtained with dithered and staring-modes. When considering all stars in the sample, the fractional well depth of the pixel is correlated with the different observed fluxes. We speculate the cause to be a small non-linearity in the pixels at the lowest well depths where deviations from linearity were previously assumed to be negligible.


title: The most metal-rich asymptotic giant branch stars

abstract: We present new stellar evolutionary sequences of very metal-rich stars evolved with the Monash Stellar Structure code and with MESA. The Monash models include masses of $1-8M_{\odot}$ with metallicities $Z=0.04$ to $Z=0.1$ and are evolved from the main sequence to the thermally-pulsing asymptotic giant branch (AGB). These are the first $Z=0.1$ AGB models in the literature. The MESA models include intermediate-mass models with $Z=0.06$ to $Z=0.09$ evolved to the onset of the thermally-pulsing phase. Third dredge-up only occurs in intermediate-mass models $Z \le 0.08$. Hot bottom burning (HBB) shows a weaker dependence on metallicity, with the minimum mass increasing from 4.5$M_{\odot}$ for $Z=0.014$ to $\approx 5.5 M_{\odot}$ for Z = 0.04, $6M_{\odot}$ for $ 0.05 \le Z \le 0.07$ and above 6.5$ M_{\odot}$ for $Z\ge 0.08$. The behaviour of the $Z=0.1$ models is unusual; most do not experience He-shell instabilities owing to rapid mass-loss on the early part of the AGB. Turning off mass-loss produces He-shell instabilities, however thermal pulses are weak and result in no third dredge-up. The minimum mass for carbon ignition is reduced from 8$M_{\odot}$ for $Z=0.04$ to 7$M_{\odot}$ for $Z=0.1$, which implies a reduction in the minimum mass for core-collapse supernovae. MESA models of similarly high metallicity ($Z=0.06 - 0.09$) show the same lowering of the minimum mass for carbon ignition: carbon burning is detected in a $6 M_{\odot}$ model at the highest metallicity ($Z=0.09$) and in all $7 M_{\odot}$ models with $Z \ge 0.06$. This demonstrates robustness of the lowered carbon burning threshold across codes.


title: Smooth local rigidity for hyperbolic toral automorphisms

abstract: We study the regularity of a conjugacy $H$ between a hyperbolic toral automorphism $A$ and its smooth perturbation $f$ We show that if $H$ is weakly differentiable then it is $C^{1+H\"older}$ and, if $A$ is also weakly irreducible, then $H$ is $C^\infty$. As a part of the proof, we establish results of independent interest on H\"older continuity of a measurable conjugacy between linear cocycles over a hyperbolic system. As a corollary, we improve regularity of the conjugacy to $C^\infty$ in prior local rigidity results.


title: Log adjunction: moduli part

abstract: Upper moduli part of adjunction is introduced and its basic property are discussed. The moduli part satisfies the BP in the case of rational multiplicities and is nef in the maximal case.


title: TOI-2076 and TOI-1807: Two young, comoving planetary systems within 50 pc identified by TESS that are ideal candidates for further follow-up

abstract: We report the discovery of two planetary systems around comoving stars; TOI-2076 (TIC 27491137) and TOI-1807 (TIC 180695581). TOI-2076 is a nearby (41.9 pc) multi-planetary system orbiting a young (204$\pm$50 Myr), bright (K = 7.115 in TIC v8.1). TOI-1807 hosts a single transiting planet, and is similarly nearby (42.58pc), similarly young (180$\pm$40 Myr), and bright. Both targets exhibit significant, periodic variability due to star spots, characteristic of their young ages. Using photometric data collected by TESS we identify three transiting planets around TOI-2076 with radii of R$_b$=3.3$\pm$0.04$R_\oplus$, R$_c$=4.4$\pm$0.05$R_\oplus$, and R$_d$=4.1$\pm$0.07$R_\oplus$. Planet TOI-2076b has a period of P$_b$=10.356 d. For both TOI 2076c and d, TESS observed only two transits, separated by a 2-year interval in which no data were collected, preventing a unique period determination. A range of long periods (>17d) are consistent with the data. We identify a short-period planet around TOI-1807 with a radius of R$_b$=1.8$\pm$0.04$R_\oplus$ and a period of P$_b$=0.549 d. Their close proximity, and bright, cool host stars, and young ages, make these planets excellent candidates for follow-up. TOI-1807b is one of the best known small ($R<2R_\oplus$) planets for characterization via eclipse spectroscopy and phase curves with JWST. TOI-1807b is the youngest ultra-short period planet discovered to date, providing valuable constraints on formation time-scales of short period planets. Given the rarity of young planets, particularly in multiple planet systems, these planets present an unprecedented opportunity to study and compare exoplanet formation, and young planet atmospheres, at a crucial transition age for formation theory.


title: DaDRA: A Python Library for Data-Driven Reachability Analysis

abstract: Reachability analysis is used to determine all possible states that a system acting under uncertainty may reach. It is a critical component to obtain guarantees of various safety-critical systems both for safety verification and controller synthesis. Though traditional approaches to reachability analysis provide formal guarantees of the reachable set, they involve complex algorithms that require full system information, which is impractical for use in real world settings. We present DaDRA, a Python library that allows for data-driven reachability analysis with arbitrarily robust probabilistic guarantees. We demonstrate the practical functionality of DaDRA on various systems including: an analytically intractable chaotic system, benchmarks for systems with nonlinear dynamics, and a realistic system acting under complex disturbance signals and controlled with an intricate controller across multiple dimensions.


title: From braids to transverse slices in reductive groups

abstract: In 1965, Steinberg's study of conjugacy classes in connected reductive groups led him to construct an affine subspace parametrising regular conjugacy classes, which he noticed is also a cross section for the conjugation action by the unipotent radical of a Borel subgroup on another affine subspace. Recently, generalisations of this slice and its cross section property have been obtained by Sevostyanov in the context of quantum group analogues of W-algebras and by He-Lusztig in the context of Deligne-Lusztig varieties. Such slices are often thought of as group analogues of Slodowy slices. In this paper we explain their relationship via common generalisations associated to Weyl group elements and provide a simple criterion for cross sections in terms of roots. In the most important class of examples this criterion is equivalent to a statement about the Deligne-Garside factors of their powers in the braid monoid being maximal in some sense. Moreover, we show that these subvarieties transversely intersect conjugacy classes and determine for a large class of factorisable r-matrices when the Semenov-Tian-Shansky bracket reduces to a Poisson structure on these slices.


title: Explaining Documents' Relevance to Search Queries

abstract: We present GenEx, a generative model to explain search results to users beyond just showing matches between query and document words. Adding GenEx explanations to search results greatly impacts user satisfaction and search performance. Search engines mostly provide document titles, URLs, and snippets for each result. Existing model-agnostic explanation methods similarly focus on word matching or content-based features. However, a recent user study shows that word matching features are quite obvious to users and thus of slight value. GenEx explains a search result by providing a terse description for the query aspect covered by that result. We cast the task as a sequence transduction problem and propose a novel model based on the Transformer architecture. To represent documents with respect to the given queries and yet not generate the queries themselves as explanations, two query-attention layers and masked-query decoding are added to the Transformer architecture. The model is trained without using any human-generated explanations. Training data are instead automatically constructed to ensure a tolerable noise level and a generalizable learned model. Experimental evaluation shows that our explanation models significantly outperform the baseline models. Evaluation through user studies also demonstrates that our explanation model generates short yet useful explanations.


title: FC-based shock-dynamics solver with neural-network localized artificial-viscosity assignment

abstract: This paper presents a spectral scheme for the numerical solution of nonlinear conservation laws in non-periodic domains under arbitrary boundary conditions. The approach relies on the use of the Fourier Continuation (FC) method for spectral representation of non-periodic functions in conjunction with smooth localized artificial viscosity assignments produced by means of a Shock-Detecting Neural Network (SDNN). Like previous shock capturing schemes and artificial viscosity techniques, the combined FC-SDNN strategy effectively controls spurious oscillations in the proximity of discontinuities. Thanks to its use of a localized but smooth artificial viscosity term, whose support is restricted to a vicinity of flow-discontinuity points, the algorithm enjoys spectral accuracy and low dissipation away from flow discontinuities, and, in such regions, it produces smooth numerical solutions -- as evidenced by an essential absence of spurious oscillations in level set lines. The FC-SDNN viscosity assignment, which does not require use of problem-dependent algorithmic parameters, induces a significantly lower overall dissipation than other methods, including the Fourier-spectral versions of the previous entropy viscosity method. The character of the proposed algorithm is illustrated with a variety of numerical results for the linear advection, Burgers and Euler equations in one and two-dimensional non-periodic spatial domains.


title: Floquet engineering of Kitaev quantum magnets

abstract: In recent years, there has been an intense search for materials realizing the Kitaev quantum spin liquid model. A number of edge-shared compounds with strong spin-orbit coupling, such as RuCl$_3$ and iridates, have been proposed to realize this model. Nevertheless, an effective spin Hamiltonian derived from the microscopic model relevant to these compounds generally contains terms that are antagonistic toward the quantum spin liquid. This is consistent with the fact the zero magnetic field ground state of these materials is generally magnetically ordered. It is a pressing issue to identify protocols to drive the system to the limit of the Kitaev quantum spin model. In this work, we propose Floquet engineering of these Kitaev quantum magnets by coupling materials to a circularly polarized laser. We demonstrate that all the magnetic interactions can be tuned in situ by the amplitude and frequency of the laser, hence providing a route to stabilize the Kitaev quantum spin liquid phase.


title: The Variability of the Black-Hole Image in M87 at the Dynamical Time Scale

abstract: The black-hole images obtained with the Event Horizon Telescope (EHT) are expected to be variable at the dynamical timescale near their horizons. For the black hole at the center of the M87 galaxy, this timescale (5-61 days) is comparable to the 6-day extent of the 2017 EHT observations. Closure phases along baseline triangles are robust interferometric observables that are sensitive to the expected structural changes of the images but are free of station-based atmospheric and instrumental errors. We explored the day-to-day variability in closure phase measurements on all six linearly independent non-trivial baseline triangles that can be formed from the 2017 observations. We showed that three triangles exhibit very low day-to-day variability, with a dispersion of $\sim3-5^\circ$. The only triangles that exhibit substantially higher variability ($\sim90-180^\circ$) are the ones with baselines that cross visibility amplitude minima on the $u-v$ plane, as expected from theoretical modeling. We used two sets of General Relativistic magnetohydrodynamic simulations to explore the dependence of the predicted variability on various black-hole and accretion-flow parameters. We found that changing the magnetic field configuration, electron temperature model, or black-hole spin has a marginal effect on the model consistency with the observed level of variability. On the other hand, the most discriminating image characteristic of models is the fractional width of the bright ring of emission. Models that best reproduce the observed small level of variability are characterized by thin ring-like images with structures dominated by gravitational lensing effects and thus least affected by turbulence in the accreting plasmas.


title: BayesDLMfMRI: Bayesian Matrix-Variate Dynamic Linear Models for Task-based fRMI Modeling in R

abstract: This article introduces an R package to perform statistical analysis for task-based fMRI data at both individual and group levels. The analysis to detect brain activation at the individual level is based on modeling the fMRI signal using Matrix-Variate Dynamic Linear Models (MDLM). Therefore, the analysis for the group stage is based on posterior distributions of the state parameter obtained from the modeling at the individual level. In this way, this package offers several R functions with different algorithms to perform inference on the state parameter to assess brain activation for both individual and group stages. Those functions allow for parallel computation when the analysis is performed for the entire brain as well as analysis at specific voxels when it is required.


title: The Atacama Cosmology Telescope: Modeling Bulk Atmospheric Motion

abstract: Fluctuating atmospheric emission is a dominant source of noise for ground-based millimeter-wave observations of the CMB temperature anisotropy at angular scales $\gtrsim 0.5^{\circ}$. We present a model of the atmosphere as a discrete set of emissive turbulent layers that move with respect to the observer with a horizontal wind velocity. After introducing a statistic derived from the time-lag dependent correlation function for detector pairs in an array, referred to as the pair-lag, we use this model to estimate the aggregate angular motion of the atmosphere derived from time-ordered data from the Atacama Cosmology Telescope (ACT). We find that estimates derived from ACT's CMB observations alone agree with those derived from satellite weather data that additionally include a height-dependent horizontal wind velocity and water vapor density. We also explore the dependence of the measured atmospheric noise spectrum on the relative angle between the wind velocity and the telescope scan direction. In particular, we find that varying the scan velocity changes the noise spectrum in a predictable way. Computing the pair-lag statistic opens up new avenues for understanding how atmospheric fluctuations impact measurements of the CMB anisotropy.


title: AVASpeech-SMAD: A Strongly Labelled Speech and Music Activity Detection Dataset with Label Co-Occurrence

abstract: We propose a dataset, AVASpeech-SMAD, to assist speech and music activity detection research. With frame-level music labels, the proposed dataset extends the existing AVASpeech dataset, which originally consists of 45 hours of audio and speech activity labels. To the best of our knowledge, the proposed AVASpeech-SMAD is the first open-source dataset that features strong polyphonic labels for both music and speech. The dataset was manually annotated and verified via an iterative cross-checking process. A simple automatic examination was also implemented to further improve the quality of the labels. Evaluation results from two state-of-the-art SMAD systems are also provided as a benchmark for future reference.


title: A Network Science Perspective to Personalized Learning

abstract: The modern educational ecosystem is not one-size fits all. Scholars are accustomed to personalization in their everyday life and expect the same from education systems. Additionally, the COVID-19 pandemic placed us all in an acute teaching and learning laboratory experimentation which now creates expectations of self-paced learning and interactions with focused educational materials. Consequently, we examine how learning objectives can be achieved through a learning platform that offers content choices and multiple modalities of engagement to support self-paced learning, and propose an approach to personalized education based on network science. This framework brings the attention to learning experiences, rather than teaching experiences, by providing the learner engagement and content choices supported by a network of knowledge, based on and driven by individual skills and goals. We conclude with a discussion of a prototype of such a learning platform, called CHUNK Learning.


title: Diverse Distributions of Self-Supervised Tasks for Meta-Learning in NLP

abstract: Meta-learning considers the problem of learning an efficient learning process that can leverage its past experience to accurately solve new tasks. However, the efficacy of meta-learning crucially depends on the distribution of tasks available for training, and this is often assumed to be known a priori or constructed from limited supervised datasets. In this work, we aim to provide task distributions for meta-learning by considering self-supervised tasks automatically proposed from unlabeled text, to enable large-scale meta-learning in NLP. We design multiple distributions of self-supervised tasks by considering important aspects of task diversity, difficulty, type, domain, and curriculum, and investigate how they affect meta-learning performance. Our analysis shows that all these factors meaningfully alter the task distribution, some inducing significant improvements in downstream few-shot accuracy of the meta-learned models. Empirically, results on 20 downstream tasks show significant improvements in few-shot learning -- adding up to +4.2% absolute accuracy (on average) to the previous unsupervised meta-learning method, and perform comparably to supervised methods on the FewRel 2.0 benchmark.