title: Symmetric Mass Generation in the 1+1 Dimensional Chiral Fermion 3-4-5-0 Model

abstract: Lattice regularization of chiral fermions has been a long-standing problem in physics. In this work, we present the density matrix renormalization group (DMRG) simulation of the 3-4-5-0 model of (1+1)D chiral fermions with an anomaly-free chiral U(1) symmetry, which contains two left-moving and two right-moving fermions carrying U(1) charges 3,4 and 5,0, respectively. Following the Wang-Wen chiral fermion model, we realize the chiral fermions and their mirror partners on the opposite boundaries of a thin strip of (2+1)D lattice model of multi-layer Chern insulator, whose finite-width implies the quantum system is effectively (1+1)D. By introducing carefully designed two sets of six-fermion local interactions to the mirror sector only, we demonstrate that the mirror fermions can be gapped out by the interaction beyond a critical strength without breaking the chiral U(1) symmetry, via the symmetric mass generation (SMG) mechanism. We show that the interaction-driven gapping transition is in the Berezinskii-Kosterlitz-Thouless (BKT) universality class. We determine the evolution of Luttinger parameters before the transition, which confirms that the transition happens exactly at the point when the interaction term becomes marginal. As the mirror sector is gapped after the transition, we check that the fermions in the light chiral fermion sector remain gapless, which provides the desired lattice regularization of chiral fermions.

categories: cond-mat.str-el hep-lat hep-ph hep-th quant-ph


title: Constraints on the Lambda-neutron interaction from charge-symmetry breaking of A=4 hypernuclei

abstract: We include the leading charge symmetry breaking contributions into the hyperon-nucleon interactions derived within chiral effective field theory up to next-to-leading order. Two low energy constants are determined using the experimentally known differences of Lambda separation energies of 4-Lambda-He and 4-Lambda-H. This allows one to predict the Lambda-neutron scattering lengths for the first time based on data. Various sources of uncertainty are discussed.


title: PRNU Emphasis: a Generalization of the Multiplicative Model

abstract: The photoresponse non-uniformity (PRNU) is a camera-specific pattern, widely adopted to solve multimedia forensics problems such as device identification or forgery detection. The theoretical analysis of this fingerprint customarily relies on a multiplicative model for the denoising residuals. This setup assumes that the nonlinear mapping from the scene irradiance to the preprocessed luminance, that is, the composition of the Camera Response Function (CRF) with the optical and digital preprocessing pipelines, is a gamma correction. Yet, this assumption seldom holds in practice. In this letter, we improve the multiplicative model by including the influence of this nonlinear mapping on the denoising residuals. We also propose a method to estimate this effect. Results evidence that the response of typical cameras deviates from a gamma correction. Experimental device identification with our model increases the TPR by a $4.93\, \%$ on average for a fixed FPR of $0.01$.


title: Physics Informed RNN-DCT Networks for Time-Dependent Partial Differential Equations

abstract: Physics-informed neural networks allow models to be trained by physical laws described by general nonlinear partial differential equations. However, traditional architectures struggle to solve more challenging time-dependent problems due to their architectural nature. In this work, we present a novel physics-informed framework for solving time-dependent partial differential equations. Using only the governing differential equations and problem initial and boundary conditions, we generate a latent representation of the problem's spatio-temporal dynamics. Our model utilizes discrete cosine transforms to encode spatial frequencies and recurrent neural networks to process the time evolution. This efficiently and flexibly produces a compressed representation which is used for additional conditioning of physics-informed models. We show experimental results on the Taylor-Green vortex solution to the Navier-Stokes equations. Our proposed model achieves state-of-the-art performance on the Taylor-Green vortex relative to other physics-informed baseline models.


title: UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Training

abstract: We present UnifiedQA-v2, a QA model built with the same process as UnifiedQA, except that it utilizes more supervision -- roughly 3x the number of datasets used for UnifiedQA. This generally leads to better in-domain and cross-domain results.


title: Stability of the microcanonical ensemble in Euclidean Quantum Gravity

abstract: This work resolves a longstanding tension between the physically-expected stability of the microcanonical ensemble for gravitating systems and the fact that the known negative mode of the asymptotically flat Schwarzschild black hole decays too rapidly at infinity to affect the ADM energy boundary term at infinity. The key to our study is that we fix an appropriate {\it off-shell} notion of energy, which we obtain by constructing the microcanonical partition function as an integral transform of the canonical partition function. After applying the rule-of-thumb for Wick rotations from our recent companion paper to deal with the conformal mode problem of Euclidean gravity, we find a positive definite action for linear perturbations about any Euclidean Schwarzchild (-AdS) black hole. Most of our work is done in a cavity with reflecting boundary conditions, but the cavity wall can be removed by taking an appropriate limit.


title: RescueNet: A High Resolution UAV Semantic Segmentation Benchmark Dataset for Natural Disaster Damage Assessment

abstract: Recent advancements in computer vision and deep learning techniques have facilitated notable progress in scene understanding, thereby assisting rescue teams in achieving precise damage assessment. In this paper, we present RescueNet, a meticulously curated high-resolution post-disaster dataset that includes detailed classification and semantic segmentation annotations. This dataset aims to facilitate comprehensive scene understanding in the aftermath of natural disasters. RescueNet comprises post-disaster images collected after Hurricane Michael, obtained using Unmanned Aerial Vehicles (UAVs) from multiple impacted regions. The uniqueness of RescueNet lies in its provision of high-resolution post-disaster imagery, accompanied by comprehensive annotations for each image. Unlike existing datasets that offer annotations limited to specific scene elements such as buildings, RescueNet provides pixel-level annotations for all classes, including buildings, roads, pools, trees, and more. Furthermore, we evaluate the utility of the dataset by implementing state-of-the-art segmentation models on RescueNet, demonstrating its value in enhancing existing methodologies for natural disaster damage assessment.


title: StyleCLIPDraw: Coupling Content and Style in Text-to-Drawing Translation

abstract: Generating images that fit a given text description using machine learning has improved greatly with the release of technologies such as the CLIP image-text encoder model; however, current methods lack artistic control of the style of image to be generated. We present an approach for generating styled drawings for a given text description where a user can specify a desired drawing style using a sample image. Inspired by a theory in art that style and content are generally inseparable during the creative process, we propose a coupled approach, known here as StyleCLIPDraw, whereby the drawing is generated by optimizing for style and content simultaneously throughout the process as opposed to applying style transfer after creating content in a sequence. Based on human evaluation, the styles of images generated by StyleCLIPDraw are strongly preferred to those by the sequential approach. Although the quality of content generation degrades for certain styles, overall considering both content \textit{and} style, StyleCLIPDraw is found far more preferred, indicating the importance of style, look, and feel of machine generated images to people as well as indicating that style is coupled in the drawing process itself. Our code (https://github.com/pschaldenbrand/StyleCLIPDraw), a demonstration (https://replicate.com/pschaldenbrand/style-clip-draw), and style evaluation data (https://www.kaggle.com/pittsburghskeet/drawings-with-style-evaluation-styleclipdraw) are publicly available.


title: Estimators of Entropy and Information via Inference in Probabilistic Models

abstract: Estimating information-theoretic quantities such as entropy and mutual information is central to many problems in statistics and machine learning, but challenging in high dimensions. This paper presents estimators of entropy via inference (EEVI), which deliver upper and lower bounds on many information quantities for arbitrary variables in a probabilistic generative model. These estimators use importance sampling with proposal distribution families that include amortized variational inference and sequential Monte Carlo, which can be tailored to the target model and used to squeeze true information values with high accuracy. We present several theoretical properties of EEVI and demonstrate scalability and efficacy on two problems from the medical domain: (i) in an expert system for diagnosing liver disorders, we rank medical tests according to how informative they are about latent diseases, given a pattern of observed symptoms and patient attributes; and (ii) in a differential equation model of carbohydrate metabolism, we find optimal times to take blood glucose measurements that maximize information about a diabetic patient's insulin sensitivity, given their meal and medication schedule.


title: Orthonormal Matrix Codebook Design for Adaptive Transform Coding

abstract: A novel algorithm for designing optimized orthonormal transform-matrix codebooks for adaptive transform coding of a non-stationary vector process is proposed. This algorithm relies on a block-wise stationary model of a non-stationary process and finds a codebook of transform-matrices by minimizing the end-to-end mean square error of transform coding averaged over the distribution of stationary blocks of vectors. The algorithm, which belongs to the class of block-coordinate descent algorithms, solves an intermediate minimization problem involving matrix-orthonormality constraints in a computationally efficient manner by mapping the problem from the Euclidean space to the Stiefel manifold. As such, the algorithm can be broadly applied to any adaptive transform coding problem. Preliminary results obtained with inter-prediction residuals in an H265 video codec are presented to demonstrate the advantage of optimized adaptive transform codes over non-adaptive codes based on the standard DCT.


title: Alternative Metrics to Select Motors for Quasi-Direct Drive Actuators

abstract: Robotic systems for legged locomotion -- including legged robots, exoskeletons, and prosthetics -- require actuators with low inertia and high output torque. Traditionally, motors have been selected for these applications by maximizing the motor gap radius. We present alternative metrics for motor selection that are invariant to transmission ratio. The proposed metrics reward minimizing the motor inertia while maximizing the torque and motor constants without special consideration for gap radius, providing a better balance of properties for legged locomotion applications. We rigorously characterize the T-Motor RI50 and demonstrate the use of the metrics by comparing the RI50 to the widely-used T-Motor U8 as a case study.


title: Bredon motivic cohomology of the complex numbers

abstract: Over the complex numbers, we compute the $C_2$-equivariant Bredon motivic cohomology ring with $\mathbb{Z}/2$ coefficients. By rigidity, this extends Suslin's calculation of the motivic cohomology ring of algebraically closed fields of characteristic zero to the $C_2$-equivariant motivic setting.


title: Smooth Linearization of Nonautonomous Coupled Systems

abstract: In a joint work with Palmer we have formulated sufficient conditions under which there exist continuous and invertible transformations of the form $H_n(x,y)$ taking solutions of a coupled system \begin{equation*} x_{n+1} =A_nx_n+f_n(x_n, y_n), \quad y_{n+1}=g_n( y_n), \end{equation*} onto the solutions of the associated partially linearized uncoupled system \begin{equation*} x_{n+1} =A_nx_n, \quad y_{n+1}=g_n( y_n). \end{equation*} In the present work we go one step further and provide conditions under which $H_n$ and $H_n^{-1}$ are smooth in one of the variables $x$ and $y$. We emphasise that our conditions are of a general form and do not involve any kind of dichotomy, nonresonance or spectral gap assumptions for the linear part which are present on most of the related works.


title: Instantaneous Physiological Estimation using Video Transformers

abstract: Video-based physiological signal estimation has been limited primarily to predicting episodic scores in windowed intervals. While these intermittent values are useful, they provide an incomplete picture of patients' physiological status and may lead to late detection of critical conditions. We propose a video Transformer for estimating instantaneous heart rate and respiration rate from face videos. Physiological signals are typically confounded by alignment errors in space and time. To overcome this, we formulated the loss in the frequency domain. We evaluated the method on the large scale Vision-for-Vitals (V4V) benchmark. It outperformed both shallow and deep learning based methods for instantaneous respiration rate estimation. In the case of heart-rate estimation, it achieved an instantaneous-MAE of 13.0 beats-per-minute.


title: On Monocular Depth Estimation and Uncertainty Quantification using Classification Approaches for Regression

abstract: Monocular depth is important in many tasks, such as 3D reconstruction and autonomous driving. Deep learning based models achieve state-of-the-art performance in this field. A set of novel approaches for estimating monocular depth consists of transforming the regression task into a classification one. However, there is a lack of detailed descriptions and comparisons for Classification Approaches for Regression (CAR) in the community and no in-depth exploration of their potential for uncertainty estimation. To this end, this paper will introduce a taxonomy and summary of CAR approaches, a new uncertainty estimation solution for CAR, and a set of experiments on depth accuracy and uncertainty quantification for CAR-based models on KITTI dataset. The experiments reflect the differences in the portability of various CAR methods on two backbones. Meanwhile, the newly proposed method for uncertainty estimation can outperform the ensembling method with only one forward propagation.


title: Conductivity reconstruction from power density data in limited view

abstract: In Acousto-Electric tomography, the objective is to extract information about the interior electrical conductivity in a physical body from knowledge of the interior power density data generated from prescribed boundary conditions for the governing elliptic partial differential equation. In this note, we consider the problem when the controlled boundary conditions are applied only on a small subset of the full boundary. We demonstrate using the unique continuation principle that the Runge approximation property is valid also for this special case of limited view data. As a consequence, we guarantee the existence of finitely many boundary conditions such that the corresponding solutions locally satisfy a non-vanishing gradient condition. This condition is essential for conductivity reconstruction from power density data. In addition, we adapt an existing reconstruction method intended for the full data situation to our setting. We implement the method numerically and investigate the opportunities and shortcomings when reconstructing from two fixed boundary conditions.


title: Aggregation as an antipredator strategy in the rock-paper-scissors model

abstract: We study a nonhierarchical tritrophic system, whose predator-prey interactions are described by the rock-paper-scissors game rules. In our stochastic simulations, individuals may move strategically towards the direction with more conspecifics to form clumps instead of moving aimlessly on the lattice. Considering that the conditioning to move gregariously depends on the organism's physical and cognitive abilities, we introduce a maximum distance an individual can perceive the environment and a minimum conditioning level to perform the gregarious movement. We investigate the pattern formation and compute the average size of the single-species spatial domains emerging from the grouping behaviour. The results reveal that the defence tactic reduces the predation risk significantly, being more profitable if individuals perceive further distances, thus creating bigger groups. Our outcomes show that the species with more conditioned organisms dominate the cyclic spatial game, controlling most of the territory. On the other hand, the species with fewer individuals ready to perform aggregation strategy gives its predator the chance to fill the more significant fraction of the grid. The spatial interactions assumed in our numerical experiments constitute a data set that may help biologists and data scientists understand how local interactions influence ecosystem dynamics.


title: The parabolic and near-parabolic renormalization for a class of polynomial maps and its applications

abstract: For a class of polynomial maps of one variable with a parabolic fixed points and degrees bigger than $21$, the parabolic renormalization is introduced based on Fatou coordinates and horn maps, and a type of maps which are invariant under the parabolic renormalization is also given. For the small perturbation of these kinds of maps, the near-parabolic renormalization is also introduced based on the first return maps defined on the fundamental regions. As an application, we show the existence of non-renormalizable polynomial maps with degrees bigger than $21$ such that the Julia sets have positive Lebesgue measure and Cremer fixed points, this provides a positive answer for the classical Fatou conjecture (the existence of Julia set with positive area) with degrees bigger than $21$.


title: Learning POD of Complex Dynamics Using Heavy-ball Neural ODEs

abstract: Proper orthogonal decomposition (POD) allows reduced-order modeling of complex dynamical systems at a substantial level, while maintaining a high degree of accuracy in modeling the underlying dynamical systems. Advances in machine learning algorithms enable learning POD-based dynamics from data and making accurate and fast predictions of dynamical systems. In this paper, we leverage the recently proposed heavy-ball neural ODEs (HBNODEs) [Xia et al. NeurIPS, 2021] for learning data-driven reduced-order models (ROMs) in the POD context, in particular, for learning dynamics of time-varying coefficients generated by the POD analysis on training snapshots generated from solving full order models. HBNODE enjoys several practical advantages for learning POD-based ROMs with theoretical guarantees, including 1) HBNODE can learn long-term dependencies effectively from sequential observations and 2) HBNODE is computationally efficient in both training and testing. We compare HBNODE with other popular ROMs on several complex dynamical systems, including the von K\'{a}rm\'{a}n Street flow, the Kurganov-Petrova-Popov equation, and the one-dimensional Euler equations for fluids modeling.


title: A Globally Convergent LP and SOCP-based algorithm for Semidefinite Programming

abstract: Semidefinite programs (SDP) are one of the most versatile frameworks in numerical optimization, serving as generalizations of many conic programs and as relaxations of NP-hard combinatorial problems. Their main drawback is their computational and memory complexity, which sets a practical limit to the size of problems solvable by off-the-shelf SDP solvers. To circumvent this fact, many algorithms have been proposed to exploit the structure of particular problems and increase the scalability of SDPs for those problem instances. Progress has been less steep, however, for general-case SDPs. In this paper, motivated by earlier results by Ahmadi and Hall, we show that a general SDP can be solved to $\epsilon$-optimality, in polynomial time, by performing a sequence of less computationally demanding Linear or Second Order Cone programs. In addition, we provide a bound on the number of iterations required to achieve $\epsilon$-optimality. These results are illustrated using random SDPs and well-known problems from the SDPLib dataset.


title: Highly-Efficient Binary Neural Networks for Visual Place Recognition

abstract: VPR is a fundamental task for autonomous navigation as it enables a robot to localize itself in the workspace when a known location is detected. Although accuracy is an essential requirement for a VPR technique, computational and energy efficiency are not less important for real-world applications. CNN-based techniques archive state-of-the-art VPR performance but are computationally intensive and energy demanding. Binary neural networks (BNN) have been recently proposed to address VPR efficiently. Although a typical BNN is an order of magnitude more efficient than a CNN, its processing time and energy usage can be further improved. In a typical BNN, the first convolution is not completely binarized for the sake of accuracy. Consequently, the first layer is the slowest network stage, requiring a large share of the entire computational effort. This paper presents a class of BNNs for VPR that combines depthwise separable factorization and binarization to replace the first convolutional layer to improve computational and energy efficiency. Our best model achieves state-of-the-art VPR performance while spending considerably less time and energy to process an image than a BNN using a non-binary convolution as a first stage.


title: A novel four-field mixed variational approach to Kirchhoff rods implemented with finite element exterior calculus

abstract: A four-field mixed variational principle is proposed for large deformation analysis of Kirchhoff rods with a $C^0$ mixed FE approximations. The core idea behind the approach is to introduce a one-parameter family of points (the centerline) and a separate one-parameter family of orthonormal frames (the Cartan moving frame) that are specified independently. The curvature and torsion of the curve are related to the relative rotation of neighboring frames. The relationship between the frame and the centerline is then enforced at the solution step using a Lagrange multiplier (which plays the role of section force). Well known frames like the Frenet-Serret are defined only using the centerline, which demands higher-order smoothness for the centerline approximation. Decoupling the frame from the position vector of the base curve leads to a description of torsion and curvature that is independent of the position information, thus allowing for simpler interpolations. This approach is then cast in the language of exterior calculus. In this framework, the strain energy may be interpreted as a differential form leading to the natural force-displacement (velocity) pairing. The four-field mixed variational principle we propose has frame, differential forms, and position vector as input arguments. While the position vector is interpolated linearly, the frames are interpolated as piecewise geodesics on the rotation group. Similarly, consistent interpolation schemes are also adopted to obtain finite dimensional approximations for other differential forms aswell. Using these discrete approximations, a discrete mixed variational principle is laid out which is then numerically extremized. The discrete approximation is then applied to benchmark problems, our numerical studies reveal an impressive performance of the proposed method without numerical instabilities or locking.


title: Calder\'on Preconditioners for the TD-EFIE discretized with Convolution Quadratures

abstract: This work focuses on the preconditioning and DC stabilization of the time domain electric field integral equation discretized in time with the convolution quadrature method. The standard formulation of the equation suffers from severe ill-conditioning for large time steps and refined meshes, in addition to DC instabilities plaguing standard solutions for late time steps. This work addresses all these issues by preconditioning the TD-EFIE operator matrices with a Calder\'on approach. Numerical results will corroborate the theory, showing the practical relevance of the proposed advancements.


title: Deep Learning to advance the Eigenspace Perturbation Method for Turbulence Model Uncertainty Quantification

abstract: The Reynolds Averaged Navier Stokes (RANS) models are the most common form of model in turbulence simulations. They are used to calculate Reynolds stress tensor and give robust results for engineering flows. But RANS model predictions have large error and uncertainty. In past, there has been some work towards using data-driven methods to increase their accuracy. In this work we outline a machine learning approach to aid the use of the Eigenspace Perturbation Method to predict the uncertainty in the turbulence model prediction. We use a trained neural network to predict the discrepancy in the shape of the RANS predicted Reynolds stress ellipsoid. We apply the model to a number of turbulent flows and demonstrate how the approach correctly identifies the regions in which modeling errors occur when compared to direct numerical simulation (DNS), large eddy simulation (LES) or experimental results from previous works.


title: Learning to Combine Instructions in LLVM Compiler

abstract: Instruction combiner (IC) is a critical compiler optimization pass, which replaces a sequence of instructions with an equivalent and optimized instruction sequence at basic block level. There can be thousands of instruction-combining patterns which need to be frequently updated as new coding idioms/applications and novel hardware evolve over time. This results in frequent updates to the IC optimization pass thereby incurring considerable human effort and high software maintenance costs. To mitigate these challenges associated with the traditional IC, we design and implement a Neural Instruction Combiner (NIC) and demonstrate its feasibility by integrating it into the standard LLVM compiler optimization pipeline. NIC leverages neural sequence-to-sequence (Seq2Seq) models for generating optimized encoded IR sequence from the unoptimized encoded IR sequence. To the best of our knowledge, ours is the first work demonstrating the feasibility of a neural instruction combiner built into a full-fledged compiler pipeline. Given the novelty of this task, we built a new dataset for training our NIC neural model. We show that NIC achieves exact match results percentage of 72% for optimized sequences as compared to traditional IC and neural machine translation metric Bleu precision score of 0.94, demonstrating its feasibility in a production compiler pipeline.


title: Fast Matching Pursuit with Multi-Gabor Dictionaries

abstract: Finding the best K-sparse approximation of a signal in a redundant dictionary is an NP-hard problem. Suboptimal greedy matching pursuit (MP) algorithms are generally used for this task. In this work, we present an acceleration technique and an implementation of the matching pursuit algorithm acting on a multi-Gabor dictionary, i.e., a concatenation of several Gabor-type time-frequency dictionaries, each of which consisting of translations and modulations of a possibly different window and time and frequency shift parameters. The technique is based on pre-computing and thresholding inner products between atoms and on updating the residual directly in the coefficient domain, i.e., without the round-trip to the signal domain. Since the proposed acceleration technique involves an approximate update step, we provide theoretical and experimental results illustrating the convergence of the resulting algorithm. The implementation is written in C (compatible with C99 and C++11) and we also provide Matlab and GNU Octave interfaces. For some settings, the implementation is up to 70 times faster than the standard Matching Pursuit Toolkit (MPTK).

categories: math.NA cs.IT cs.MS cs.NA eess.SP math.IT


title: Parallel Type Decomposition Scheme for Quasi-Linear Abstract Hyperbolic Equation

abstract: Cauchy problem for an abstract hyperbolic equation with the Lipschitz continuous operator is considered in the Hilbert space. The operator corresponding to the elliptic part of the equation is a sum of operators $A_{1},\,A_{2},\,\ldots,\,A_{m}$. Each addend is a self-adjoint and positive definite operator. A parallel type decomposition scheme for an approximate solution of the stated problem is constructed. The main idea of the scheme is that on each local interval classic difference problems are solved in parallel (independently from each other) respectively with the operators $A_{1},\,A_{2},\,\ldots,\,A_{m}$. The weighted average of the received solutions is announced as an approximate solution at the right end of the local interval. Convergence of the proposed scheme is proved and the approximate solution error is estimated, as well as the error of the difference analogue for the first-order derivative for the case when the initial problem data satisfy the natural sufficient conditions for solution existence.


title: Fine-Grained Prediction of Political Leaning on Social Media with Unsupervised Deep Learning

abstract: Predicting the political leaning of social media users is an increasingly popular task, given its usefulness for electoral forecasts, opinion dynamics models and for studying the political dimension of polarization and disinformation. Here, we propose a novel unsupervised technique for learning fine-grained political leaning from the textual content of social media posts. Our technique leverages a deep neural network for learning latent political ideologies in a representation learning task. Then, users are projected in a low-dimensional ideology space where they are subsequently clustered. The political leaning of a user is automatically derived from the cluster to which the user is assigned. We evaluated our technique in two challenging classification tasks and we compared it to baselines and other state-of-the-art approaches. Our technique obtains the best results among all unsupervised techniques, with micro F1 = 0.426 in the 8-class task and micro F1 = 0.772 in the 3-class task. Other than being interesting on their own, our results also pave the way for the development of new and better unsupervised approaches for the detection of fine-grained political leaning.


title: Multimode capacity of atomic-frequency comb quantum memories

abstract: Ensemble-based quantum memories are key to developing multiplexed quantum repeaters, able to overcome the intrinsic rate limitation imposed by finite communication times over long distances. Rare-earth ion doped crystals are main candidates for highly multimode quantum memories, where time, frequency and spatial multiplexing can be exploited to store multiple modes. In this context the atomic frequency comb (AFC) quantum memory provides large temporal multimode capacity, which can readily be combined with multiplexing in frequency and space. In this article, we derive theoretical formulas for quantifying the temporal multimode capacity of AFC-based memories, for both optical memories with fixed storage time and spin-wave memories with longer storage times and on-demand read out. The temporal multimode capacity is expressed in key memory parameters, such as AFC bandwidth, fixed-delay storage time, memory efficiency, and control field Rabi frequency. Current experiments in europium- and praseodymium-doped Y$_2$SiO$_5$ are analyzed within this theoretical framework, and prospects for higher temporal capacity in these materials are considered. In addition we consider the possibility of spectral and spatial multiplexing to further increase the mode capacity, with examples given for both rare earh ions.


title: TwistSLAM: Constrained SLAM in Dynamic Environment

abstract: Classical visual simultaneous localization and mapping (SLAM) algorithms usually assume the environment to be rigid. This assumption limits the applicability of those algorithms as they are unable to accurately estimate the camera poses and world structure in real life scenes containing moving objects (e.g. cars, bikes, pedestrians, etc.). To tackle this issue, we propose TwistSLAM: a semantic, dynamic and stereo SLAM system that can track dynamic objects in the environment. Our algorithm creates clusters of points according to their semantic class. Thanks to the definition of inter-cluster constraints modeled by mechanical joints (function of the semantic class), a novel constrained bundle adjustment is then able to jointly estimate both poses and velocities of moving objects along with the classical world structure and camera trajectory. We evaluate our approach on several sequences from the public KITTI dataset and demonstrate quantitatively that it improves camera and object tracking compared to state-of-the-art approaches.


title: A Collision-Free MPC for Whole-Body Dynamic Locomotion and Manipulation

abstract: In this paper, we present a real-time whole-body planner for collision-free legged mobile manipulation. We enforce both self-collision and environment-collision avoidance as soft constraints within a Model Predictive Control (MPC) scheme that solves a multi-contact optimal control problem. By penalizing the signed distances among a set of representative primitive collision bodies, the robot is able to safely execute a variety of dynamic maneuvers while preventing any self-collisions. Moreover, collision-free navigation and manipulation in both static and dynamic environments are made viable through efficient queries of distances and their gradients via a euclidean signed distance field. We demonstrate through a comparative study that our approach only slightly increases the computational complexity of the MPC planning. Finally, we validate the effectiveness of our framework through a set of hardware experiments involving dynamic mobile manipulation tasks with potential collisions, such as locomotion balancing with the swinging arm, weight throwing, and autonomous door opening.


title: Limits and exponentiable functors in simplicial homotopy type theory

abstract: We develop the theory of limits and colimits in $\infty$-categories within the synthetic framework of simplicial homotopy type theory developed by Riehl and Shulman. We also show that in this setting, the limit of a family of spaces can be computed as a dependant product. Additionally, we develop a synthetic version of Conduch\'e fibrations.


title: Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance

abstract: In this paper, we study contrastive learning from an optimization perspective, aiming to analyze and address a fundamental issue of existing contrastive learning methods that either rely on a large batch size or a large dictionary of feature vectors. We consider a global objective for contrastive learning, which contrasts each positive pair with all negative pairs for an anchor point. From the optimization perspective, we explain why existing methods such as SimCLR require a large batch size in order to achieve a satisfactory result. In order to remove such requirement, we propose a memory-efficient Stochastic Optimization algorithm for solving the Global objective of Contrastive Learning of Representations, named SogCLR. We show that its optimization error is negligible under a reasonable condition after a sufficient number of iterations or is diminishing for a slightly different global contrastive objective. Empirically, we demonstrate that SogCLR with small batch size (e.g., 256) can achieve similar performance as SimCLR with large batch size (e.g., 8192) on self-supervised learning task on ImageNet-1K. We also attempt to show that the proposed optimization technique is generic and can be applied to solving other contrastive losses, e.g., two-way contrastive losses for bimodal contrastive learning. The proposed method is implemented in our open-sourced library LibAUC (www.libauc.org).


title: Kibble-Zurek Mechanism for Nonequilibrium Phase Transitions in Driven Systems with Quenched Disorder

abstract: We numerically study the density of topological defects for a two-dimensional assembly of particles driven over quenched disorder as a function of quench rate through the nonequilibrium phase transition from a plastic disordered flowing state to a moving anisotropic crystal. A dynamical ordering transition of this type occurs for vortices in type-II superconductors, colloids, and other particle-like systems in the presence of random disorder. We find that on the ordered side of the transition, the density of topological defects $\rho_d$ scales as a power law, $\rho_d \propto 1/t_{q}^\beta$, where $t_{q}$ is the time duration of the quench across the transition. This type of scaling is predicted in the Kibble-Zurek mechanism for varied quench rates across a continuous phase transition. We show that scaling with the same exponent holds for varied strengths of quenched disorder. The value of the exponent can be connected to the directed percolation universality class. Our results suggest that the Kibble-Zurek mechanism can be applied to general nonequilibrium phase transitions.


title: Direct evidence of magnetic reconnection onset via the tearing instability

abstract: Magnetic reconnection is a sporadic process responsible for energy release in space and laboratory plasmas. It is believed that the tearing mode instability may be responsible for the onset of reconnection in the magnetotail. However, due to its elusive nature, there is an absence of in-situ observations of the tearing instability prior to magnetic reconnection in our nearest natural plasma laboratory. Using neural network outlier detection methods in conjunction with Cluster spacecraft data, we find unique electron pitch angle distributions that are consistent with simulation predictions of the tearing instability and the subsequent evolution of plasma electrons and reconnection. We confirm that the events identified via our neural network outlier method are well above the tearing stability threshold based on the criterion detailed in this paper. We find signatures of magnetic reconnection minutes after the majority of tearing observations. Our analysis of the tearing instability provides new insights into the fundamental understanding of the mechanism responsible for reconnection, a process that is ubiquitous in different astrophysical plasma regimes across the universe and in laboratory experiments on Earth.


title: Scales and Locomotion: Non-Reversible Longitudinal Drag

abstract: Locomotion requires that an animal or robot be able to move itself forward farther than it moves backward in each gait cycle (formally, that it be able to break the symmetry of its interactions with the world). Previous work has established that a difference between lateral and longitudinal drag provides sufficient conditions for locomotion to be possible. The geometric mechanics community has used this principle to build a geometric framework for describing the effectiveness and efficiency of undulatory locomotion. Researchers in biology and robotics have observed that structures such as snake scales additionally provide a difference between forward and backward longitudinal drag. As yet, however, the impact of scales on the geometric features relevant to locomotion effectiveness and efficiency have not yet been explored. We present a geometric model for a single-joint undulating system with scales and identify the features needed to understand its motion. Mathematically, the scales can be treated as inducing a "Finsler metric" on the configuration space, and this paper lays the groundwork for further research into application of such Finsler metrics to robotic locomotion.


title: HeRo 2.0: A Low-Cost Robot for Swarm Robotics Research

abstract: The current state of electronic component miniaturization coupled with the increasing efficiency in hardware and software allow the development of smaller and compact robotic systems. The convenience of using these small, simple, yet capable robots has gathered the research community's attention towards practical applications of swarm robotics. This paper presents the design of a novel platform for swarm robotics applications that is low cost, easy to assemble using off-the-shelf components, and deeply integrated with the most used robotic framework available today: ROS (Robot Operating System). The robotic platform is entirely open, composed of a 3D printed body and open-source software. We describe its architecture, present its main features, and evaluate its functionalities executing experiments using a couple of robots. Results demonstrate that the proposed mobile robot is very effective given its small size and reduced cost, being suitable for swarm robotics research and education.


title: Radiopurity studies of a rock sample from the Aut region

abstract: Efforts are underway to set up an underground laboratory in India for rare event studies like double beta decay, dark matter, etc. For such experiments, mitigation of radiation background is of paramount importance and understanding ambient background at the site, originating from the rock, is one of the crucial factors. With this motivation, the radiopurity studies of a rock sample from the potential laboratory site in the Aut tunnel of Himachal Pradesh (India) have been carried out using the TIFR low background experimental setup (TiLES). The concentration of $^{40}$K in Aut rock is observed to be lower by a factor of ~1000 as compared to the samples from BWH (Bodi West Hill), Tamil Nadu (India), current designated site for India-based Neutrino Observatory. The natural radioactive trace impurity $^{232}$Th is lower in the Aut rock, while $^{238}$U is somewhat higher than the BWH rock. Overall, the ambient gamma ray background at Aut is expected to be lower than the BWH, while ambient neutron background is expected to be similar. Further, to assess the neutron-induced long lived activity, fast neutron activation studies have been carried out on the both Aut and BWH rock samples at the Pelletron Linac Facility, Mumbai.


title: Imaging Scatterometer for Observing Changes to Optical Coatings During Air Annealing

abstract: Air annealing generally reduces absorption, scattering, and mechanical loss in amorphous coatings up to temperatures where damage occurs. Our instrument uses an industrial oven with viewports to observe coating scatter and damage during annealing.


title: Evaluation of the Gauss integral

abstract: The normal or Gaussian distribution plays a prominent role in almost all fields of science. However, it is well known that the Gauss (or Euler--Poisson) integral over a finite boundary, as it is necessary for instance for the error function or the cumulative distribution of the normal distribution, cannot be expressed by analytic functions. This is proven by the Risch algorithm. Still, there are proposals for approximate solutions. In this paper, we give a new solution in terms of normal distributions by applying a geometric procedure iteratively to the problem.


title: Design and Characterization of 3D Printed, Open-Source Actuators for Legged Locomotion

abstract: Impressive animal locomotion capabilities are mediated by the co-evolution of the skeletal morphology and muscular properties. Legged robot performance would also likely benefit from the co-optimization of actuators and leg morphology. However, development of custom actuators for legged robots is often expensive and time consuming, which discourages roboticists from pursuing performance gains afforded by application-specific actuator optimization. This paper presents open-source designs for two quasi-direct-drive actuators with performance regimes appropriate for an 8--15 kg robot, built completely with off the shelf and 3D-printed components for less than $200 USD each. The mechanical, electrical, and thermal properties of each actuator are characterized and compared to benchmark data. Actuators subjected to 420k strides of gait data experienced only a 2% reduction in efficiency and 26 mrad in backlash growth, demonstrating viability for rigorous and sustained research applications. We present a thermal solution that nearly doubles the thermally-driven torque limits of our plastic actuator design. The performance results are comparable to traditional metallic actuators for use in high-speed legged robots of the same scale. These 3D printed designs demonstrate an approach for designing and characterizing low-cost, highly customizable, and highly reproducible actuators, democratizing the field of actuator design and enabling co-design and optimization of actuators and robot legs.


title: Finite-Sum Coupled Compositional Stochastic Optimization: Theory and Applications

abstract: This paper studies stochastic optimization for a sum of compositional functions, where the inner-level function of each summand is coupled with the corresponding summation index. We refer to this family of problems as finite-sum coupled compositional optimization (FCCO). It has broad applications in machine learning for optimizing non-convex or convex compositional measures/objectives such as average precision (AP), p-norm push, listwise ranking losses, neighborhood component analysis (NCA), deep survival analysis, deep latent variable models, etc., which deserves finer analysis. Yet, existing algorithms and analyses are restricted in one or other aspects. The contribution of this paper is to provide a comprehensive convergence analysis of a simple stochastic algorithm for both non-convex and convex objectives. Our key result is the improved oracle complexity with the parallel speed-up by using the moving-average based estimator with mini-batching. Our theoretical analysis also exhibits new insights for improving the practical implementation by sampling the batches of equal size for the outer and inner levels. Numerical experiments on AP maximization, NCA, and p-norm push corroborate some aspects of the theory.


title: Time Complexity of Consensus in Dynamic Networks Under Oblivious Message Adversaries

abstract: Consensus is a most fundamental task in distributed computing. This paper studies the consensus problem for a set of processes connected by a dynamic directed network, in which computation and communication is lock-step synchronous but controlled by an oblivious message adversary. In this basic model, determining consensus solvability and designing consensus algorithms in the case where it is possible, has been shown to be surprisingly difficult. We present an explicit decision procedure to determine if consensus is possible under a given adversary. This in turn enables us, for the first time, to study the time complexity of consensus in this model. In particular, we derive time complexity upper bounds for consensus solvability both for a centralized decision procedure as well as for solving distributed consensus. We complement these results with time complexity lower bounds. Intriguingly, we find that reaching consensus under an oblivious message adversary can take exponentially longer than broadcasting the input value of some process to all other processes.


title: Non-linear Hopf manifolds are locally conformally Kahler

abstract: A Hopf manifold is a quotient of $C^n\backslash 0$ by the cyclic group generated by a holomorphic contraction. Hopf manifolds are diffeomorphic to $S^1\times S^{2n-1}$ and hence do not admit Kahler metrics. It is known that Hopf manifolds defined by linear contractions (called linear Hopf manifolds) have locally conformally Kahler (LCK) metrics. In this paper we prove that the Hopf manifolds defined by non-linear holomorphic contractions admit holomorphic embeddings into linear Hopf manifolds, and, moreover they admit LCK metrics.


title: Data-Driven Safety Verification for Legged Robots

abstract: Planning safe motions for legged robots requires sophisticated safety verification tools. However, designing such tools for such complex systems is challenging due to the nonlinear and high-dimensional nature of these systems' dynamics. In this letter, we present a probabilistic verification framework for legged systems, which evaluates the safety of planned trajectories by learning an assessment function from trajectories collected from a closed-loop system. Our approach does not require an analytic expression of the closed-loop dynamics, thus enabling safety verification of systems with complex models and controllers. Our framework consists of an offline stage that initializes a safety assessment function by simulating a nominal model and an online stage that adapts the function to address the sim-to-real gap. The performance of the proposed approach for safety verification is demonstrated using a quadruped balancing task and a humanoid reaching task. The results demonstrate that our framework accurately predicts the systems' safety both at the planning phase to generate robust trajectories and at execution phase to detect unexpected external disturbances.


title: The rise of the lottery heroes: why zero-shot pruning is hard

abstract: Recent advances in deep learning optimization showed that just a subset of parameters are really necessary to successfully train a model. Potentially, such a discovery has broad impact from the theory to application; however, it is known that finding these trainable sub-network is a typically costly process. This inhibits practical applications: can the learned sub-graph structures in deep learning models be found at training time? In this work we explore such a possibility, observing and motivating why common approaches typically fail in the extreme scenarios of interest, and proposing an approach which potentially enables training with reduced computational effort. The experiments on either challenging architectures and datasets suggest the algorithmic accessibility over such a computational gain, and in particular a trade-off between accuracy achieved and training complexity deployed emerges.


title: A deterministic algorithm for finding $r$-power divisors

abstract: Building on work of Boneh, Durfee and Howgrave-Graham, we present a deterministic algorithm that provably finds all integers $p$ such that $p^r \mathrel| N$ in time $O(N^{1/4r+\epsilon})$ for any $\epsilon > 0$. For example, the algorithm can be used to test squarefreeness of $N$ in time $O(N^{1/8+\epsilon})$; previously, the best rigorous bound for this problem was $O(N^{1/6+\epsilon})$, achieved via the Pollard--Strassen method.


title: Near-exact treatment of seniority-zero ground and excited states with a Richardson-Gaudin mean-field

abstract: Eigenvectors of the reduced Bardeen-Cooper-Schrieffer Hamiltonian, Richardson-Gaudin (RG) states, are used as a variational wavefunction Ansatz for strongly-correlated electronic systems. These states are geminal products whose coefficients are solutions of non-linear equations. Previous results showed un-physical behaviour but in this contribution it is shown that with only the variational solution for the ground state, all the seniority-zero states are quite well approximated. The difficulty is in choosing the correct RG state. The systems studied showed a clear choice and we expect it should always be possible to reason physically which state to choose.


title: Learning Transferable Reward for Query Object Localization with Policy Adaptation

abstract: We propose a reinforcement learning based approach to query object localization, for which an agent is trained to localize objects of interest specified by a small exemplary set. We learn a transferable reward signal formulated using the exemplary set by ordinal metric learning. Our proposed method enables test-time policy adaptation to new environments where the reward signals are not readily available, and outperforms fine-tuning approaches that are limited to annotated images. In addition, the transferable reward allows repurposing the trained agent from one specific class to another class. Experiments on corrupted MNIST, CU-Birds, and COCO datasets demonstrate the effectiveness of our approach.


title: Exploiting Problem Structure in Deep Declarative Networks: Two Case Studies

abstract: Deep declarative networks and other recent related works have shown how to differentiate the solution map of a (continuous) parametrized optimization problem, opening up the possibility of embedding mathematical optimization problems into end-to-end learnable models. These differentiability results can lead to significant memory savings by providing an expression for computing the derivative without needing to unroll the steps of the forward-pass optimization procedure during the backward pass. However, the results typically require inverting a large Hessian matrix, which is computationally expensive when implemented naively. In this work we study two applications of deep declarative networks -- robust vector pooling and optimal transport -- and show how problem structure can be exploited to obtain very efficient backward pass computations in terms of both time and memory. Our ideas can be used as a guide for improving the computational performance of other novel deep declarative nodes.


title: Can autonomy make bicycle-sharing systems more sustainable? Environmental impact analysis of an emerging mobility technology

abstract: Autonomous bicycles have recently been proposed as a new and more efficient approach to bicycle-sharing systems (BSS), but the corresponding environmental implications remain unresearched. Conducting environmental impact assessments at an early technological stage is critical to influencing the design and, ultimately, environmental impacts of a system. Consequently, this paper aims to assess the environmental impact of autonomous shared bikes compared with current station-based and dockless systems under different sets of modeling hypotheses and mode-shift scenarios. The results indicate that autonomy could reduce the environmental impact per passenger kilometer traveled of current station-based and dockless BSS by 33.1 % and 58.0 %. The sensitivity analysis shows that the environmental impact of autonomous shared bicycles will mainly depend on vehicle usage rates and the need for infrastructure. Finally, this study highlights the importance of targeting the mode replacement from more polluting modes, especially as traditional mobility modes decarbonize and become more efficient.


title: Cardiac Reentry Modeled by Spatiotemporal Chaos in a Coupled Map Lattice

abstract: Arrhythmias are potentially fatal disruptions to the normal heart rhythm, but their underlying dynamics is still poorly understood. Theoretical modeling is an important tool to fill this gap. Typical studies often employ detailed multidimensional conductance-based models. We describe the cardiac muscle with a three-dimensional map-based membrane potential model in lattices. Although maps retain the biophysical behavior of cells and generate computationally efficient tissue models, few studies have used them to understand cardiac dynamics. Our study captures healthy and pathological behaviors with fewer parameters and simpler equations than conductance models. We successfully generalize results obtained previously with reaction-diffusion systems, showing how chaotic properties result in reentry, a pathological propagation of stimuli that evolves to arrhythmias with complex spatiotemporal features. The bifurcation diagram of the single cell is very similar to that obtained in a detailed conductance-based model. We find torsade de pointes, a clinical manifestation of some types of tachycardia in the electrocardiogram, using a generic sampling of the whole network during spiral waves. We also find a novel type of dynamical pattern, with wavefronts composed of synchronized cardiac plateaus and bursts. Our study provides the first in-depth look at the use of map-based models to simulate complex cardiac dynamics.


title: Gaussian Belief Trees for Chance Constrained Asymptotically Optimal Motion Planning

abstract: In this paper, we address the problem of sampling-based motion planning under motion and measurement uncertainty with probabilistic guarantees. We generalize traditional sampling-based tree-based motion planning algorithms for deterministic systems and propose belief-$\mathcal{A}$, a framework that extends any kinodynamical tree-based planner to the belief space for linear (or linearizable) systems. We introduce appropriate sampling techniques and distance metrics for the belief space that preserve the probabilistic completeness and asymptotic optimality properties of the underlying planner. We demonstrate the efficacy of our approach for finding safe low-cost paths efficiently and asymptotically optimally in simulation, for both holonomic and non-holonomic systems.


title: Quantum Error Correction Scheme for Fully Correlated Noise

abstract: This paper investigates quantum error correction schemes for fully-correlated noise channels on an $n$-qubit system, where error operators take the form $W^{\otimes n}$, with $W$ being an arbitrary $2\times 2$ unitary operator. In previous literature, a recursive quantum error correction scheme can be used to protect $k$ qubits using $(k+1)$-qubit ancilla. We implement this scheme on 3-qubit and 5-qubit channels using the IBM quantum computers, where we uncover an error in the previous paper related to the decomposition of the encoding/decoding operator into elementary quantum gates. Here, we present a modified encoding/decoding operator that can be efficiently decomposed into (a) standard gates available in the \texttt{qiskit} library and (b) basic gates comprised of single-qubit gates and CNOT gates. Since IBM quantum computers perform relatively better with fewer basic gates, a more efficient decomposition gives more accurate results. Our experiments highlight the importance of an efficient decomposition for the encoding/decoding operators and demonstrate the effectiveness of our proposed schemes in correcting quantum errors. Furthermore, we explore a special type of channel with error operators of the form $\sigma_x^{\otimes n}, \sigma_y^{\otimes n}$ and $\sigma_z^{\otimes n}$, where $\sigma_x, \sigma_y, \sigma_z$ are the Pauli matrices. For these channels, we implement a hybrid quantum error correction scheme that protects both quantum and classical information using IBM's quantum computers. We conduct experiments for $n = 3, 4, 5$ and show significant improvements compared to recent work.


title: Internet of Nano, Bio-Nano, Biodegradable and Ingestible Things: A Survey

abstract: In recent years, advances in biotechnology, nanotechnology and materials science have led to development of revolutionizing applications in Internet of Things (IoT). In particular, the interconnection of nanomaterials, nanoimplants and nanobiosensors with existing IoT networks have inspired the concepts of Internet of Nano Things (IoNT), Internet of Bio-Nano Things (IoBNT), Internet of Biodegradable Things (IoBDT) and Internet of Ingestible Things (IoIT). To date, although there are several survey papers that addressed these concepts separately, there is no current survey covering all studies in IoNT, IoBNT, IoBDT and IoIT. Therefore, in this paper, we provide a complete overview of all recent work in these four areas. Furthermore, we emphasize the research challenges, potential applications, and open research areas.


title: The fundamental equations for inversion of operator pencils on Banach space

abstract: We prove that the resolvent of a linear operator pencil is analytic on an open annulus if and only if the coefficients of the Laurent series satisfy a system of fundamental equations and are geometrically bounded. Our analysis extends earlier work on the fundamental equations to include the case where the resolvent has an isolated essential singularity. We find a closed form for the resolvent and use the fundamental equations to establish key spectral separation properties when the resolvent has only a finite number of isolated singularities. Finally we show that our results can also be applied to polynomial pencils.


title: TrimBERT: Tailoring BERT for Trade-offs

abstract: Models based on BERT have been extremely successful in solving a variety of natural language processing (NLP) tasks. Unfortunately, many of these large models require a great deal of computational resources and/or time for pre-training and fine-tuning which limits wider adoptability. While self-attention layers have been well-studied, a strong justification for inclusion of the intermediate layers which follow them remains missing in the literature. In this work, we show that reducing the number of intermediate layers in BERT-Base results in minimal fine-tuning accuracy loss of downstream tasks while significantly decreasing model size and training time. We further mitigate two key bottlenecks, by replacing all softmax operations in the self-attention layers with a computationally simpler alternative and removing half of all layernorm operations. This further decreases the training time while maintaining a high level of fine-tuning accuracy.


title: Fourier-Based Augmentations for Improved Robustness and Uncertainty Calibration

abstract: Diverse data augmentation strategies are a natural approach to improving robustness in computer vision models against unforeseen shifts in data distribution. However, the ability to tailor such strategies to inoculate a model against specific classes of corruptions or attacks -- without incurring substantial losses in robustness against other classes of corruptions -- remains elusive. In this work, we successfully harden a model against Fourier-based attacks, while producing superior-to-AugMix accuracy and calibration results on both the CIFAR-10-C and CIFAR-100-C datasets; classification error is reduced by over ten percentage points for some high-severity noise and digital-type corruptions. We achieve this by incorporating Fourier-basis perturbations in the AugMix image-augmentation framework. Thus we demonstrate that the AugMix framework can be tailored to effectively target particular distribution shifts, while boosting overall model robustness.


title: Construction of Large-Scale Misinformation Labeled Datasets from Social Media Discourse using Label Refinement

abstract: Malicious accounts spreading misinformation has led to widespread false and misleading narratives in recent times, especially during the COVID-19 pandemic, and social media platforms struggle to eliminate these contents rapidly. This is because adapting to new domains requires human intensive fact-checking that is slow and difficult to scale. To address this challenge, we propose to leverage news-source credibility labels as weak labels for social media posts and propose model-guided refinement of labels to construct large-scale, diverse misinformation labeled datasets in new domains. The weak labels can be inaccurate at the article or social media post level where the stance of the user does not align with the news source or article credibility. We propose a framework to use a detection model self-trained on the initial weak labels with uncertainty sampling based on entropy in predictions of the model to identify potentially inaccurate labels and correct for them using self-supervision or relabeling. The framework will incorporate social context of the post in terms of the community of its associated user for surfacing inaccurate labels towards building a large-scale dataset with minimum human effort. To provide labeled datasets with distinction of misleading narratives where information might be missing significant context or has inaccurate ancillary details, the proposed framework will use the few labeled samples as class prototypes to separate high confidence samples into false, unproven, mixture, mostly false, mostly true, true, and debunk information. The approach is demonstrated for providing a large-scale misinformation dataset on COVID-19 vaccines.


title: Detecting change-points in noisy GPS time series with continuous piecewise structures

abstract: Detecting change-points in noisy data sequences with an underlying continuous piecewise structure is a challenging problem, especially when prior knowledge of the exact nature of the structural changes is unknown. One important application is the automatic detection of slow slip events (SSEs), a type of slow earthquakes, in GPS measurements of ground deformation. We propose a new method based on Singular Spectrum Analysis to obscure the deviation from the piecewise-linear structure, allowing us to apply Isolate-Detect to detect change-points in SSE data with piecewise-non-linear structures. We demonstrate its effectiveness in both simulated and real SSE data.


title: All analytic solutions for geodesic motion in axially symmetric space-times

abstract: Recent observations of the orbits of star clusters around Sgr $A^\star$, imaging of black holes and gravitational waveforms of merging compact objects require a detailed understanding of the general relativistic geodesic motion. We came up with a method to provide all the possible geodesics in an axially symmetric space-time. The Kerr metric is explicitly worked out, recovering the Schwarzschild geodesics in the static limit. We also found the most general Killing tensor and its associated constant of motion for an axisymmetric space-time. The relevance of these results is crucial to understanding the different scenarios and the fundamental nature of the compact object at the galactic center.


title: Microgrid Optimal Energy Scheduling Considering Neural Network based Battery Degradation

abstract: Battery energy storage system (BESS) can effec-tively mitigate the uncertainty of variable renewable generation. Degradation is unpreventable and hard to model and predict for batteries such as the most popular Lithium-ion battery (LiB). In this paper, we propose a data driven method to predict the bat-tery degradation per a given scheduled battery operational pro-file. Particularly, a neural network based battery degradation (NNBD) model is proposed to quantify the battery degradation with inputs of major battery degradation factors. When incorpo-rating the proposed NNBD model into microgrid day-ahead scheduling (MDS), we can establish a battery degradation based MDS (BDMDS) model that can consider the equivalent battery degradation cost precisely with the proposed cycle based battery usage processing (CBUP) method for the NNBD model. Since the proposed NNBD model is highly non-linear and non-convex, BDMDS would be very hard to solve. To address this issue, a neural network and optimization decoupled heuristic (NNODH) algorithm is proposed in this paper to effectively solve this neural network embedded optimization problem. Simulation results demonstrate that the proposed NNODH algorithm is able to ob-tain the optimal solution with lowest total cost including normal operation cost and battery degradation cost.


title: Optimal channel selection with discrete QCQP

abstract: Reducing the high computational cost of large convolutional neural networks is crucial when deploying the networks to resource-constrained environments. We first show the greedy approach of recent channel pruning methods ignores the inherent quadratic coupling between channels in the neighboring layers and cannot safely remove inactive weights during the pruning procedure. Furthermore, due to these inactive weights, the greedy methods cannot guarantee to satisfy the given resource constraints and deviate with the true objective. In this regard, we propose a novel channel selection method that optimally selects channels via discrete QCQP, which provably prevents any inactive weights and guarantees to meet the resource constraints tightly in terms of FLOPs, memory usage, and network size. We also propose a quadratic model that accurately estimates the actual inference time of the pruned network, which allows us to adopt inference time as a resource constraint option. Furthermore, we generalize our method to extend the selection granularity beyond channels and handle non-sequential connections. Our experiments on CIFAR-10 and ImageNet show our proposed pruning method outperforms other fixed-importance channel pruning methods on various network architectures.


title: On the role of the point at infinity in Deny's principle of positivity of mass for Riesz potentials

abstract: First introduced by J. Deny, the classical principle of positivity of mass states that if $\kappa_\alpha\mu\leqslant\kappa_\alpha\nu$ everywhere on $\mathbb{R}^n$, then $\mu(\mathbb{R}^n)\leqslant\nu(\mathbb{R}^n)$. Here $\mu,\nu$ are positive Radon measures on $\mathbb{R}^n$, $n\geqslant2$, and $\kappa_\alpha\mu$ is the potential of $\mu$ with respect to the Riesz kernel $|x-y|^{\alpha-n}$ of order $\alpha\in(0,2]$, $\alpha<n$. We strengthen Deny's principle by showing that $\mu(\mathbb{R}^n)\leqslant\nu(\mathbb{R}^n)$ still holds even if $\kappa_\alpha\mu\leqslant\kappa_\alpha\nu$ is fulfilled only on a proper subset $A$ of $\mathbb{R}^n$ that is not inner $\alpha$-thin at infinity; and moreover, this condition on $A$ cannot in general be improved. Hence, if $\xi$ is a signed measure on $\mathbb{R}^n$ with $\int1\,d\xi>0$, then $\kappa_\alpha\xi>0$ everywhere on $\mathbb{R}^n$, except for a subset which is inner $\alpha$-thin at infinity. The analysis performed is based on the author's recent theories of inner Riesz balayage and inner Riesz equilibrium measures (Potential Anal., 2022), the inner equilibrium measure being understood in an extended sense where both the energy and the total mass may be infinite.


title: KinoJGM: A framework for efficient and accurate quadrotor trajectory generation and tracking in dynamic environments

abstract: Unmapped areas and aerodynamic disturbances render autonomous navigation with quadrotors extremely challenging. To fly safely and efficiently, trajectory planners and trackers must be able to navigate unknown environments with unpredictable aerodynamic effects in real-time. When encountering aerodynamic effects such as strong winds, most current approaches to quadrotor trajectory planning and tracking will not attempt to deviate from a determined plan, even if it is risky, in the hope that any aerodynamic disturbances can be resisted by a robust controller. This paper presents a novel systematic trajectory planning and tracking framework for autonomous quadrotors. We propose a Kinodynamic Jump Space Search (Kino-JSS) to generate a safe and efficient route in unknown environments with aerodynamic disturbances. A real-time Gaussian Process is employed to model the effects of aerodynamic disturbances, which we then integrate with a Model Predictive Controller to achieve efficient and accurate trajectory optimization and tracking. We demonstrate our system to improve the efficiency of trajectory generation in unknown environments by up to 75\% in the cases tested, compared with recent state-of-the-art. We also demonstrate that our system improves the accuracy of tracking in selected environments with unpredictable aerodynamic effects.


title: A sensitivity analysis approach for the causal hazard ratio in randomized and observational studies

abstract: The Hazard Ratio (HR) is often reported as the main causal effect when studying survival data. Despite its popularity, the HR suffers from an unclear causal interpretation. As already pointed out in the literature, there is a built-in selection bias in the HR, because similarly to the truncation by death problem, the HR conditions on post-treatment survival. A recently proposed alternative, inspired by the Survivor Average Causal Effect (SACE), is the causal HR, defined as the ratio between hazards across treatment groups among the study participants that would have survived regardless of their treatment assignment. We discuss the challenge in identifying the causal HR and present a sensitivity analysis identification approach in randomized controlled trials utilizing a working frailty model. We further extend our framework to adjust for potential confounders using inverse probability of treatment weighting. We present a Cox-based and a flexible non-parametric kernel-based estimation under right censoring. We study the finite-sample properties of the proposed estimation method through simulations. We illustrate the utility of our framework using two real-data examples.


title: History of Solar Neutrino Observations

abstract: The first solar neutrino experiment led by Raymond Davis Jr. showed a deficit of neutrinos relative to the solar model prediction, referred to as the "solar neutrino problem" since the 1970s. The Kamiokande experiment led by Masatoshi Koshiba successfully observed solar neutrinos, as first reported in 1989. The observed flux of solar neutrinos was almost half the prediction and confirmed the solar neutrino problem. This problem was not resolved for some time due to possible uncertainties in the solar model. In 2001, it was discovered that the solar neutrino problem is due to neutrino oscillations by comparing the Super-Kamiokande and Sudbury Neutrino Observatory results, which was the first model-independent comparison. Detailed studies of solar neutrino oscillations have since been performed, and the results of solar neutrino experiments are consistent with solar model predictions when the effect of neutrino oscillations are taken into account. In this article, the history of solar neutrino observations is reviewed with the contributions of Kamiokande and Super-Kamiokande detailed.

categories: hep-ex astro-ph.HE astro-ph.SR hep-ph physics.hist-ph


title: Standard Deviation-Based Quantization for Deep Neural Networks

abstract: Quantization of deep neural networks is a promising approach that reduces the inference cost, making it feasible to run deep networks on resource-restricted devices. Inspired by existing methods, we propose a new framework to learn the quantization intervals (discrete values) using the knowledge of the network's weight and activation distributions, i.e., standard deviation. Furthermore, we propose a novel base-2 logarithmic quantization scheme to quantize weights to power-of-two discrete values. Our proposed scheme allows us to replace resource-hungry high-precision multipliers with simple shift-add operations. According to our evaluations, our method outperforms existing work on CIFAR10 and ImageNet datasets and even achieves better accuracy performance with 3-bit weights and activations when compared to the full-precision models. Moreover, our scheme simultaneously prunes the network's parameters and allows us to flexibly adjust the pruning ratio during the quantization process.


title: Applying Polynomial Decoupling Methods to the Polynomial NARX Model

abstract: System identification uses measurements of a dynamic system's input and output to reconstruct a mathematical model for that system. These can be mechanical, electrical, physiological, among others. Since most of the systems around us exhibit some form of nonlinear behavior, nonlinear system identification techniques are the tools that will help us gain a better understanding of our surroundings and potentially let us improve their performance. One model that is often used to represent nonlinear systems is the polynomial NARX model, an equation error model where the output is a polynomial function of the past inputs and outputs. That said, a major disadvantage with the polynomial NARX model is that the number of parameters increases rapidly with increasing polynomial order. Furthermore, the polynomial NARX model is a black-box model, and is therefore difficult to interpret. This paper discusses a decoupling algorithm for the polynomial NARX model that substitutes the multivariate polynomial with a transformation matrix followed by a bank of univariate polynomials. This decreases the number of model parameters significantly and also imposes structure on the black-box NARX model. Since a non-convex optimization is required for this identification technique, initialization is an important factor to consider. In this paper the decoupling algorithm is developed in conjunction with several different initialization techniques. The resulting algorithms are applied to two nonlinear benchmark problems: measurement data from the Silver-Box and simulation data from the Bouc-Wen friction model, and the performance is evaluated for different validation signals in both simulation and prediction.


title: Four-point functions with multi-cycle fields in symmetric orbifolds and the D1-D5 CFT

abstract: We study $S_N$-invariant four-point functions with two generic multi-cycle fields and two twist-2 fields, at the free orbifold point of the D1-D5 CFT. We derive the explicit factorization of these functions following from the action of the symmetric group on the composite multi-cycle fields. Apart from non-trivial symmetry factors that we compute, the function with multi-cycle operators is reduced to a sum of connected correlators in which the composite fields have, at most, two cycles. The correlators with two double-cycle and two single-cycle fields give the leading order contribution in the large-$N$ limit. We derive explicit formulas for these functions, encompassing a large class of choices for the single- and the double-cycle fields, including generic Ramond ground states, NS chiral fields and the marginal deformation operator. We are thus able to extract important dynamical information from the short-distance OPEs: conformal dimensions, R-charges and structure constants of families of BPS and non-BPS fields present in the corresponding light-light and heavy-light channels. We also discuss properties of generic multi-cycle $Q$-point functions in $M^N/S_N$ orbifolds, using a technology due to Pakman, Rastelli and Razamat.


title: Mathematical structures of cohomological field theories

abstract: A mathematical framework of cohomological field theories (CohFTs) is formulated in the language of bigraded manifolds. Algebraic properties of operators in CohFTs are studied. Methods of constructing CohFTs, with or without gauge symmetries, are discussed. In particular, a generalization of the Mathai-Quillen formalism is given. Examples such as topological quantum mechanics, topological sigma model, topological M-theory, and topological Yang-Mills theory can be obtained uniformly using this new formalism.


title: Analyzing Human Observer Ability in Morphing Attack Detection -- Where Do We Stand?

abstract: Few studies have focused on examining how people recognize morphing attacks, even as several publications have examined the susceptibility of automated FRS and offered morphing attack detection (MAD) approaches. MAD approaches base their decisions either on a single image with no reference to compare against (S-MAD) or using a reference image (D-MAD). One prevalent misconception is that an examiner's or observer's capacity for facial morph detection depends on their subject expertise, experience, and familiarity with the issue and that no works have reported the specific results of observers who regularly verify identity (ID) documents for their jobs. As human observers are involved in checking the ID documents having facial images, a lapse in their competence can have significant societal challenges. To assess the observers' proficiency, this work first builds a new benchmark database of realistic morphing attacks from 48 different subjects, resulting in 400 morphed images. We also capture images from Automated Border Control (ABC) gates to mimic the realistic border-crossing scenarios in the D-MAD setting with 400 probe images to study the ability of human observers to detect morphed images. A new dataset of 180 morphing images is also produced to research human capacity in the S-MAD environment. In addition to creating a new evaluation platform to conduct S-MAD and D-MAD analysis, the study employs 469 observers for D-MAD and 410 observers for S-MAD who are primarily governmental employees from more than 40 countries, along with 103 subjects who are not examiners. The analysis offers intriguing insights and highlights the lack of expertise and failure to recognize a sizable number of morphing attacks by experts. The results of this study are intended to aid in the development of training programs to prevent security failures while determining whether an image is bona fide or altered.


title: Efficient Video Segmentation Models with Per-frame Inference

abstract: Most existing real-time deep models trained with each frame independently may produce inconsistent results across the temporal axis when tested on a video sequence. A few methods take the correlations in the video sequence into account,e.g., by propagating the results to the neighboring frames using optical flow or extracting frame representations using multi-frame information, which may lead to inaccurate results or unbalanced latency. In this work, we focus on improving the temporal consistency without introducing computation overhead in inference. To this end, we perform inference at each frame. Temporal consistency is achieved by learning from video frames with extra constraints during the training phase. introduced for inference. We propose several techniques to learn from the video sequence, including a temporal consistency loss and online/offline knowledge distillation methods. On the task of semantic video segmentation, weighing among accuracy, temporal smoothness, and efficiency, our proposed method outperforms keyframe-based methods and a few baseline methods that are trained with each frame independently, on datasets including Cityscapes, Camvid, and 300VW-Mask. We further apply our training method to video instance segmentation on YouTubeVISand develop an application of portrait matting in video sequences, by segmenting temporally consistent instance-level trimaps across frames. Experiments show superior qualitative and quantitative results. Code is available at: https://git.io/vidseg.


title: A Straight Lightning Bolt?! Observation of a Predicted Macro Dark Matter Signature

abstract: Recently, four remarkably straight very brief flashes of light were captured on video in Perth, Australia within 0.5s of one another. Straight lightning was recently identified as a prediction of macroscopic dark matter (macros) -- a broad class of alternative candidates to particle dark matter. A sufficiently large macro passing through the atmosphere producing a straight column ofplasma would produce fluorescence, or, under atmospheric conditions conducive to lightning, seeda very straight lightning strike visible to the naked eye. Other explanations are considered, but areproblematic.


title: BagPipe: Accelerating Deep Recommendation Model Training

abstract: Deep learning based recommendation models (DLRM) are widely used in several business critical applications. Training such recommendation models efficiently is challenging because they contain billions of embedding-based parameters, leading to significant overheads from embedding access. By profiling existing systems for DLRM training, we observe that around 75\% of the iteration time is spent on embedding access and model synchronization. Our key insight in this paper is that embedding access has a specific structure which can be used to accelerate training. We observe that embedding accesses are heavily skewed, with around 1\% of embeddings representing more than 92\% of total accesses. Further, we observe that during offline training we can lookahead at future batches to determine exactly which embeddings will be needed at what iteration in the future. Based on these insights, we develop Bagpipe, a system for training deep recommendation models that uses caching and prefetching to overlap remote embedding accesses with the computation. We design an Oracle Cacher, a new component that uses a lookahead algorithm to generate optimal cache update decisions while providing strong consistency guarantees against staleness. We also design a logically replicated, physically partitioned cache and show that our design can reduce synchronization overheads in a distributed setting. Finally, we propose a disaggregated system architecture and show that our design can enable low-overhead fault tolerance. Our experiments using three datasets and four models show that Bagpipe provides a speed up of up to 5.6x compared to state of the art baselines, while providing the same convergence and reproducibility guarantees as synchronous training.


title: Koopman Spectral Analysis of Intermittent Dynamics in Complex Systems: A Case Study in Pathophysiological Processes of Obstructive Sleep Apnea

abstract: Complex systems, such as pathophysiological processes, commonly exhibit chaotic, nonlinear, and intermittent phenomena. Koopman operator theory and Hankel alternative view of Koopman (HAVOK) model have been widely used to decompose the chaos of the complex system dynamics into an intermittent forced linear system. Although the statistics of the intermittent forcing have been proposed to characterize intermittencies in the HAVOK model, they were not adequate to attribute for the mode switching of nonlinear dynamics and the fat-tailed non-Gaussian distribution originated from high-frequency bursts and rarely-observed intermittent forcing. The paper proposed a new intermittency dynamics analysis approach to characterize the intermittent phases, chaotic bursts, and local spectral-temporal properties of various intermittent dynamics modes using spectral decomposition and wavelet analysis. To validate our methods, the intermittency behavior of apneic events in obstructive sleep apnea disorder was selected as the case, in which heart rate variability (HRV) features were extracted. Next, we constructed the Hankel matrix from the HRV features and obtained the last eigen time-delay coordinate by singular value decomposition of the Hankel matrix, which was modeled as an intermittent forcing input. The statistics of the forcing in OSA demonstrated the fat-tailed distribution of the intermittent forcing, which correspond to the intermittency of the underlying OSA pathophysiological process. The pooled means and standard deviations of the burst duration and the inter-burst duration across OSA patients were also calculated to be minutes and minutes. Scalogram amplitude and spectral decomposition of the wavelet transform exhibited various predominant frequencies and dynamics modes associated with apneic events.


title: Thompson Sampling with Unrestricted Delays

abstract: We investigate properties of Thompson Sampling in the stochastic multi-armed bandit problem with delayed feedback. In a setting with i.i.d delays, we establish to our knowledge the first regret bounds for Thompson Sampling with arbitrary delay distributions, including ones with unbounded expectation. Our bounds are qualitatively comparable to the best available bounds derived via ad-hoc algorithms, and only depend on delays via selected quantiles of the delay distributions. Furthermore, in extensive simulation experiments, we find that Thompson Sampling outperforms a number of alternative proposals, including methods specifically designed for settings with delayed feedback.


title: Angular momentum in the internal SO(3) symmetry space relating the size of universe and the Higgs mass

abstract: We show that with an internal SO(3) symmetric triplet of Higgs fields, the conserved quantity associated with this internal SO(3) symmetry leads to spontaneous symmetry breaking giving the Higgs field a mass.


title: On distinguishability distillation and dilution exponents

abstract: In this note, I define error exponents and strong converse exponents for the tasks of distinguishability distillation and dilution. These are counterparts to the one-shot distillable distinguishability and the one-shot distinguishability cost, as previously defined in the resource theory of asymmetric distinguishability. I show that they can be evaluated by semi-definite programming, establish a number of their properties, bound them using Renyi relative entropies, and relate them to each other.


title: First High Resolution Interferometric Observation of a Solar Prominence With ALMA

abstract: We present the first observation of a solar prominence at $84-116$ GHz using the high resolution interferometric imaging of ALMA. Simultaneous observations in H$\alpha$ from Bia{\l}kaw Observatory and with SDO/AIA reveal similar prominence morphology to the ALMA observation. The contribution functions of 3 mm and H$\alpha$ emission are shown to have significant overlap across a range of gas pressures. We estimate the maximum millimetre-continuum optical thickness to be $\tau_\mathrm{3mm}\approx 2$, and the brightness temperature from the observed H$\alpha$ intensity. The brightness temperature measured by ALMA is $\sim 6000-7000$ K in the prominence spine, which correlates well with the estimated brightness temperature for a gas temperature of 8000 K.


title: Understanding Adversarial Robustness from Feature Maps of Convolutional Layers

abstract: The adversarial robustness of a neural network mainly relies on two factors: model capacity and anti-perturbation ability. In this paper, we study the anti-perturbation ability of the network from the feature maps of convolutional layers. Our theoretical analysis discovers that larger convolutional feature maps before average pooling can contribute to better resistance to perturbations, but the conclusion is not true for max pooling. It brings new inspiration to the design of robust neural networks and urges us to apply these findings to improve existing architectures. The proposed modifications are very simple and only require upsampling the inputs or slightly modifying the stride configurations of downsampling operators. We verify our approaches on several benchmark neural network architectures, including AlexNet, VGG, RestNet18, and PreActResNet18. Non-trivial improvements in terms of both natural accuracy and adversarial robustness can be achieved under various attack and defense mechanisms. The code is available at \url{https://github.com/MTandHJ/rcm}.


title: A hybrid high-order scheme for the stationary, incompressible magnetohydrodynamics equations

abstract: We propose and analyse a hybrid high-order (HHO) scheme for stationary incompressible magnetohydrodynamics equations. The scheme has an arbitrary order of accuracy and is applicable on generic polyhedral meshes. For sources that are small enough, we prove error estimates in energy norm for the velocity and magnetic field, and $L^2$-norm for the pressure; these estimates are fully robust with respect to small faces, and of optimal order with respect to the mesh size. Using compactness techniques, we also prove that the scheme converges to a solution of the continuous problem, irrespective of the source being small or large. Finally, we illustrate our theoretical results through 3D numerical tests on tetrahedral and Voronoi mesh families.


title: Chiral Anomaly in Euler Fluid and Beltrami Flow

abstract: We show that the chiral anomaly of quantum field theories with Dirac fermions subject to an axial background field is an inherent property of kinematics of a perfect classical fluid. Celebrated Beltrami flows (stationary solutions of Euler equations with extensive helicity) exhibit the chiral anomaly equivalent to that known for Dirac fermions. A prominent effect of the chiral anomaly is the transport electric current at equilibrium. We show that it is also a property of Beltrami flows.


title: List Locally Surjective Homomorphisms in Hereditary Graph Classes

abstract: A locally surjective homomorphism from a graph $G$ to a graph $H$ is an edge-preserving mapping from $V(G)$ to $V(H)$ that is surjective in the neighborhood of each vertex in $G$. In the list locally surjective homomorphism problem, denoted by LLSHom($H$), the graph $H$ is fixed and the instance consists of a graph $G$ whose every vertex is equipped with a subset of $V(H)$, called list. We ask for the existence of a locally surjective homomorphism from $G$ to $H$, where every vertex of $G$ is mapped to a vertex from its list. In this paper, we study the complexity of the LLSHom($H$) problem in $F$-free graphs, i.e., graphs that exclude a fixed graph $F$ as an induced subgraph. We aim to understand for which pairs $(H,F)$ the problem can be solved in subexponential time. We show that for all graphs $H$, for which the problem is NP-hard in general graphs, it cannot be solved in subexponential time in $F$-free graphs unless $F$ is a bounded-degree forest or the ETH fails. The initial study reveals that a natural subfamily of bounded-degree forests $F$ that might lead to some tractability results is the family $\mathcal S$ consisting of forests whose every component has at most three leaves. In this case, we exhibit the following dichotomy theorem: besides the cases that are polynomial-time solvable in general graphs, the graphs $H \in \{P_3,C_4\}$ are the only connected ones that allow for a subexponential-time algorithm in $F$-free graphs for every $F \in \mathcal S$ (unless the ETH fails).


title: Learning Invariant Weights in Neural Networks

abstract: Assumptions about invariances or symmetries in data can significantly increase the predictive power of statistical models. Many commonly used models in machine learning are constraint to respect certain symmetries in the data, such as translation equivariance in convolutional neural networks, and incorporation of new symmetry types is actively being studied. Yet, efforts to learn such invariances from the data itself remains an open research problem. It has been shown that marginal likelihood offers a principled way to learn invariances in Gaussian Processes. We propose a weight-space equivalent to this approach, by minimizing a lower bound on the marginal likelihood to learn invariances in neural networks resulting in naturally higher performing models.


title: On Learning and Testing of Counterfactual Fairness through Data Preprocessing

abstract: Machine learning has become more important in real-life decision-making but people are concerned about the ethical problems it may bring when used improperly. Recent work brings the discussion of machine learning fairness into the causal framework and elaborates on the concept of Counterfactual Fairness. In this paper, we develop the Fair Learning through dAta Preprocessing (FLAP) algorithm to learn counterfactually fair decisions from biased training data and formalize the conditions where different data preprocessing procedures should be used to guarantee counterfactual fairness. We also show that Counterfactual Fairness is equivalent to the conditional independence of the decisions and the sensitive attributes given the processed non-sensitive attributes, which enables us to detect discrimination in the original decision using the processed data. The performance of our algorithm is illustrated using simulated data and real-world applications.


title: Long-Term Missing Value Imputation for Time Series Data Using Deep Neural Networks

abstract: We present an approach that uses a deep learning model, in particular, a MultiLayer Perceptron (MLP), for estimating the missing values of a variable in multivariate time series data. We focus on filling a long continuous gap (e.g., multiple months of missing daily observations) rather than on individual randomly missing observations. Our proposed gap filling algorithm uses an automated method for determining the optimal MLP model architecture, thus allowing for optimal prediction performance for the given time series. We tested our approach by filling gaps of various lengths (three months to three years) in three environmental datasets with different time series characteristics, namely daily groundwater levels, daily soil moisture, and hourly Net Ecosystem Exchange. We compared the accuracy of the gap-filled values obtained with our approach to the widely-used R-based time series gap filling methods ImputeTS and mtsdi. The results indicate that using an MLP for filling a large gap leads to better results, especially when the data behave nonlinearly. Thus, our approach enables the use of datasets that have a large gap in one variable, which is common in many long-term environmental monitoring observations.


title: Systematic upper limits on the size of missing pulsar glitches in the first UTMOST open data release

abstract: A systematic, semi-automated search for pulsar glitches in the first UTMOST public data release is presented. The search is carried out using a hidden Markov model which incorporates both glitches and timing noise into the model of the assumed phase evolution of the pulsar. Glitches are detected through Bayesian model selection between models with and without glitches present with minimal human intervention. Nine glitches are detected among seven objects, all of which have been previously reported. No new glitches were detected. Injection studies are used to place 90\% frequentist upper limits on the size of undetected glitches in each of the 282 objects searched. The mean upper limit obtained is $\Delta f^{90\%}/f = 1.9 \times 10^{-8}$, with a range of $4.1 \times 10^{-11} \leq \Delta f^{90\%}/f \leq 2.7 \times 10^{-7}$, assuming step events with no post-glitch recoveries. It is demonstrated that including glitch recovery has a mild effect, in most cases increasing the upper limit by a factor of $\lesssim 5$ conservatively assuming complete recovery on a timescale of $100\,\mathrm{d}$.