title: Privacy-Preserving Online Content Moderation: A Federated Learning Use Case

abstract: Users are daily exposed to a large volume of harmful content on various social network platforms. One solution is developing online moderation tools using Machine Learning techniques. However, the processing of user data by online platforms requires compliance with privacy policies. Federated Learning (FL) is an ML paradigm where the training is performed locally on the users' devices. Although the FL framework complies, in theory, with the GDPR policies, privacy leaks can still occur. For instance, an attacker accessing the final trained model can successfully perform unwanted inference of the data belonging to the users who participated in the training process. In this paper, we propose a privacy-preserving FL framework for online content moderation that incorporates Differential Privacy (DP). To demonstrate the feasibility of our approach, we focus on detecting harmful content on Twitter - but the overall concept can be generalized to other types of misbehavior. We simulate a text classifier - in FL fashion - which can detect tweets with harmful content. We show that the performance of the proposed FL framework can be close to the centralized approach - for both the DP and non-DP FL versions. Moreover, it has a high performance even if a small number of clients (each with a small number of data points) are available for the FL training. When reducing the number of clients (from 50 to 10) or the data points per client (from 1K to 0.1K), the classifier can still achieve ~81% AUC. Furthermore, we extend the evaluation to four other Twitter datasets that capture different types of user misbehavior and still obtain a promising performance (61% - 80% AUC). Finally, we explore the overhead on the users' devices during the FL training phase and show that the local training does not introduce excessive CPU utilization and memory consumption overhead.


title: KeypartX: Graph-based Perception (Text) Representation

abstract: The availability of big data has opened up big opportunities for individuals, businesses and academics to view big into what is happening in their world. Previous works of text representation mostly focused on informativeness from massive words' frequency or cooccurrence. However, big data is a double-edged sword which is big in volume but unstructured in format. The unstructured edge requires specific techniques to transform 'big' into meaningful instead of informative alone. This study presents KeypartX, a graph-based approach to represent perception (text in general) by key parts of speech. Different from bag-of-words/vector-based machine learning, this technique is human-like learning that could extracts meanings from linguistic (semantic, syntactic and pragmatic) information. Moreover, KeypartX is big-data capable but not hungry, which is even applicable to the minimum unit of text:sentence.


title: Excitonic effects in X-ray absorption spectra of fluoride salts and their surfaces

abstract: Operando X-ray absorption spectroscopy (XAS) can probe the electrode-electrolyte interface with single-digit nanometer depth resolution and offers a wealth of insight into the evolution and Coulombic efficiency or degradation of prototype cells, provided that the spectra can be reliably interpreted in terms of local oxidation state, atomic coordination, and electronic structure aboutthe excited atoms. To this end, we explore fluorine K-edge XAS of mono- (Li, Na, K) and di-valent (Mg, Ca, Zn) fluoride salts from a theoretical standpoint and discover a surprising level of detailed electronic structure information about these materials, despite the relatively predictable oxidation state and ionicity of the fluoride anion and the metal cation. Utilizing a recently developed many-body approach based on the delta-SCF method, we calculate the XAS using density functional theory and experimental spectral profiles are well reproduced, despite some experimental discrepancies in energy alignment within the literature, which we can correct for in our simulations. We outline a general methodology to explain shifts in the main XAS peak energies in terms of a simple exciton model and explain line-shape differences resulting from mixing of core-excited states with metal d character (for K and Ca specifically). Given ultimate applications to evolving interfaces, some understanding of the role of surfaces and their terminations in defining new spectral features is provided to indicate the sensitivity of such measurements to changes in interfacial chemistry.


title: Direct evidence of a continuous transition between waves and particles

abstract: The correlation between particle and wave descriptions of electron-matter interactions is analyzed by measuring the delocalization of an evanescent field using electron microscopy. Its spatial extension coincides with the energy-dependent, self-coherence length of propagating wave packets that obey the time-dependent Schr\"odinger equation and undergo a Goos-H\"anchen shift. In the Heisenberg limit they are created by self-interferences during coherent-inelastic Coulomb interactions with a decoherence phase {\Delta}{\phi} = 0.5 rad and shrink to particle-like dimensions for energy losses of more than 1000 eV.


title: Properties of the Prompt Optical Counterpart Arising from the Cooling of Electrons in Gamma-Ray Bursts

abstract: This work extends a contemporaneous effort (Panaitescu & Vestrand 2022) to study the properties of the lower-energy counterpart synchrotron emission produced by the cooling of relativistic Gamma-Ray Burst (GRB) electrons through radiation (synchrotron and self-Compton) emission and adiabatic losses. We derive the major characteristics (pulse duration, lag-time after burst, brightness relative to the burst) of the Prompt Optical Counterpart (POC) accompanying GRBs. Depending on the magnetic field life-time, duration of electron injection, and electron transit-time Dto from hard X-ray (GRB) to optical emitting energies, a (true) POC may appear during the GRB pulse (of duration dtg) or after (delayed OC). The signature of counterparts arising from the cooling of GRB electrons is that true POC pulses (Dto < dtg) last as long as the corresponding GRB pulse (dto ~ dtg) while delayed OC pulses (Dto > dtg) last as long as the transit-time (dto ~ Dto). If OC variability can be measured, then another signature for this OC mechanism is that the GRB variability is "passed" only to POCs but is lost for delayed OCs. Within the GRB electron cooling model for counterparts, POCs should be on average dimmer than delayed one (which is found to be consistent with the data), and harder GRB low-energy slopes bLE should be associated more often with the dimmer POCs The range of low-energy slopes bLE in [-1/2,1/3] produced by electron cooling and the average burst brightness of 1 mJy (with 1 dex dispersion) imply that POCs of hard GRBs can be dimmer than R=20 and difficult to detect by robotic telescopes (unless there is another mechanism that overshines the emission from cooling electrons) and that the POCs of soft GRBs can be brighter than R=10, i.e. as bright as the Optical Flashes (OFs) seen for several bursts.


title: Obtaining Leibniz's rule for derivations in its most general form

abstract: The main purpose of this paper is to obtain Leibniz's rule for generalized types of derivations via Newton's binomial formula. In fact, we provide a short formula to calculate the nth power of any kind of derivations.


title: Mapping the space of quasisymmetric stellarators using optimized near-axis expansion

abstract: A method is demonstrated to rapidly calculate the shapes and properties of quasi-axisymmetric and quasi-helically symmetric stellarators. In this approach, optimization is applied to the equations of magnetohydrodynamic equilibrium and quasisymmetry, expanded in the small distance from the magnetic axis, as formulated by Garren and Boozer [Phys. Fluids B, 3, 2805 (1991)]. Due to the reduction of the equations by the expansion, the computational cost is significantly reduced, to times on the order of 1 cpu-second, enabling wide and high-resolution scans over parameter space. In contrast to traditional stellarator optimization, here the cost function serves to maximize the volume in which the expansion is accurate. A key term in the cost function is $|| \nabla\mathbf B ||$, to maximize scale lengths in the field. Using this method, a database of $5\times 10^5$ optimized configurations is calculated and presented. Quasisymmetric configurations are observed to exist in continuous bands, varying in the ratio of the magnetic axis length to average major radius. Several qualitatively new types of configuration are found, including quasi-helically symmetric fields in which the number of field periods is two or more than six.


title: Griffiths inequalities for non-interacting rotors

abstract: We prove Griffiths inequalities for spins in n>1 dimensions with no interaction.


title: Ubiquitous smartphone based localization with door crossing detection

abstract: The positioning of users using their smartphones represents interesting service for various areas. Position of users can represent valuable information for various service providers. In industry 4.0 smart devices such as smartphone or tablet can help users to react faster in case of emergency. It can help to reduce reaction times for service workers and improve users orientation in the environment, or delegate work to the nearest available employee. In previous work we have described modular positioning system that is able to automatically select optimal positioning module based on available radio signals. In this paper we will focus on estimation of crossing between environments e.g. indoor and outdoor. The proposed algorithm is crucial for implementation of seamless positioning. Since both environments have specific demands not only on positioning solutions but also on maps and navigation algorithms. The proposed algorithm does not require deployment of new infrastructure and can be used on widely available smartphones. The algorithm was tested in real conditions by different users and using various smartphone devices to prove its performance under various conditions.


title: Dynamics of advantageous mutant spread in spatial death-birth and birth-death Moran models

abstract: The spread of an advantageous mutation through a population is of fundamental interest in population genetics. While the classical Moran model is formulated for a well-mixed population, it has long been recognized that in real-world applications, the population usually has an explicit spatial structure which can significantly influence the dynamics. In the context of cancer initiation in epithelial tissue, several recent works have analyzed the dynamics of advantageous mutant spread on integer lattices, using the biased voter model from particle systems theory. In this spatial version of the Moran model, individuals first reproduce according to their fitness and then replace a neighboring individual. From a biological standpoint, the opposite dynamics, where individuals first die and are then replaced by a neighboring individual according to its fitness, are equally relevant. Here, we investigate this death-birth analogue of the biased voter model. We construct the process mathematically, derive the associated dual process, establish bounds on the survival probability of a single mutant, and prove that the process has an asymptotic shape. We also briefly discuss alternative birth-death and death-birth dynamics, depending on how the mutant fitness advantage affects the dynamics. We show that birth-death and death-birth formulations of the biased voter model are equivalent when fitness affects the former event of each update of the model, whereas the birth-death model is fundamentally different from the death-birth model when fitness affects the latter event.


title: Multiplexed control of spin quantum memories in a photonic circuit

abstract: A central goal in many quantum information processing applications is a network of quantum memories that can be entangled with each other while being individually controlled and measured with high fidelity. This goal has motivated the development of programmable photonic integrated circuits (PICs) with integrated spin quantum memories using diamond color center spin-photon interfaces. However, this approach introduces a challenge in the microwave control of individual spins within closely packed registers. Here, we present a quantum-memory-integrated photonics platform capable of (i) the integration of multiple diamond color center spins into a cryogenically compatible, high-speed programmable PIC platform; (ii) selective manipulation of individual spin qubits addressed via tunable magnetic field gradients; and (iii) simultaneous control of multiple qubits using numerically optimized microwave pulse shaping. The combination of localized optical control, enabled by the PIC platform, together with selective spin manipulation opens the path to scalable quantum networks on intra-chip and inter-chip platforms.


title: Wide-Area Geolocalization with a Limited Field of View Camera

abstract: Cross-view geolocalization, a supplement or replacement for GPS, localizes an agent within a search area by matching images taken from a ground-view camera to overhead images taken from satellites or aircraft. Although the viewpoint disparity between ground and overhead images makes cross-view geolocalization challenging, significant progress has been made assuming that the ground agent has access to a panoramic camera. For example, our prior work (WAG) introduced changes in search area discretization, training loss, and particle filter weighting that enabled city-scale panoramic cross-view geolocalization. However, panoramic cameras are not widely used in existing robotic platforms due to their complexity and cost. Non-panoramic cross-view geolocalization is more applicable for robotics, but is also more challenging. This paper presents Restricted FOV Wide-Area Geolocalization (ReWAG), a cross-view geolocalization approach that generalizes WAG for use with standard, non-panoramic ground cameras by creating pose-aware embeddings and providing a strategy to incorporate particle pose into the Siamese network. ReWAG is a neural network and particle filter system that is able to globally localize a mobile agent in a GPS-denied environment with only odometry and a 90 degree FOV camera, achieving similar localization accuracy as what WAG achieved with a panoramic camera and improving localization accuracy by a factor of 100 compared to a baseline vision transformer (ViT) approach. A video highlight that demonstrates ReWAG's convergence on a test path of several dozen kilometers is available at https://youtu.be/U_OBQrt8qCE.


title: The Pursuit for Gamma-ray Emitting Pulsar Wind Nebulae with the Fermi-Large Area Telescope

abstract: There are at least 125 Galactic pulsar wind nebulae (PWNe) that have been discovered from radio wavelengths to TeV gamma-rays, the majority of which were first identified in radio or X-ray surveys. An increasing number of PWNe are being identified in the TeV band by ground-based air Cherenkov Telescopes such as HESS, MAGIC, and VERITAS such that they constitute the dominant source class of Galactic TeV emitters. Combining available MeV-GeV data with observations in the TeV band is critical for precise characterization of high-energy emission from the relativistic particle population in PWNe, thus revealing the capability to produce a significant fraction of the detected Galactic CR flux. However, MeV-GeV PWN counterparts are still largely lacking even after 12 years of continuous observation of the entire sky. Less than a dozen PWNe are currently identified by the Fermi-LAT in the MeV-GeV band. Most PWNe are located along the Galactic plane embedded within the prominent, diffuse Galactic gamma-ray emission, which makes these sources difficult to disentangle from the bright diffuse background. We present a systematic search for gamma-ray counterparts to known PWNe in the 300MeV - 2TeV energy band using 11.5 years of Fermi-LAT data. For the first part of this search, we target the locations of PWNe previously identified across the electromagnetic spectrum that are not powered by pulsars previously detected by the Fermi-LAT as pulsating gamma-ray signals, which includes 6 Fermi PWNe and 7 Fermi PWN associations. We report the analysis of 58 total regions of interest and provide all firm and tentative detections along with their morphological and spectral characteristics. There are 11 unidentified gamma-ray sources that we classify as firm PWN counterparts, which doubles the PWN population detected by the Fermi-LAT, and 22 gamma-ray sources that are PWN candidates.


title: WordStream Maker: A Lightweight End-to-end Visualization Platform for Qualitative Time-series Data

abstract: Whether it is in the form of transcribed conversations, blog posts, or tweets, qualitative data provides a reader with rich insight into both the overarching trends as well as the diversity of human ideas expressed through text. Handling and analyzing large amounts of qualitative data, however, is difficult, often requiring multiple time-intensive perusals in order to identify patterns. This difficulty is multiplied with each additional question or time point present in a data set. A primary challenge then is creating visualizations that support the interpretation of qualitative data by making it easier to identify and explore trends of interest. By combining the affordances of both text and visualizations, WordStream has previously enabled ease of information retrieval and processing of time-series text data, but the data-wrangling necessary to produce a WordStream remains a significant barrier for non-technical users. In response, this paper presents WordStream Maker: an end-to-end platform with a pipeline that utilizes natural language processing (NLP) to help non-technical users process raw text data and generate a customizable visualization without programming practice. Lessons learned from integrating NLP into visualization and scaling to large data sets are discussed, along with use cases to demonstrate the usefulness of the platform.


title: Analysis of the new standard hash function

abstract: On 2$^{nd}$ October 2012 the NIST (National Institute of Standards and Technology) in the United States of America announced the new hashing algorithm which will be adopted as standard from now on. Among a total of 73 candidates, the winner was Keccak, designed by a group of cryptographers from Belgium and Italy. The public selection of a new standard of cryptographic hash function SHA (Secure Hash Algorithm) took five years. Its object is to generate a hash a fixed size from a pattern with arbitrary length. The first selection on behalf of NIST on a standard of this family took place in 1993 when SHA-1 was chosen, which later on was replaced by SHA-2. This paper is focused on the analysis both from the point of view of security and the implementation of the Keccak function, which is the base of the new SHA-3 standard. In particular, an implementation in the mobile platform Android is presented here, providing the first known external library in this mobile operating system so that any developer could use the new standard hashing. Finally, the new standard in applications in the Internet of Things is analysed.


title: Undefinability of multiplication in Presburger arithmetic with sets of powers

abstract: We begin by proving that any Presburger-definable image of one or more sets of powers has zero natural density. Then, by adapting the proof of a dichotomy result on o-minimal structures by Friedman and Miller, we produce a similar dichotomy for expansions of Presburger arithmetic on the integers. Combining these two results, we obtain that the expansion of the ordered group of integers by any number of sets of powers does not define multiplication.


title: Transformer-Based Microbubble Localization

abstract: Ultrasound Localization Microscopy (ULM) is an emerging technique that employs the localization of echogenic microbubbles (MBs) to finely sample and image the microcirculation beyond the diffraction limit of ultrasound imaging. Conventional MB localization methods are mainly based on considering a specific Point Spread Function (PSF) for MBs, which leads to loss of information caused by overlapping MBs, non-stationary PSFs, and harmonic MB echoes. Therefore, it is imperative to devise methods that can accurately localize MBs while being resilient to MB nonlinearities and variations of MB concentrations that distort MB PSFs. This paper proposes a transformer-based MB localization approach to address this issue. We adopted DEtection TRansformer (DETR) arXiv:2005.12872 , which is an end-to-end object recognition method that detects a unique bounding box for each of the detected objects using set-based Hungarian loss and bipartite matching. To the authors' knowledge, this is the first time transformers have been used for MB localization. To appraise the proposed strategy, the pre-trained DETR network's performance has been tested for detecting MBs using transfer learning principles. We have fine-tuned the network on a subset of randomly selected frames of the dataset provided by the IEEE IUS Ultra-SR challenge organizers and then tested on the rest using cross-validation. For the simulation dataset, the paper supports the deployment of transformer-based solutions for MB localization at high accuracy.


title: On star-$k$-PCGs: Exploring class boundaries for small $k$ values

abstract: A graph $G=(V,E)$ is a star-$k$-PCG if there exists a weight function $w: V \rightarrow R^+$ and $k$ mutually exclusive intervals $I_1, I_2, \ldots I_k$, such that there is an edge $uv \in E$ if and only if $w(u)+w(v) \in \bigcup_i I_i$. These graphs are related to two important classes of graphs: PCGs and multithreshold graphs. It is known that for any graph $G$ there exists a $k$ such that $G$ is a star-$k$-PCG. Thus, for a given graph $G$ it is interesting to know which is the minimum $k$ such that $G$ is a star-$k$-PCG. We define this minimum $k$ as the star number of the graph, denoted by $\gamma(G)$. Here we investigate the star number of simple graph classes, such as graphs of small size, caterpillars, cycles and grids. Specifically, we determine the exact value of $\gamma(G)$ for all the graphs with at most 7 vertices. By doing so we show that the smallest graphs with star number 2 are only 4 and have exactly 5 vertices; the smallest graphs with star number 3 are only 3 and have exactly 7 vertices. Next, we provide a construction showing that the star number of caterpillars is one. Moreover, we show that the star number of cycles and two dimensional grid graphs is 2 and that the star number of $4$-dimensional grids is at least 3. Finally, we conclude with numerous open problems.


title: Authentication and encryption for a robotic ad hoc network using identity-based cryptography

abstract: In some situations the communications of a place can be affected, totally lost, or not even exist. In these cases, the MANETs play an important role, allowing to establish a communications point using the different nodes of the network to reach the destination using decentralized communications. This paper proposes the implementation of a Robotic MANET, a decentralized network using robots as its nodes, which allows to move the network nodes to the desired location remotely. For this, each robot has as a core a Raspberry Pi with the capabilities to perform audio and video streaming, remote control of robots, tracking of objects, and deployment of wireless networks. To protect the network, different security mechanisms are used that allow secure authentication on the network by different nodes and encryption of information transmitted between them. All communications are protected through Identity-Based Cryptography, specifically with an Identity-Based Signcryption scheme.


title: Pairs of saddle connections of typical flat surfaces on fixed affine orbifolds

abstract: We prove that the asymptotic number of pairs of saddle connections with length smaller than $L$ with bounded virtual area is quadratic for almost every translation surface with respect to any ergodic $SL(2,\mathbb{R})$-invariant measure. A key tool of the proof is that Siegel-Veech transforms of bounded functions with compact supports are in $L^{2+\kappa}$ for every $SL(2,\mathbb{R})$-invariant measure.


title: A Meyer-Vietoris formula for the determinant of the Dirichlet-to-Neumann operator on Riemann surfaces

abstract: This paper presents a Meyer-Vietoris type gluing formula for a conformal invariant of a Riemannian surface with boundary that is defined by the determinant of the Dirichlet-to-Neumann operator. The formula is used to bound the asymptotics of the invariant under degeneration. It is shown that the associated height function on the moduli space of hyperbolic surfaces with geodesic boundary is proper only in genus zero. Properness implies a compactness theorem for Steklov isospectral metrics in the case of genus zero. The formula also provides asymptotics for the determinant of the Laplacian with Dirichlet or Neumann boundary conditions. For the proof, we derive an extension of Kirchhoff's weighted matrix tree theorem for graph Laplacians with an external potential.


title: Stochastic Planning for ASV Navigation Using Satellite Images

abstract: Autonomous surface vessels (ASV) represent a promising technology to automate water-quality monitoring of lakes. In this work, we use satellite images as a coarse map and plan sampling routes for the robot. However, inconsistency between the satellite images and the actual lake, as well as environmental disturbances such as wind, aquatic vegetation, and changing water levels can make it difficult for robots to visit places suggested by the prior map. This paper presents a robust route-planning algorithm that minimizes the expected total travel distance given these environmental disturbances, which induce uncertainties in the map. We verify the efficacy of our algorithm in simulations of over a thousand Canadian lakes and demonstrate an application of our algorithm in a 3.7 km-long real-world robot experiment on a lake in Northern Ontario, Canada. Videos are available on our website https://pcctp.github.io/.


title: Revocation management in vehicular ad-hoc networks

abstract: This paper describes a solution for the efficient management of revocation in vehicular ad-hoc networks, for both certificate-based and identity-based authentication. It proposes the use of an authenticated data structure based on a dynamic hash tree, which is a perfect $k$-ary tree, together with a new version of the SHA-3 hash function. This combination allows optimizing search and insertion operations in the tree. Consequently, the proposal is very useful both when vehicular networks are widely used, and in urban environments. Simulation results are promising and confirm this hypothesis.


title: ControlVC: Zero-Shot Voice Conversion with Time-Varying Controls on Pitch and Speed

abstract: Recent developments in neural speech synthesis and vocoding have sparked a renewed interest in voice conversion (VC). Beyond timbre transfer, achieving controllability on para-linguistic parameters such as pitch and Speed is critical in deploying VC systems in many application scenarios. Existing studies, however, either only provide utterance-level global control or lack interpretability on the controls. In this paper, we propose ControlVC, the first neural voice conversion system that achieves time-varying controls on pitch and speed. ControlVC uses pre-trained encoders to compute pitch and linguistic embeddings from the source utterance and speaker embeddings from the target utterance. These embeddings are then concatenated and converted to speech using a vocoder. It achieves speed control through TD-PSOLA pre-processing on the source utterance, and achieves pitch control by manipulating the pitch contour before feeding it to the pitch encoder. Systematic subjective and objective evaluations are conducted to assess the speech quality and controllability. Results show that, on non-parallel and zero-shot conversion tasks, ControlVC significantly outperforms two other self-constructed baselines on speech quality, and it can successfully achieve time-varying pitch and speed control.


title: Integrity 2022: Integrity in Social Networks and Media

abstract: This is the proposal for the third edition of the Workshop on Integrity in Social Networks and Media, Integrity 2022, following the success of the first two Workshops held in conjunction with the 13th & 14th ACM Conference on Web Search and Data Mining (WSDM) in 2020 and 2021. The goal of the workshop is to bring together researchers and practitioners to discuss content and interaction integrity challenges in social networks and social media platforms. The event consists of (1) a series of invited talks by reputed members of the Integrity community from both academia and industry, (2) a call-for-papers for contributed talks and posters, and (3) a panel with the speakers.


title: Effective low-energy models for superconducting impurity systems

abstract: We present two complementary methods to calculate the Andreev bound state energies of a single-level quantum dot connected to superconducting leads described by the superconducting impurity Anderson model. The first method, which is based on a mapping to a low-energy model, can be utilized to extract the Andreev bound state energies from finite-temperature, imaginary-time quantum Monte Carlo data without the necessity of any analytic continuation technique. The second method maps the full model on an exactly solvable superconducting atomic limit with renormalized parameters. As such, it represents a fast and reliable method for a quick scan of the parameter space. We demonstrate that after adding a simple band correction this method can provide predictions for measurable quantities, including the Josephson current, that are in a solid quantitative agreement with precise results obtained by the numerical renormalization group and quantum Monte Carlo.


title: The Role of Symmetry in Constructing Geometric Flat Outputs for Free-Flying Robotic Systems

abstract: Mechanical systems naturally evolve on principal bundles describing their inherent symmetries. The ensuing factorization of the configuration manifold into a symmetry group and an internal shape space has provided deep insights into the locomotion of many robotic and biological systems. On the other hand, the property of differential flatness has enabled efficient, effective planning and control algorithms for various robotic systems. Yet, a practical means of finding a flat output for an arbitrary robotic system remains an open question. In this work, we demonstrate surprising new connections between these two domains, for the first time employing symmetry directly to construct a flat output. We provide sufficient conditions for the existence of a trivialization of the bundle in which the group variables themselves are a flat output. We call this a geometric flat output, since it is equivariant (i.e. maintains the symmetry) and is often global or almost-global, properties not typically enjoyed by other flat outputs. In such a trivialization, the motion planning problem is easily solved, since a given trajectory for the group variables will fully determine the trajectory for the shape variables that exactly achieves this motion. We provide a partial catalog of robotic systems with geometric flat outputs and worked examples for the planar rocket, planar aerial manipulator, and quadrotor.


title: Leveraging Self-Supervised Training for Unintentional Action Recognition

abstract: Unintentional actions are rare occurrences that are difficult to define precisely and that are highly dependent on the temporal context of the action. In this work, we explore such actions and seek to identify the points in videos where the actions transition from intentional to unintentional. We propose a multi-stage framework that exploits inherent biases such as motion speed, motion direction, and order to recognize unintentional actions. To enhance representations via self-supervised training for the task of unintentional action recognition we propose temporal transformations, called Temporal Transformations of Inherent Biases of Unintentional Actions (T2IBUA). The multi-stage approach models the temporal information on both the level of individual frames and full clips. These enhanced representations show strong performance for unintentional action recognition tasks. We provide an extensive ablation study of our framework and report results that significantly improve over the state-of-the-art.


title: Cem Mil Podcasts: A Spoken Portuguese Document Corpus For Multi-modal, Multi-lingual and Multi-Dialect Information Access Research

abstract: In this paper we describe the Portuguese-language podcast dataset we have released for academic research purposes. We give an overview of how the data was sampled, descriptive statistics over the collection, as well as information about the distribution over Brazilian and Portuguese dialects. We give results from experiments on multi-lingual summarization, showing that summarizing podcast transcripts can be performed well by a system supporting both English and Portuguese. We also show experiments on Portuguese podcast genre classification using text metadata. Combining this collection with previously released English-language collection opens up the potential for multi-modal, multi-lingual and multi-dialect podcast information access research.


title: Robust and Secure Hybrid Quantum-Classical Computation on Untrusted Cloud-Based Quantum Hardware

abstract: Quantum computers are currently accessible through a cloud-based platform that allows users to run their programs on a suite of quantum hardware. As the quantum computing ecosystem grows in popularity and utility, it is reasonable to expect more companies, including untrustworthy or untrustworthy or unreliable vendors, to begin offering quantum computers as hardware as a service at various price or performance points. Since computing time on quantum hardware is expensive and the access queue may be long, users will be enticed to use less expensive but less reliable or trustworthy hardware. Less trusted vendors may tamper with the results and or parameters of quantum circuits, providing the user with a sub-optimal solution or incurring a cost of higher iterations. In this paper, we model and simulate adversarial tampering of input parameters and measurement outcomes on an exemplary hybrid quantum classical algorithm namely, Quantum Approximate Optimization Algorithm (QAOA). We observe a maximum performance degradation of approximately 40%. To achieve comparable performance with minimal parameter tampering, the user incurs a minimum cost of 20X higher iteration. We propose distributing the computation (iterations) equally among the various hardware options to ensure trustworthy computing for a mix of trusted and untrusted hardware. In the chosen performance metrics, we observe a maximum improvement of approximately 30%. In addition, we propose re-initialization of the parameters after a few initial iterations to fully recover the original program performance and an intelligent run adaptive split heuristic, which allows users to identify tampered/untrustworthy hardware at runtime and allocate more iterations to the reliable hardware, resulting in a maximum improvement of approximately 45%.


title: After DART: Using the first full-scale test of a kinetic impactor to inform a future planetary defense mission

abstract: NASA's Double Asteroid Redirection Test (DART) is the first full-scale test of an asteroid deflection technology. Results from the hypervelocity kinetic impact and Earth-based observations, coupled with LICIACube and the later Hera mission, will result in measurement of the momentum transfer efficiency accurate to ~10% and characterization of the Didymos binary system. But DART is a single experiment; how could these results be used in a future planetary defense necessity involving a different asteroid? We examine what aspects of Dimorphos's response to kinetic impact will be constrained by DART results; how these constraints will help refine knowledge of the physical properties of asteroidal materials and predictive power of impact simulations; what information about a potential Earth impactor could be acquired before a deflection effort; and how design of a deflection mission should be informed by this understanding. We generalize the momentum enhancement factor $\beta$, showing that a particular direction-specific $\beta$ will be directly determined by the DART results, and that a related direction-specific $\beta$ is a figure of merit for a kinetic impact mission. The DART $\beta$ determination constrains the ejecta momentum vector, which, with hydrodynamic simulations, constrains the physical properties of Dimorphos's near-surface. In a hypothetical planetary defense exigency, extrapolating these constraints to a newly discovered asteroid will require Earth-based observations and benefit from in-situ reconnaissance. We show representative predictions for momentum transfer based on different levels of reconnaissance and discuss strategic targeting to optimize the deflection and reduce the risk of a counterproductive deflection in the wrong direction.


title: The cubic Pell equation L-function

abstract: For $d > 1$ a cubefree rational integer, we define an $L$-function (denoted $L_d(s)$) whose coefficients are derived from the cubic theta function for $\mathbb Q\left(\sqrt{-3}\right)$. The Dirichlet series defining $L_d(s)$ converges for $\text{Re}(s) > 1$, and its coefficients vanish except at values corresponding to integral solutions of $mx^3 - dny^3 = 1$ in $\mathbb Q\left(\sqrt{-3}\right)$, where $m$ and $n$ are squarefree. By generalizing the methods used to prove the Takhtajan-Vinogradov trace formula, we obtain the meromorphic continuation of $L_d(s)$ to $\text{Re}(s) > \frac{1}{2}$ and prove that away from its poles, it satisfies the bound $L_d(s) \ll |s|^{\frac{7}{2}}$ and has a possible simple pole at $s = \frac{2}{3}$, possible poles at the zeros of a certain Appell hypergeometric function, with no other poles. We conjecture that the latter case does not occur, so that $L_d(s)$ has no other poles with $\text{Re}(s) > \frac{1}{2}$ besides the possible simple pole at $s = \frac{2}{3}$.


title: Tighter Variational Bounds are Not Necessarily Better. A Research Report on Implementation, Ablation Study, and Extensions

abstract: This report explains, implements and extends the works presented in "Tighter Variational Bounds are Not Necessarily Better" (T Rainforth et al., 2018). We provide theoretical and empirical evidence that increasing the number of importance samples $K$ in the importance weighted autoencoder (IWAE) (Burda et al., 2016) degrades the signal-to-noise ratio (SNR) of the gradient estimator in the inference network and thereby affecting the full learning process. In other words, even though increasing $K$ decreases the standard deviation of the gradients, it also reduces the magnitude of the true gradient faster, thereby increasing the relative variance of the gradient updates. Extensive experiments are performed to understand the importance of $K$. These experiments suggest that tighter variational bounds are beneficial for the generative network, whereas looser bounds are preferable for the inference network. With these insights, three methods are implemented and studied: the partially importance weighted autoencoder (PIWAE), the multiply importance weighted autoencoder (MIWAE) and the combination importance weighted autoencoder (CIWAE). Each of these three methods entails IWAE as a special case but employs the importance weights in different ways to ensure a higher SNR of the gradient estimators. In our research study and analysis, the efficacy of these algorithms is tested on multiple datasets such as MNIST and Omniglot. Finally, we demonstrate that the three presented IWAE variations are able to generate approximate posterior distributions that are much closer to the true posterior distribution than for the IWAE, while matching the performance of the IWAE generative network or potentially outperforming it in the case of PIWAE.


title: Predicting asteroid material properties from a DART-like kinetic impact

abstract: NASA's Double Asteroid Redirection Test (DART) mission is the first full-scale test of the kinetic impactor method for asteroid deflection, in which a spacecraft intentionally impacts an asteroid to change its trajectory. DART represents an important first step for planetary defense technology demonstration, providing a realistic assessment of the effectiveness of the kinetic impact approach on a near-Earth asteroid. The momentum imparted to the asteroid is transferred from the impacting spacecraft and enhanced by the momentum of material ejected from the impact site. However, the magnitude of the ejecta contribution is dependent on the material properties of the target. These properties, such as strength and shear modulus, are unknown for the DART target asteroid, Dimorphos, as well as most asteroids since such properties are difficult to characterize remotely. This study examines how hydrocode simulations can be used to estimate material properties from information available post-impact, specifically the asteroid size and shape, the velocity and properties of the impacting spacecraft, and the final velocity change imparted to the asteroid. Across >300 three-dimensional simulations varying seven material parameters describing the asteroid, we found many combinations of properties could reproduce a particular asteroid velocity. Additional observations, such as asteroid mass or crater size, are required to further constrain properties like asteroid strength or outcomes like the momentum enhancement provided by impact ejecta. Our results demonstrate the vital importance of having as much knowledge as possible prior to an impact mission, with key material parameters being the asteroid's mass, porosity, strength, and elastic properties.


title: Detecting cosmological gravitational waves background after removal of compact binary coalescences in future gravitational wave detectors

abstract: The improved sensitivity of third generation gravitational wave detectors opens the possibility of detecting the primordial cosmological stochastic gravitational wave background (SGWB). Detection of the cosmological SGWB is facing a novel challenge: it will likely be masked by the foreground generated by a large number of coalescences of compact binary systems consisting of black holes and/or neutron stars. In this paper, we investigate the possibility of reducing this foreground by removing (notching) the individually resolved compact binary signals in time-frequency space. We establish that such an approach could be used to reach the SGWB sensitivity floor defined by the unresolved part of the compact binaries foreground, which we find to be between $\Omega_{\rm GW} \sim (9.1 \times10^{-12} - 8.6\times10^{-11})$ for a frequency independent energy density spectrum and depending on the rate of coalescing binary neutron star systems. Since third-generation gravitational wave detectors will not be able to resolve all compact binaries, the unresolvable component of the compact binaries foreground may limit the SGWB searches with these detectors.


title: "My Privacy for their Security": Employees' Privacy Perspectives and Expectations when using Enterprise Security Software

abstract: Employees are often required to use Enterprise Security Software ("ESS") on corporate and personal devices. ESS products collect users' activity data including users' location, applications used, and websites visited - operating from employees' device to the cloud. To the best of our knowledge, the privacy implications of this data collection have yet to be explored. We conduct an online survey (n=258) and a semi-structured interview (n=22) with ESS users to understand their privacy perceptions, the challenges they face when using ESS, and the ways they try to overcome those challenges. We found that while many participants reported receiving no information about what data their ESS collected, those who received some information often underestimated what was collected. Employees reported lack of communication about various data collection aspects including: the entities with access to the data and the scope of the data collected. We use the interviews to uncover several sources of misconceptions among the participants. Our findings show that while employees understand the need for data collection for security, the lack of communication and ambiguous data collection practices result in the erosion of employees' trust on the ESS and employers. We obtain suggestions from participants on how to mitigate these misconceptions and collect feedback on our design mockups of a privacy notice and privacy indicators for ESS. Our work will benefit researchers, employers, and ESS developers to protect users' privacy in the growing ESS market.


title: Enhancing Data Diversity for Self-training Based Unsupervised Cross-modality Vestibular Schwannoma and Cochlea Segmentation

abstract: Automatic segmentation of vestibular schwannoma (VS) and cochlea from magnetic resonance imaging can facilitate VS treatment planning. Unsupervised segmentation methods have shown promising results without requiring the time-consuming and laborious manual labeling process. In this paper, we present an approach for VS and cochlea segmentation in an unsupervised domain adaptation setting. Specifically, we first develop a cross-site cross-modality unpaired image translation strategy to enrich the diversity of the synthesized data. Then, we devise a rule-based offline augmentation technique to further minimize the domain gap. Lastly, we adopt a self-configuring segmentation framework empowered by self-training to obtain the final results. On the CrossMoDA 2022 validation leaderboard, our method has achieved competitive VS and cochlea segmentation performance with mean Dice scores of 0.8178 $\pm$ 0.0803 and 0.8433 $\pm$ 0.0293, respectively.


title: Real-Time Model Predictive Control for Industrial Manipulators with Singularity-Tolerant Hierarchical Task Control

abstract: This paper proposes a real-time model predictive control (MPC) scheme to execute multiple tasks using robots over a finite-time horizon. In industrial robotic applications, we must carefully consider multiple constraints for avoiding joint position, velocity, and torque limits. In addition, singularity-free and smooth motions require executing tasks continuously and safely. Instead of formulating nonlinear MPC problems, we devise linear MPC problems using kinematic and dynamic models linearized along nominal trajectories produced by hierarchical controllers. These linear MPC problems are solvable via the use of Quadratic Programming; therefore, we significantly reduce the computation time of the proposed MPC framework so the resulting update frequency is higher than 1 kHz. Our proposed MPC framework is more efficient in reducing task tracking errors than a baseline based on operational space control (OSC). We validate our approach in numerical simulations and in real experiments using an industrial manipulator. More specifically, we deploy our method in two practical scenarios for robotic logistics: 1) controlling a robot carrying heavy payloads while accounting for torque limits, and 2) controlling the end-effector while avoiding singularities.


title: Magnetic Phases of Spatially-Modulated Spin-1 Chains in Rydberg Excitons: Classical and Quantum Simulations

abstract: In this work, we study the magnetic phases of a spatially-modulated chain of spin-1 Rydberg excitons. Using the Density Matrix Renormalization Group (DMRG) technique we study various magnetic and topologically nontrivial phases using both single-particle properties like local magnetization and quantum entropy as well as many-body ones like pair-wise N\'eel and long-range string correlations. In particular, we investigate the emergence and robustness of Haldane phase, a topological phase of anti-ferromagnetic spin-1 chains. Further, we devise a hybrid quantum algorithm employing Restricted Boltzmann Machine to simulate the ground state of such a system which shows very good agreement with the results of exact diagonalization (ED) and DMRG.


title: Logarithmically larger deletion codes of all distances

abstract: The deletion distance between two binary words $u,v \in \{0,1\}^n$ is the smallest $k$ such that $u$ and $v$ share a common subsequence of length $n-k$. A set $C$ of binary words of length $n$ is called a $k$-deletion code if every pair of distinct words in $C$ has deletion distance greater than $k$. In 1965, Levenshtein initiated the study of deletion codes by showing that, for $k\ge 1$ fixed and $n$ going to infinity, a $k$-deletion code $C\subseteq \{0,1\}^n$ of maximum size satisfies $\Omega_k(2^n/n^{2k}) \leq |C| \leq O_k( 2^n/n^k)$. We make the first asymptotic improvement to these bounds by showing that there exist $k$-deletion codes with size at least $\Omega_k(2^n \log n/n^{2k})$. Our proof is inspired by Jiang and Vardy's improvement to the classical Gilbert--Varshamov bounds. We also establish several related results on the number of longest common subsequences and shortest common supersequences of a pair of words with given length and deletion distance.


title: Hebbian Deep Learning Without Feedback

abstract: Recent approximations to backpropagation (BP) have mitigated many of BP's computational inefficiencies and incompatibilities with biology, but important limitations still remain. Moreover, the approximations significantly decrease accuracy in benchmarks, suggesting that an entirely different approach may be more fruitful. Here, grounded on recent theory for Hebbian learning in soft winner-take-all networks, we present multilayer SoftHebb, i.e. an algorithm that trains deep neural networks, without any feedback, target, or error signals. As a result, it achieves efficiency by avoiding weight transport, non-local plasticity, time-locking of layer updates, iterative equilibria, and (self-) supervisory or other feedback signals -- which were necessary in other approaches. Its increased efficiency and biological compatibility do not trade off accuracy compared to state-of-the-art bio-plausible learning, but rather improve it. With up to five hidden layers and an added linear classifier, accuracies on MNIST, CIFAR-10, STL-10, and ImageNet, respectively reach 99.4%, 80.3%, 76.2%, and 27.3%. In conclusion, SoftHebb shows with a radically different approach from BP that Deep Learning over few layers may be plausible in the brain and increases the accuracy of bio-plausible machine learning. Code is available at https://github.com/NeuromorphicComputing/SoftHebb.


title: Maximizing Metapopulation Growth Rate and Biomass in Stream Networks

abstract: We consider the logistic metapopulation model over a stream network and use the metapopulation growth rate and the total biomass (of the positive equilibrium) as metrics for different aspects of population persistence. Our objective is to find distributions of resources that maximize these persistence measures. We begin our study by considering stream networks consisting of three nodes and prove that the strategy to maximize the total biomass is to concentrate all the resources in the most upstream locations. In contrast, when the diffusion rates are sufficiently small, the metapopulation growth rate is maximized when all resources are concentrated in one of the most downstream locations. These two main results are generalized to stream networks with any number of patches.


title: Physics-Informed Graph Neural Network for Spatial-temporal Production Forecasting

abstract: Production forecast based on historical data provides essential value for developing hydrocarbon resources. Classic history matching workflow is often computationally intense and geometry-dependent. Analytical data-driven models like decline curve analysis (DCA) and capacitance resistance models (CRM) provide a grid-free solution with a relatively simple model capable of integrating some degree of physics constraints. However, the analytical solution may ignore subsurface geometries and is appropriate only for specific flow regimes and otherwise may violate physics conditions resulting in degraded model prediction accuracy. Machine learning-based predictive model for time series provides non-parametric, assumption-free solutions for production forecasting, but are prone to model overfit due to training data sparsity; therefore may be accurate over short prediction time intervals. We propose a grid-free, physics-informed graph neural network (PI-GNN) for production forecasting. A customized graph convolution layer aggregates neighborhood information from historical data and has the flexibility to integrate domain expertise into the data-driven model. The proposed method relaxes the dependence on close-form solutions like CRM and honors the given physics-based constraints. Our proposed method is robust, with improved performance and model interpretability relative to the conventional CRM and GNN baseline without physics constraints.


title: Trajectory and Sway Prediction Towards Fall Prevention

abstract: Falls are the leading cause of fatal and non-fatal injuries, particularly for older persons. Imbalance can result from the body's internal causes (illness), or external causes (active or passive perturbation). Active perturbation results from applying an external force to a person, while passive perturbation results from human motion interacting with a static obstacle. This work proposes a metric that allows for the monitoring of the person's torso and its correlation to active and passive perturbations. We show that large changes in the torso sway can be strongly correlated to active perturbations. We also show that we can reasonably predict the future path and expected change in torso sway by conditioning the expected path and torso sway on the past trajectory, torso motion, and the surrounding scene. This could have direct future applications to fall prevention. Results demonstrate that the torso sway is strongly correlated with perturbations. And our model is able to make use of the visual cues presented in the panorama and condition the prediction accordingly.


title: Whodunit? Learning to Contrast for Authorship Attribution

abstract: Authorship attribution is the task of identifying the author of a given text. The key is finding representations that can differentiate between authors. Existing approaches typically use manually designed features that capture a dataset's content and style, but these approaches are dataset-dependent and yield inconsistent performance across corpora. In this work, we propose \textit{learning} author-specific representations by fine-tuning pre-trained generic language representations with a contrastive objective (Contra-X). We show that Contra-X learns representations that form highly separable clusters for different authors. It advances the state-of-the-art on multiple human and machine authorship attribution benchmarks, enabling improvements of up to 6.8% over cross-entropy fine-tuning. However, we find that Contra-X improves overall accuracy at the cost of sacrificing performance for some authors. Resolving this tension will be an important direction for future work. To the best of our knowledge, we are the first to integrate contrastive learning with pre-trained language model fine-tuning for authorship attribution.


title: JPEG Artifact Correction using Denoising Diffusion Restoration Models

abstract: Diffusion models can be used as learned priors for solving various inverse problems. However, most existing approaches are restricted to linear inverse problems, limiting their applicability to more general cases. In this paper, we build upon Denoising Diffusion Restoration Models (DDRM) and propose a method for solving some non-linear inverse problems. We leverage the pseudo-inverse operator used in DDRM and generalize this concept for other measurement operators, which allows us to use pre-trained unconditional diffusion models for applications such as JPEG artifact correction. We empirically demonstrate the effectiveness of our approach across various quality factors, attaining performance levels that are on par with state-of-the-art methods trained specifically for the JPEG restoration task.


title: Concurrent Graph Queries on the Lucata Pathfinder

abstract: High-performance analysis of unstructured data like graphs now is critical for applications ranging from business intelligence to genome analysis. Towards this, data centers hold large graphs in memory to serve multiple concurrent queries from different users. Even a single analysis often explores multiple options. Current computing architectures often are not the most time- or energy-efficient solutions. The novel Lucata Pathfinder architecture tackles this problem, combining migratory threads for low-latency reading with memory-side processing for high-performance accumulation. One hundred to 750 concurrent breadth-first searches (BFS) all achieve end-to-end speed-ups of 81% to 97% over one-at-a-time queries on a graph with 522M edges. Comparing to RedisGraph running on a large Intel-based server, the Pathfinder achieves a 19$\times$ speed-up running 128 BFS queries concurrently. The Pathfinder also efficiently supports a mix of concurrent analyses, demonstrated with connected components and BFS.


title: DomainATM: Domain Adaptation Toolbox for Medical Data Analysis

abstract: Domain adaptation (DA) is an important technique for modern machine learning-based medical data analysis, which aims at reducing distribution differences between different medical datasets. A proper domain adaptation method can significantly enhance the statistical power by pooling data acquired from multiple sites/centers. To this end, we have developed the Domain Adaptation Toolbox for Medical data analysis (DomainATM) - an open-source software package designed for fast facilitation and easy customization of domain adaptation methods for medical data analysis. The DomainATM is implemented in MATLAB with a user-friendly graphical interface, and it consists of a collection of popular data adaptation algorithms that have been extensively applied to medical image analysis and computer vision. With DomainATM, researchers are able to facilitate fast feature-level and image-level adaptation, visualization and performance evaluation of different adaptation methods for medical data analysis. More importantly, the DomainATM enables the users to develop and test their own adaptation methods through scripting, greatly enhancing its utility and extensibility. An overview characteristic and usage of DomainATM is presented and illustrated with three example experiments, demonstrating its effectiveness, simplicity, and flexibility. The software, source code, and manual are available online.


title: Neuromorphic Integrated Sensing and Communications

abstract: Neuromorphic computing is an emerging technology that support event-driven data processing for applications requiring efficient online inference and/or control. Recent work has introduced the concept of neuromorphic communications, whereby neuromorphic computing is integrated with impulse radio (IR) transmission to implement low-energy and low-latency remote inference in wireless Internet-of-Things (IoT) networks. In this paper, we introduce neuromorphic integrated sensing and communications (N-ISAC), a novel solution that enables efficient online data decoding and radar sensing. N-ISAC leverages a common IR waveform for the dual purpose of conveying digital information and of detecting the presence or absence of a radar target. A spiking neural network (SNN) is deployed at the receiver to decode digital data and to detect the radar target using directly the received signal. The SNN operation is optimized by balancing performance metrics for data communications and radar sensing, highlighting synergies and trade-offs between the two applications.


title: Highly Scalable Task Grouping for Deep Multi-Task Learning in Prediction of Epigenetic Events

abstract: Deep neural networks trained for predicting cellular events from DNA sequence have become emerging tools to help elucidate the biological mechanism underlying the associations identified in genome-wide association studies. To enhance the training, multi-task learning (MTL) has been commonly exploited in previous works where trained networks were needed for multiple profiles differing in either event modality or cell type. All existing works adopted a simple MTL framework where all tasks share a single feature extraction network. Such a strategy even though effective to certain extent leads to substantial negative transfer, meaning the existence of large portion of tasks for which models obtained through MTL perform worse than those by single task learning. There have been methods developed to address such negative transfer in other domains, such as computer vision. However, these methods are generally difficult to scale up to handle large amount of tasks. In this paper, we propose a highly scalable task grouping framework to address negative transfer by only jointly training tasks that are potentially beneficial to each other. The proposed method exploits the network weights associated with task specific classification heads that can be cheaply obtained by one-time joint training of all tasks. Our results using a dataset consisting of 367 epigenetic profiles demonstrate the effectiveness of the proposed approach and its superiority over baseline methods.


title: On Z2 harmonic functions on $\mathbb{R}^2$ and the polynomial Pell's equation

abstract: There has been many studies on Z2 harmonic functions, differential forms or spinors recently. This paper focuses on a very special and relatively simple aspect: Z2 harmonic functions on $\mathbb{R}^2$ with point singularities.


title: Closing the Loop: Graph Networks to Unify Semantic Objects and Visual Features for Multi-object Scenes

abstract: In Simultaneous Localization and Mapping (SLAM), Loop Closure Detection (LCD) is essential to minimize drift when recognizing previously visited places. Visual Bag-of-Words (vBoW) has been an LCD algorithm of choice for many state-of-the-art SLAM systems. It uses a set of visual features to provide robust place recognition but fails to perceive the semantics or spatial relationship between feature points. Previous work has mainly focused on addressing these issues by combining vBoW with semantic and spatial information from objects in the scene. However, they are unable to exploit spatial information of local visual features and lack a structure that unifies semantic objects and visual features, therefore limiting the symbiosis between the two components. This paper proposes SymbioLCD2, which creates a unified graph structure to integrate semantic objects and visual features symbiotically. Our novel graph-based LCD system utilizes the unified graph structure by applying a Weisfeiler-Lehman graph kernel with temporal constraints to robustly predict loop closure candidates. Evaluation of the proposed system shows that having a unified graph structure incorporating semantic objects and visual features improves LCD prediction accuracy, illustrating that the proposed graph structure provides a strong symbiosis between these two complementary components. It also outperforms other Machine Learning algorithms - such as SVM, Decision Tree, Random Forest, Neural Network and GNN based Graph Matching Networks. Furthermore, it has shown good performance in detecting loop closure candidates earlier than state-of-the-art SLAM systems, demonstrating that extended semantic and spatial awareness from the unified graph structure significantly impacts LCD performance.


title: In-context Learning and Induction Heads

abstract: "Induction heads" are attention heads that implement a simple algorithm to complete token sequences like [A][B] ... [A] -> [B]. In this work, we present preliminary and indirect evidence for a hypothesis that induction heads might constitute the mechanism for the majority of all "in-context learning" in large transformer models (i.e. decreasing loss at increasing token indices). We find that induction heads develop at precisely the same point as a sudden sharp increase in in-context learning ability, visible as a bump in the training loss. We present six complementary lines of evidence, arguing that induction heads may be the mechanistic source of general in-context learning in transformer models of any size. For small attention-only models, we present strong, causal evidence; for larger models with MLPs, we present correlational evidence.


title: Unsupervised active speaker detection in media content using cross-modal information

abstract: We present a cross-modal unsupervised framework for active speaker detection in media content such as TV shows and movies. Machine learning advances have enabled impressive performance in identifying individuals from speech and facial images. We leverage speaker identity information from speech and faces, and formulate active speaker detection as a speech-face assignment task such that the active speaker's face and the underlying speech identify the same person (character). We express the speech segments in terms of their associated speaker identity distances, from all other speech segments, to capture a relative identity structure for the video. Then we assign an active speaker's face to each speech segment from the concurrently appearing faces such that the obtained set of active speaker faces displays a similar relative identity structure. Furthermore, we propose a simple and effective approach to address speech segments where speakers are present off-screen. We evaluate the proposed system on three benchmark datasets -- Visual Person Clustering dataset, AVA-active speaker dataset, and Columbia dataset -- consisting of videos from entertainment and broadcast media, and show competitive performance to state-of-the-art fully supervised methods.


title: The center and invariants of standard filiform Lie algebras

abstract: This paper describes the centers of the universal enveloping algebras and the invariant rings of the standard filiform Lie algebras over fields of characteristic zero and also over large enough prime characteristic. We determine explicit generators for the quotient fields and also a compact form for the generators for the invariants rings. We prove several combinatorial results concerning the Hilbert series of these algebras.


title: Combinatorial Proofs of Properties of Double-Point Enhanced Grid Homology

abstract: We provide a purely combinatorial proof of a skein exact sequence obeyed by double-point enhanced grid homology. We also extend the theory to coefficients over $\mathbb{Z},$ and discuss alternatives to the Ozsv\'ath-Szab\'o $\tau$ invariant.


title: Two Bicomplex and One Multicomplex Least Mean Square algorithms

abstract: We study and introduce new gradient operators in the complex and bicomplex settings, inspired from the well-known Least Mean Square (LMS) algorithm invented in 1960 by Widrow and Hoff for Adaptive Linear Neuron (ADALINE). These gradient operators will be used to formulate new learning rules for the Bicomplex Least Mean Square (BLMS) algorithms and we will also formulate these learning rules will for the case of multicomplex LMS algorithms (MLMS). This approach extends both the classical real and complex LMS algorithms.


title: Moduli of $G$-constellations and crepant resolutions I: the abelian case

abstract: For a finite abelian subgroup $G\subset SL_n(\mathbb{C})$, we study whether a given crepant resolution $X$ of the quotient variety $\mathbb{C}^n/G$ is obtained as a moduli space of $G$-constellations. In particular we show that, if $X$ admits a natural $G$-constellation family in the sense of Logvinenko over it with all fibers being indecomposable as $\mathbb{C}[\mathbb{C}^n]$-modules, then $X$ is isomorphic to the normalization of a fine moduli space of $G$-constellations.


title: Moduli of $G$-constellations and crepant resolutions II: the Craw-Ishii conjecture

abstract: For any given finite subgroup $G\subset SL_3(\mathbb{C})$, we show that every projective crepant resolution $X$ of the quotient variety $\mathbb{C}^3/G$ is isomorphic to the moduli space of $\theta$-stable $G$-constellations for a generic stability condition $\theta$, as conjectured by Craw and Ishii. We also show that generators of the Cox ring of $X$ can be obtained from semi-invariants for representations of the McKay quiver of $G$.


title: Learning Chess With Language Models and Transformers

abstract: Representing a board game and its positions by text-based notation enables the possibility of NLP applications. Language models, can help gain insight into a variety of interesting problems such as unsupervised learning rules of a game, detecting player behavior patterns, player attribution, and ultimately learning the game to beat state of the art. In this study, we applied BERT models, first to the simple Nim game to analyze its performance in the presence of noise in a setup of a few-shot learning architecture. We analyzed the model performance via three virtual players, namely Nim Guru, Random player, and Q-learner. In the second part, we applied the game learning language model to the chess game, and a large set of grandmaster games with exhaustive encyclopedia openings. Finally, we have shown that model practically learns the rules of the chess game and can survive games against Stockfish at a category-A rating level.


title: Symmetries of algebras captured by actions of weak Hopf algebras

abstract: In this paper, we present a generalization of well-established results regarding symmetries of $\Bbbk$-algebras, where $\Bbbk$ is a field. Traditionally, for a $\Bbbk$-algebra $A$, the group $\Bbbk$-algebra automorphisms of $A$ captures the symmetries of $A$ via group actions. Similarly, the Lie algebra of derivations of $A$ captures the symmetries of $A$ via Lie algebra actions. In this paper, given a category $\mathcal{C}$ whose objects possess $\Bbbk$-linear monoidal categories of modules, we introduce an object $\operatorname{Sym}_{\mathcal{C}}(A)$ that captures the symmetries of $A$ via actions of objects in $\mathcal{C}$. Our study encompasses various categories whose objects include groupoids, Lie algebroids, and more generally, cocommutative weak Hopf algebras. Notably, we demonstrate that for a positively graded non-connected $\Bbbk$-algebra $A$, some of its symmetries are naturally captured within the weak Hopf framework.


title: CryptoGCN: Fast and Scalable Homomorphically Encrypted Graph Convolutional Network Inference

abstract: Recently cloud-based graph convolutional network (GCN) has demonstrated great success and potential in many privacy-sensitive applications such as personal healthcare and financial systems. Despite its high inference accuracy and performance on cloud, maintaining data privacy in GCN inference, which is of paramount importance to these practical applications, remains largely unexplored. In this paper, we take an initial attempt towards this and develop $\textit{CryptoGCN}$--a homomorphic encryption (HE) based GCN inference framework. A key to the success of our approach is to reduce the tremendous computational overhead for HE operations, which can be orders of magnitude higher than its counterparts in the plaintext space. To this end, we develop an approach that can effectively take advantage of the sparsity of matrix operations in GCN inference to significantly reduce the computational overhead. Specifically, we propose a novel AMA data formatting method and associated spatial convolution methods, which can exploit the complex graph structure and perform efficient matrix-matrix multiplication in HE computation and thus greatly reduce the HE operations. We also develop a co-optimization framework that can explore the trade offs among the accuracy, security level, and computational overhead by judicious pruning and polynomial approximation of activation module in GCNs. Based on the NTU-XVIEW skeleton joint dataset, i.e., the largest dataset evaluated homomorphically by far as we are aware of, our experimental results demonstrate that $\textit{CryptoGCN}$ outperforms state-of-the-art solutions in terms of the latency and number of homomorphic operations, i.e., achieving as much as a 3.10$\times$ speedup on latency and reduces the total Homomorphic Operation Count by 77.4\% with a small accuracy loss of 1-1.5$\%$.


title: Speech Enhancement with Perceptually-motivated Optimization and Dual Transformations

abstract: To address the monaural speech enhancement problem, numerous research studies have been conducted to enhance speech via operations either in time-domain on the inner-domain learned from the speech mixture or in time--frequency domain on the fixed full-band short time Fourier transform (STFT) spectrograms. Very recently, a few studies on sub-band based speech enhancement have been proposed. By enhancing speech via operations on sub-band spectrograms, those studies demonstrated competitive performances on the benchmark dataset of DNS2020. Despite attractive, this new research direction has not been fully explored and there is still room for improvement. As such, in this study, we delve into the latest research direction and propose a sub-band based speech enhancement system with perceptually-motivated optimization and dual transformations, called PT-FSE. Specially, our proposed PT-FSE model improves its backbone, a full-band and sub-band fusion model, by three efforts. First, we design a frequency transformation module that aims to strengthen the global frequency correlation. Then a temporal transformation is introduced to capture long range temporal contexts. Lastly, a novel loss, with leverage of properties of human auditory perception, is proposed to facilitate the model to focus on low frequency enhancement. To validate the effectiveness of our proposed model, extensive experiments are conducted on the DNS2020 dataset. Experimental results show that our PT-FSE system achieves substantial improvements over its backbone, but also outperforms the current state-of-the-art while being 27\% smaller than the SOTA. With average NB-PESQ of 3.57 on the benchmark dataset, our system offers the best speech enhancement results reported till date.


title: Joint Speech Activity and Overlap Detection with Multi-Exit Architecture

abstract: Overlapped speech detection (OSD) is critical for speech applications in scenario of multi-party conversion. Despite numerous research efforts and progresses, comparing with speech activity detection (VAD), OSD remains an open challenge and its overall performance is far from satisfactory. The majority of prior research typically formulates the OSD problem as a standard classification problem, to identify speech with binary (OSD) or three-class label (joint VAD and OSD) at frame level. In contrast to the mainstream, this study investigates the joint VAD and OSD task from a new perspective. In particular, we propose to extend traditional classification network with multi-exit architecture. Such an architecture empowers our system with unique capability to identify class using either low-level features from early exits or high-level features from last exit. In addition, two training schemes, knowledge distillation and dense connection, are adopted to further boost our system performance. Experimental results on benchmark datasets (AMI and DIHARD-III) validated the effectiveness and generality of our proposed system. Our ablations further reveal the complementary contribution of proposed schemes. With $F_1$ score of 0.792 on AMI and 0.625 on DIHARD-III, our proposed system outperforms several top performing models on these datasets, but also surpasses the current state-of-the-art by large margins across both datasets. Besides the performance benefit, our proposed system offers another appealing potential for quality-complexity trade-offs, which is highly preferred for efficient OSD deployment.


title: A meta-analysis of molecular spectroscopy databases, and prospects of molecule detection with some future facilities

abstract: Molecules reside broadly in the interstellar space and can be detected via spectroscopic observations. To date, more than 271 molecular species have been identified in interstellar medium or circumstellar envelopes. Molecular spectroscopic parameters measured in laboratory make the identification of new species and derivation of physical parameters possible. These spectroscopic parameters are systematically collected into databases, two of the most commonly used being the CDMS and JPL databases. While new spectroscopic parameters are continuously measured/calculated and added to those databases, at any point in time it is the existing spectroscopic data that ultimately limits what molecules can possibly be identified in astronomical data. In this work, we conduct a meta-analysis of the CDMS and JPL databases. We show the statistics of transition frequencies and their uncertainties in these two databases, and discuss the line confusion problem under certain physical environments. We then assess the prospects of detecting molecules in common ISM environments using a few facilities that are expected to be conducting spectroscopic observations in the future. Results show that CSST/HSTDM and SKA1-mid have the potential to detect some complex organic molecules, or even amino acids, with reasonable assumptions about ISM environments.


title: Fast Lifelong Adaptive Inverse Reinforcement Learning from Demonstrations

abstract: Learning from Demonstration (LfD) approaches empower end-users to teach robots novel tasks via demonstrations of the desired behaviors, democratizing access to robotics. However, current LfD frameworks are not capable of fast adaptation to heterogeneous human demonstrations nor the large-scale deployment in ubiquitous robotics applications. In this paper, we propose a novel LfD framework, Fast Lifelong Adaptive Inverse Reinforcement learning (FLAIR). Our approach (1) leverages learned strategies to construct policy mixtures for fast adaptation to new demonstrations, allowing for quick end-user personalization, (2) distills common knowledge across demonstrations, achieving accurate task inference; and (3) expands its model only when needed in lifelong deployments, maintaining a concise set of prototypical strategies that can approximate all behaviors via policy mixtures. We empirically validate that FLAIR achieves adaptability (i.e., the robot adapts to heterogeneous, user-specific task preferences), efficiency (i.e., the robot achieves sample-efficient adaptation), and scalability (i.e., the model grows sublinearly with the number of demonstrations while maintaining high performance). FLAIR surpasses benchmarks across three control tasks with an average 57% improvement in policy returns and an average 78% fewer episodes required for demonstration modeling using policy mixtures. Finally, we demonstrate the success of FLAIR in a table tennis task and find users rate FLAIR as having higher task (p<.05) and personalization (p<.05) performance.


title: Convective-wave solutions of the Richard-Gavrilyuk model for inclined shallow water flow

abstract: We study for the Richard-Gavrilyuk model of inclined shallow water flow, an extension of the classical Saint Venant equations incorporating vorticity, the new feature of convective-wave solutions analogous to contact discontinuitis in inviscid conservation laws. These are traveling waves for which fluid velocity is constant and equal to the speed of propagation of the wave, but fluid height and/or enstrophy (thus vorticity) varies. Together with hydraulic shocks, they play an important role in the structure of Riemann solutions.


title: A Focused Study on Sequence Length for Dialogue Summarization

abstract: Output length is critical to dialogue summarization systems. The dialogue summary length is determined by multiple factors, including dialogue complexity, summary objective, and personal preferences. In this work, we approach dialogue summary length from three perspectives. First, we analyze the length differences between existing models' outputs and the corresponding human references and find that summarization models tend to produce more verbose summaries due to their pretraining objectives. Second, we identify salient features for summary length prediction by comparing different model settings. Third, we experiment with a length-aware summarizer and show notable improvement on existing models if summary length can be well incorporated. Analysis and experiments are conducted on popular DialogSum and SAMSum datasets to validate our findings.


title: Limit behavior of a class of Cantor-integers

abstract: In this paper, we study a class of Cantor-integers $\{C_n\}_{n\geq 1}$ with the base conversion function $f:\{0,\dots,m\}\to \{0,\dots,p\}$ being strictly increasing and satisfying $f(0)=0$ and $f(m)=p$. Firstly we provide an algorithm to compute the superior and inferior of the sequence $\left\{\frac{C_n}{n^{\alpha}}\right\}_{n\geq 1}$ where $\alpha =\log_{m+1}^{p+1}$, and obtain the exact values of the superior and inferior when $f$ is a class of quadratic function. Secondly we show that the sequence $\left\{\frac{C_n}{n^{\alpha}}\right\}_{n\geq 1}$ is dense in the close interval with the endpoints being its inferior and superior respectively. As a consequence, (i) we get the upper and lower pointwise density $1/\alpha$-density of the self-similar measure supported on $\mathfrak{C}$ at $0$, where $\mathfrak{C}$ is the Cantor set induced by Cantor-integers. (ii) the sequence $\{\frac{C_n}{n^{\alpha}}\}_{n\geq 1}$ does not have cumulative distribution function but have logarithmic distribution functions (given by a specific Lebesgue integral). Lastly we obtain the Mellin-Perron formula for the summation function of Cantor-integers. In addition, we investigate some analytic properties of the limit function induced by Cantor-integers.


title: The falsification by fellow traveler property implies geodesic autostackability

abstract: Groups with the falsification by fellow traveler property are known to have solvable word problem, but they are not known to be automatic or to have finite convergent rewriting systems. In this paper, we show that these groups admit a generalization of the two properties; namely, they are geodesically autostackable. As a key part of proving this, we show that a wider class of groups, namely groups with a weight non-increasing synchronously regular convergent prefix-rewriting system, have a bounded regular convergent prefix-rewriting system.


title: Structure and dynamics of spray detonation in n-heptane droplet-vapor-air mixtures

abstract: Spray detonation in n-heptane two-phase mixtures is simulated using Eulerian Lagrangian method. Two-dimensional configuration is considered, and the effects of droplet diameter and liquid equivalence ratio on detonation propagation, structure, and dynamics are investigated. The results show that the average detonation propagation speed first increases and then decreases as liquid equivalence ratio changes, and the speed peaks at higher liquid equivalence ratio for larger droplets. The triple points and transverse detonations vaporize or aerodynamically expel the droplets from their trajectories, resulting in non-uniform distributions of fuel vapor and reaction zones behind the detonation. In addition, droplet dispersion distance in the post-detonation area increases for larger droplets due to lower evaporation. Moreover, small droplets generally lead to higher detonated n-heptane fraction, and fuel detonative combustion directly affects the variations of detonated fuel fraction. For larger droplets, V shaped dependence on liquid equivalence ratio is seen for large droplets, dominated by variations of post-detonation deflagration. It is found that spray detonation structure is significantly influenced by liquid fuel equivalence ratio and droplet diameter. The dependence of key locations in spray detonation structure on liquid fuel properties is also evaluated, e.g., reaction front and sonic plane. Furthermore, the leading shock Mach number slightly decreases with droplet size. When the liquid equivalence ratio is high, spray detonation exhibits pronounced unsteadiness, such as instantaneous or complete extinction. Either extinction is caused by strong heat absorption of evaporating droplets behind the shock. Moreover, localized detonative spot is observed due to the compression of multiple transverse shocks.


title: Credit Information in Earnings Calls

abstract: We develop a novel technique to extract credit-relevant information from the text of quarterly earnings calls. This information is not spanned by fundamental or market variables and forecasts future credit spread changes. One reason for such forecastability is that our text-based measure predicts future credit spread risk and firm profitability. More firm- and call-level complexity increase the forecasting power of our measure for spread changes. Out-of-sample portfolio tests show the information in our measure is valuable for investors. Both results suggest that investors do not fully internalize the credit-relevant information contained in earnings calls.


title: Lithium, masses, and kinematics of young Galactic dwarf and giant stars with extreme [$\alpha$/Fe] ratios

abstract: Recent spectroscopic explorations of large Galactic stellar samples stars have revealed the existence of red giants with [$\alpha$/Fe] ratios that are anomalously high, given their relatively young ages. We revisit the GALAH DR3 survey to look for both dwarfs and giants with extreme [$\alpha$/Fe] ratios, that is, the upper 1% in the [$\alpha$/Fe]-[Fe/H] plane over the range in [Fe/H] between -1.1 and +0.4 dex. We refer to these outliers as "ex$\alpha$fe" stars. We used the GALAH DR3 data and their value-added catalog to trace the properties (abundances, masses, ages, and kinematics) of the ex$\alpha$fe stars. We investigated the effects of secular evolution and the magnitude limitations of GALAH to understand the mass and metallicity distributions of the sample stars. We also discuss the corresponding biases in previous studies of stars with high [$\alpha$/Fe] in other surveys. We find both dwarf and giant ex$\alpha$fe stars younger than 3 Gyr, which we refer to as "y-ex$\alpha$fe" stars. Dwarf y-ex$\alpha$fe stars exhibit lithium abundances similar to those of young [$\alpha$/Fe]-normal dwarfs at the same age and [Fe/H]. In particular, the youngest and most massive stars of both populations exhibit the highest Li abundances, A(Li)~3.5 dex (i.e., a factor of 2 above the protosolar value), while cooler/older stars exhibit the same Li depletion patterns increasing with both decreasing mass and increasing age. In addition, the [Fe/H] and mass distributions of both the dwarf and giant y-ex$\alpha$fe stars do not differ from those of their [$\alpha$/Fe]-normal counterparts found in the thin disk and they share the same kinematic properties. We conclude that y-ex$\alpha$fe dwarfs and giants are indeed young, their mass distribution shows no peculiarity, and they differ from young [$\alpha$/Fe]-normal stars by their extreme [$\alpha$/Fe] content only. However, their origin remains unclear.


title: A Simple Strategy to Provable Invariance via Orbit Mapping

abstract: Many applications require robustness, or ideally invariance, of neural networks to certain transformations of input data. Most commonly, this requirement is addressed by training data augmentation, using adversarial training, or defining network architectures that include the desired invariance by design. In this work, we propose a method to make network architectures provably invariant with respect to group actions by choosing one element from a (possibly continuous) orbit based on a fixed criterion. In a nutshell, we intend to 'undo' any possible transformation before feeding the data into the actual network. Further, we empirically analyze the properties of different approaches which incorporate invariance via training or architecture, and demonstrate the advantages of our method in terms of robustness and computational efficiency. In particular, we investigate the robustness with respect to rotations of images (which can hold up to discretization artifacts) as well as the provable orientation and scaling invariance of 3D point cloud classification.


title: Super-resolution atomic microscopy using orbit angular momentum laser with temporal modulation

abstract: In this paper we propose a dark-state-based trapping strategy to break the optical diffraction limit for microscopy. We utilize a spatially dependent coupling field and a probe laser field with temporal and spatial modulation to interact with three-level atoms. The temporal modulation allows us to reduce the full width at half maximum (FWHM) of point spread function, and the spatial modulation help us obtain better spatial resolution than Gaussian beam. In addition, we also propose a proof-of-principle experiment protocol and discuss its feasibility.


title: On the value-distribution of the logarithms of symmetric power L-functions in the level aspect

abstract: We consider the value distribution of logarithms of symmetric power L-functions associated with newforms of even weight and prime power level. In the symmetric square case, under certain plausible analytical conditions, we prove that certain averages of those values in the level aspect, involving continuous bounded or Riemann integrable test functions, can be written as integrals involving a density function (the "M-function") which is related with the Sato-Tate measure. Moreover, even in the case of general symmetric power L-functions, we show the same type of formula when for some special type of test functions. We see that a kind of parity phenomenon of the density function exists.


title: Concordance based Survival Cobra with regression type weak learners

abstract: In this paper, we predict conditional survival functions through a combined regression strategy. We take weak learners as different random survival trees. We propose to maximize concordance in the right-censored set up to find the optimal parameters. We explore two approaches, a usual survival cobra and a novel weighted predictor based on the concordance index. Our proposed formulations use two different norms, say, Max-norm and Frobenius norm, to find a proximity set of predictions from query points in the test dataset. We illustrate our algorithms through three different real-life dataset implementations.


title: Tradeoffs between convergence rate and noise amplification for momentum-based accelerated optimization algorithms

abstract: We study momentum-based first-order optimization algorithms in which the iterations utilize information from the two previous steps and are subject to an additive white noise. This setup uses noise to account for uncertainty in either gradient evaluation or iteration updates, and it includes Polyak's heavy-ball and Nesterov's accelerated methods as special cases. For strongly convex quadratic problems, we use the steady-state variance of the error in the optimization variable to quantify noise amplification and identify fundamental stochastic performance tradeoffs. Our approach utilizes the Jury stability criterion to provide a novel geometric characterization of conditions for linear convergence, and it reveals the relation between the noise amplification and convergence rate as well as their dependence on the condition number and the constant algorithmic parameters. This geometric insight leads to simple alternative proofs of standard convergence results and allows us to establish ``uncertainty principle'' of strongly convex optimization: for the two-step momentum method with linear convergence rate, the lower bound on the product between the settling time and noise amplification scales quadratically with the condition number. Our analysis also identifies a key difference between the gradient and iterate noise models: while the amplification of gradient noise can be made arbitrarily small by sufficiently decelerating the algorithm, the best achievable variance for the iterate noise model increases linearly with the settling time in the decelerating regime. Finally, we introduce two parameterized families of algorithms that strike a balance between noise amplification and settling time while preserving order-wise Pareto optimality for both noise models.


title: The extended quasi-Einstein manifolds with generalised Ricci solitons

abstract: As a generalization of Einstein manifolds, the nearly quasi-Einstein manifolds and pseudo quasi-Einstein manifolds are both interesting and useful in studying the general relativity. In this paper, we study the extended quasi-Einstein manifolds which derive from pseudo quasi-Einstein manifolds. After showing the existence theorem of extended quasi-Einstein manifold, we give some special geometric properties of such manifolds. At the same time, we also discuss the extended quasi-Einstein manifolds with certain soliton like generalised Ricci soliton or Riemann soliton. Furthermore, we construct some nontrivial example to illustrate these extended quasi-Einstein manifolds.


title: Efficient Exponential Integrator Finite Element Method for Semilinear Parabolic Equations

abstract: In this paper, we propose an efficient exponential integrator finite element method for solving a class of semilinear parabolic equations in rectangular domains. The proposed method first performs the spatial discretization of the model equation using the finite element approximation with continuous multilinear rectangular basis functions, and then takes the explicit exponential Runge-Kutta approach for time integration of the resulting semi-discrete system to produce fully-discrete numerical solution. Under certain regularity assumptions, error estimates measured in $H^1$-norm are successfully derived for the proposed schemes with one and two RK stages. More remarkably, the mass and coefficient matrices of the proposed method can be simultaneously diagonalized with an orthogonal matrix, which provides a fast solution process based on tensor product spectral decomposition and fast Fourier transform. Various numerical experiments in two and three dimensions are also carried out to validate the theoretical results and demonstrate the excellent performance of the proposed method.


title: DeepChrome 2.0: Investigating and Improving Architectures, Visualizations, & Experiments

abstract: Histone modifications play a critical role in gene regulation. Consequently, predicting gene expression from histone modification signals is a highly motivated problem in epigenetics. We build upon the work of DeepChrome by Singh et al. (2016), who trained classifiers that map histone modification signals to gene expression. We present a novel visualization technique for providing insight into combinatorial relationships among histone modifications for gene regulation that uses a generative adversarial network to generate histone modification signals. We also explore and compare various architectural changes, with results suggesting that the 645k-parameter convolutional neural network from DeepChrome has the same predictive power as a 12-parameter linear network. Results from cross-cell prediction experiments, where the model is trained and tested on datasets of varying sizes, cell-types, and correlations, suggest the relationship between histone modification signals and gene expression is independent of cell type. We release our PyTorch re-implementation of DeepChrome on GitHub \footnote{\url{github.com/ssss1029/gene_expression_294}}.\parfillskip=0pt


title: Interventional Causal Representation Learning

abstract: Causal representation learning seeks to extract high-level latent factors from low-level sensory data. Most existing methods rely on observational data and structural assumptions (e.g., conditional independence) to identify the latent factors. However, interventional data is prevalent across applications. Can interventional data facilitate causal representation learning? We explore this question in this paper. The key observation is that interventional data often carries geometric signatures of the latent factors' support (i.e. what values each latent can possibly take). For example, when the latent factors are causally connected, interventions can break the dependency between the intervened latents' support and their ancestors'. Leveraging this fact, we prove that the latent causal factors can be identified up to permutation and scaling given data from perfect $do$ interventions. Moreover, we can achieve block affine identification, namely the estimated latent factors are only entangled with a few other latents if we have access to data from imperfect interventions. These results highlight the unique power of interventional data in causal representation learning; they can enable provable identification of latent factors without any assumptions about their distributions or dependency structure.


title: Local_INN: Implicit Map Representation and Localization with Invertible Neural Networks

abstract: Robot localization is an inverse problem of finding a robot's pose using a map and sensor measurements. In recent years, Invertible Neural Networks (INNs) have successfully solved ambiguous inverse problems in various fields. This paper proposes a framework that solves the localization problem with INN. We design an INN that provides implicit map representation in the forward path and localization in the inverse path. By sampling the latent space in evaluation, Local\_INN outputs robot poses with covariance, which can be used to estimate the uncertainty. We show that the localization performance of Local\_INN is on par with current methods with much lower latency. We show detailed 2D and 3D map reconstruction from Local\_INN using poses exterior to the training set. We also provide a global localization algorithm using Local\_INN to tackle the kidnapping problem.