title: PROB: Probabilistic Objectness for Open World Object Detection

abstract: Open World Object Detection (OWOD) is a new and challenging computer vision task that bridges the gap between classic object detection (OD) benchmarks and object detection in the real world. In addition to detecting and classifying seen/labeled objects, OWOD algorithms are expected to detect novel/unknown objects - which can be classified and incrementally learned. In standard OD, object proposals not overlapping with a labeled object are automatically classified as background. Therefore, simply applying OD methods to OWOD fails as unknown objects would be predicted as background. The challenge of detecting unknown objects stems from the lack of supervision in distinguishing unknown objects and background object proposals. Previous OWOD methods have attempted to overcome this issue by generating supervision using pseudo-labeling - however, unknown object detection has remained low. Probabilistic/generative models may provide a solution for this challenge. Herein, we introduce a novel probabilistic framework for objectness estimation, where we alternate between probability distribution estimation and objectness likelihood maximization of known objects in the embedded feature space - ultimately allowing us to estimate the objectness probability of different proposals. The resulting Probabilistic Objectness transformer-based open-world detector, PROB, integrates our framework into traditional object detection models, adapting them for the open-world setting. Comprehensive experiments on OWOD benchmarks show that PROB outperforms all existing OWOD methods in both unknown object detection ($\sim 2\times$ unknown recall) and known object detection ($\sim 10\%$ mAP). Our code will be made available upon publication at https://github.com/orrzohar/PROB.


title: Associative Algebras with Small Derived Ideal

abstract: The paper concerns extra special associative algebras, an analogue of the Heisenberg Lie algebra. In particular, we say that an associative algebra is extra special if its center is equal to its derived ideal and the center is 1-dimensional. In this paper, we classify extra special associative algebras by proving that their structure is equivalent to that of extra special Leibniz algebras. We then characterize their (Schur) multipliers via dimension and completely determine their capability. We connect this with the related notion of unicentral algebras and discuss the problem of classifying extra special diassociative algebras.


title: Learning a Pedestrian Social Behavior Dictionary

abstract: Understanding pedestrian behavior patterns is a key component to building autonomous agents that can navigate among humans. We seek a learned dictionary of pedestrian behavior to obtain a semantic description of pedestrian trajectories. Supervised methods for dictionary learning are impractical since pedestrian behaviors may be unknown a priori and the process of manually generating behavior labels is prohibitively time consuming. We instead utilize a novel, unsupervised framework to create a taxonomy of pedestrian behavior observed in a specific space. First, we learn a trajectory latent space that enables unsupervised clustering to create an interpretable pedestrian behavior dictionary. We show the utility of this dictionary for building pedestrian behavior maps to visualize space usage patterns and for computing the distributions of behaviors. We demonstrate a simple but effective trajectory prediction by conditioning on these behavior labels. While many trajectory analysis methods rely on RNNs or transformers, we develop a lightweight, low-parameter approach and show results comparable to SOTA on the ETH and UCY datasets.


title: Investigations on the Influence of Combined Inter-Aural Cue Distortions on Overall Audio Quality

abstract: There is a considerable interest in developing algorithms that can predict audio quality of perceptually coded signals to avoid the cost of extensive listening tests during development time. While many established algorithms for predicting the perceived quality of signals with monaural (timbral) distortions are available (PEAQ, POLQA), predicting the quality degradation of stereo and multi-channel spatial signals is still considered a challenge. Audio quality degradation arising from spatial distortions is usually measured in terms of well known inter-aural cue distortion measures such as Inter-aural Level Difference Distortions (ILDD), Inter-aural Time Difference Distortions (ITDD) and Inter-aural Cross Correlation Distortions (IACCD). However, the extent to which their interaction influences the overall audio quality degradation in complex signals as expressed - for example - in a multiple stimuli test is not yet thoroughly studied. We propose a systematic approach that introduces controlled combinations of spatial distortions on a representative set of signals and evaluates their influence on overall perceived quality degradation by analyzing listening test scores over said signals. From this study we derive guidelines for designing meaningful distortion measures that consider inter-aural cue distortion interactions.


title: MeshDQN: A Deep Reinforcement Learning Framework for Improving Meshes in Computational Fluid Dynamics

abstract: Meshing is a critical, but user-intensive process necessary for stable and accurate simulations in computational fluid dynamics (CFD). Mesh generation is often a bottleneck in CFD pipelines. Adaptive meshing techniques allow the mesh to be updated automatically to produce an accurate solution for the problem at hand. Existing classical techniques for adaptive meshing require either additional functionality out of solvers, many training simulations, or both. Current machine learning techniques often require substantial computational cost for training data generation, and are restricted in scope to the training data flow regime. MeshDQN is developed as a general purpose deep reinforcement learning framework to iteratively coarsen meshes while preserving target property calculation. A graph neural network based deep Q network is used to select mesh vertices for removal and solution interpolation is used to bypass expensive simulations at each step in the improvement process. MeshDQN requires a single simulation prior to mesh coarsening, while making no assumptions about flow regime, mesh type, or solver, only requiring the ability to modify meshes directly in a CFD pipeline. MeshDQN successfully improves meshes for two 2D airfoils.


title: High temperature equilibrium of 3D and 2D chalcogenide perovskites

abstract: Chalcogenide perovskites have been recently under the researchers spotlight as novel absorber materials for photovoltaic applications. BaZrS$_3$, the most investigated compound of this family, shows a high absorption coefficient, a bandgap of around 1.8 eV, and excellent environmental and thermal stability. In addition to the 3D perovskite BaZrS$_3$, the Ba-Zr-S compositional space contains various 2-D Ruddlesden-Popper phases Ba$_{x+1}$Zr$_x$S$_{3x+1}$ (with $x=$ 1, 2, 3) which have recently been reported. In this work it will be shown that at high temperature the Gibbs free energies of 3D and 2D perovskites are very close, suggesting that 2D phases can be easily formed at high temperatures. The analysis of the product of the BaS and ZrS$_2$ solid-state reaction, in different stoichiometric conditions, present a mixture of BaZrS$_3$ and Ba$_4$Zr$_3$S$_{10}$. To carefully resolve the composition, XRD, SEM and EDS analysis were complemented with Raman spectroscopy. For this purpose, the phonon modes, and the consequent Raman spectra, were calculated for the 3D and 2D chalcogenide perovskites, as well as for the binary precursors. This thorough characterization demonstrates the thermodynamic limitations and experimental difficulties in forming phase-pure chalcogenide perovskites through solid state synthesis, and the importance of using multiple techniques to soundly resolve the composition of these chalcogenide materials.


title: Convergence map with action-angle variables based on square matrix for nonlinear lattice optimization

abstract: To analyze nonlinear dynamic systems, we developed a new technique based on the square matrix method. We propose this technique called the \convergence map" for generating particle stability diagrams similar to the frequency maps widely used in accelerator physics to estimate dynamic aperture. The convergence map provides similar information as the frequency map but in a much shorter computing time. The dynamic equation can be rewritten in terms of action-angle variables provided by the square matrix derived from the accelerator lattice. The convergence map is obtained by solving the exact nonlinear equation iteratively by the perturbation method using Fourier transform and studying convergence. When the iteration is convergent, the solution is expressed as a quasi-periodic analytical function as a highly accurate approximation, and hence the motion is stable. The border of stable motion determines the dynamical aperture. As an example, we applied the new method to the nonlinear optimization of the NSLS-II storage ring and demonstrated a dynamic aperture comparable to or larger than the nominal one obtained by particle tracking. The computation speed of the convergence map is 30 to 300 times faster than the speed of the particle tracking, depending on the size of the ring lattice (number of superperiods). The computation speed ratio is larger for complex lattices with low symmetry, such as particle colliders.


title: Equation of state and Taylor expansions at nonzero isospin chemical potential

abstract: We compute the equation of state of isospin asymmetric QCD at zero and non-zero temperatures using direct simulations of lattice QCD with three dynamical flavors at physical quark masses. In addition to the pressure and the trace anomaly and their behavior towards the continuum limit, we will particularly discuss the extraction of the speed of sound. Furthermore, we discuss first steps towards the extension of the EoS to small non-zero baryon chemical potentials via Taylor expansion.


title: Machine Learned Interatomic Potential for Dispersion Strengthened Plasma Facing Components

abstract: Tungsten (W) is a material of choice for the divertor material due to its high melting temperature, thermal conductivity, and sputtering threshold. However, W has a very high brittle-to-ductile transition temperature and at fusion reactor temperatures ($\geq$1000K) may undergo recrystallization and grain growth. Dispersion-strengthening W with zirconium carbide (ZrC) can improve ductility and limit grain growth, but much of the effects of the dispersoids on microstructural evolution and thermomechanical properties at high temperature are still unknown. We present a machine learned Spectral Neighbor Analysis Potential (SNAP) for W-ZrC that can now be used to study these materials. In order to construct a potential suitable for large-scale atomistic simulations at fusion reactor temperatures, it is necessary to train on ab initio data generated for a diverse set of structures, chemical environments, and temperatures. Further accuracy and stability tests of the potential were achieved using objective functions for both material properties and high temperature stability. Validation of lattice parameters, surface energies, bulk moduli, and thermal expansion is confirmed on the optimized potential. Tensile tests of W/ZrC bicrystals show that while the W(110)-ZrC(111) C-terminated bicrystal has the highest ultimate tensile strength (UTS) at room temperature, observed strength decreases with increasing temperature. At 2500K, the terminating C layer diffuses into the W, resulting in a weaker W-Zr interface. Meanwhile, the W(110)-ZrC(111) Zr-terminated bicrystal has the highest UTS at 2500K.


title: Avoiding spurious correlations via logit correction

abstract: Empirical studies suggest that machine learning models trained with empirical risk minimization (ERM) often rely on attributes that may be spuriously correlated with the class labels. Such models typically lead to poor performance during inference for data lacking such correlations. In this work, we explicitly consider a situation where potential spurious correlations are present in the majority of training data. In contrast with existing approaches, which use the ERM model outputs to detect the samples without spurious correlations and either heuristically upweight or upsample those samples, we propose the logit correction (LC) loss, a simple yet effective improvement on the softmax cross-entropy loss, to correct the sample logit. We demonstrate that minimizing the LC loss is equivalent to maximizing the group-balanced accuracy, so the proposed LC could mitigate the negative impacts of spurious correlations. Our extensive experimental results further reveal that the proposed LC loss outperforms state-of-the-art solutions on multiple popular benchmarks by a large margin, an average 5.5\% absolute improvement, without access to spurious attribute labels. LC is also competitive with oracle methods that make use of the attribute labels. Code is available at https://github.com/shengliu66/LC.


title: Generalizable Human-Robot Collaborative Assembly Using Imitation Learning and Force Control

abstract: Robots have been steadily increasing their presence in our daily lives, where they can work along with humans to provide assistance in various tasks on industry floors, in offices, and in homes. Automated assembly is one of the key applications of robots, and the next generation assembly systems could become much more efficient by creating collaborative human-robot systems. However, although collaborative robots have been around for decades, their application in truly collaborative systems has been limited. This is because a truly collaborative human-robot system needs to adjust its operation with respect to the uncertainty and imprecision in human actions, ensure safety during interaction, etc. In this paper, we present a system for human-robot collaborative assembly using learning from demonstration and pose estimation, so that the robot can adapt to the uncertainty caused by the operation of humans. Learning from demonstration is used to generate motion trajectories for the robot based on the pose estimate of different goal locations from a deep learning-based vision system. The proposed system is demonstrated using a physical 6 DoF manipulator in a collaborative human-robot assembly scenario. We show successful generalization of the system's operation to changes in the initial and final goal locations through various experiments.


title: Tools and methods for Human-Autonomy Teaming: Contributions to cognitive state monitoring and system adaptation

abstract: The Human-Autonomy Teaming paradigm (HAT) has recently emerged to model and design hybrid teams, where a human operator must cooperate with an artificial agent, able to independently evolve in dynamic and uncertain situations. An important challenge in HAT is to transform autonomous systems into better teammates, capable of joining humans in highly interdependent activities. The presented works explore two main avenues, supported by industrial collaborations (in the domain of transportation and industrial systems), academic partnerships (especially with South Australian universities), and with the supervision PhD students. The first axis deals with the monitoring of cognitive states, to equip the machine with an ability to detect when human face difficulties. To address this question, a global approach is proposed to classify operators mental workload from the fusion of multisourced physiological and behavioral data. The second axis focused on the mechanisms for adapting human-autonomy teaming, making machine more compatible with human. Two kinds of solution are explored. One focused on the offline enhancement of the know-how-to-cooperate of machines, with the aid of CWA method and MDE techniques. The other deals with online adaptation of human-machine cooperation, where autonomous system can be considered inside the team - as a teammate - or above the team-as a coach. Finally, new research directions are opened, supported by ongoing initiatives in France and abroad. These perspectives relate to the consolidation of a multilevel approach for cognitive state monitoring, the building of a transparent dialogue between human and autonomy, a deeper consideration of transitional and longitudinal situations in HAT, and the scale-up challenge of studying HAT with human teams.


title: Unauthorized Drone Detection: Experiments and Prototypes

abstract: The increase in the number of unmanned aerial vehicles a.k.a. drones pose several threats to public privacy, critical infrastructure and cyber security. Hence, detecting unauthorized drones is a significant problem which received attention in the last few years. In this paper, we present our experimental work on three drone detection methods (i.e., acoustic detection, radio frequency (RF) detection, and visual detection) to evaluate their efficacy in both indoor and outdoor environments. Owing to the limitations of these schemes, we present a novel encryption-based drone detection scheme that uses a two-stage verification of the drone's received signal strength indicator (RSSI) and the encryption key generated from the drone's position coordinates to reliably detect an unauthorized drone in the presence of authorized drones.


title: Identifying Heterogeneous Treatment Effects in Multiple Outcomes using Joint Confidence Intervals

abstract: Heterogeneous treatment effects (HTEs) are commonly identified during randomized controlled trials (RCTs). Identifying subgroups of patients with similar treatment effects is of high interest in clinical research to advance precision medicine. Often, multiple clinical outcomes are measured during an RCT, each having a potentially heterogeneous effect. Recently there has been high interest in identifying subgroups from HTEs, however, there has been less focus on developing tools in settings where there are multiple outcomes. In this work, we propose a framework for partitioning the covariate space to identify subgroups across multiple outcomes based on the joint CIs. We test our algorithm on synthetic and semi-synthetic data where there are two outcomes, and demonstrate that our algorithm is able to capture the HTE in both outcomes simultaneously.


title: On the optimal rank-1 approximation of matrices in the Chebyshev norm

abstract: The problem of low rank approximation is ubiquitous in science. Traditionally this problem is solved in unitary invariant norms such as Frobenius or spectral norm due to existence of efficient methods for building approximations. However, recent results reveal the potential of low rank approximations in Chebyshev norm, which naturally arises in many applications. In this paper we tackle the problem of building optimal rank-1 approximations in the Chebyshev norm. We investigate the properties of alternating minimization algorithm for building the low rank approximations and demonstrate how to use it to construct optimal rank-1 approximation. As a result we propose an algorithm that is capable of building optimal rank-1 approximations in Chebyshev norm for small matrices.


title: PANCO2: a Python library to measure intracluster medium pressure profiles from Sunyaev-Zeldovich observations

abstract: We present panco2, an open-source Python library designed to extract galaxy cluster pressure profiles from maps of the thermal Sunyaev-Zeldovich effect. The extraction is based on forward modeling of the total observed signal, allowing to take into account usual features of millimeter observations, such as beam smearing, data processing filtering, and point source contamination. panco2 offers a large flexibility in the inputs that can be handled and in the analysis options, enabling refined analyses and studies of systematic effects. We detail the functionalities of the code, the algorithm used to infer pressure profile measurements, and the typical data products. We present examples of running sequences, and the validation on simulated inputs. The code is available on GitHub at https://github.com/fkeruzore/panco2, and comes with an extensive technical documentation to complement this paper at https://panco2.readthedocs.io.


title: SMARTQUERY: An Active Learning Framework for Graph Neural Networks through Hybrid Uncertainty Reduction

abstract: Graph neural networks have achieved significant success in representation learning. However, the performance gains come at a cost; acquiring comprehensive labeled data for training can be prohibitively expensive. Active learning mitigates this issue by searching the unexplored data space and prioritizing the selection of data to maximize model's performance gain. In this paper, we propose a novel method SMARTQUERY, a framework to learn a graph neural network with very few labeled nodes using a hybrid uncertainty reduction function. This is achieved using two key steps: (a) design a multi-stage active graph learning framework by exploiting diverse explicit graph information and (b) introduce label propagation to efficiently exploit known labels to assess the implicit embedding information. Using a comprehensive set of experiments on three network datasets, we demonstrate the competitive performance of our method against state-of-the-arts on very few labeled data (up to 5 labeled nodes per class).


title: Multi-Agent Reinforcement Learning with Reward Delays

abstract: This paper considers multi-agent reinforcement learning (MARL) where the rewards are received after delays and the delay time varies across agents and across time steps. Based on the V-learning framework, this paper proposes MARL algorithms that efficiently deal with reward delays. When the delays are finite, our algorithm reaches a coarse correlated equilibrium (CCE) with rate $\tilde{\mathcal{O}}(\frac{H^3\sqrt{S\mathcal{T}_K}}{K}+\frac{H^3\sqrt{SA}}{\sqrt{K}})$ where $K$ is the number of episodes, $H$ is the planning horizon, $S$ is the size of the state space, $A$ is the size of the largest action space, and $\mathcal{T}_K$ is the measure of total delay formally defined in the paper. Moreover, our algorithm is extended to cases with infinite delays through a reward skipping scheme. It achieves convergence rate similar to the finite delay case.


title: Optical Refrigeration for an Optomechanical Amplifier

abstract: We explore the viability of using optical refrigeration as a low-vibration cooling method for a phase-sensitive optomechanical amplifier proposed to improve the sensitivity of future gravitational wave detectors. We find that with moderate improvements on coolants currently available, optical refrigeration can improve the amplifier gain by a factor of 10 relative to what is possible with radiative cooling. We also show that the technique does not add significant noise to the amplifier. These results indicate that optical refrigeration can play an important role in cooling optomechanical devices.


title: Optimal list decoding from noisy entropy inequality

abstract: A noisy entropy inequality for boolean functions by Samorodnitsky is applied to binary codes. It is shown that a binary code that achieves capacity on the binary erasure channel admits optimal list size for list decoding on some binary symmetric channels (in a regime where this optimal list size is exponentially large).


title: Time Governors for Safe Path-Following Control

abstract: Safe and smooth robot motion around obstacles is an essential skill for autonomous robots, especially when operating around people and other robots. Conventionally, due to real-time operation requirements and onboard computation limitations, many robot motion planning and control methods follow a two-step approach: first construct a (e.g., piecewise linear) collision-free reference path for a simplified robot model, and then execute the reference plan via path-following control for a more accurate and complex robot model. A challenge of such a decoupled robot motion planning and control method for highly dynamic robotic systems is ensuring the safety of path-following control as well as the successful completion of the reference plan. In this paper, we introduce a novel dynamical systems approach for online closed-loop time parametrization, called $\textit{a time governor}$, of a reference path for provably correct and safe path-following control based on feedback motion prediction, where the safety of robot motion under path-following control is continuously monitored using predicted robot motion. After introducing the general framework of time governors for safe path following, we present an example application for the fully actuated high-order robot dynamics using proportional-and-higher-order-derivative (PhD) path-following control whose feedback motion prediction is performed by Lyapunov ellipsoids and Vandemonde simplexes. In numerical simulations, we investigate the role of reference position and velocity feedback, and motion prediction on path-following performance and robot motion.


title: Drones-aided Asset Maintenance in Hospitals

abstract: The rapid outbreak of COVID-19 pandemic invoked scientists and researchers to prepare the world for future disasters. During the pandemic, global authorities on healthcare urged the importance of disinfection of objects and surfaces. To implement efficient and safe disinfection services during the pandemic, robots have been utilized for indoor assets. In this paper, we envision the use of drones for disinfection of outdoor assets in hospitals and other facilities. Such heterogeneous assets may have different service demands (e.g., service time, quantity of the disinfectant material etc.), whereas drones have typically limited capacity (i.e., travel time, disinfectant carrying capacity). To serve all the facility assets in an efficient manner, the drone to assets allocation and drone travel routes must be optimized. In this paper, we formulate the capacitated vehicle routing problem (CVRP) to find optimal route for each drone such that the total service time is minimized, while simultaneously the drones meet the demands of each asset allocated to it. The problem is solved using mixed integer programming (MIP). As CVRP is an NP-hard problem, we propose a lightweight heuristic to achieve sub-optimal performance while reducing the time complexity in solving the problem involving a large number of assets.


title: Downscaling Extreme Rainfall Using Physical-Statistical Generative Adversarial Learning

abstract: Modeling the risk of extreme weather events in a changing climate is essential for developing effective adaptation and mitigation strategies. Although the available low-resolution climate models capture different scenarios, accurate risk assessment for mitigation and adaption often demands detail that they typically cannot resolve. Here, we develop a dynamic data-driven downscaling (super-resolution) method that incorporates physics and statistics in a generative framework to learn the fine-scale spatial details of rainfall. Our method transforms coarse-resolution ($0.25^{\circ} \times 0.25^{\circ}$) climate model outputs into high-resolution ($0.01^{\circ} \times 0.01^{\circ}$) rainfall fields while efficaciously quantifying uncertainty. Results indicate that the downscaled rainfall fields closely match observed spatial fields and their risk distributions.


title: Compound Tokens: Channel Fusion for Vision-Language Representation Learning

abstract: We present an effective method for fusing visual-and-language representations for several question answering tasks including visual question answering and visual entailment. In contrast to prior works that concatenate unimodal representations or use only cross-attention, we compose multimodal representations via channel fusion. By fusing on the channels, the model is able to more effectively align the tokens compared to standard methods. These multimodal representations, which we call compound tokens are generated with cross-attention transformer layers. First, vision tokens are used as queries to retrieve compatible text tokens through cross-attention. We then chain the vision tokens and the queried text tokens along the channel dimension. We call the resulting representations compound tokens. A second group of compound tokens are generated using an analogous process where the text tokens serve as queries to the cross-attention layer. We concatenate all the compound tokens for further processing with multimodal encoder. We demonstrate the effectiveness of compound tokens using an encoder-decoder vision-language model trained end-to-end in the open-vocabulary setting. Compound Tokens achieve highly competitive performance across a range of question answering tasks including GQA, VQA2.0, and SNLI-VE.


title: PGFed: Personalize Each Client's Global Objective for Federated Learning

abstract: Personalized federated learning has received an upsurge of attention due to the mediocre performance of conventional federated learning (FL) over heterogeneous data. Unlike conventional FL which trains a single global consensus model, personalized FL allows different models for different clients. However, existing personalized FL algorithms only implicitly transfer the collaborative knowledge across the federation by embedding the knowledge into the aggregated model or regularization. We observed that this implicit knowledge transfer fails to maximize the potential of each client's empirical risk toward other clients. Based on our observation, in this work, we propose Personalized Global Federated Learning (PGFed), a novel personalized FL framework that enables each client to personalize its own global objective by explicitly and adaptively aggregating the empirical risks of itself and other clients. To avoid massive (O(N^2)) communication overhead and potential privacy leakage while achieving this, each client's risk is estimated through a first-order approximation for other clients' adaptive risk aggregation. On top of PGFed, we develop a momentum upgrade, dubbed PGFedMo, to more efficiently utilize clients' empirical risks. Our extensive experiments on four datasets under different federated settings show consistent improvements of PGFed over previous state-of-the-art methods. The code is publicly available at https://github.com/ljaiverson/pgfed.


title: Pinhole interference in three-dimensional fuzzy space

abstract: We investigate a quantum-to-classical transition which arises naturally within the fuzzy sphere formalism for three-dimensional non-commutative quantum mechanics. This transition may be understood as the mechanism of decoherence, but without requiring an additional external heat bath. We focus on treating a two-pinhole interference configuration within this formalism, as it provides an illustrative toy model for which this transition is readily observed and quantified. Specifically, we demonstrate a suppression of the quantum interference effects for objects passing through the pinholes with sufficiently-high energies or numbers of constituent particles. Our work extends a similar treatment of the double slit experiment by Pittaway and Scholtz (2021) within the two-dimensional Moyal plane, only it addresses two key shortcomings that arise in that context. These are, firstly that the interference pattern in the Moyal plane lacks the expected reflection symmetry present in the pinhole setup, and secondly that the quantum-to-classical transition manifested in the Moyal plane occurs only at unrealistically high velocities and/or particle numbers. Both of these issues are solved in the fuzzy sphere framework.


title: Crowd Density Estimation using Imperfect Labels

abstract: Density estimation is one of the most widely used methods for crowd counting in which a deep learning model learns from head-annotated crowd images to estimate crowd density in unseen images. Typically, the learning performance of the model is highly impacted by the accuracy of the annotations and inaccurate annotations may lead to localization and counting errors during prediction. A significant amount of works exist on crowd counting using perfectly labelled datasets but none of these explore the impact of annotation errors on the model accuracy. In this paper, we investigate the impact of imperfect labels (both noisy and missing labels) on crowd counting accuracy. We propose a system that automatically generates imperfect labels using a deep learning model (called annotator) which are then used to train a new crowd counting model (target model). Our analysis on two crowd counting models and two benchmark datasets shows that the proposed scheme achieves accuracy closer to that of the model trained with perfect labels showing the robustness of crowd models to annotation errors.


title: Objective Assessment of Spatial Audio Quality using Directional Loudness Maps

abstract: This work introduces a feature extracted from stereophonic/binaural audio signals aiming to represent a measure of perceived quality degradation in processed spatial auditory scenes. The feature extraction technique is based on a simplified stereo signal model considering auditory events positioned towards a given direction in the stereo field using amplitude panning (AP) techniques. We decompose the stereo signal into a set of directional signals for given AP values in the Short-Time Fourier Transform domain and calculate their overall loudness to form a directional loudness representation or maps. Then, we compare directional loudness maps of a reference signal and a deteriorated version to derive a distortion measure aiming to describe the associated perceived degradation scores reported in listening tests. The measure is then tested on an extensive listening test database with stereo signals processed by state-of-the-art perceptual audio codecs using non waveform-preserving techniques such as bandwidth extension and joint stereo coding, known for presenting a challenge to existing quality predictors. Results suggest that the derived distortion measure can be incorporated as an extension to existing automated perceptual quality assessment algorithms for improving prediction on spatially coded audio signals.


title: CLIP: Train Faster with Less Data

abstract: Deep learning models require an enormous amount of data for training. However, recently there is a shift in machine learning from model-centric to data-centric approaches. In data-centric approaches, the focus is to refine and improve the quality of the data to improve the learning performance of the models rather than redesigning model architectures. In this paper, we propose CLIP i.e., Curriculum Learning with Iterative data Pruning. CLIP combines two data-centric approaches i.e., curriculum learning and dataset pruning to improve the model learning accuracy and convergence speed. The proposed scheme applies loss-aware dataset pruning to iteratively remove the least significant samples and progressively reduces the size of the effective dataset in the curriculum learning training. Extensive experiments performed on crowd density estimation models validate the notion behind combining the two approaches by reducing the convergence time and improving generalization. To our knowledge, the idea of data pruning as an embedded process in curriculum learning is novel.


title: Twitter Data Analysis: Izmir Earthquake Case

abstract: T\"urkiye is located on a fault line; earthquakes often occur on a large and small scale. There is a need for effective solutions for gathering current information during disasters. We can use social media to get insight into public opinion. This insight can be used in public relations and disaster management. In this study, Twitter posts on Izmir Earthquake that took place on October 2020 are analyzed. We question if this analysis can be used to make social inferences on time. Data mining and natural language processing (NLP) methods are used for this analysis. NLP is used for sentiment analysis and topic modelling. The latent Dirichlet Allocation (LDA) algorithm is used for topic modelling. We used the Bidirectional Encoder Representations from Transformers (BERT) model working with Transformers architecture for sentiment analysis. It is shown that the users shared their goodwill wishes and aimed to contribute to the initiated aid activities after the earthquake. The users desired to make their voices heard by competent institutions and organizations. The proposed methods work effectively. Future studies are also discussed.


title: Agent Miner: An Algorithm for Discovering Agent Systems from Event Data

abstract: Process discovery studies ways to use event data generated by business processes and recorded by IT systems to construct models that describe the processes. Existing discovery algorithms are predominantly concerned with constructing process models that represent the control flow of the processes. Agent system mining argues that business processes often emerge from interactions of autonomous agents and uses event data to construct models of the agents and their interactions. This paper presents and evaluates Agent Miner, an algorithm for discovering models of agents and their interactions from event data composing the system that has executed the processes which generated the input data. The conducted evaluation using our open-source implementation of Agent Miner and publicly available industrial datasets confirms that our algorithm can provide insights into the process participants and their interaction patterns and often discovers models that describe the business processes more faithfully than process models discovered using conventional process discovery algorithms.


title: Discovering Class-Specific GAN Controls for Semantic Image Synthesis

abstract: Prior work has extensively studied the latent space structure of GANs for unconditional image synthesis, enabling global editing of generated images by the unsupervised discovery of interpretable latent directions. However, the discovery of latent directions for conditional GANs for semantic image synthesis (SIS) has remained unexplored. In this work, we specifically focus on addressing this gap. We propose a novel optimization method for finding spatially disentangled class-specific directions in the latent space of pretrained SIS models. We show that the latent directions found by our method can effectively control the local appearance of semantic classes, e.g., changing their internal structure, texture or color independently from each other. Visual inspection and quantitative evaluation of the discovered GAN controls on various datasets demonstrate that our method discovers a diverse set of unique and semantically meaningful latent directions for class-specific edits.


title: A Standardized Framework for Collecting Graduate Student Input in Faculty Searches

abstract: We present a procedure designed to standardize input received during faculty searches with the goal of amplifying student voices. The framework was originally used to collect feedback from graduate students, but it can be adapted easily to collect feedback from undergraduate students, faculty, staff or other stakeholders. Implementing this framework requires agreement across participating parties and minimal organization prior to the start of faculty candidate visits.


title: NEAL: An open-source tool for audio annotation

abstract: Passive acoustic monitoring is used widely in ecology, biodiversity, and conservation studies. Data sets collected via acoustic monitoring are often extremely large and built to be processed automatically using Artificial Intelligence and Machine learning models, which aim to replicate the work of domain experts. These models, being supervised learning algorithms, need to be trained on high quality annotations produced by experts. Since the experts are often resource-limited, a cost-effective process for annotating audio is needed to get maximal use out of the data. We present an open-source interactive audio data annotation tool, NEAL (Nature+Energy Audio Labeller). Built using R and the associated Shiny framework, the tool provides a reactive environment where users can quickly annotate audio files and adjust settings that automatically change the corresponding elements of the user interface. The app has been designed with the goal of having both expert birders and citizen scientists contribute to acoustic annotation projects. The popularity and flexibility of R programming in bioacoustics means that the Shiny app can be modified for other bird labelling data sets, or even to generic audio labelling tasks. We demonstrate the app by labelling data collected from wind farm sites across Ireland.


title: Stabbing balls with line segments and polygonal paths

abstract: We study the problem of ordered stabbing of $n$ balls (of arbitrary and possibly different radii, no ball contained in another) in $\mathbb{R}^d$, $d \geq 3$, with either a directed line segment or a (directed) polygonal curve. Here, the line segment, respectively polygonal curve, shall visit (intersect) the given sequence of balls in the order of the sequence. We present a deterministic algorithm that decides whether there exists a line segment stabbing the given sequence of balls in order, in time $O(n^{4d-2} \log n)$. Due to the descriptional complexity of the region containing these line segments, we can not extend this algorithm to actually compute one. We circumvent this hurdle by devising a randomized algorithm for a relaxed variant of the ordered line segment stabbing problem, which is built upon the central insights from the aforementioned decision algorithm. We further show that this algorithm can be plugged into an algorithmic scheme by Guibas et al., yielding an algorithm for a relaxed variant of the minimum-link ordered stabbing path problem that achieves approximation factor 2 with respect to the number of links. We conclude with experimental evaluations of the latter two algorithms, showing practical applicability.


title: Patterns on logistic map: back to front

abstract: Recently patterns were found in the least significant digits in the logistic map orbits in the chaotic regime. However, the dynamic of these digits was not explored in deep. We propose a new interpretation of the patterns found in the least significant digits of the logistic map in a chaotic regime, based on exploring the digits' dynamics. We explored these digits by the dynamic iteration method for low positions. When the dynamic of the least significant digits was explored, periodic and fixed digits were found with dynamic analogs to fixed and periodic points of discrete systems. Periodic digits designated well-established period sizes, which are independent of parameter control or initial condition. Fixed digits have attraction and stability characteristics, such as fixed points. This analysis demonstrates that the logistic map's least significant digits have characteristic dynamics.


title: The effect of nonlinear lensing on the coupling of ultrafast laser pulses to hollow-core waveguides

abstract: Gas-filled hollow-core fibres are a flexible platform for the manipulation of ultrafast laser pulses through a variety of nonlinear optical effects. Efficient high-fidelity coupling of the initial pulses is very important for system performance. Here we study the effect of self-focusing in gas-cell windows on the coupling of ultrafast laser pulses into hollow-core fibres using (2+1)-dimensional numerical simulations. As expected, we find that the coupling efficiency is degraded and the duration of the coupled pulses changed when the entrance window is too close to the fibre entrance. The interplay of nonlinear spatio-temporal reshaping and the linear dispersion of the window create different results depending on the window material, pulse duration, and pulse wavelength, with longer-wavelength beams more tolerant of high intensity in the window. While shifting the nominal focus to compensate can restore some of the lost coupling efficiency, it improves the pulse duration only marginally. From our simulations we derive a simple expression for the minimum distance between the window and the HCF entrance facet. Our results have implications for the often space-constrained design of hollow-core-fibre systems, especially where the input energy is not constant.


title: Learning Disentangled Label Representations for Multi-label Classification

abstract: Although various methods have been proposed for multi-label classification, most approaches still follow the feature learning mechanism of the single-label (multi-class) classification, namely, learning a shared image feature to classify multiple labels. However, we find this One-shared-Feature-for-Multiple-Labels (OFML) mechanism is not conducive to learning discriminative label features and makes the model non-robustness. For the first time, we mathematically prove that the inferiority of the OFML mechanism is that the optimal learned image feature cannot maintain high similarities with multiple classifiers simultaneously in the context of minimizing cross-entropy loss. To address the limitations of the OFML mechanism, we introduce the One-specific-Feature-for-One-Label (OFOL) mechanism and propose a novel disentangled label feature learning (DLFL) framework to learn a disentangled representation for each label. The specificity of the framework lies in a feature disentangle module, which contains learnable semantic queries and a Semantic Spatial Cross-Attention (SSCA) module. Specifically, learnable semantic queries maintain semantic consistency between different images of the same label. The SSCA module localizes the label-related spatial regions and aggregates located region features into the corresponding label feature to achieve feature disentanglement. We achieve state-of-the-art performance on eight datasets of three tasks, \ie, multi-label classification, pedestrian attribute recognition, and continual multi-label learning.


title: Topic Modeling on Clinical Social Work Notes for Exploring Social Determinants of Health Factors

abstract: Most research studying social determinants of health (SDoH) has focused on physician notes or structured elements of the electronic medical record (EMR). We hypothesize that clinical notes from social workers, whose role is to ameliorate social and economic factors, might provide a richer source of data on SDoH. We sought to perform topic modeling to identify robust topics of discussion within a large cohort of social work notes. We retrieved a diverse, deidentified corpus of 0.95 million clinical social work notes from 181,644 patients at the University of California, San Francisco. We used word frequency analysis and Latent Dirichlet Allocation (LDA) topic modeling analysis to characterize this corpus and identify potential topics of discussion. Word frequency analysis identified both medical and non-medical terms associated with specific ICD10 chapters. The LDA topic modeling analysis extracted 11 topics related to social determinants of health risk factors including financial status, abuse history, social support, risk of death, and mental health. In addition, the topic modeling approach captured the variation between different types of social work notes and across patients with different types of diseases or conditions. We demonstrated that social work notes contain rich, unique, and otherwise unobtainable information on an individual's SDoH.


title: On the Capacity Region of a Quantum Switch with Entanglement Purification

abstract: Quantum switches are envisioned to be an integral component of future entanglement distribution networks. They can provide high quality entanglement distribution service to end-users by performing quantum operations such as entanglement swapping and entanglement purification. In this work, we characterize the capacity region of such a quantum switch under noisy channel transmissions and imperfect quantum operations. We express the capacity region as a function of the channel and network parameters (link and entanglement swap success probability), entanglement purification yield and application level parameters (target fidelity threshold). In particular, we provide necessary conditions to verify if a set of request rates belong to the capacity region of the switch. We use these conditions to find the maximum achievable end-to-end user entanglement generation throughput by solving a set of linear optimization problems. We develop a max-weight scheduling policy and prove that the policy stabilizes the switch for all feasible request arrival rates. As we develop scheduling policies, we also generate new results for computing the conditional yield distribution of different classes of purification protocols. From numerical experiments, we discover that performing link-level entanglement purification followed by entanglement swaps provides a larger capacity region than doing entanglement swaps followed by end-to-end entanglement purification. The conclusions obtained in this work can yield useful guidelines for subsequent quantum switch designs.


title: A Graphical Theoretical Framework for Cylindrical Cavity Expansion in Mohr-Coulomb Geomaterials

abstract: This paper develops a complete analytical solution for the drained (or dry) cylindrical cavity expansion in non-associated Mohr-Coulomb soil, by using the graphical approach and Lagrangian formulation of the cavity boundary value problem (through tracing the responses of a single soil particle at the cavity wall). The novelty of the new solution lies not only in the relaxation of the strict intermediacy assumption for the vertical stress as usually adopted in the previous analyses, but in the comprehensive consideration of arbitrary values of K_0, the coefficient of earth pressure at rest, as well. The essence of the so-called graphical method, i.e., the unique geometrical analysis and tracking of the deviatoric stress trajectory, is fulfilled by leveraging the deformation requirement that during drained expansion the progressive development of the radial and tangential strains must maintain to be compressive and tensile, respectively. With the incorporation of the radial equilibrium condition, the problem is formulated to solve a single first-order differential equation for the internal cavity pressure with respect to a pivotal auxiliary variable, for all the distinct scenarios of K_0 being covered. Some selected results are presented for the calculated cavity expansion curve and limit cavity pressure through an example analysis.


title: Early-Forming Massive Stars Suppress Star Formation and Hierarchical Cluster Assembly

abstract: Feedback from massive stars plays an important role in the formation of star clusters. Whether a very massive star is born early or late in the cluster formation timeline has profound implications for the star cluster formation and assembly processes. We carry out a controlled experiment to characterize the effects of early-forming massive stars on star cluster formation. We use the star formation software suite \texttt{Torch}, combining self-gravitating magnetohydrodynamics, ray-tracing radiative transfer, $N$-body dynamics, and stellar feedback to model four initially identical $10^4$ M$_\odot$ giant molecular clouds with a Gaussian density profile peaking at $521.5 \mbox{ cm}^{-3}$. Using the \texttt{Torch} software suite through the \texttt{AMUSE} framework we modify three of the models to ensure that the first star that forms is very massive (50, 70, 100 M$_\odot$). Early-forming massive stars disrupt the natal gas structure, resulting in fast evacuation of the gas from the star forming region. The star formation rate is suppressed, reducing the total mass of stars formed. Our fiducial control model without an early massive star has a larger star formation rate and total efficiency by up to a factor of three and a higher average star formation efficiency per free-fall time by up to a factor of seven. Early-forming massive stars promote the buildup of spatially separate and gravitationally unbound subclusters, while the control model forms a single massive cluster.


title: Lie structures and chain ideal lattices

abstract: The purpose of this paper is twofold. Firstly, to emphasise that the class of Lie algebras with chain lattices of ideals are elementary blocks in the embedding or decomposition of Lie algebras with finite lattice of ideals. Secondly, to show that the number of Lie algebras of this class is large and they support other types of Lie structures. Beginning with general examples and algebraic decompositions, we focus on computational algorithms to build Lie algebras in which the lattice of ideals is a chain. The chain condition forces gradings on the nilradicals of this class of algebras. Our algorithms yield to several positive naturally graded parametric families of Lie algebras. Further generalizations and other kind of structures will also be discussed.


title: Can we still use PEAQ? A Performance Analysis of the ITU Standard for the Objective Assessment of Perceived Audio Quality

abstract: The Perceptual Evaluation of Audio Quality (PEAQ) method as described in the International Telecommunication Union (ITU) recommendation ITU-R BS.1387 has been widely used for computationally estimating the quality of perceptually coded audio signals without the need for extensive subjective listening tests. However, many reports have highlighted clear limitations of the scheme after the end of its standardization, particularly involving signals coded with newer technologies such as bandwidth extension or parametric multi-channel coding. Until now, no other method for measuring the quality of both speech and audio signals has been standardized by the ITU. Therefore, a further investigation of the causes for these limitations would be beneficial to a possible update of said scheme. Our experimental results indicate that the performance of PEAQ's model of disturbance loudness is still as good as (and sometimes superior to) other state-of-the-art objective measures, albeit with varying performance depending on the type of degraded signal content (i.e. speech or music). This finding evidences the need for an improved cognitive model. In addition, results indicate that an updated mapping of Model Output Values (MOVs) to PEAQ's Distortion Index (DI) based on newer training data can greatly improve performance. Finally, some suggestions for the improvement of PEAQ are provided based on the reported results and comparison to other systems.


title: The Struggles of Chessland

abstract: This is a fairy tale taking place in Chessland, located in the Bermuda triangle. The chess pieces survey their land and trap enemy pieces. Behind the story, there is fascinating mathematics on how to optimize surveying and trapping. The tale is written by the students in the PRIMES STEP junior group, who were in grades 6 through 9. The paper has a conclusion, written by the group's mentor, Tanya Khovanova, explaining the students' results in terms of graph theory.


title: Knowledge-Decks: Automatically Generating Presentation Slide Decks of Visual Analytics Knowledge Discovery Applications

abstract: Visual Analytics (VA) tools provide ways for users to harness insights and knowledge from datasets. Recalling and retelling user experiences while utilizing VA tools has attracted significant interest. Nevertheless, each user sessions are unique. Even when different users have the same intention when using a VA tool, they may follow different paths and uncover different insights. Current methods of manually processing such data to recall and retell users' knowledge discovery paths may also be time-consuming, especially when there is the need to present users' findings to third parties. This paper presents a novel system that collects user intentions, behavior, and insights during knowledge discovery sessions, automatically structure the data, and extracts narrations of knowledge discovery as PowerPoint slide decks. The system is powered by a Knowledge Graph designed based on a formal and reproducible modeling process. To evaluate our system, we have attached it to two existing VA tools where users were asked to perform pre-defined tasks. Several slide decks and other analysis metrics were extracted from the generated Knowledge Graph. Experts scrutinized and confirmed the usefulness of our automated process for using the slide decks to disclose knowledge discovery paths to others and to verify whether the VA tools themselves were effective.


title: Prediction of Scene Plausibility

abstract: Understanding the 3D world from 2D images involves more than detection and segmentation of the objects within the scene. It also includes the interpretation of the structure and arrangement of the scene elements. Such understanding is often rooted in recognizing the physical world and its limitations, and in prior knowledge as to how similar typical scenes are arranged. In this research we pose a new challenge for neural network (or other) scene understanding algorithms - can they distinguish between plausible and implausible scenes? Plausibility can be defined both in terms of physical properties and in terms of functional and typical arrangements. Hence, we define plausibility as the probability of encountering a given scene in the real physical world. We build a dataset of synthetic images containing both plausible and implausible scenes, and test the success of various vision models in the task of recognizing and understanding plausibility.


title: Conditions for Estimation of Sensitivities of Voltage Magnitudes to Complex Power Injections

abstract: Voltage phase angle measurements are often unavailable from sensors in distribution networks and transmission network boundaries. Therefore, this paper addresses the conditions for estimating sensitivities of voltage magnitudes with respect to complex (active and reactive) electric power injections based on sensor measurements. These sensitivities represent submatrices of the inverse power flow Jacobian. We extend previous results to show that the sensitivities of a bus voltage magnitude with respect to active power injections are unique and different from those with respect to reactive power. The classical Newton-Raphson power flow model is used to derive a novel representation of bus voltage magnitudes as an underdetermined linear operator of the active and reactive power injections; parameterized by the bus power factors. Two conditions that ensure the existence of unique complex power injections given voltage magnitudes are established for this underdetermined linear system, thereby compressing the solution space. The first is a sufficient condition based on the bus power factors. The second is a necessary and sufficient condition based on the system eigenvalues. We use matrix completion theory to develop estimation methods for recovering sensitivity matrices with varying levels of sensor availability. Simulations verify the results and demonstrate engineering use of the proposed methods.


title: Estimating Time-Varying Direct and Indirect Causal Excursion Effects with Longitudinal Binary Outcomes

abstract: Construction of just-in-time adaptive interventions, such as prompts delivered by mobile apps to promote and maintain behavioral change, requires knowledge about time-varying moderated effects to inform when and how we deliver intervention options. Micro-randomized trials (MRT) have emerged as a sequentially randomized design to gather requisite data for effect estimation. The existing literature (Qian et al., 2020; Boruvka et al., 2018; Dempsey et al., 2020) has defined a general class of causal estimands, referred to as "causal excursion effects", to assess the time-varying moderated effect. However, there is limited statistical literature on how to address potential between-cluster treatment effect heterogeneity and within-cluster interference in a sequential treatment setting for longitudinal binary outcomes. In this paper, based on a cluster conceptualization of the potential outcomes, we define a larger class of direct and indirect causal excursion effects for proximal and lagged binary outcomes, and propose a new inferential procedure that addresses effect heterogeneity and interference. We provide theoretical guarantees of consistency and asymptotic normality of the estimator. Extensive simulation studies confirm our theory empirically and show the proposed procedure provides consistent point estimator and interval estimates with valid coverage. Finally, we analyze a data set from a multi-institution MRT study to assess the time-varying moderated effects of mobile prompts upon binary study engagement outcomes.


title: Parallelizing Maximal Clique Enumeration on GPUs

abstract: We present a GPU solution for exact maximal clique enumeration (MCE) that performs a search tree traversal following the Bron-Kerbosch algorithm. Prior works on parallelizing MCE on GPUs perform a breadth-first traversal of the tree, which has limited scalability because of the explosion in the number of tree nodes at deep levels. We propose to parallelize MCE on GPUs by performing depth-first traversal of independent subtrees in parallel. Since MCE suffers from high load imbalance and memory capacity requirements, we propose a worker list for dynamic load balancing, as well as partial induced subgraphs and a compact representation of excluded vertex sets to regulate memory consumption. Our evaluation shows that our GPU implementation on a single GPU outperforms the state-of-the-art parallel CPU implementation by a geometric mean of 4.9x (up to 16.7x), and scales efficiently to multiple GPUs. Our code has been open-sourced to enable further research on accelerating MCE.


title: Nondestructive KPFM-assisted Quality Control in Fabrication of GaAs High-Speed Electronics

abstract: In this paper, we report on the method of nondestructive quality control that can be used in fabrication of GaAs high-speed electronics. The method relies on the surface potential mapping and enables rigid in vivo analysis of transport properties of an active electronic device incorporated into a complex integrated circuit. The study is inspired by our ongoing development of a millimeter wave intelligent reflective surface for 6G communications. To provide desired beamforming capabilities, such a surface should utilize hundreds of identical microscale GaAs diode switches with series resistance of a few ohms. Thus, we develop a ladder-like layered ohmic contact to heavily Si-doped GaAs and cross-study it via transmission line method and Kelvin probe force microscopy. The contact resistivity as low as 0.15~$\mu \Omega \,$cm$^2$ is measured resulting in only a 0.6~$\Omega$ of resistance for the contact area of 3$\times$3~$\mu$m$^2$. Moreover, the tendencies observed suggest that one can rigidly analyze the evolution of contact resistance and the profile of resistivity under contact in response to rapid thermal annealing, once the surface potential map across the ``ladder'' is known.


title: Polaron with Quadratic Electron-phonon Interaction

abstract: We present the first numerically exact study of a polaron with quadratic coupling to the oscillator displacement, using two alternative methodological developments. Our results cover both anti-adiabatic and adiabatic regimes and the entire range of electron-phonon coupling $g_2$, from the system's stability threshold at attractive $g_2=-1$ to arbitrary strong repulsion at $g_2 \gg 1$. Key properties of quadratic polarons prove dramatically different from their linear counterparts. They (i) are insensitive even to large quadratic coupling except in the anti-adiabatic limit near the threshold of instability at attraction; (ii) depend only on the adiabatic ratio but are insensitive to the electron dispersion and dimension of space; (iii) feature weak lattice deformations even at the instability point. Our results are of direct relevance to properties of electrons at low densities in polar materials, including recent proposals for their superconducting states.


title: NarraSum: A Large-Scale Dataset for Abstractive Narrative Summarization

abstract: Narrative summarization aims to produce a distilled version of a narrative to describe its most salient events and characters. Summarizing a narrative is challenging as it requires an understanding of event causality and character behaviors. To encourage research in this direction, we propose NarraSum, a large-scale narrative summarization dataset. It contains 122K narrative documents, which are collected from plot descriptions of movies and TV episodes with diverse genres, and their corresponding abstractive summaries. Experiments show that there is a large performance gap between humans and the state-of-the-art summarization models on NarraSum. We hope that this dataset will promote future research in summarization, as well as broader studies of natural language understanding and generation. The dataset is available at https://github.com/zhaochaocs/narrasum.


title: Search for subsolar-mass black hole binaries in the second part of Advanced LIGO's and Advanced Virgo's third observing run

abstract: We describe a search for gravitational waves from compact binaries with at least one component with mass 0.2 $M_\odot$ -- $1.0 M_\odot$ and mass ratio $q \geq 0.1$ in Advanced LIGO and Advanced Virgo data collected between 1 November 2019, 15:00 UTC and 27 March 2020, 17:00 UTC. No signals were detected. The most significant candidate has a false alarm rate of 0.2 $\mathrm{yr}^{-1}$. We estimate the sensitivity of our search over the entirety of Advanced LIGO's and Advanced Virgo's third observing run, and present the most stringent limits to date on the merger rate of binary black holes with at least one subsolar-mass component. We use the upper limits to constrain two fiducial scenarios that could produce subsolar-mass black holes: primordial black holes (PBH) and a model of dissipative dark matter. The PBH model uses recent prescriptions for the merger rate of PBH binaries that include a rate suppression factor to effectively account for PBH early binary disruptions. If the PBHs are monochromatically distributed, we can exclude a dark matter fraction in PBHs $f_\mathrm{PBH} \gtrsim 0.6$ (at 90% confidence) in the probed subsolar-mass range. However, if we allow for broad PBH mass distributions we are unable to rule out $f_\mathrm{PBH} = 1$. For the dissipative model, where the dark matter has chemistry that allows a small fraction to cool and collapse into black holes, we find an upper bound $f_{\mathrm{DBH}} < 10^{-5}$ on the fraction of atomic dark matter collapsed into black holes.


title: A data-driven uncertainty modelling and reduction approach for energy optimisation problems

abstract: Taking uncertainty into account is crucial when making strategic decisions. To guard against the risk of adverse scenarios, traditional optimisation techniques incorporate uncertainty on the basis of prior knowledge on its distribution. In this paper, we show how, based on a limited amount of historical data, we can generate from a low-dimensional space the underlying structure of uncertainty that could then be used in such optimisation frameworks. To this end, we first exploit the correlation between the sources of uncertainty through a principal component analysis to reduce dimensionality. Next, we perform clustering to reveal the typical uncertainty patterns, and finally we generate polyhedral uncertainty sets based on a kernel density estimation (KDE) of marginal probability functions.


title: Detecting Outdated Code Element References in Software Repository Documentation

abstract: Outdated documentation is a pervasive problem in software development, preventing effective use of software, and misleading users and developers alike. We posit that one possible reason why documentation becomes out of sync so easily is that developers are unaware of when their source code modifications render the documentation obsolete. Ensuring that the documentation is always in sync with the source code takes considerable effort, especially for large codebases. To address this situation, we propose an approach that can automatically detect code element references that survive in the documentation after all source code instances have been deleted. In this work, we analysed over 3,000 GitHub projects and found that most projects contain at least one outdated code element reference at some point in their history. We submitted GitHub issues to real-world projects containing outdated references detected by our approach, some of which have already led to documentation fixes. As an initiative toward keeping documentation in software repositories up-to-date, we have made our implementation available for developers to scan their GitHub projects for outdated code element references.


title: An efficient numerical algorithm for the moment neural activation

abstract: Derived from spiking neuron models via the diffusion approximation, the moment activation (MA) faithfully captures the nonlinear coupling of correlated neural variability. However, numerical evaluation of the MA faces significant challenges due to a number of ill-conditioned Dawson-like functions. By deriving asymptotic expansions of these functions, we develop an efficient numerical algorithm for evaluating the MA and its derivatives ensuring reliability, speed, and accuracy. We also provide exact analytical expressions for the MA in the weak fluctuation limit. Powered by this efficient algorithm, the MA may serve as an effective tool for investigating the dynamics of correlated neural variability in large-scale spiking neural circuits.


title: Single-Spin Readout and Quantum Sensing using Optomechanically Induced Transparency

abstract: Solid-state spin defects are promising quantum sensors for a large variety of sensing targets. Some of these defects couple appreciably to strain in the host material. We propose to use this strain coupling for mechanically-mediated dispersive single-shot spin readout by an optomechanically-induced transparency measurement. Surprisingly, the estimated measurement times for negatively-charged silicon-vacancy defects in diamond are an order of magnitude shorter than those for single-shot optical fluorescence readout. Our scheme can also be used for general parameter-estimation metrology and offers a higher sensitivity than conventional schemes using continuous position detection.


title: PyQMC: an all-Python real-space quantum Monte Carlo module in PySCF

abstract: We describe a new open-source Python-based package for high accuracy correlated electron calculations using quantum Monte Carlo (QMC) in real space: PyQMC. PyQMC implements modern versions of QMC algorithms in an accessible format, enabling algorithmic development and easy implementation of complex workflows. Tight integration with the PySCF environment allows for simple comparison between QMC calculations and other many-body wave function techniques, as well as access to high accuracy trial wave functions.


title: Modeling Wind Turbine Performance and Wake Interactions with Machine Learning

abstract: Different machine learning (ML) models are trained on SCADA and meteorological data collected at an onshore wind farm and then assessed in terms of fidelity and accuracy for predictions of wind speed, turbulence intensity, and power capture at the turbine and wind farm levels for different wind and atmospheric conditions. ML methods for data quality control and pre-processing are applied to the data set under investigation and found to outperform standard statistical methods. A hybrid model, comprised of a linear interpolation model, Gaussian process, deep neural network (DNN), and support vector machine, paired with a DNN filter, is found to achieve high accuracy for modeling wind turbine power capture. Modifications of the incoming freestream wind speed and turbulence intensity, $TI$, due to the evolution of the wind field over the wind farm and effects associated with operating turbines are also captured using DNN models. Thus, turbine-level modeling is achieved using models for predicting power capture while farm-level modeling is achieved by combining models predicting wind speed and $TI$ at each turbine location from freestream conditions with models predicting power capture. Combining these models provides results consistent with expected power capture performance and holds promise for future endeavors in wind farm modeling and diagnostics. Though training ML models is computationally expensive, using the trained models to simulate the entire wind farm takes only a few seconds on a typical modern laptop computer, and the total computational cost is still lower than other available mid-fidelity simulation approaches.


title: Fin-intersecting MAD families

abstract: We introduce a new class of almost disjoint families which we call fin-intersecting almost disjoint families. They are related to almost disjoint families whose Vietoris Hyperspace of their Isbell-Mr\'owka spaces are pseudocompact. We show that under $\mathfrak p=\mathfrak c$ fin-intersecting MAD families exist generically and they also exist if $\mathfrak{a<s}$, but that there are also non fin-intersecting MAD families in ZFC. We also show that under CH, there exists fin intersecting MAD families which remain like that after adding an arbitrary quantity of Cohen reals and Random reals. These results give more models in which pseudocompact MAD families exist.


title: A Theory of Semantic Communication

abstract: Semantic communication is an emerging research area that has gained a wide range of attention recently. Despite this growing interest, there remains a notable absence of a comprehensive and widely-accepted framework for characterizing semantic communication. This paper introduces a new conceptualization of semantic communication and formulates two fundamental problems, which we term language exploitation and language design. Our contention is that the challenge of language design can be effectively situated within the broader framework of joint source-channel coding theory, underpinned by a comprehensive end-to-end distortion metric. To tackle the language exploitation problem, we put forth three approaches: semantic encoding, semantic decoding, and a synergistic combination of both in the form of combined semantic encoding and decoding. Furthermore, we establish the semantic distortion-cost region as a critical framework for assessing the language exploitation problem. For each of the three proposed approaches, the achievable distortion-cost region is characterized. Overall, this paper aims to shed light on the intricate dynamics of semantic communication, paving the way for a deeper understanding of this evolving field.


title: A Theoretical Thrust Density Limit for Hall Thrusters

abstract: Hall Thrusters typically operate at thrust densities on the order of 10 N/m2, which is well below the thrust density limits discussed in previous literature. These limits have been considered here and each component of thrust density is analyzed to demonstrate the relative contribution to the total thrust density. Dependencies of the thrust density limits upon the thruster geometry, electron mobility, and the applied magnetic field are revealed and compared with experimental data.


title: Plasmonic Resonant Intercluster Coulombic Decay

abstract: Light-induced energy confinement in nanoclusters via plasmon excitations influences applications in nanophotonics, photocatalysis, and the design of controlled slow electron sources. The resonant decay of these excitations through the cluster's ionization continuum provides a unique probe of the collective electronic behavior. However, the transfer of a part of this decay amplitude to the continuum of a second conjugated cluster may offer control and efficacy in sharing the energy nonlocally to instigate remote collective events. With the example of a spherically nested dimer Na20@C240 of two plasmonic systems we find that such a transfer is possible through the resonant intercluster Coulomb decay (RICD) as a fundamental process. This plasmonic RICD signal can be experimentally detected by the photoelectron velocity map imaging technique.

categories: physics.atm-clus cond-mat.mes-hall physics.atom-ph physics.chem-ph physics.comp-ph


title: Event knowledge in large language models: the gap between the impossible and the unlikely

abstract: Word co-occurrence patterns in language corpora contain a surprising amount of conceptual knowledge. Large language models (LLMs), trained to predict words in context, leverage these patterns to achieve impressive performance on diverse semantic tasks requiring world knowledge. An important but understudied question about LLMs' semantic abilities is whether they acquire generalized knowledge of common events. Here, we test whether five pre-trained LLMs (from 2018's BERT to 2023's MPT) assign higher likelihood to plausible descriptions of agent-patient interactions than to minimally different implausible versions of the same event. Using three curated sets of minimal sentence pairs (total n=1,215), we found that pre-trained LLMs possess substantial event knowledge, outperforming other distributional language models. In particular, they almost always assign higher likelihood to possible vs. impossible events (The teacher bought the laptop vs. The laptop bought the teacher). However, LLMs show less consistent preferences for likely vs. unlikely events (The nanny tutored the boy vs. The boy tutored the nanny). In follow-up analyses, we show that (i) LLM scores are driven by both plausibility and surface-level sentence features, (ii) LLM scores generalize well across syntactic variants (active vs. passive constructions) but less well across semantic variants (synonymous sentences), (iii) some LLM errors mirror human judgment ambiguity, and (iv) sentence plausibility serves as an organizing dimension in internal LLM representations. Overall, our results show that important aspects of event knowledge naturally emerge from distributional linguistic patterns, but also highlight a gap between representations of possible/impossible and likely/unlikely events.


title: Topological waves in the continuum in magnetized graphene devices

abstract: We show that topological waves at the interface between two magnetic domains in a graphene device are possible. First, we consider the case of a linear relation between the applied gate voltage and local density in the channel and, secondly, we investigate the effect of non-local Coulomb interactions. We obtain two distinct edge modes for each interaction type: a Yanai mode with rotational flow and dispersion relation that extends to infinite wave-number, and a Kelvin mode with purely longitudinal flow and bound dispersion relation. The scattering matrix concept is applied to verify the infinite frequency regime of the spectrum, and the bulk-edge correspondence principle is satisfied if one takes into account the Kelvin modes that merge with an imaginary cut of the bulk band.

categories: cond-mat.mes-hall cond-mat.other cond-mat.quant-gas physics.plasm-ph


title: Various types of continuity and their interpretations in ideal topological spaces

abstract: This paper is a continuation of work started in \cite{njampavcont} on preserving continuity in ideal topological spaces. We will deal with $\theta$-continuity and weak continuity and give their translations in ideal topological spaces. As consequences of those results, we will prove that every $\theta$-continuous function is continuous if topologies are generated by $\theta$-open sets and we will give an example of weakly continuous function which is not $\tau_\theta$-continuous. This will complete the diagram of relations between continuous, $\tau_\theta$-continuous, $\theta$-continuous, weakly continuous and faintly continuous functions.


title: Intensity correlations in the forward four-wave mixing driven by a single pump

abstract: We study the field intensity fluctuations of two independent four-wave mixing signals generated in a cold rubidium sample as well as the transmission signals. We employ an experimental setup using a single CW laser to induce the nonlinear process in a forward geometry using either parallel and circular or orthogonal and linear polarizations of the input fields. Even though the spectra of each experimental configuration are significantly different due to the distinct level structures of each scenario, both cases present intensit-intensity cross-correlation of the four-wave mixing signals. We also calculate the cross-correlation between the input fields and draft a theoretical model that points that resonant phase-noise to amplitude-noise conversion allows the observation of Rabi oscillations in the cross-correlation curves.


title: From Navier-Stokes millennium-prize problem to soft matter computing

abstract: Clay Mathematical Institute, in the year 2000, formulated a list of seven unsolved mathematical problems which might influence and direct the course of the research in the 21st century. Navier-Stokes regularity problem is one of the seven problems and has not been solved till date. These equations govern the motion of the viscous fluids, such as liquids, gases, gels, polymers. The present article is a spotlight on the NSE problem: a review of the past and current efforts to solve it, and our changing perspectives and understanding of these equations. The major debate is to either prove that the solutions to Navier-Stokes equations (NSE) are smooth or to prove that the solutions reach singularity at a finite-time (blowup); given some initial conditions. While in the past, the focus was on finding bounds for the smooth solutions, recently, there has been growing interest in finding solutions that blowup. The current article places the Turing-completeness of Euler equations (a subclass of NSE) into the centre-stage, by discussing the recent developments that are pointing towards that the idea that the fluid equations should be viewed as a 'computer program'. Given this is the case, the article then argues to see 'continuum fluid' from a complexity notion, and thus, as a Turing machine. This notion connects the discipline of fluid mechanics to disciplines like, 'neuromorphic computing, reservoir computing' and potentially leading to emerging new discipline, "soft matter complexity, computing, and learning", each of which has been discussed in brief.

categories: math.AP math-ph math.FA math.MP nlin.CD physics.flu-dyn


title: Applications of AI in Astronomy

abstract: We provide a brief, and inevitably incomplete overview of the use of Machine Learning (ML) and other AI methods in astronomy, astrophysics, and cosmology. Astronomy entered the big data era with the first digital sky surveys in the early 1990s and the resulting Terascale data sets, which required automating of many data processing and analysis tasks, for example the star-galaxy separation, with billions of feature vectors in hundreds of dimensions. The exponential data growth continued, with the rise of synoptic sky surveys and the Time Domain Astronomy, with the resulting Petascale data streams and the need for a real-time processing, classification, and decision making. A broad variety of classification and clustering methods have been applied for these tasks, and this remains a very active area of research. Over the past decade we have seen an exponential growth of the astronomical literature involving a variety of ML/AI applications of an ever increasing complexity and sophistication. ML and AI are now a standard part of the astronomical toolkit. As the data complexity continues to increase, we anticipate further advances leading towards a collaborative human-AI discovery.


title: Caustic-like Structures in UHECR Flux after Propagation in Turbulent Intergalactic Magnetic Fields

abstract: UHECR propagation in a turbulent intergalactic magnetic field in the small-angle scattering regime is well understood for propagation distances much larger than the field coherence scale. The diffusion theory doesn't work and unexpected effects may appear for propagation over smaller distances, from a few and up to 10-20 coherence scales. We study the propagation of UHECRs in this regime, which may be relevant for intermediate mass UHECR nuclei and nG scale intergalactic magnetic fields with 1 Mpc coherence scale. We found that the trajectories form a non-trivial caustic-like pattern with strong deviation from isotropy. Thus, measurements of the flux from a source at a given distance will depend on the position of the observer.


title: iEnhancer-ELM: improve enhancer identification by extracting position-related multiscale contextual information based on enhancer language models

abstract: Motivation: Enhancers are important cis-regulatory elements that regulate a wide range of biological functions and enhance the transcription of target genes. Although many feature extraction methods have been proposed to improve the performance of enhancer identification, they cannot learn position-related multiscale contextual information from raw DNA sequences. Results: In this article, we propose a novel enhancer identification method (iEnhancer-ELM) based on BERT-like enhancer language models. iEnhancer-ELM tokenizes DNA sequences with multi-scale k-mers and extracts contextual information of different scale k-mers related with their positions via an multi-head attention mechanism. We first evaluate the performance of different scale k-mers, then ensemble them to improve the performance of enhancer identification. The experimental results on two popular benchmark datasets show that our model outperforms stateof-the-art methods. We further illustrate the interpretability of iEnhancer-ELM. For a case study, we discover 30 enhancer motifs via a 3-mer-based model, where 12 of motifs are verified by STREME and JASPAR, demonstrating our model has a potential ability to unveil the biological mechanism of enhancer. Availability and implementation: The models and associated code are available at https://github.com/chen-bioinfo/iEnhancer-ELM Contact: junjiechen@hit.edu.cn Supplementary information: Supplementary data are available at Bioinformatics Advances online.


title: A combinatorial proof of the $\lambda_g$ conjecture in genus 2

abstract: We give a simple combinatorial proof of the $\lambda_g$ conjectue in genus 2. We use a description of the class $\lambda_2$ as a linear combination of boundary strata, and show the conjecture follows inductively from applications of the projection formula, string equation, and dilaton equation.


title: TIDAL: Topology-Inferred Drug Addiction Learning

abstract: Drug addiction or drug overdose is a global public health crisis, and the design of anti-addiction drugs remains a major challenge due to intricate mechanisms. Since experimental drug screening and optimization are too time-consuming and expensive, there is urgent need to develop innovative artificial intelligence (AI) methods for addressing the challenge. We tackle this challenge by topology-inferred drug addiction learning (TIDAL) built from integrating topological Laplacian, deep bidirectional transformer, and ensemble-assisted neural networks (EANNs). The topological Laplacian is a novel algebraic topology tool that embeds molecular topological invariants and algebraic invariants into its harmonic spectra and non-harmonic spectra, respectively. These invariants complement sequence information extracted from a bidirectional transformer. We validate the proposed TIDAL framework on 22 drug addiction related, 4 hERG, and 12 DAT datasets, showing that TIDAL is a state-of-the-art framework for the modeling and analysis of drug addiction data. We carry out cross-target analysis of the current drug addiction candidates to alert their side effects and identify their repurposing potentials, revealing drugmediated linear and bilinear target correlations. Finally, TIDAL is applied to shed light on relative efficacy, repurposing potential, and potential side effects of 12 existing anti-addiction medications. Our results suggest that TIDAL provides a new computational strategy for pressingly-needed anti-substance addiction drug development.


title: Policy Learning for Active Target Tracking over Continuous SE(3) Trajectories

abstract: This paper proposes a novel model-based policy gradient algorithm for tracking dynamic targets using a mobile robot, equipped with an onboard sensor with limited field of view. The task is to obtain a continuous control policy for the mobile robot to collect sensor measurements that reduce uncertainty in the target states, measured by the target distribution entropy. We design a neural network control policy with the robot $SE(3)$ pose and the mean vector and information matrix of the joint target distribution as inputs and attention layers to handle variable numbers of targets. We also derive the gradient of the target entropy with respect to the network parameters explicitly, allowing efficient model-based policy gradient optimization.


title: Neumann Boundary Problem of Second Order Parabolic Quasi-Linear System with Variable Coefficient on a Vector Bundle

abstract: Classical results of second order parabolic quasi-linear equations always require that the nonlinear terms are controlled by a power of the unknown functions and their first derivatives. We improve the previous results. More precisely, in the present article the upper bound of nonlinear term can be extended to a power series.


title: A Refinement of Pohst's Inequality

abstract: We generalize an inequality conjectured by Pohst in 1977 and recently proved by the author and independently by Battistoni and Molteni. This new inequality improves a bound for the regulator in terms of the discriminant for totally real number fields by taking into account the signs of conjugates of the fundamental unit. We give a new interpretation to the problem and exploit the combinatorial method used by Pohst.


title: Bulk ReSe2: record high refractive index and biaxially anisotropic material for all-dielectric nanophotonics

abstract: We show that bulk rhenium diselenide, ReSe2 is characterized by record high value of the refractive index exceeding 5 in near-infrared frequency range. We use back focal plane reflection spectroscopy to extract the components of the ReSe2 permittivity tensor and reveal its extreme biaxial anisotropy. We also demonstrate the good agreement between the experimental data and the predictions of the density functional theory. The combination of the large refractive index and giant optical anisotropy makes ReSe2 a perspective material for all-dielectric nanophotonics in the near-infrared frequency range.


title: Measurement-based quantum thermal machines with feedback control

abstract: We investigate coupled-qubit-based thermal machines powered by quantum measurements and feedback. We consider two different versions of the machine: 1) a quantum Maxwell's demon where the coupled-qubit system is connected to a detachable single shared bath, and 2) a measurement-assisted refrigerator where the coupled-qubit system is in contant with a hot and cold bath. In the quantum Maxwell's demon case we discuss both discrete and continuous measurements. We find that the power output from a single qubit-based device can be improved by coupling it to the second qubit. We further find that the simultaneous measurement of both qubits can produce higher net heat extraction compared to two setups operated in parallel where only single-qubit measurements are performed. In the refrigerator case, we use continuous measurement and unitary operations to power the coupled-qubit-based refrigerator. We find that the cooling power of a refrigerator operated with swap operations can be enhanced by performing suitable measurements.


title: Online Estimation of the Koopman Operator Using Fourier Features

abstract: Transfer operators offer linear representations and global, physically meaningful features of nonlinear dynamical systems. Discovering transfer operators, such as the Koopman operator, require careful crafted dictionaries of observables, acting on states of the dynamical system. This is ad hoc and requires the full dataset for evaluation. In this paper, we offer an optimization scheme to allow joint learning of the observables and Koopman operator with online data. Our results show we are able to reconstruct the evolution and represent the global features of complex dynamical systems.


title: A mirror inertial forward-reflected-backward splitting: Global convergence and linesearch extension beyond convexity and Lipschitz smoothness

abstract: This work investigates a Bregman and inertial extension of the forward-reflected-backward algorithm [Y. Malitsky and M. Tam, SIAM J. Optim., 30 (2020), pp. 1451--1472] applied to structured nonconvex minimization problems under relative smoothness. To this end, the proposed algorithm hinges on two key features: taking inertial steps in the dual space, and allowing for possibly negative inertial values. Our analysis begins with studying an associated envelope function that takes inertial terms into account through a novel product space formulation. Such construction substantially differs from similar objects in the literature and could offer new insights for extensions of splitting algorithms. Global convergence and rates are obtained by appealing to the generalized concave Kurdyka-Lojasiewicz (KL) property, which allows us to describe a sharp upper bound on the total length of iterates. Finally, a linesearch extension is given to enhance the proposed method.


title: Constrained Reinforcement Learning via Dissipative Saddle Flow Dynamics

abstract: In constrained reinforcement learning (C-RL), an agent seeks to learn from the environment a policy that maximizes the expected cumulative reward while satisfying minimum requirements in secondary cumulative reward constraints. Several algorithms rooted in sampled-based primal-dual methods have been recently proposed to solve this problem in policy space. However, such methods are based on stochastic gradient descent ascent algorithms whose trajectories are connected to the optimal policy only after a mixing output stage that depends on the algorithm's history. As a result, there is a mismatch between the behavioral policy and the optimal one. In this work, we propose a novel algorithm for constrained RL that does not suffer from these limitations. Leveraging recent results on regularized saddle-flow dynamics, we develop a novel stochastic gradient descent-ascent algorithm whose trajectories converge to the optimal policy almost surely.


title: Autonomous Apple Fruitlet Sizing and Growth Rate Tracking using Computer Vision

abstract: In this paper, we present a computer vision-based approach to measure the sizes and growth rates of apple fruitlets. Measuring the growth rates of apple fruitlets is important because it allows apple growers to determine when to apply chemical thinners to their crops in order to optimize yield. The current practice of obtaining growth rates involves using calipers to record sizes of fruitlets across multiple days. Due to the number of fruitlets needed to be sized, this method is laborious, time-consuming, and prone to human error. With images collected by a hand-held stereo camera, our system, segments, clusters, and fits ellipses to fruitlets to measure their diameters. The growth rates are then calculated by temporally associating clustered fruitlets across days. We provide quantitative results on data collected in an apple orchard, and demonstrate that our system is able to predict abscise rates within 3.5% of the current method with a 6 times improvement in speed, while requiring significantly less manual effort. Moreover, we provide results on images captured by a robotic system in the field, and discuss the next steps required to make the process fully autonomous.


title: Learning and Blending Robot Hugging Behaviors in Time and Space

abstract: We introduce an imitation learning-based physical human-robot interaction algorithm capable of predicting appropriate robot responses in complex interactions involving a superposition of multiple interactions. Our proposed algorithm, Blending Bayesian Interaction Primitives (B-BIP) allows us to achieve responsive interactions in complex hugging scenarios, capable of reciprocating and adapting to a hugs motion and timing. We show that this algorithm is a generalization of prior work, for which the original formulation reduces to the particular case of a single interaction, and evaluate our method through both an extensive user study and empirical experiments. Our algorithm yields significantly better quantitative prediction error and more-favorable participant responses with respect to accuracy, responsiveness, and timing, when compared to existing state-of-the-art methods.


title: Space is a latent sequence: Structured sequence learning as a unified theory of representation in the hippocampus

abstract: Fascinating and puzzling phenomena, such as landmark vector cells, splitter cells, and event-specific representations to name a few, are regularly discovered in the hippocampus. Without a unifying principle that can explain these divergent observations, each experiment seemingly discovers a new anomaly or coding type. Here, we provide a unifying principle that the mental representation of space is an emergent property of latent higher-order sequence learning. Treating space as a sequence resolves myriad phenomena, and suggests that the place-field mapping methodology where sequential neuron responses are interpreted in spatial and Euclidean terms might itself be a source of anomalies. Our model, called Clone-structured Causal Graph (CSCG), uses a specific higher-order graph scaffolding to learn latent representations by mapping sensory inputs to unique contexts. Learning to compress sequential and episodic experiences using CSCGs result in the emergence of cognitive maps - mental representations of spatial and conceptual relationships in an environment that are suited for planning, introspection, consolidation, and abstraction. We demonstrate that over a dozen different hippocampal phenomena, ranging from those reported in classic experiments to the most recent ones, are succinctly and mechanistically explained by our model.