title: Diagnosis of Parkinson's Disease Based on Voice Signals Using SHAP and Hard Voting Ensemble Method

abstract: Background and Objective: Parkinson's disease (PD) is the second most common progressive neurological condition after Alzheimer's, characterized by motor and non-motor symptoms. Developing a method to diagnose the condition in its beginning phases is essential because of the significant number of individuals afflicting with this illness. PD is typically identified using motor symptoms or other Neuroimaging techniques, such as DATSCAN and SPECT. These methods are expensive, time-consuming, and unavailable to the general public; furthermore, they are not very accurate. These constraints encouraged us to develop a novel technique using SHAP and Hard Voting Ensemble Method based on voice signals. Methods: In this article, we used Pearson Correlation Coefficients to understand the relationship between input features and the output, and finally, input features with high correlation were selected. These selected features were classified by the Extreme Gradient Boosting (XGBoost), Light Gradient Boosting Machine (LightGBM), Gradient Boosting, and Bagging. Moreover, the Hard Voting Ensemble Method was determined based on the performance of the four classifiers. At the final stage, we proposed Shapley Additive exPlanations (SHAP) to rank the features according to their significance in diagnosing Parkinson's disease. Results and Conclusion: The proposed method achieved 85.42% accuracy, 84.94% F1-score, 86.77% precision, 87.62% specificity, and 83.20% sensitivity. The study's findings demonstrated that the proposed method outperformed state-of-the-art approaches and can assist physicians in diagnosing Parkinson's cases.


title: Exact Recursive Probabilistic Programming

abstract: Recursive calls over recursive data are useful for generating probability distributions, and probabilistic programming allows computations over these distributions to be expressed in a modular and intuitive way. Exact inference is also useful, but unfortunately, existing probabilistic programming languages do not perform exact inference on recursive calls over recursive data, forcing programmers to code many applications manually. We introduce a probabilistic language in which a wide variety of recursion can be expressed naturally, and inference carried out exactly. For instance, probabilistic pushdown automata and their generalizations are easy to express, and polynomial-time parsing algorithms for them are derived automatically. We eliminate recursive data types using program transformations related to defunctionalization and refunctionalization. These transformations are assured correct by a linear type system, and a successful choice of transformations, if there is one, is guaranteed to be found by a greedy algorithm.


title: Correlations between student connectivity and academic performance: a pandemic follow-up

abstract: Social network analysis (SNA) has been gaining traction as a technique for quantitatively studying student collaboration. We analyze networks, constructed from student self-reports of collaboration on homework assignments, in two courses from the University of Colorado Boulder and one course from the Colorado School of Mines. All three courses occurred during the COVID-19 pandemic, which allows for a comparison between the course at the Colorado School of Mines (in a fully remote format) with results from a previous pre-pandemic study of student collaboration at the Colorado School of Mines (in a hybrid format). We compute nodal centrality measures and calculate the correlation between student centrality and performance. Results varied widely between each of the courses studied. The course at the Colorado School of Mines had strong correlations between many centrality measures and performance which matched the patterns seen in the pre-pandemic study. The courses at the University of Colorado Boulder showed weaker correlations, and one course showed nearly no correlations at all between students' connectivity to their classmates and their performance. Taken together, the results from the trio of courses indicate that the context and environment in which the course is situated play a more important role in fostering a correlation between student collaboration and course performance than the format (remote, hybrid, in-person) of the course. Additionally, we conducted a short study on the effect that missing nodes may have on the correlations calculated from the measured networks. This investigation showed that missing nodes tend to shift correlations towards zero, providing evidence that the statistically significant correlations measured in our networks are not spurious.


title: Masked Spiking Transformer

abstract: The combination of Spiking Neural Networks (SNNs) and Transformers has attracted significant attention due to their potential for high energy efficiency and high-performance nature. However, existing works on this topic typically rely on direct training, which can lead to suboptimal performance. To address this issue, we propose to leverage the benefits of the ANN-to-SNN conversion method to combine SNNs and Transformers, resulting in significantly improved performance over existing state-of-the-art SNN models. Furthermore, inspired by the quantal synaptic failures observed in the nervous system, which reduces the number of spikes transmitted across synapses, we introduce a novel Masked Spiking Transformer (MST) framework that incorporates a Random Spike Masking (RSM) method to prune redundant spikes and reduce energy consumption without sacrificing performance. Our experimental results demonstrate that the proposed MST model achieves a significant reduction of 26.8% in power consumption when the masking ratio is 75% while maintaining the same level of performance as the unmasked model.


title: Automatic Assessment of Functional Movement Screening Exercises with Deep Learning Architectures

abstract: (1) Background: The success of physiotherapy depends on the regular and correct performance of movement exercises. A system that automatically evaluates these could support the therapy. Previous approaches in this area rarely rely on Deep Learning methods and do not yet fully use their potential. (2) Methods: Using a measurement system consisting of 17 IMUs, a dataset of four Functional Movement Screening (FMS) exercises is recorded. Exercise execution is evaluated by physiotherapists using the FMS criteria. This dataset is used to train a neural network that assigns the correct FMS score to an exercise repetition. We use an architecture consisting of CNN, LSTM and Dense layers. Based on this framework, we apply various methods to optimize the performance of the network. For the optimization, we perform a extensive hyperparameter optimization. In addition, we are comparing different CNN structures that have been specifically adapted for use with IMU data. Finally, the developed network is trained with the data of different FMS exercises and the performance is compared. (3) Results: The evaluation shows that the presented approach achieves a convincing performance in the classification of unknown repetitions of already known subjects. However, the trained network is yet unable to achieve consistent performance on the data of a previously unknown subjects. Additionally, it can be seen that the performance of the network differs significantly depending on the exercise it is trained for.


title: A Reproducible and Realistic Evaluation of Partial Domain Adaptation Methods

abstract: Unsupervised Domain Adaptation (UDA) aims at classifying unlabeled target images leveraging source labeled ones. In this work, we consider the Partial Domain Adaptation (PDA) variant, where we have extra source classes not present in the target domain. Most successful algorithms use model selection strategies that rely on target labels to find the best hyper-parameters and/or models along training. However, these strategies violate the main assumption in PDA: only unlabeled target domain samples are available. Moreover, there are also inconsistencies in the experimental settings - architecture, hyper-parameter tuning, number of runs - yielding unfair comparisons. The main goal of this work is to provide a realistic evaluation of PDA methods with the different model selection strategies under a consistent evaluation protocol. We evaluate 7 representative PDA algorithms on 2 different real-world datasets using 7 different model selection strategies. Our two main findings are: (i) without target labels for model selection, the accuracy of the methods decreases up to 30 percentage points; (ii) only one method and model selection pair performs well on both datasets. Experiments were performed with our PyTorch framework, BenchmarkPDA, which we open source.


title: Sliding friction and superlubricity of colloidal AFM probes coated by tribo-induced graphitic transfer layers

abstract: Colloidal probe Atomic Force Microscopy (AFM) allows to explore sliding friction phenomena in graphite contacts of nominal lateral size up to hundreds of nanometers. It is known that contact formation involves tribo-induced material transfer of graphite flakes from the graphitic substrate to the colloidal probe. In this context, sliding states with nearly-vanishing friction, i.e. superlubricity, may set in. A comprehensive investigation of the transfer layer properties is mandatory to ascertain the origin of superlubricity. Here we explore the friction response of micrometric beads, of different size and pristine surface roughness, sliding on graphite under ambient conditions. We show that such tribosystems undergo a robust transition towards a low-adhesion, low-friction state dominated by mechanical interactions at one dominant tribo-induced nanocontact. Friction force spectroscopy reveals that the nanocontact can be superlubric or dissipative, in fact undergoing a load-driven transition from dissipative stick-slip to continuous superlubric sliding. This behavior is excellently described by the thermally-activated, single-asperity Prandtl-Tomlinson model. Our results indicate that upon formation of the transfer layer, friction depends on the energy landscape experienced by the topographically-highest tribo-induced nanoasperity. Consistently we find larger dissipation when the tribo-induced nanoasperity is sled against surfaces with higher atomic corrugation than graphite, like MoS2 and WS2, in prototypical Van der Waals layered hetero-junctions.


title: spred: Solving $L_1$ Penalty with SGD

abstract: We propose to minimize a generic differentiable objective with $L_1$ constraint using a simple reparametrization and straightforward stochastic gradient descent. Our proposal is the direct generalization of previous ideas that the $L_1$ penalty may be equivalent to a differentiable reparametrization with weight decay. We prove that the proposed method, \textit{spred}, is an exact differentiable solver of $L_1$ and that the reparametrization trick is completely ``benign" for a generic nonconvex function. Practically, we demonstrate the usefulness of the method in (1) training sparse neural networks to perform gene selection tasks, which involves finding relevant features in a very high dimensional space, and (2) neural network compression task, to which previous attempts at applying the $L_1$-penalty have been unsuccessful. Conceptually, our result bridges the gap between the sparsity in deep learning and conventional statistical learning.


title: Robust Active Distillation

abstract: Distilling knowledge from a large teacher model to a lightweight one is a widely successful approach for generating compact, powerful models in the semi-supervised learning setting where a limited amount of labeled data is available. In large-scale applications, however, the teacher tends to provide a large number of incorrect soft-labels that impairs student performance. The sheer size of the teacher additionally constrains the number of soft-labels that can be queried due to prohibitive computational and/or financial costs. The difficulty in achieving simultaneous \emph{efficiency} (i.e., minimizing soft-label queries) and \emph{robustness} (i.e., avoiding student inaccuracies due to incorrect labels) hurts the widespread application of knowledge distillation to many modern tasks. In this paper, we present a parameter-free approach with provable guarantees to query the soft-labels of points that are simultaneously informative and correctly labeled by the teacher. At the core of our work lies a game-theoretic formulation that explicitly considers the inherent trade-off between the informativeness and correctness of input instances. We establish bounds on the expected performance of our approach that hold even in worst-case distillation instances. We present empirical evaluations on popular benchmarks that demonstrate the improved distillation performance enabled by our work relative to that of state-of-the-art active learning and active distillation methods.


title: Statistical inference for rough volatility: Minimax Theory

abstract: Rough volatility models have gained considerable interest in the quantitative finance community in recent years. In this paradigm, the volatility of the asset price is driven by a fractional Brownian motion with a small value for the Hurst parameter $H$. In this work, we provide a rigorous statistical analysis of these models. To do so, we establish minimax lower bounds for parameter estimation and design procedures based on wavelets attaining them. We notably obtain an optimal speed of convergence of $n^{-1/(4H+2)}$ for estimating $H$ based on n sampled data, extending results known only for the easier case $H>1/2$ so far. We therefore establish that the parameters of rough volatility models can be inferred with optimal accuracy in all regimes.


title: Exponential Enhancement of Dark Matter Freezeout Abundance

abstract: A novel paradigm for thermal dark matter (DM), termed "bouncing dark matter", is presented. In canonical thermal DM scenarios, the DM abundance falls exponentially as the temperature drops below the mass of DM, until thermal freezeout occurs. This note explores a broader class of thermal DM models that are exceptions to this rule, where the DM abundance can deviate from the exponentially falling curve, and even rise exponentially, while in thermal equilibrium. Such scenarios can feature present day DM annihilation cross sections much larger than the canonical thermal target, improving the prospects for indirect detection of DM annihilation signals.


title: Statistical inference for rough volatility: Central limit theorems

abstract: In recent years, there has been a substantive interest in rough volatility models. In this class of models, the local behavior of stochastic volatility is much more irregular than semimartingales and resembles that of a fractional Brownian motion with Hurst parameter $H < 0.5$. In this paper, we derive a consistent and asymptotically mixed normal estimator of $H$ based on high-frequency price observations. In contrast to previous works, we work in a semiparametric setting and do not assume any a priori relationship between volatility estimators and true volatility. Furthermore, our estimator attains a rate of convergence that is known to be optimal in a minimax sense in parametric rough volatility models.


title: One-shot Detail Retouching with Patch Space Neural Transformation Blending

abstract: Photo retouching is a difficult task for novice users as it requires expert knowledge and advanced tools. Photographers often spend a great deal of time generating high-quality retouched photos with intricate details. In this paper, we introduce a one-shot learning based technique to automatically retouch details of an input image based on just a single pair of before and after example images. Our approach provides accurate and generalizable detail edit transfer to new images. We achieve these by proposing a new representation for image to image maps. Specifically, we propose neural field based transformation blending in the patch space for defining patch to patch transformations for each frequency band. This parametrization of the map with anchor transformations and associated weights, and spatio-spectral localized patches, allows us to capture details well while staying generalizable. We evaluate our technique both on known ground truth filters and artist retouching edits. Our method accurately transfers complex detail retouching edits.


title: Unraveling Twisty Linear Polarization Morphologies in Black Hole Images

abstract: We investigate general relativistic magnetohydrodynamic simulations (GRMHD) to determine the physical origin of the twisty patterns of linear polarization seen in spatially resolved black hole images and explain their morphological dependence on black hole spin. By characterising the observed emission with a simple analytic ring model, we find that the twisty morphology is determined by the magnetic field structure in the emitting region. Moreover, the dependence of this twisty pattern on spin can be attributed to changes in the magnetic field geometry that occur due to the frame dragging. By studying an analytic ring model, we find that the roles of Doppler boosting and lensing are subdominant. Faraday rotation may cause a systematic shift in the linear polarization pattern, but we find that its impact is subdominant for models with strong magnetic fields and modest ion-to-electron temperature ratios. Models with weaker magnetic fields are much more strongly affected by Faraday rotation and have more complicated emission geometries than can be captured by a ring model. However, these models are currently disfavoured by the recent EHT observations of M87*. Our results suggest that linear polarization maps can provide a probe of the underlying magnetic field structure around a black hole, which may then be usable to indirectly infer black hole spins. The generality of these results should be tested with alternative codes, initial conditions, and plasma physics prescriptions.


title: Robotic observation pipeline for small bodies in the solar system based on open-source software and commercially available telescope hardware

abstract: The observation of small bodies in the Space Environment is an ongoing important task in astronomy. While nowadays new objects are mostly detected in larger sky surveys, several follow-up observations are usually needed for each object to improve the accuracy of orbit determination. In particular objects orbiting close to Earth, so called Near-Earth Objects are of special concern as a small but not negligible fraction of them can have a non-zero impact probability with Earth. Telescopes are often hosted by amateur observatories. With upcoming new NEO search campaigns by very wide field of view telescopes, like the Vera C. Rubin Observatory, NASA's NEO surveyor space mission and ESA's Flyeye telescopes, the number of NEO discoveries will increase dramatically. This will require an increasing number of useful telescopes for follow-up observations at different geographical locations. While well-equipped amateur astronomers often host instruments which might be capable of creating useful measurements, both observation planning and scheduling, and also analysis are still a major challenge for many observers. In this work we present a fully robotic planning, scheduling and observation pipeline that extends the widely used open-source cross-platform software KStars/Ekos for INDI devices. The method consists of algorithms which automatically select NEO candidates with priority according to ESA's NEOCC. It then analyses detectable objects (based on limiting magnitudes, geographical position, and time) with preliminary ephemeris from the Minor Planet Center. Optimal observing slots during the night are calculated and scheduled. Immediately before the measurement the accurate position of the minor body is recalculated and finally the images are taken. Besides the detailed description of all components, we will show a complete robotic hard- and software solution based on our methods.


title: Dark matter indirect detection limits from complete annihilation patterns

abstract: While cosmological and astrophysical probes suggest that dark matter would make up for 85% of the total matter content of the Universe, the determination of its nature remains one of the greatest challenges of fundamental physics. Assuming the $\Lambda$CDM cosmological model, Weakly Interacting Massive Particles would annihilate into Standard Model particles, yielding $\gamma$-rays, which could be detected by ground-based telescopes. Dwarf spheroidal galaxies represent promising targets for such indirect searches as they are assumed to be highly dark matter dominated with the absence of astrophysical sources nearby. Previous studies have led to upper limits on the annihilation cross-section assuming single exclusive annihilation channels. In this work, we consider a more realistic situation and take into account the complete annihilation pattern within a given particle physics model. This allows us to study the impact on the derived upper limits on the dark matter annihilation cross-section from a full annihilation pattern compared to the case of a single annihilation channel. We use mockdata for the Cherenkov Telescope Array simulating the observations of the promising dwarf spheroidal galaxy Sculptor. We show the impact of considering the full annihilation pattern within a simple framework where the Standard Model of particle physics is extended by a singlet scalar. Such a model shows new features in the shape of the predicted upper limit which reaches a value of $\langle \sigma v \rangle = 3.8\times10^{-24}~\rm{cm}^{-3}\rm{s}^{-1}$ for a dark matter mass of 1 TeV at 95% confidence level. We suggest to consider the complete particle physics information in order to derive more realistic limits.


title: Cost Design in Atomic Routing Games

abstract: An atomic routing game is a multiplayer game on a directed graph. Each player in the game chooses a path -- a sequence of links that connect its origin node to its destination node -- with the lowest cost, where the cost of each link is a function of all players' choices. We develop a novel numerical method to design the link cost function in atomic routing games such that the players' choices at the Nash equilibrium minimize a given smooth performance function. This method first approximates the nonsmooth Nash equilibrium conditions with smooth ones, then iteratively improves the link cost function via implicit differentiation. We demonstrate the application of this method to atomic routing games that model noncooperative agents navigating in grid worlds.


title: Immunological Approaches to Load Balancing in MIMD Systems

abstract: Effective utilization of Multiple-Instruction-Multiple-Data (MIMD) parallel computers requires the application of good load balancing techniques. In this paper we show that heuristics derived from observation of complex natural systems, such as the mammalian immune system, can lead to effective load balancing strategies. In particular, the immune system processes of regulation, suppression, tolerance, and memory are seen to be powerful load balancing mechanisms. We provide a detailed example of our approach applied to parallelization of an image processing task, that of extracting the circuit design from the images of the layers of a CMOS integrated circuit. The results of this experiment show that good speedup characteristics can be obtained when using immune system derived load balancing strategies.


title: Model theory and Ultrapower Embedding Problems in Operator Algebras

abstract: We survey the model theoretic approach to a variety of ultrapower embedding problems in operator algebras.


title: On the factorization invariants of arithmetical congruence monoids

abstract: In this paper, we study various factorization invariants of arithmetical congruence monoids. The invariants we investigate are the catenary degree, a measure of the maximum distance between any two factorizations of the same element, the length density, which describes the distribution of the factorization lengths of an element, and the omega primality, which measures how far an element is from being prime.


title: Force-Aware Interface via Electromyography for Natural VR/AR Interaction

abstract: While tremendous advances in visual and auditory realism have been made for virtual and augmented reality (VR/AR), introducing a plausible sense of physicality into the virtual world remains challenging. Closing the gap between real-world physicality and immersive virtual experience requires a closed interaction loop: applying user-exerted physical forces to the virtual environment and generating haptic sensations back to the users. However, existing VR/AR solutions either completely ignore the force inputs from the users or rely on obtrusive sensing devices that compromise user experience. By identifying users' muscle activation patterns while engaging in VR/AR, we design a learning-based neural interface for natural and intuitive force inputs. Specifically, we show that lightweight electromyography sensors, resting non-invasively on users' forearm skin, inform and establish a robust understanding of their complex hand activities. Fuelled by a neural-network-based model, our interface can decode finger-wise forces in real-time with 3.3% mean error, and generalize to new users with little calibration. Through an interactive psychophysical study, we show that human perception of virtual objects' physical properties, such as stiffness, can be significantly enhanced by our interface. We further demonstrate that our interface enables ubiquitous control via finger tapping. Ultimately, we envision our findings to push forward research towards more realistic physicality in future VR/AR.


title: On genus-0 invariants of Calabi-Yau hybrid models

abstract: We compute genus zero correlators of hybrid phases of Calabi-Yau gauged linear sigma models (GLSMs), i.e. of phases that are Landau-Ginzburg orbifolds fibered over some base. These correlators are generalisations of Gromov-Witten and FJRW invariants. Using previous results on the structure of the of the sphere- and hemisphere partition functions of GLSMs when evaluated in different phases, we extract the I-function and the J-function from a GLSM calculation. The J-function is the generating function of the correlators. We use the field theoretic description of hybrid models to identify the states that are inserted in these correlators. We compute the invariants for examples of one- and two-parameter hybrid models. Our results match with results from mirror symmetry and FJRW theory.


title: Axioms for Automated Market Makers: A Mathematical Framework in FinTech and Decentralized Finance

abstract: Within this work we consider an axiomatic framework for Automated Market Makers (AMMs). By imposing reasonable axioms on the underlying utility function, we are able to characterize the properties of the swap size of the assets and of the resulting pricing oracle. In providing these general AMM axioms, we define a novel measure of price impacts that can be used to quantify those costs between different constructions. We have analyzed many existing AMMs and shown that the vast majority of them satisfy our axioms. We have also considered the question of fees and divergence loss. In doing so, we have proposed a new fee structure so as to make the AMM indifferent to transaction splitting. Finally, we have proposed a novel AMM that has nice analytical properties and provides a large range over which there is no divergence loss.


title: A Quarter Century of Guitar Nebula/Filament Evolution

abstract: We have collected a new deep {\it Chandra X-ray Observatory} ({\it CXO}) exposure of PSR B2224+65 and the `Guitar Nebula', mapping the complex X-ray structure. This is accompanied by a new {\it HST} H$\alpha$ image of the head of the Guitar. Comparing the {\it HST} and {\it CXO} structures in 4 epochs over 25 years, we constrain the evolution of the TeV particles that light up the filament. Cross-field diffusion appears to be enhanced, likely by the injected particles, behind the filament's sharp leading edge, explaining the filament width and its evolving surface brightness profile.


title: Fractional Integrable and Related Discrete Nonlinear Schr\"odinger Equations

abstract: Integrable fractional equations such as the fractional Korteweg-deVries and nonlinear Schr\"odinger equations are key to the intersection of nonlinear dynamics and fractional calculus. In this manuscript, the first discrete/differential difference equation of this type is found, the fractional integrable discrete nonlinear Schr\"odinger equation. This equation is linearized; special soliton solutions are found whose peak velocities exhibit more complicated behavior than other previously obtained fractional integrable equations. This equation is compared with the closely related fractional averaged discrete nonlinear Schr\"odinger equation which has simpler structure than the integrable case. For positive fractional parameter and small amplitude waves, the soliton solutions of the integrable and averaged equations have similar behavior.


title: Estimating the Performance of Entity Resolution Algorithms: Lessons Learned Through PatentsView.org

abstract: This paper introduces a novel evaluation methodology for entity resolution algorithms. It is motivated by PatentsView.org, a U.S. Patents and Trademarks Office patent data exploration tool that disambiguates patent inventors using an entity resolution algorithm. We provide a data collection methodology and tailored performance estimators that account for sampling biases. Our approach is simple, practical and principled -- key characteristics that allow us to paint the first representative picture of PatentsView's disambiguation performance. This approach is used to inform PatentsView's users of the reliability of the data and to allow the comparison of competing disambiguation algorithms.


title: Interpretable Option Discovery using Deep Q-Learning and Variational Autoencoders

abstract: Deep Reinforcement Learning (RL) is unquestionably a robust framework to train autonomous agents in a wide variety of disciplines. However, traditional deep and shallow model-free RL algorithms suffer from low sample efficiency and inadequate generalization for sparse state spaces. The options framework with temporal abstractions is perhaps the most promising method to solve these problems, but it still has noticeable shortcomings. It only guarantees local convergence, and it is challenging to automate initiation and termination conditions, which in practice are commonly hand-crafted. Our proposal, the Deep Variational Q-Network (DVQN), combines deep generative- and reinforcement learning. The algorithm finds good policies from a Gaussian distributed latent-space, which is especially useful for defining options. The DVQN algorithm uses MSE with KL-divergence as regularization, combined with traditional Q-Learning updates. The algorithm learns a latent-space that represents good policies with state clusters for options. We show that the DVQN algorithm is a promising approach for identifying initiation and termination conditions for option-based reinforcement learning. Experiments show that the DVQN algorithm, with automatic initiation and termination, has comparable performance to Rainbow and can maintain stability when trained for extended periods after convergence.


title: Split-Spectrum Based Distributed State Estimation for Linear Systems

abstract: This paper studies a distributed state estimation problem for both continuous- and discrete-time linear systems. A simply structured distributed estimator (comprising interconnected local estimators) is first described for estimating the state of a continuous and multi-channel linear system whose sensed outputs are distributed across a fixed multi-agent network. The estimator is then extended to non-stationary networks whose graphs switch according to a switching signal. The estimator is guaranteed to solve the problem, provided a network-widely shared high gain condition achieving a form of spectrum separation is satisfied. As an alternative to sharing a common gain across the network, a fully distributed version of the estimator is also studied in which each agent adaptively adjusts a local gain, though the practicality of this approach is subject to a robustness issue common to adaptive control. A discrete-time version of the distributed state estimation problem is also studied, and a corresponding estimator based again on spectrum separation, but not high gain, is proposed for time-varying networks. For each scenario, it is explained how to construct the estimator so that the state estimation errors in the local estimators all converge to zero exponentially fast at a fixed but arbitrarily chosen rate, provided the network's graph is strongly connected for all time. The proposed estimators are inherently resilient to abrupt changes in the number of agents and communication links in the inter-agent communication graph upon which the algorithms depend, provided the network is redundantly strongly connected and redundantly jointly observable.


title: Quantum supersymmetric pairs and $\imath$Schur duality of type AIII

abstract: We construct quantum supersymmetric pairs $({\bold U},{\bold U}^\imath)$ of type AIII and elucidate their fundamental properties. An $\imath$Schur duality between the $\imath$quantum supergroup ${\bold U}^\imath$ and the Hecke algebra of type B acting on a tensor space is established, providing a super generalization of the $\imath$Schur duality of type AIII. Additionally, we construct a (quasi) $K$-matrix for arbitrary parameters, which facilitates the realization of the Hecke algebra action on the tensor space.


title: Optimizing Data Collection for Machine Learning

abstract: Modern deep learning systems require huge data sets to achieve impressive performance, but there is little guidance on how much or what kind of data to collect. Over-collecting data incurs unnecessary present costs, while under-collecting may incur future costs and delay workflows. We propose a new paradigm for modeling the data collection workflow as a formal optimal data collection problem that allows designers to specify performance targets, collection costs, a time horizon, and penalties for failing to meet the targets. Additionally, this formulation generalizes to tasks requiring multiple data sources, such as labeled and unlabeled data used in semi-supervised learning. To solve our problem, we develop Learn-Optimize-Collect (LOC), which minimizes expected future collection costs. Finally, we numerically compare our framework to the conventional baseline of estimating data requirements by extrapolating from neural scaling laws. We significantly reduce the risks of failing to meet desired performance targets on several classification, segmentation, and detection tasks, while maintaining low total collection costs.


title: CaiRL: A High-Performance Reinforcement Learning Environment Toolkit

abstract: This paper addresses the dire need for a platform that efficiently provides a framework for running reinforcement learning (RL) experiments. We propose the CaiRL Environment Toolkit as an efficient, compatible, and more sustainable alternative for training learning agents and propose methods to develop more efficient environment simulations. There is an increasing focus on developing sustainable artificial intelligence. However, little effort has been made to improve the efficiency of running environment simulations. The most popular development toolkit for reinforcement learning, OpenAI Gym, is built using Python, a powerful but slow programming language. We propose a toolkit written in C++ with the same flexibility level but works orders of magnitude faster to make up for Python's inefficiency. This would drastically cut climate emissions. CaiRL also presents the first reinforcement learning toolkit with a built-in JVM and Flash support for running legacy flash games for reinforcement learning research. We demonstrate the effectiveness of CaiRL in the classic control benchmark, comparing the execution speed to OpenAI Gym. Furthermore, we illustrate that CaiRL can act as a drop-in replacement for OpenAI Gym to leverage significantly faster training speeds because of the reduced environment computation time.


title: Investigations on Effective Electromagnetic and Gravitational Scenarios

abstract: The work aims effective and low-dimensional systems. Some different contexts involving gravitational and electromagnetic interactions are investigated. The electromagnetic one approaches bosonic and fermionic Effective Quantum Field Theories non-minimally coupled in three spacetime dimensions submitted to the expansion of Foldy-Wouthuysen Transformation, what generates (non-)relativistic corrections. A study of the effects of an external electromagnetic field derived from the Maxwell-Chern-Simons Electrodynamics on the obtained interactions are executed, as well as the impact produced by the dimensional reduction on expanded higher dimensional fermionic system in comparison to the low-dimensional one. In the scenario of gravitational effective model, scalar and fermionic particle scatterings reveal inter-particles interactions beyond monopole-monopole, leading to velocity and spin contributions, and the results are compared to a modified Electrodynamics effective model. A non-perturbative model resourcing to Casual Dynamics Triangulation data is adopted to serve as consistency check of the potentials resultants. Low-dimensional Maxwell-Higgs effective models with modified kinetic terms are studied, submitting them to a Bogomol'nyi prescription-type for calculation of inferior (non-trivial) bound energy and the self-dual equations. Vortex solutions for gauge field non-specified by an ansatz are achieved and their topological feature detailed.


title: Bayes-optimal limits in structured PCA, and how to reach them

abstract: How do statistical dependencies in measurement noise influence high-dimensional inference? To answer this, we study the paradigmatic spiked matrix model of principal components analysis (PCA), where a rank-one matrix is corrupted by additive noise. We go beyond the usual independence assumption on the noise entries, by drawing the noise from a low-order polynomial orthogonal matrix ensemble. The resulting noise correlations make the setting relevant for applications but analytically challenging. We provide the first characterization of the Bayes-optimal limits of inference in this model. If the spike is rotation-invariant, we show that standard spectral PCA is optimal. However, for more general priors, both PCA and the existing approximate message passing algorithm (AMP) fall short of achieving the information-theoretic limits, which we compute using the replica method from statistical mechanics. We thus propose a novel AMP, inspired by the theory of Adaptive Thouless-Anderson-Palmer equations, which saturates the theoretical limit. This AMP comes with a rigorous state evolution analysis tracking its performance. Although we focus on specific noise distributions, our methodology can be generalized to a wide class of trace matrix ensembles at the cost of more involved expressions. Finally, despite the seemingly strong assumption of rotation-invariant noise, our theory empirically predicts algorithmic performance on real data, pointing at remarkable universality properties.

categories: cs.IT cond-mat.stat-mech cs.LG math.IT stat.ML


title: Towards Performance Portable Programming for Distributed Heterogeneous Systems

abstract: Hardware heterogeneity is here to stay for high-performance computing. Large-scale systems are currently equipped with multiple GPU accelerators per compute node and are expected to incorporate more specialized hardware in the future. This shift in the computing ecosystem offers many opportunities for performance improvement; however, it also increases the complexity of programming for such architectures. This work introduces a runtime framework that enables effortless programming for heterogeneous systems while efficiently utilizing hardware resources. The framework is integrated within a distributed and scalable runtime system to facilitate performance portability across heterogeneous nodes. Along with the design, this paper describes the implementation and optimizations performed, achieving up to 300% improvement in a shared memory benchmark and up to 10 times in distributed device communication. Preliminary results indicate that our software incurs low overhead and achieves 40% improvement in a distributed Jacobi proxy application while hiding the idiosyncrasies of the hardware.


title: Rearranged Stochastic Heat Equation

abstract: The purpose of this work is to provide an explicit construction of a strong Feller semigroup on the space of probability measures over the real line that additionally maps bounded measurable functions into Lipschitz continuous functions, with a Lipschitz constant that blows up in an integrable manner in small time. Our construction relies on a rearranged version of the stochastic heat equation on the circle driven by a coloured noise. Formally, this stochastic equation writes as a reflected equation in infinite dimension. Under the action of the rearrangement, the solution is forced to live in a space of quantile functions that is isometric to the space of probability measures on the real line. We prove the equation to be solvable by means of an Euler scheme in which we alternate flat dynamics in the space of random variables on the circle with a rearrangement operation that projects back the random variables onto the subset of quantile functions. A first challenge is to prove that this scheme is tight. A second one is to provide a consistent theory for the limiting reflected equation and in particular to interpret in a relevant manner the reflection term. The last step in our work is to establish the aforementioned Lipschitz property of the semigroup by adapting earlier ideas from the Bismut-Elworthy-Li formula.


title: Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought

abstract: Large language models (LLMs) have shown remarkable reasoning capabilities given chain-of-thought prompts (examples with intermediate reasoning steps). Existing benchmarks measure reasoning ability indirectly, by evaluating accuracy on downstream tasks such as mathematical reasoning. However, it is unclear how these models obtain the answers and whether they rely on simple heuristics rather than the generated chain-of-thought. To enable systematic exploration of the reasoning ability of LLMs, we present a new synthetic question-answering dataset called PrOntoQA, where each example is generated from a synthetic world model represented in first-order logic. This allows us to parse the generated chain-of-thought into symbolic proofs for formal analysis. Our analysis on InstructGPT and GPT-3 shows that LLMs are quite capable of making correct individual deduction steps, and so are generally capable of reasoning, even in fictional contexts. However, they have difficulty with proof planning: When multiple valid deduction steps are available, they are not able to systematically explore the different options.


title: Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization

abstract: We tackle the problem of aligning pre-trained large language models (LMs) with human preferences. If we view text generation as a sequential decision-making problem, reinforcement learning (RL) appears to be a natural conceptual framework. However, using RL for LM-based generation faces empirical challenges, including training instability due to the combinatorial action space, as well as a lack of open-source libraries and benchmarks customized for LM alignment. Thus, a question rises in the research community: is RL a practical paradigm for NLP? To help answer this, we first introduce an open-source modular library, RL4LMs (Reinforcement Learning for Language Models), for optimizing language generators with RL. The library consists of on-policy RL algorithms that can be used to train any encoder or encoder-decoder LM in the HuggingFace library (Wolf et al. 2020) with an arbitrary reward function. Next, we present the GRUE (General Reinforced-language Understanding Evaluation) benchmark, a set of 6 language generation tasks which are supervised not by target strings, but by reward functions which capture automated measures of human preference. GRUE is the first leaderboard-style evaluation of RL algorithms for NLP tasks. Finally, we introduce an easy-to-use, performant RL algorithm, NLPO (Natural Language Policy Optimization) that learns to effectively reduce the combinatorial action space in language generation. We show 1) that RL techniques are generally better than supervised methods at aligning LMs to human preferences; and 2) that NLPO exhibits greater stability and performance than previous policy gradient methods (e.g., PPO (Schulman et al. 2017)), based on both automatic and human evaluations.


title: The Effect of Warm-Glow on User Perceived Usability and Intention to Adopt Technology: Extending UTAUT2

abstract: In this work we investigate the effect that warm-glow has on user's perception of the usability of a technology as well as their intention to adopt within the context of the second version of the Unified Theory of Acceptance and Use of Technology (UTUAT2). The UTAUT2 model was extended for this purpose, incorporating two existing constructs designed to capture the two aspects of warm-low (extrinsic and intrinsic), forming the UTAUT2 + WG model. An experimental approach was then taken to evaluate this proposed model, where participants were exposed to a vignette describing a hypothetical technology which was designed to evoke a feeling of warm-glow. The collected data was analyzed using the partial least squares approach in order to evaluate our ex-tended model/ The results revealed that warm-glow does indeed influence user behavior and plays a prominent role. Warm-glow was found to influence user perception of the usability of a technology, where effectiveness is reflected through the factor of performance expectancy (PE), efficiency through the factor of effort expectancy (EE), and satisfaction through hedonic motivation (HM). Furthermore, warm-glow was found to influence user behavioral intention to adopt technology. The paper concludes by discussing the implications of these findings.


title: Learning over time using a neuromorphic adaptive control algorithm for robotic arms

abstract: In this paper, we explore the ability of a robot arm to learn the underlying operation space defined by the positions (x, y, z) that the arm's end-effector can reach, including disturbances, by deploying and thoroughly evaluating a Spiking Neural Network SNN-based adaptive control algorithm. While traditional control algorithms for robotics have limitations in both adapting to new and dynamic environments, we show that the robot arm can learn the operational space and complete tasks faster over time. We also demonstrate that the adaptive robot control algorithm based on SNNs enables a fast response while maintaining energy efficiency. We obtained these results by performing an extensive search of the adaptive algorithm parameter space, and evaluating algorithm performance for different SNN network sizes, learning rates, dynamic robot arm trajectories, and response times. We show that the robot arm learns to complete tasks 15% faster in specific experiment scenarios such as scenarios with six or nine random target points.


title: Event-based Temporally Dense Optical Flow Estimation with Sequential Learning

abstract: Event cameras provide an advantage over traditional frame-based cameras when capturing fast-moving objects without a motion blur. They achieve this by recording changes in light intensity (known as events), thus allowing them to operate at a much higher frequency and making them suitable for capturing motions in a highly dynamic scene. Many recent studies have proposed methods to train neural networks (NNs) for predicting optical flow from events. However, they often rely on a spatio-temporal representation constructed from events over a fixed interval, such as 10Hz used in training on the DSEC dataset. This limitation restricts the flow prediction to the same interval (10Hz) whereas the fast speed of event cameras, which can operate up to 3kHz, has not been effectively utilized. In this work, we show that a temporally dense flow estimation at 100Hz can be achieved by treating the flow estimation as a sequential problem using two different variants of recurrent networks - Long-short term memory (LSTM) and spiking neural network (SNN). First, We utilize the NN model constructed similar to the popular EV-FlowNet but with LSTM layers to demonstrate the efficiency of our training method. The model not only produces 10x more frequent optical flow than the existing ones, but the estimated flows also have 13% lower errors than predictions from the baseline EV-FlowNet. Second, we construct an EV-FlowNet SNN but with leaky integrate and fire neurons to efficiently capture the temporal dynamics. We found that simple inherent recurrent dynamics of SNN lead to significant parameter reduction compared to the LSTM model. In addition, because of its event-driven computation, the spiking model is estimated to consume only 1.5% energy of the LSTM model, highlighting the efficiency of SNN in processing events and the potential for achieving temporally dense flow.


title: Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks

abstract: Since the recognition in the early nineties of the vanishing/exploding (V/E) gradient issue plaguing the training of neural networks (NNs), significant efforts have been exerted to overcome this obstacle. However, a clear solution to the V/E issue remained elusive so far. In this manuscript a new architecture of NN is proposed, designed to mathematically prevent the V/E issue to occur. The pursuit of approximate dynamical isometry, i.e. parameter configurations where the singular values of the input-output Jacobian are tightly distributed around 1, leads to the derivation of a NN's architecture that shares common traits with the popular Residual Network model. Instead of skipping connections between layers, the idea is to filter the previous activations orthogonally and add them to the nonlinear activations of the next layer, realising a convex combination between them. Remarkably, the impossibility for the gradient updates to either vanish or explode is demonstrated with analytical bounds that hold even in the infinite depth case. The effectiveness of this method is empirically proved by means of training via backpropagation an extremely deep multilayer perceptron of 50k layers, and an Elman NN to learn long-term dependencies in the input of 10k time steps in the past. Compared with other architectures specifically devised to deal with the V/E problem, e.g. LSTMs for recurrent NNs, the proposed model is way simpler yet more effective. Surprisingly, a single layer vanilla RNN can be enhanced to reach state of the art performance, while converging super fast; for instance on the psMNIST task, it is possible to get test accuracy of over 94% in the first epoch, and over 98% after just 10 epochs.


title: Mapping groups associated with real-valued function spaces and direct limits of Sobolev-Lie groups

abstract: Let $M$ be a compact smooth manifold of dimension $m$ (without boundary) and $G$ be a finite-dimensional Lie group, with Lie algebra $g$. Let $H^{>m/2}(M,G)$ be the group of all mappings $\gamma\colon M\to G$ which are $H^s$ for some $s>m/2$. We show that $H^{>m/2}(M,G)$ can be made a regular Lie group in Milnor's sense, modelled on the Silva space $H^{>m/2}(M,g)$ which is the locally convex direct limit of the Hilbert spaces $H^s(M,g)$ for $s>m/2$, such that $H^{>m/2}(M,G)$ is the direct limit of the Hilbert-Lie groups $H^s(M,G)$ for $s>m/2$ as a smooth Lie group. We also explain how the (known) Lie group structure on $H^s(M,G)$ can be obtained as a special case of a general construction of Lie groups $F(M,G)$ whenever real-valued function spaces $F(U,R)$ on open subsets $U$ of $R^m$ are given, subject to simple axioms.


title: OPT-Mimic: Imitation of Optimized Trajectories for Dynamic Quadruped Behaviors

abstract: Reinforcement Learning (RL) has seen many recent successes for quadruped robot control. The imitation of reference motions provides a simple and powerful prior for guiding solutions towards desired solutions without the need for meticulous reward design. While much work uses motion capture data or hand-crafted trajectories as the reference motion, relatively little work has explored the use of reference motions coming from model-based trajectory optimization. In this work, we investigate several design considerations that arise with such a framework, as demonstrated through four dynamic behaviours: trot, front hop, 180 backflip, and biped stepping. These are trained in simulation and transferred to a physical Solo 8 quadruped robot without further adaptation. In particular, we explore the space of feed-forward designs afforded by the trajectory optimizer to understand its impact on RL learning efficiency and sim-to-real transfer. These findings contribute to the long standing goal of producing robot controllers that combine the interpretability and precision of model-based optimization with the robustness that model-free RL-based controllers offer.


title: Summary Report Topical Group on Application and Industry Community Engagement Frontier Snowmass 2021

abstract: HEP community leads and operates cutting-edge experiments for the DOE Office of Science which have challenging sensing, data processing, and computing requirements that far surpass typical industrial applications. To make necessary progress in the energy, material, and fundamental sciences, development of novel technologies is often required to enable these advanced detector and accelerator programs. Our capabilities include efficient co-design, which is a prerequisite to enable the deployment of advanced techniques in a scientific setting where development spans from rapid prototyping to robust and reliable production scale. This applies across the design spectrum from the low level fabrication techniques to the high level software development. It underpins the requirement for a holistic approach of innovation that accelerates the cycle of technology development and deployment. The challenges set by the next generation of experiments requires a collaborative approach between academia, industry and national labs. Just a single stakeholder will be unable to deliver the technologies required for the success of the scientific goals. Tools and techniques developed for High Energy Physics (HEP) research can accelerate scientific discovery more broadly across DOE Office of Science and other federal initiatives and also benefit industry applications.


title: LOPR: Latent Occupancy PRediction using Generative Models

abstract: Environment prediction frameworks are integral for autonomous vehicles, enabling safe navigation in dynamic environments. LiDAR generated occupancy grid maps (L-OGMs) offer a robust bird's eye-view scene representation that facilitates joint scene predictions without relying on manual labeling unlike commonly used trajectory prediction frameworks. Prior approaches have optimized deterministic L-OGM prediction architectures directly in grid cell space. While these methods have achieved some degree of success in prediction, they occasionally grapple with unrealistic and incorrect predictions. We claim that the quality and realism of the forecasted occupancy grids can be enhanced with the use of generative models. We propose a framework that decouples occupancy prediction into: representation learning and stochastic prediction within the learned latent space. Our approach allows for conditioning the model on other available sensor modalities such as RGB-cameras and high definition maps. We demonstrate that our approach achieves state-of-the-art performance and is readily transferable between different robotic platforms on the real-world NuScenes, Waymo Open, and a custom dataset we collected on an experimental vehicle platform.


title: On the doubling condition in the infinite-dimensional setting

abstract: We present a systematic approach to the problem whether a topologically infinite-dimensional space can be made homogeneous in the Coifman--Weiss sense. The answer to the examined question is negative, as expected. Our leading representative of spaces with this property is $\mathbb{T}^{\omega} = \mathbb{T} \times \mathbb{T} \times \cdots$ with the natural product topology.


title: Numerical treatment of the energy equation in compressible flows simulations

abstract: We analyze the conservation properties of various discretizations of the system of compressible Euler equations for shock-free flows, with special focus on the treatment of the energy equation and on the induced discrete equations for other thermodynamic quantities. The analysis is conducted both theoretically and numerically and considers two important factors characterizing the various formulations, namely the choice of the energy equation and the splitting used in the discretization of the convective terms. The energy equations analyzed are total and internal energy, total enthalpy, pressure, speed of sound and entropy. In all the cases examined the discretization of the convective terms is made with locally conservative and kinetic-energy preserving schemes. Some important relations between the various formulations are highlighted and the performances of the various schemes are assessed by considering two widely used test cases. Together with some popular formulations from the literature, also new and potentially useful ones are analyzed.


title: Estimating productivity gains in digital automation

abstract: This paper proposes a novel productivity estimation model to evaluate the effects of adopting Artificial Intelligence (AI) components in a production chain. Our model provides evidence to address the "AI's" Solow's Paradox. We provide (i) theoretical and empirical evidence to explain Solow's dichotomy; (ii) a data-driven model to estimate and asses productivity variations; (iii) a methodology underpinned on process mining datasets to determine the business process, BP, and productivity; (iv) a set of computer simulation parameters; (v) and empirical analysis on labour-distribution. These provide data on why we consider AI Solow's paradox a consequence of metric mismeasurement.


title: PLOT: Prompt Learning with Optimal Transport for Vision-Language Models

abstract: With the increasing attention to large vision-language models such as CLIP, there has been a significant amount of effort dedicated to building efficient prompts. Unlike conventional methods of only learning one single prompt, we propose to learn multiple comprehensive prompts to describe diverse characteristics of categories such as intrinsic attributes or extrinsic contexts. However, directly matching each prompt to the same visual feature is problematic, as it pushes the prompts to converge to one point. To solve this problem, we propose to apply optimal transport to match the vision and text modalities. Specifically, we first model images and the categories with visual and textual feature sets. Then, we apply a two-stage optimization strategy to learn the prompts. In the inner loop, we optimize the optimal transport distance to align visual features and prompts by the Sinkhorn algorithm, while in the outer loop, we learn the prompts by this distance from the supervised data. Extensive experiments are conducted on the few-shot recognition task and the improvement demonstrates the superiority of our method. The code is available at https://github.com/CHENGY12/PLOT.


title: Rethinking infrastructure design: Evaluating pedestrians and VRUs' psychophysiological and behavioral responses to different roadway designs

abstract: The integration of human-centric approaches has gained more attention recently due to more automated systems being introduced into our built environments (buildings, roads, vehicles, etc.), which requires a correct understanding of how humans perceive such systems and respond to them. This paper introduces an Immersive Virtual Environment-based method to evaluate the infrastructure design with psycho-physiological and behavioral responses from the vulnerable road users, especially for pedestrians. A case study of pedestrian mid-block crossings with three crossing infrastructure designs (painted crosswalk, crosswalk with flashing beacons, and a smartphone app for connected vehicles) are tested. Results from 51 participants indicate there are differences between the subjective and objective measurement. A higher subjective safety rating is reported for the flashing beacon design, while the psychophysiological and behavioral data indicate that the flashing beacon and smartphone app are similar in terms of crossing behaviors, eye tracking measurements, and heart rate. In addition, the smartphone app scenario appears to have a lower stress level as indicated by eye tracking data, although many participants don't have prior experience with it. Suggestions are made for the implementation of new technologies, which can increase public acceptance of new technologies and pedestrian safety in the future.


title: Fast Ewald summation for Stokes flow with arbitrary periodicity

abstract: A fast and spectrally accurate Ewald summation method for the evaluation of stokeslet, stresslet and rotlet potentials of three-dimensional Stokes flow is presented. This work extends the previously developed Spectral Ewald method for Stokes flow to periodic boundary conditions in any number (three, two, one, or none) of the spatial directions, in a unified framework. The periodic potential is split into a short-range and a long-range part, where the latter is treated in Fourier space using the fast Fourier transform. A crucial component of the method is the modified kernels used to treat singular integration. We derive new modified kernels, and new improved truncation error estimates for the stokeslet and stresslet. An automated procedure for selecting parameters based on a given error tolerance is designed and tested. Analytical formulas for validation in the doubly and singly periodic cases are presented. We show that the computational time of the method scales like O(N log N) for N sources and targets, and investigate how the time depends on the error tolerance and window function, i.e. the function used to smoothly spread irregular point data to a uniform grid. The method is fastest in the fully periodic case, while the run time in the free-space case is around three times as large. Furthermore, the highest efficiency is reached when applying the method to a uniform source distribution in a primary cell with low aspect ratio. The work presented in this paper enables efficient and accurate simulations of three-dimensional Stokes flow with arbitrary periodicity using e.g. boundary integral and potential methods.


title: And what if two musical versions don't share melody, harmony, rhythm, or lyrics ?

abstract: Version identification (VI) has seen substantial progress over the past few years. On the one hand, the introduction of the metric learning paradigm has favored the emergence of scalable yet accurate VI systems. On the other hand, using features focusing on specific aspects of musical pieces, such as melody, harmony, or lyrics, yielded interpretable and promising performances. In this work, we build upon these recent advances and propose a metric learning-based system systematically leveraging four dimensions commonly admitted to convey musical similarity between versions: melodic line, harmonic structure, rhythmic patterns, and lyrics. We describe our deliberately simple model architecture, and we show in particular that an approximated representation of the lyrics is an efficient proxy to discriminate between versions and non-versions. We then describe how these features complement each other and yield new state-of-the-art performances on two publicly available datasets. We finally suggest that a VI system using a combination of melodic, harmonic, rhythmic and lyrics features could theoretically reach the optimal performances obtainable on these datasets.


title: Testing predictions of representation cost theory with CNNs

abstract: It is widely acknowledged that trained convolutional neural networks (CNNs) have different levels of sensitivity to signals of different frequency. In particular, a number of empirical studies have documented CNNs sensitivity to low-frequency signals. In this work we show with theory and experiments that this observed sensitivity is a consequence of the frequency distribution of natural images, which is known to have most of its power concentrated in low-to-mid frequencies. Our theoretical analysis relies on representations of the layers of a CNN in frequency space, an idea that has previously been used to accelerate computations and study implicit bias of network training algorithms, but to the best of our knowledge has not been applied in the domain of model robustness.


title: Understanding Prior Bias and Choice Paralysis in Transformer-based Language Representation Models through Four Experimental Probes

abstract: Recent work on transformer-based neural networks has led to impressive advances on multiple-choice natural language understanding (NLU) problems, such as Question Answering (QA) and abductive reasoning. Despite these advances, there is limited work still on understanding whether these models respond to perturbed multiple-choice instances in a sufficiently robust manner that would allow them to be trusted in real-world situations. We present four confusion probes, inspired by similar phenomena first identified in the behavioral science community, to test for problems such as prior bias and choice paralysis. Experimentally, we probe a widely used transformer-based multiple-choice NLU system using four established benchmark datasets. Here we show that the model exhibits significant prior bias and to a lesser, but still highly significant degree, choice paralysis, in addition to other problems. Our results suggest that stronger testing protocols and additional benchmarks may be necessary before the language models are used in front-facing systems or decision making with real world consequences.


title: A perspective on the microscopic pressure (stress) tensor: history, current understanding, and future challenges

abstract: The pressure tensor (equivalent to the negative stress tensor) at both microscopic and macroscopic levels is fundamental to many aspects of engineering and science, including fluid dynamics, solid mechanics, biophysics, and thermodynamics. In this perspective paper, we review methods to calculate the microscopic pressure tensor. Connections between different pressure forms for equilibrium and non-equilibrium systems are established. We also point out several challenges in the field, including the historical controversies over the definition of the microscopic pressure tensor; the difficulties with many-body and long-range potentials; the insufficiency of software and computational tools; and the lack of experimental routes to probe the pressure tensor at the nanoscale. Possible future directions are suggested.


title: Enriching Vulnerability Reports Through Automated and Augmented Description Summarization

abstract: Security incidents and data breaches are increasing rapidly, and only a fraction of them is being reported. Public vulnerability databases, e.g., national vulnerability database (NVD) and common vulnerability and exposure (CVE), have been leading the effort in documenting vulnerabilities and sharing them to aid defenses. Both are known for many issues, including brief vulnerability descriptions. Those descriptions play an important role in communicating the vulnerability information to security analysts in order to develop the appropriate countermeasure. Many resources provide additional information about vulnerabilities, however, they are not utilized to boost public repositories. In this paper, we devise a pipeline to augment vulnerability description through third party reference (hyperlink) scrapping. To normalize the description, we build a natural language summarization pipeline utilizing a pretrained language model that is fine-tuned using labeled instances and evaluate its performance against both human evaluation (golden standard) and computational metrics, showing initial promising results in terms of summary fluency, completeness, correctness, and understanding.


title: Geometric stability conditions under autoequivalences and applications: Elliptic Surfaces

abstract: On a Weierstrass elliptic surface, we describe the action of the relative Fourier-Mukai transform on the geometric chamber of $\mathrm{Stab}(X)$, and in the K3 case we also study the action on one of its boundary components. Using new estimates for the Gieseker chamber we prove that Gieseker stability for polarizations on certain Friedman chamber is preserved by the derived dual of the relative Fourier-Mukai transform. As an application of our description of the action, we also prove projectivity for some moduli spaces of Bridgeland semistable objects.


title: Geometric properties of Blaschke-like maps on domains with a conic boundary

abstract: For a circle $ C $ contained in the unit disk, the necessary and sufficient condition for the existence of a triangle inscribed in the unit circle and circumscribed about $ C $ is known as Chapple's formula. The geometric properties of Blaschke products of degree 3 given by Daepp et al. (2002) and Frantz (2004) allow us to extend Chapple's formula to the case of ellipses in the unit disk. The main aim of this paper is to provide a further extension of Chapple's formula. Introducing a Blaschke-like map of a domain whose boundary is a conic, we extend their results to the case where the outer curve is an ellipse or a parabola. Moreover, we also give some geometrical properties for the Blaschke-like maps of degree $ d $.


title: Understanding Substructures in Commonsense Relations in ConceptNet

abstract: Acquiring commonsense knowledge and reasoning is an important goal in modern NLP research. Despite much progress, there is still a lack of understanding (especially at scale) of the nature of commonsense knowledge itself. A potential source of structured commonsense knowledge that could be used to derive insights is ConceptNet. In particular, ConceptNet contains several coarse-grained relations, including HasContext, FormOf and SymbolOf, which can prove invaluable in understanding broad, but critically important, commonsense notions such as 'context'. In this article, we present a methodology based on unsupervised knowledge graph representation learning and clustering to reveal and study substructures in three heavily used commonsense relations in ConceptNet. Our results show that, despite having an 'official' definition in ConceptNet, many of these commonsense relations exhibit considerable sub-structure. In the future, therefore, such relations could be sub-divided into other relations with more refined definitions. We also supplement our core study with visualizations and qualitative analyses.


title: Flattening laser frequency comb spectra with a high dynamic range, broadband spectral shaper on-a-chip

abstract: Spectral shaping is critical to many fields of science. In astronomy for example, the detection of exoplanets via the Doppler effect hinges on the ability to calibrate a high resolution spectrograph. Laser frequency combs can be used for this, but the wildly varying intensity across the spectrum can make it impossible to optimally utilize the entire comb, leading to a reduced overall precision of calibration. To circumvent this, astronomical applications of laser frequency combs rely on a bulk optic setup which can flatten the output spectrum before sending it to the spectrograph. Such flatteners require complex and expensive optical elements like spatial light modulators and have non-negligible bench top footprints. Here we present an alternative in the form of an all-photonic spectral shaper that can be used to flatten the spectrum of a laser frequency comb. The device consists of a circuit etched into a silicon nitride wafer that supports an arrayed-waveguide grating to disperse the light over hundreds of nanometers in wavelength, followed by Mach-Zehnder interferometers to control the amplitude of each channel, thermo-optic phase modulators to phase the channels and a second arrayed-waveguide grating to recombine the spectrum. The demonstrator device operates from 1400 to 1800 nm (covering the astronomical H band), with twenty 20 nm wide channels. The device allows for nearly 40 dBs of dynamic modulation of the spectrum via the Mach-Zehnders , which is greater than that offered by most spatial light modulators. With a superluminescent diode, we reduced the static spectral variation to ~3 dB, limited by the properties of the components used in the circuit and on a laser frequency comb we managed to reduce the modulation to 5 dBs, sufficient for astronomical applications.


title: Characterizations of product Hardy spaces on stratified groups by singular integrals and maximal functions

abstract: A large part of the theory of Hardy spaces on products of Euclidean spaces has been extended to the setting of products of stratified Lie groups. This includes characterisation of Hardy spaces by square functions and by atomic decompositions, proof of the duality of Hardy spaces with BMO, and description of many interpolation spaces. Until now, however, two aspects of the classical theory have been conspicuously absent: the characterisation of Hardy spaces by singular integrals (of Christ--Geller type) or by (vertical or nontangential) maximal functions. In this paper we fill in these gaps by developing new techniques on products of stratified groups, using the ideas of Chen, Cowling, Lee, Li and Ottazzi on the Heisenberg group with flag structure.


title: Interpretable Deep Tracking

abstract: Imagine experiencing a crash as the passenger of an autonomous vehicle. Wouldn't you want to know why it happened? Current end-to-end optimizable deep neural networks (DNNs) in 3D detection, multi-object tracking, and motion forecasting provide little to no explanations about how they make their decisions. To help bridge this gap, we design an end-to-end optimizable multi-object tracking architecture and training protocol inspired by the recently proposed method of interchange intervention training (IIT). By enumerating different tracking decisions and associated reasoning procedures, we can train individual networks to reason about the possible decisions via IIT. Each network's decisions can be explained by the high-level structural causal model (SCM) it is trained in alignment with. Moreover, our proposed model learns to rank these outcomes, leveraging the promise of deep learning in end-to-end training, while being inherently interpretable.


title: Learning from Viral Content

abstract: We study learning on social media with an equilibrium model of users interacting with shared news stories. Rational users arrive sequentially, observe an original story (i.e., a private signal) and a sample of predecessors' stories in a news feed, and then decide which stories to share. The observed sample of stories depends on what predecessors share as well as the sampling algorithm generating news feeds. We focus on how often this algorithm selects more viral (i.e., widely shared) stories. Showing users viral stories can increase information aggregation, but it can also generate steady states where most shared stories are wrong. These misleading steady states self-perpetuate, as users who observe wrong stories develop wrong beliefs, and thus rationally continue to share them. Finally, we describe several consequences for platform design and robustness.


title: The perturbation bound of the extended vertical linear complementarity problem

abstract: In this paper, we discuss the perturbation analysis of the extended vertical linear complementarity problem (EVLCP). Under the assumption of the row $\mathcal{W}$-property, several absolute and relative perturbation bounds of EVLCP are given, which can be reduced to some existing results. Some numerical examples are given to show the proposed bounds.


title: Course-Prerequisite Networks for Analyzing and Understanding Academic Curricula

abstract: Understanding a complex system of relationships between courses is of great importance for the university's educational mission. This paper is dedicated to the study of course-prerequisite networks (CPNs), where nodes represent courses and directed links represent the formal prerequisite relationships between them. The main goal of CPNs is to model interactions between courses, represent the flow of knowledge in academic curricula, and serve as a key tool for visualizing, analyzing, and optimizing complex curricula. First, we consider several classical centrality measures, discuss their meaning in the context of CPNs, and use them for the identification of important courses. Next, we describe the hierarchical structure of a CPN using the topological stratification of the network. Finally, we perform the interdependence analysis, which allows to quantify the strength of knowledge flow between university divisions and helps to identify the most intradependent, influential, and interdisciplinary areas of study. We discuss how course-prerequisite networks can be used by students, faculty, and administrators for detecting important courses, improving existing and creating new courses, navigating complex curricula, allocating teaching resources, increasing interdisciplinary interactions between departments, revamping curricula, and enhancing the overall students' learning experience. The proposed methodology can be used for the analysis of any CPN, and it is illustrated with a network of courses taught at the California Institute of Technology. The network data analyzed in this paper is publicly available in the GitHub repository.


title: Beurling-Carleson sets, inner functions and a semi-linear equation

abstract: Beurling-Carleson sets have appeared in a number of areas of complex analysis such as boundary zero sets of analytic functions, inner functions with derivative in the Nevanlinna class, cyclicity in weighted Bergman spaces, Fuchsian groups of Widom-type and the corona problem in quotient Banach algebras. After surveying these developments, we give a general definition of Beurling-Carleson sets and discuss some of their basic properties. We show that the Roberts decomposition characterizes measures that do not charge Beurling-Carleson sets. For a positive singular measure $\mu$ on the unit circle, let $S_\mu$ denote the singular inner function with singular measure $\mu$. In the second part of the paper, we use a corona-type decomposition to relate a number of properties of singular measures on the unit circle such as membership of $S'_\mu$ in the Nevanlinna class $\mathcal N$, area conditions on level sets of $S_\mu$ and wepability. It was known that each of these properties holds for measures concentrated on Beurling-Carleson sets. We show that each of these properties implies that $\mu$ lives on a countable union of Beurling-Carleson sets. We also describe partial relations involving the membership of $S'_\mu$ in the Hardy space $H^p$, membership of $S_\mu$ in the Besov space $B^p$ and $(1-p)$-Beurling-Carleson sets and give a number of examples which show that our results are optimal. Finally, we show that measures that live on countable unions of $\alpha$-Beurling-Carleson sets are almost in bijection with nearly-maximal solutions of $\Delta u = u^p \cdot \chi_{u > 0}$ when $p > 3$ and $\alpha = \frac{p-3}{p-1}$.


title: Time-walk and jitter correction in SNSPDs at high count rates

abstract: Superconducting nanowire single-photon detectors (SNSPDs) are a leading detector type for time correlated single photon counting, especially in the near-infrared. When operated at high count rates, SNSPDs exhibit increased timing jitter caused by internal device properties and features of the RF amplification chain. Variations in RF pulse height and shape lead to variations in the latency of timing measurements. To compensate for this, we demonstrate a calibration method that correlates delays in detection events with the time elapsed between pulses. The increase in jitter at high rates can be largely canceled in software by applying corrections derived from the calibration process. We demonstrate our method with a single-pixel tungsten silicide SNSPD and show it decreases high count rate jitter. The technique is especially effective at removing a long tail that appears in the instrument response function at high count rates. At a count rate of 11.4 MCounts/s we reduce the full width at one percent maximum level (FW1%M) by 45%. The method therefore enables certain quantum communication protocols that are rate-limited by the (FW1%M) metric to operate almost twice as fast. \c{opyright} 2022. All rights reserved.


title: A systematic review of the use of Deep Learning in Satellite Imagery for Agriculture

abstract: Agricultural research is essential for increasing food production to meet the requirements of an increasing population in the coming decades. Recently, satellite technology has been improving rapidly and deep learning has seen much success in generic computer vision tasks and many application areas which presents an important opportunity to improve analysis of agricultural land. Here we present a systematic review of 150 studies to find the current uses of deep learning on satellite imagery for agricultural research. Although we identify 5 categories of agricultural monitoring tasks, the majority of the research interest is in crop segmentation and yield prediction. We found that, when used, modern deep learning methods consistently outperformed traditional machine learning across most tasks; the only exception was that Long Short-Term Memory (LSTM) Recurrent Neural Networks did not consistently outperform Random Forests (RF) for yield prediction. The reviewed studies have largely adopted methodologies from generic computer vision, except for one major omission: benchmark datasets are not utilised to evaluate models across studies, making it difficult to compare results. Additionally, some studies have specifically utilised the extra spectral resolution available in satellite imagery, but other divergent properties of satellite images - such as the hugely different scales of spatial patterns - are not being taken advantage of in the reviewed studies.


title: An attention-based backend allowing efficient fine-tuning of transformer models for speaker verification

abstract: In recent years, self-supervised learning paradigm has received extensive attention due to its great success in various down-stream tasks. However, the fine-tuning strategies for adapting those pre-trained models to speaker verification task have yet to be fully explored. In this paper, we analyze several feature extraction approaches built on top of a pre-trained model, as well as regularization and learning rate schedule to stabilize the fine-tuning process and further boost performance: multi-head factorized attentive pooling is proposed to factorize the comparison of speaker representations into multiple phonetic clusters. We regularize towards the parameters of the pre-trained model and we set different learning rates for each layer of the pre-trained model during fine-tuning. The experimental results show our method can significantly shorten the training time to 4 hours and achieve SOTA performance: 0.59%, 0.79% and 1.77% EER on Vox1-O, Vox1-E and Vox1-H, respectively.


title: Random Weight Factorization Improves the Training of Continuous Neural Representations

abstract: Continuous neural representations have recently emerged as a powerful and flexible alternative to classical discretized representations of signals. However, training them to capture fine details in multi-scale signals is difficult and computationally expensive. Here we propose random weight factorization as a simple drop-in replacement for parameterizing and initializing conventional linear layers in coordinate-based multi-layer perceptrons (MLPs) that significantly accelerates and improves their training. We show how this factorization alters the underlying loss landscape and effectively enables each neuron in the network to learn using its own self-adaptive learning rate. This not only helps with mitigating spectral bias, but also allows networks to quickly recover from poor initializations and reach better local minima. We demonstrate how random weight factorization can be leveraged to improve the training of neural representations on a variety of tasks, including image regression, shape representation, computed tomography, inverse rendering, solving partial differential equations, and learning operators between function spaces.


title: Limit trees for free group automorphisms: universality

abstract: To any free group automorphism, we associate a universal (cone of) limit tree(s) with three defining properties: first, the tree has a minimal isometric action of the free group with trivial arc stabilizers; second, there is a unique expanding dilation of the tree that represents the free group automorphism; and finally, the loxodromic elements are exactly the elements that weakly limit to dominating attracting laminations under forward iteration by the automorphism. So the action on the tree detects the automorphism's dominating exponential dynamics. As a corollary, our previously constructed limit pretree that detects the exponential dynamics is canonical. We also characterize all very small trees that admit an expanding homothety representing a given automorphism. In the appendix, we prove a variation of Feighn--Handel's recognition theorem for atoroidal outer automorphisms.


title: Probabilistic Volumetric Fusion for Dense Monocular SLAM

abstract: We present a novel method to reconstruct 3D scenes from images by leveraging deep dense monocular SLAM and fast uncertainty propagation. The proposed approach is able to 3D reconstruct scenes densely, accurately, and in real-time while being robust to extremely noisy depth estimates coming from dense monocular SLAM. Differently from previous approaches, that either use ad-hoc depth filters, or that estimate the depth uncertainty from RGB-D cameras' sensor models, our probabilistic depth uncertainty derives directly from the information matrix of the underlying bundle adjustment problem in SLAM. We show that the resulting depth uncertainty provides an excellent signal to weight the depth-maps for volumetric fusion. Without our depth uncertainty, the resulting mesh is noisy and with artifacts, while our approach generates an accurate 3D mesh with significantly fewer artifacts. We provide results on the challenging Euroc dataset, and show that our approach achieves 92% better accuracy than directly fusing depths from monocular SLAM, and up to 90% improvements compared to the best competing approach.


title: Extra electron reflections in concentrated alloys do not necessitate short-range order

abstract: In many concentrated alloys of current interest, the observation of diffuse superlattice intensities by transmission electron microscopy has been attributed to chemical short-range order. We briefly review these findings and comment on the plausibility of widespread interpretations, noting the absence of expected peaks, conflicts with theoretical predictions, and the possibility of alternative explanations.


title: Polariton Enhanced Free Charge Carrier Generation in Donor-Acceptor Cavity Systems by a Second-Hybridization Mechanism

abstract: Cavity quantum electrodynamics has been studied as a potential approach to modify free charge carrier generation in donor-acceptor heterojunctions because of the delocalization and controllable energy level properties of hybridized light-matter states known as polaritons. However, in many experimental systems, cavity coupling decreases charge separation. Here, we theoretically study the quantum dynamics of a coherent and dissipative donor-acceptor cavity system, to investigate the dynamical mechanism and further discover the conditions under which polaritons may enhance free charge carrier generation. We use open quantum system methods based on single-pulse pumping to find that polaritons have the potential to connect excitonic states and charge separated states, further enhancing free charge generation on an ultrafast timescale of several hundred femtoseconds. The mechanism involves that polaritons with proper energy levels allow the exciton to overcome the high Coulomb barrier induced by electron-hole attraction. Moreover, we propose that a second-hybridization between a polariton state and dark states with similar energy enables the formation of the hybrid charge separated states that are optically active. These two mechanisms lead to a maximum of 50% enhancement of free charge carrier generation on a short timescale. However, our simulation reveals that on the longer timescale of picoseconds, internal conversion and cavity loss dominate and suppress free charge carrier generation, reproducing the experimental results. Thus, our work shows that polaritons can affect the charge separation mechanism and promote free charge carrier generation efficiency, but predominantly on a short timescale after photoexcitation.


title: Relative Entropy (RE) Based LTI System Modeling Equipped with time delay Estimation and Online Modeling

abstract: This paper proposes an impulse response modeling in presence of input and noisy output of a linear time-invariant (LTI) system. The approach utilizes Relative Entropy (RE) to choose the optimum impulse response estimate, optimum time delay and optimum impulse response length. The desired RE is the Kulback-Lielber divergence of the estimated distribution from its unknown true distribution. A unique probabilistic validation approach estimates the desired relative entropy and minimizes this criterion to provide the impulse response estimate. Classical methods have approached this system modeling problem from two separate angles for the time delay estimation and for the order selection. Time delay methods focus on time delay estimate minimizing various proposed criteria, while the existing order selection approaches choose the optimum impulse response length based on their proposed criteria. The strength of the proposed RE based method is in using the RE based criterion to estimate both the time delay and impulse response length simultaneously. In addition, estimation of the noise variance, when the Signal to Noise Ratio (SNR) is unknown is also concurrent and is based on optimizing the same RE based criterion. The RE based approach is also extended for online impulse response estimations. The online method reduces the model estimation computational complexity upon the arrival of a new sample. The introduced efficient stopping criteria for this online approaches is extremely valuable in practical applications. Simulation results illustrate precision and efficiency of the proposed method compared to the conventional time delay or order selection approaches.


title: Electron-Photon Vertex and Dynamical Chiral Symmetry Breaking in Reduced QED: An Advanced Study of Gauge Invariance

abstract: We study the effect of a refined electron-photon vertex on the dynamical breaking of chiral symmetry in reduced quantum electrodynamics. We construct an educated {\em ansatz} for this vertex which satisfies the required discrete symmetries under parity, time reversal and charge conjugation operations. Furthermore, it reproduces its asymptotic perturbative limit in the weak coupling regime and ensures the massless electron propagator is multiplicatively renormalizable in its leading logarithmic expansion. Employing this vertex {\em ansatz}, we solve the gap equation to compute dynamically generated electron mass whose dependence on the electromagnetic coupling is found to satisfy Miransky scaling law. We also investigate the gauge dependence of this dynamical mass as well as that of the critical coupling above which chiral symmetry is dynamically broken. As a litmus test of our vertex construction, both these quantities are rendered virtually gauge independent within a certain interval of values considered for the covariant gauge parameter.


title: A Predictor-Informed Multi-Subject Bayesian Approach for Dynamic Functional Connectivity

abstract: Time Varying Functional Connectivity (TVFC) investigates how the interactions among brain regions vary over the course of an fMRI experiment. The transitions between different individual connectivity states can be modulated by changes in underlying physiological mechanisms that drive functional network dynamics, e.g., changes in attention or cognitive effort as measured by pupil dilation. In this paper, we develop a multi-subject Bayesian framework for estimating dynamic functional networks as a function of time-varying exogenous physiological covariates that are simultaneously recorded in each subject during the fMRI experiment. More specifically, we consider a dynamic Gaussian graphical model approach, where a non-homogeneous hidden Markov model is employed to classify the fMRI time series into latent neurological states, borrowing strength over the entire time course of the experiment. The state-transition probabilities are assumed to vary over time and across subjects, as a function of the underlying covariates, allowing for the estimation of recurrent connectivity patterns and the sharing of networks among the subjects. Our modeling approach further assumes sparsity in the network structures, via shrinkage priors. We achieve edge selection in the estimated graph structures, by introducing a multi-comparison procedure for shrinkage-based inferences with Bayesian false discovery rate control. We apply our modeling framework on a resting-state experiment where fMRI data have been collected concurrently with pupillometry measurements, leading us to assess the heterogeneity of the effects of changes in pupil dilation, previously linked to changes in norepinephrine-containing locus coeruleus, on the subjects' propensity to change connectivity states.


title: Structural Estimation of Markov Decision Processes in High-Dimensional State Space with Finite-Time Guarantees

abstract: We consider the task of estimating a structural model of dynamic decisions by a human agent based upon the observable history of implemented actions and visited states. This problem has an inherent nested structure: in the inner problem, an optimal policy for a given reward function is identified while in the outer problem, a measure of fit is maximized. Several approaches have been proposed to alleviate the computational burden of this nested-loop structure, but these methods still suffer from high complexity when the state space is either discrete with large cardinality or continuous in high dimensions. Other approaches in the inverse reinforcement learning (IRL) literature emphasize policy estimation at the expense of reduced reward estimation accuracy. In this paper we propose a single-loop estimation algorithm with finite time guarantees that is equipped to deal with high-dimensional state spaces without compromising reward estimation accuracy. In the proposed algorithm, each policy improvement step is followed by a stochastic gradient step for likelihood maximization. We show that the proposed algorithm converges to a stationary solution with a finite-time guarantee. Further, if the reward is parameterized linearly, we show that the algorithm approximates the maximum likelihood estimator sublinearly. Finally, by using robotics control problems in MuJoCo and their transfer settings, we show that the proposed algorithm achieves superior performance compared with other IRL and imitation learning benchmarks.


title: Effective and Robust Non-Prehensile Manipulation via Persistent Homology Guided Monte-Carlo Tree Search

abstract: Performing object retrieval in real-world workspaces must tackle challenges including \emph{uncertainty} and \emph{clutter}. One option is to apply prehensile operations, which can be time consuming in highly-cluttered scenarios. On the other hand, non-prehensile actions, such as pushing simultaneously multiple objects, can help to quickly clear a cluttered workspace and retrieve a target object. Such actions, however, can also lead to increased uncertainty as it is difficult to estimate the outcome of pushing operations. The proposed framework in this work integrates topological tools and Monte-Carlo Tree Search (MCTS) to achieve effective and robust pushing for object retrieval. It employs persistent homology to automatically identify manageable clusters of blocking objects without the need for manually adjusting hyper-parameters. Then, MCTS uses this information to explore feasible actions to push groups of objects, aiming to minimize the number of operations needed to clear the path to the target. Real-world experiments using a Baxter robot, which involves some noise in actuation, show that the proposed framework achieves a higher success rate in solving retrieval tasks in dense clutter than alternatives. Moreover, it produces solutions with few pushing actions improving the overall execution time. More critically, it is robust enough that it allows one to plan the sequence of actions offline and then execute them reliably on a Baxter robot.