title: A geometric formulation of Schaefer's theory of Cosserat solids

abstract: The Cosserat solid is a theoretical model of a continuum whose elementary constituents are notional rigid bodies. Here we present a formulation of the mechanics of a Cosserat solid in the language of modern differential geometry and exterior calculus, motivated by Schaefer's "motor field" theory. The solid is modelled as a principal fibre bundle and configurations are related by translations and rotations of each constituent. This kinematic property is described in a coordinate-independent manner by a bundle map. Configurations are equivalent if this bundle map is a global Euclidean isometry. Inequivalent configurations, representing deformations of the solid, are characterised by the local structure of the bundle map. Using Cartan's magic formula we show that the strain associated with infinitesimal deformations is the Lie derivative of a connection one-form on the bundle, revealing it to be a Lie algebra-valued one-form. Extending Schaefer's theory, we derive the finite strain by integrating the infinitesimal strain along a prescribed path. This is path independent when the curvature of the connection one-form is zero. Path dependence signals the presence of topological defects and the non-zero curvature is then recognised as the density of topological defects. Mechanical stresses are defined by a virtual work principle in which the Lie algebra-valued strain one-form is paired with a dual Lie algebra-valued stress two-form to yield a scalar work volume form. The d'Alembert principle for the work form provides the balance laws, which is shown to be integrable for a hyperelastic Cosserat solid. The breakdown of integrability, relevant to active oriented solids, is briefly examined. Our work elucidates the geometric structure of Cosserat solids, aids in constitutive modelling of active oriented materials, and suggests structure-preserving integration schemes.

categories: math-ph cond-mat.mtrl-sci cond-mat.soft math.DG math.MP


title: Unsupervised correspondence with combined geometric learning and imaging for radiotherapy applications

abstract: The aim of this study was to develop a model to accurately identify corresponding points between organ segmentations of different patients for radiotherapy applications. A model for simultaneous correspondence and interpolation estimation in 3D shapes was trained with head and neck organ segmentations from planning CT scans. We then extended the original model to incorporate imaging information using two approaches: 1) extracting features directly from image patches, and 2) including the mean square error between patches as part of the loss function. The correspondence and interpolation performance were evaluated using the geodesic error, chamfer distance and conformal distortion metrics, as well as distances between anatomical landmarks. Each of the models produced significantly better correspondences than the baseline non-rigid registration approach. The original model performed similarly to the model with direct inclusion of image features. The best performing model configuration incorporated imaging information as part of the loss function which produced more anatomically plausible correspondences. We will use the best performing model to identify corresponding anatomical points on organs to improve spatial normalisation, an important step in outcome modelling, or as an initialisation for anatomically informed registrations. All our code is publicly available at https://github.com/rrr-uom-projects/Unsup-RT-Corr-Net


title: MOND via Matrix Gravity

abstract: MOND theory has arisen as a promising alternative to dark matter in explaining the collection of discrepancies that constitute the so-called missing mass problem. The MOND paradigm is briefly reviewed. It is shown that MOND theory can be incorporated in the framework of the recently proposed Matrix Gravity. In particular, we demonstrate that Matrix Gravity contains MOND as a particular case, which adds to the validity of Matrix Gravity and proves it is deserving of further inquiry.


title: Generative Filtering for Recursive Bayesian Inference with Streaming Data

abstract: In the streaming data setting, where data arrive continuously or in frequent batches and there is no pre-determined amount of total data, Bayesian models can employ recursive updates, incorporating each new batch of data into the model parameters' posterior distribution. Filtering methods are currently used to perform these updates efficiently, however, they suffer from eventual degradation as the number of unique values within the filtered samples decreases. We propose Generative Filtering, a method for efficiently performing recursive Bayesian updates in the streaming setting. Generative Filtering retains the speed of a filtering method while using parallel updates to avoid degenerate distributions after repeated applications. We derive rates of convergence for Generative Filtering and conditions for the use of sufficient statistics instead of fully storing all past data. We investigate the alleviation of filtering degradation through simulation and Ecological species count data.


title: Perception-and-Energy-aware Motion Planning for UAV using Learning-based Model under Heteroscedastic Uncertainty

abstract: Global navigation satellite systems (GNSS) denied environments/conditions require unmanned aerial vehicles (UAVs) to energy-efficiently and reliably fly. To this end, this study presents perception-and-energy-aware motion planning for UAVs in GNSS-denied environments. The proposed planner solves the trajectory planning problem by optimizing a cost function consisting of two indices: the total energy consumption of a UAV and the perception quality of light detection and ranging (LiDAR) sensor mounted on the UAV. Before online navigation, a high-fidelity simulator acquires a flight dataset to learn energy consumption for the UAV and heteroscedastic uncertainty associated with LiDAR measurements, both as functions of the horizontal velocity of the UAV. The learned models enable the online planner to estimate energy consumption and perception quality, reducing UAV battery usage and localization errors. Simulation experiments in a photorealistic environment confirm that the proposed planner can address the trade-off between energy efficiency and perception quality under heteroscedastic uncertainty. The open-source code is released at https://gitlab.com/ReI08/perception-energy-planner.


title: ECN with QUIC: Challenges in the Wild

abstract: TCP and QUIC can both leverage ECN to avoid congestion loss and its retransmission overhead. However, both protocols require support of their remote endpoints and it took two decades since the initial standardization of ECN for TCP to reach 80% ECN support and more in the wild. In contrast, the QUIC standard mandates ECN support, but there are notable ambiguities that make it unclear if and how ECN can actually be used with QUIC on the Internet. Hence, in this paper, we analyze ECN support with QUIC in the wild: We conduct repeated measurements on more than 180M domains to identify HTTP/3 websites and analyze the underlying QUIC connections w.r.t. ECN support. We only find 20% of QUIC hosts, providing 6% of HTTP/3 websites, to mirror client ECN codepoints. Yet, mirroring ECN is only half of what is required for ECN with QUIC, as QUIC validates mirrored ECN codepoints to detect network impairments: We observe that less than 2% of QUIC hosts, providing less than 0.3% of HTTP/3 websites, pass this validation. We identify possible root causes in content providers not supporting ECN via QUIC and network impairments hindering ECN. We thus also characterize ECN with QUIC distributedly to traverse other paths and discuss our results w.r.t. QUIC and ECN innovations beyond QUIC.


title: Analysis and Experimental Validation of the WPT Efficiency of the Both-Sides Retrodirective System

abstract: The retrodirective antenna array is considered as a mechanism to enable target tracking of a power receiver for long range wireless power transfer (WPT) due to its simplicity in implementation using only analog circuits. By installing the retrodirective capability on both the generator and rectenna arrays, a feedback loop that produces a high efficiency WPT channel is created. In this paper, we characterize the dynamics of this phenomenon using a discrete-time state-space model based on S-parameters and show that the system can naturally achieve maximum theoretical WPT efficiency. We further confirmed the theoretical analysis through a hardware experiment using a 12-port circuit board with measurable S-parameters mimicking a static wireless channel. The results collected from the hardware experiment show agreement with the proposed theoretical framework by comparing the theoretical efficiency with the measured efficiency and by showing that the collected data points follow the predicted condition to achieve maximum efficiency.


title: Strichartz estimates and global well-posedness of the cubic NLS on $\mathbb{T}^{2}$

abstract: The optimal $L^4$-Strichartz estimate for the Schr{\"o}dinger equation on the two-dimensional rational torus $\mathbb{T}^2$ is proved, which improves an estimate of Bourgain. A new method based on incidence geometry is used. The approach yields a stronger $L^4$ bound on a logarithmic time scale, which implies global existence of solutions to the cubic (mass-critical) nonlinear Schr\"odinger equation in $H^s(\mathbb{T}^2)$ for any $s>0$ and data which is small in the critical norm.


title: Almost-periodic solutions to the NLS equation with smooth convolution potentials

abstract: We consider the one-dimensional NLS equation with a convolution potential and a quintic nonlinearity. We prove that, for most choices of potentials with polynomially decreasing Fourier coefficients, there exist almost-periodic solutions in the Gevrey class with frequency satisfying a Bryuno non-resonance condition. This allows convolution potentials of class $C^p$, for any integer $p$: as far as we know this is the first result where the regularity of the potential is arbitrarily large and not compensated by a corresponding smoothing of the nonlinearity.


title: SINCERE: Supervised Information Noise-Contrastive Estimation REvisited

abstract: The information noise-contrastive estimation (InfoNCE) loss function provides the basis of many self-supervised deep learning methods due to its strong empirical results and theoretic motivation. Previous work suggests a supervised contrastive (SupCon) loss to extend InfoNCE to learn from available class labels. However, in this work we find that the prior SupCon loss formulation has questionable justification because it can encourage some images from the same class to repel one another in the learned embedding space. We propose the Supervised InfoNCE REvisited (SINCERE) loss as a theoretically-justified supervised extension of InfoNCE that never causes images from the same class to repel one another. Experiments show that SINCERE leads to better separation of embeddings from different classes while delivering competitive classification accuracy for supervised and transfer learning. We further show an information-theoretic bound that relates SINCERE loss to the symmeterized KL divergence between data-generating distributions for a target class and all other classes.


title: Fast coherent control of nitrogen-14 spins associated with nitrogen-vacancy centers in diamonds using dynamical decoupling

abstract: A nitrogen-vacancy (NV) center in a diamond enables the access to an electron spin, which is expected to present highly sensitive quantum sensors. Although exploiting a nitrogen nuclear spin improves the sensitivity, manipulating it using a resonant pulse requires a long gate time owing to its small gyromagnetic ratio. Another technique to control nuclear spins is a conditional rotation gate based on dynamical decoupling, which is faster but unavailable for nitrogen spins owing to the lack of transverse hyperfine coupling with the electron spin. In this study, we generated effective transverse coupling by applying a weak off-axis magnetic field. An effective coupling depends on the off-axis field; the conditional rotation gate on the nitrogen-14 spins of an NV center was demonstrated within 4.2 {\mu}s under an 1.8% off-axis field and a longitudinal field of approximately 280 mT. We estimated that a population transfer from the electron to nitrogen spins can be implemented with 8.7 {\mu}s. Our method is applicable to an ensemble of NV centers, in addition to a single NV center.


title: Spring-IMU Fusion Based Proprioception for Feedback Control of Soft Manipulators

abstract: This paper presents a novel framework to realize proprioception and closed-loop control for soft manipulators. Deformations with large elongation and large bending can be precisely predicted using geometry-based sensor signals obtained from the inductive springs and the inertial measurement units (IMUs) with the help of machine learning techniques. Multiple geometric signals are fused into robust pose estimations, and a data-efficient training process is achieved after applying the strategy of sim-to-real transfer. As a result, we can achieve proprioception that is robust to the variation of external loading and has an average error of 0.7% across the workspace on a pneumatic-driven soft manipulator. The realized proprioception on soft manipulator is then contributed to building a sensor-space based algorithm for closed-loop control. A gradient descent solver is developed to drive the end-effector to achieve the required poses by iteratively computing a sequence of reference sensor signals. A conventional controller is employed in the inner loop of our algorithm to update actuators (i.e., the pressures in chambers) for approaching a reference signal in the sensor-space. The systematic function of closed-loop control has been demonstrated in tasks like path following and pick-and-place under different external loads.


title: Joint RIS Phase Profile Design and Power Allocation for Parameter Estimation in Presence of Eavesdropping

abstract: We consider secure transmission of a deterministic complex-valued parameter vector from a transmitter to an intended receiver in the presence of an eavesdropper in a reconfigurable intelligent surface (RIS)-integrated environment. We aim to jointly optimize the RIS phase profile and the power allocation matrix at the transmitter to enhance the estimation accuracy at the intended receiver while limiting that at the eavesdropper. We utilize the trace of the Fisher information matrix (FIM), equivalently, the average Fisher information, as the estimation accuracy metric, and obtain its closed form expression for the intended receiver and the eavesdropper. Accordingly, the joint RIS phase profile and power allocation problem is formulated, and it is solved via alternating optimization. When the power allocation matrix is fixed during alternating optimization, the optimal RIS phase profile design problem is formulated as a non-convex problem and it is solved via semidefinite relaxation and rank reduction. When the RIS phase profile is fixed, a linear programming formulation is obtained for optimal power allocation. Via simulations, the effects of RIS phase design and power allocation are illustrated individually and jointly. Moreover, extensions are provided by considering the presence of line of sight paths in the environment and the availability of RIS elements with adjustable magnitudes.


title: Rare tau decays via exchange of on-shell almost degenerate Majorana neutrinos, $\tau^{\mp} \to \pi^{\mp} N_j \to \pi^{\mp} \mu^{\mp} \pi^{\pm}$ and $\tau^{\mp} \to \pi^{\mp} N_j \to \pi^{\mp} \mu^{\pm} \pi^{\mp}$

abstract: We investigate rare decays of tau leptons that occur via exchange of heavy on-shell neutrinos $N_j$ ($j=1,2$). These neutrinos can be either Dirac or Majorana, and are considered to be almost degenerate in mass. The decays can thus be either lepton number conserving (LNC), $\tau^{\mp} \to \pi^{\mp} N_j \to \pi^{\mp} \mu^{\mp} \pi^{\pm}$, or lepton number violating (LNV), $\tau^{\mp} \to \pi^{\mp} N_j \to \pi^{\mp} \mu^{\pm} \pi^{\mp}$. If neutrinos are Dirac, only LNC decays are possible. If they are Majorana, both LNC and LNV are possible. We derive the corresponding expressions for the effective decay widths $\Gamma_{{\rm eff},\mp}^{\rm (X)}$ (X=LNC, LNV) of these rare decays, where we account for $N_1$-$N_2$ overlap and oscillation effects and for the finite detector length effects. We then numerically evaluate these decay widths as well as the related CP violation asymmetry width $\Delta \Gamma_{\rm CP}^{\rm (X)} = (\Gamma_{{\rm eff},-}^{\rm (X)} - \Gamma_{{\rm eff},+}^{\rm (X)})$. We conclude that for certain, presently allowed, ranges of the heavy-light neutrino mixing parameters, such decays and asymmetries could be observed in Belle II experiment.


title: Calibration-based Dual Prototypical Contrastive Learning Approach for Domain Generalization Semantic Segmentation

abstract: Prototypical contrastive learning (PCL) has been widely used to learn class-wise domain-invariant features recently. These methods are based on the assumption that the prototypes, which are represented as the central value of the same class in a certain domain, are domain-invariant. Since the prototypes of different domains have discrepancies as well, the class-wise domain-invariant features learned from the source domain by PCL need to be aligned with the prototypes of other domains simultaneously. However, the prototypes of the same class in different domains may be different while the prototypes of different classes may be similar, which may affect the learning of class-wise domain-invariant features. Based on these observations, a calibration-based dual prototypical contrastive learning (CDPCL) approach is proposed to reduce the domain discrepancy between the learned class-wise features and the prototypes of different domains for domain generalization semantic segmentation. It contains an uncertainty-guided PCL (UPCL) and a hard-weighted PCL (HPCL). Since the domain discrepancies of the prototypes of different classes may be different, we propose an uncertainty probability matrix to represent the domain discrepancies of the prototypes of all the classes. The UPCL estimates the uncertainty probability matrix to calibrate the weights of the prototypes during the PCL. Moreover, considering that the prototypes of different classes may be similar in some circumstances, which means these prototypes are hard-aligned, the HPCL is proposed to generate a hard-weighted matrix to calibrate the weights of the hard-aligned prototypes during the PCL. Extensive experiments demonstrate that our approach achieves superior performance over current approaches on domain generalization semantic segmentation tasks.


title: Using the Gerchberg-Saxton algorithm to reconstruct non-modulated pyramid wavefront sensor measurements

abstract: Adaptive optics (AO) is a technique to improve the resolution of ground-based telescopes by correcting, in real-time, optical aberrations due to atmospheric turbulence and the telescope itself. With the rise of Giant Segmented Mirror Telescopes (GSMT), AO is needed more than ever to reach the full potential of these future observatories. One of the main performance drivers of an AO system is the wavefront sensing operation, consisting of measuring the shape of the above mentioned optical aberrations. Aims. The non-modulated pyramid wavefront sensor (nPWFS) is a wavefront sensor with high sensitivity, allowing the limits of AO systems to be pushed. The high sensitivity comes at the expense of its dynamic range, which makes it a highly non-linear sensor. We propose here a novel way to invert nPWFS signals by using the principle of reciprocity of light propagation and the Gerchberg-Saxton (GS) algorithm. We test the performance of this reconstructor in two steps: the technique is first implemented in simulations, where some of its basic properties are studied. Then, the GS reconstructor is tested on the Santa Cruz Extreme Adaptive optics Laboratory (SEAL) testbed located at the University of California Santa Cruz. This new way to invert the nPWFS measurements allows us to drastically increase the dynamic range of the reconstruction for the nPWFS, pushing the dynamics close to a modulated PWFS. The reconstructor is an iterative algorithm requiring heavy computational burden, which could be an issue for real-time purposes in its current implementation. However, this new reconstructor could still be helpful in the case of many wavefront control operations. This reconstruction technique has also been successfully tested on the Santa Cruz Extreme AO Laboratory (SEAL) bench where it is now used as the standard way to invert nPWFS signal.


title: Navigation with shadow prices to optimize multi-commodity flow rates

abstract: We propose a method for providing communication network infrastructure in autonomous multi-agent teams. In particular, we consider a set of communication agents that are placed alongside regular agents from the system in order to improve the rate of information transfer between the latter. In order to find the optimal positions to place such agents, we define a flexible performance function that adapts to network requirements for different systems. We provide an algorithm based on shadow prices of a related convex optimization problem in order to drive the configuration of the complete system towards a local maximum. We apply our method to three different performance functions associated with three practical scenarios in which we show both the performance of the algorithm and the flexibility it allows for optimizing different network requirements.


title: On the variation of the sum of digits in the Zeckendorf representation: an algorithm to compute the distribution and mixing properties

abstract: We study probability measures defined by the variation of the sum of digits in the Zeckendorf representation. For $r\ge 0$ and $d\in\mathbb{Z}$, we consider $\mu^{(r)}(d)$ the density of integers $n\in\mathbb{N}$ for which the sum of digits increases by $d$ when $r$ is added to $n$. We give a probabilistic interpretation of $\mu^{(r)}$ via the dynamical system provided by the odometer of Zeckendorf-adic integers and its unique invariant measure. We give an algorithm for computing $\mu^{(r)}$ and we deduce a control on the tail of the negative distribution of $\mu^{(r)}$, as well as the formula $\mu^{(F_{\ell})} = \mu^{(1)}$ where $F_{\ell}$ is a term in the Fibonacci sequence. Finally, we decompose the Zeckendorf representation of an integer $r$ into so-called "blocks" and show that when added to an adic Zeckendorf integer, the successive actions of these blocks can be seen as a sequence of mixing random variables.


title: Virtual Hyperspectral Images and Spectral Feature Extraction Using Symmetric Autoencoders

abstract: Spectral data acquired through remote sensing are invaluable for environmental and resource studies. However, these datasets are often marred by nuisance phenomena such as atmospheric interference, sensor noise and other complexities, posing significant challenges for accurate analysis. We show that an autoencoder architecture, called symmetric autoencoder (SymAE), which leverages symmetry under reordering of pixels, can learn to disentangle the influence of nuisance features from class-invariant spectral features on a pixel-by-pixel basis. This disentanglement is achieved through a purely data-driven process, obviating the need for transfer models, noise distribution priors, or reference `clean signals.' Additionally, SymAE can generate virtual hyperspectral images by manipulating the nuisance effects of each pixel. Using AVIRIS instrument data, we demonstrate that these virtual images are valuable for subsequent image analysis tasks. The extraction of invariant spectral features within classes, enabled by SymAE, also positions it as highly effective in clustering and classification tasks. We demonstrate this by delivering state-of-the-art classification results for a purely spectral method across four popular benchmark HSI datasets.


title: Domain wall dynamics driven by a transient laser-induced magnetisation

abstract: One of the fundamental effects of the laser-matter interaction is the appearance of an induced transient magnetisation. While the underlying phenomena differ in their microscopic origin and cover a diverse array of materials, here we address a fundamental question about the possibility to drive domain-wall dynamics on the femtosecond timescale of the exchange interactions solely by longitudinal changes of the magnetic moments. We verify the viability of this hypothesis in the case of a generic ferromagnetic system described in the framework of the high-temperature micromagnetic model based on the Landau-Lifshitz-Bloch equation. The effect is investigated in a 1D model at constant temperature as well as in a full micromagnetic framework considering realistic laser-induced heating. Our results demonstrate that domain-wall deformation in a femtosecond timeframe leads to the displacement of the wall on a larger timescale up to nanoseconds accompanied by a release of excess energy in the form of spin waves. The domain wall deformation leads to the appearance of a magnetisation gradient across the wall which promotes the motion towards the region consisting of spins with decreased magnetisation length. The total displacement is enhanced at larger temperatures and smaller damping due to an increase of the longitudinal relaxation time which ensures the longer presence of the induced magnetisation gradient. We also demonstrate an enhanced domain wall motion in the presence of the Dzyaloshinskii-Moriya interaction attributed to augmented magnonic torques. Our results are important towards the understanding of ultrafast magnetism phenomena on the sub-picosecond timescale.


title: Comparison of One- Two- and Three- Dimensional CNN models for Drawing-Test-Based Diagnostics of the Parkinson's Disease

abstract: Subject: In this article, convolutional networks of one, two, and three dimensions are compared with respect to their ability to distinguish between the drawing tests produced by Parkinson's disease patients and healthy control subjects. Motivation: The application of deep learning techniques for the analysis of drawing tests to support the diagnosis of Parkinson's disease has become a growing trend in the area of Artificial Intelligence. Method: The dynamic features of the handwriting signal are embedded in the static test data to generate one-dimensional time series, two-dimensional RGB images and three-dimensional voxelized point clouds, and then one-, two-, and three-dimensional CNN can be used to automatically extract features for effective diagnosis. Novelty: While there are many results that describe the application of two-dimensional convolutional models to the problem, to the best knowledge of the authors, there are no results based on the application of three-dimensional models and very few using one-dimensional models. Main result: The accuracy of the one-, two- and three-dimensional CNN models was 62.50%, 77.78% and 83.34% in the DraWritePD dataset (acquired by the authors) and 73.33%, 80.00% and 86.67% in the PaHaW dataset (well known from the literature), respectively. For these two data sets, the proposed three-dimensional convolutional classification method exhibits the best diagnostic performance.


title: CLIP-DIY: CLIP Dense Inference Yields Open-Vocabulary Semantic Segmentation For-Free

abstract: The emergence of CLIP has opened the way for open-world image perception. The zero-shot classification capabilities of the model are impressive but are harder to use for dense tasks such as image segmentation. Several methods have proposed different modifications and learning schemes to produce dense output. Instead, we propose in this work an open-vocabulary semantic segmentation method, dubbed CLIP-DIY, which does not require any additional training or annotations, but instead leverages existing unsupervised object localization approaches. In particular, CLIP-DIY is a multi-scale approach that directly exploits CLIP classification abilities on patches of different sizes and aggregates the decision in a single map. We further guide the segmentation using foreground/background scores obtained using unsupervised object localization methods. With our method, we obtain state-of-the-art zero-shot semantic segmentation results on PASCAL VOC and perform on par with the best methods on COCO. The code is available at http://github.com/wysoczanska/clip-diy


title: Automated Market Makers for Cross-chain DeFi and Sharded Blockchains

abstract: In this paper we provide an execution framework for Automated Market Maker (AMM) to be deployed across independent blockchain platforms as well as concurrent sharding within the same blockchain platform. The framework provides economic incentives to participate through a mechanism that guarantee fixed prices across pairwise liquidity pools.


title: Tiled Multiplane Images for Practical 3D Photography

abstract: The task of synthesizing novel views from a single image has useful applications in virtual reality and mobile computing, and a number of approaches to the problem have been proposed in recent years. A Multiplane Image (MPI) estimates the scene as a stack of RGBA layers, and can model complex appearance effects, anti-alias depth errors and synthesize soft edges better than methods that use textured meshes or layered depth images. And unlike neural radiance fields, an MPI can be efficiently rendered on graphics hardware. However, MPIs are highly redundant and require a large number of depth layers to achieve plausible results. Based on the observation that the depth complexity in local image regions is lower than that over the entire image, we split an MPI into many small, tiled regions, each with only a few depth planes. We call this representation a Tiled Multiplane Image (TMPI). We propose a method for generating a TMPI with adaptive depth planes for single-view 3D photography in the wild. Our synthesized results are comparable to state-of-the-art single-view MPI methods while having lower computational overhead.


title: On the Non-Associativity of Analog Computations

abstract: The energy efficiency of analog forms of computing makes it one of the most promising candidates to deploy resource-hungry machine learning tasks on resource-constrained system such as mobile or embedded devices. However, it is well known that for analog computations the safety net of discretization is missing, thus all analog computations are exposed to a variety of imperfections of corresponding implementations. Examples include non-linearities, saturation effect and various forms of noise. In this work, we observe that the ordering of input operands of an analog operation also has an impact on the output result, which essentially makes analog computations non-associative, even though the underlying operation might be mathematically associative. We conduct a simple test by creating a model of a real analog processor which captures such ordering effects. With this model we assess the importance of ordering by comparing the test accuracy of a neural network for keyword spotting, which is trained based either on an ordered model, on a non-ordered variant, and on real hardware. The results prove the existence of ordering effects as well as their high impact, as neglecting ordering results in substantial accuracy drops.


title: NAS-NeRF: Generative Neural Architecture Search for Neural Radiance Fields

abstract: Neural radiance fields (NeRFs) enable high-quality novel view synthesis, but their high computational complexity limits deployability. While existing neural-based solutions strive for efficiency, they use one-size-fits-all architectures regardless of scene complexity. The same architecture may be unnecessarily large for simple scenes but insufficient for complex ones. Thus, there is a need to dynamically optimize the neural network component of NeRFs to achieve a balance between computational complexity and specific targets for synthesis quality. We introduce NAS-NeRF, a generative neural architecture search strategy that generates compact, scene-specialized NeRF architectures by balancing architecture complexity and target synthesis quality metrics. Our method incorporates constraints on target metrics and budgets to guide the search towards architectures tailored for each scene. Experiments on the Blender synthetic dataset show the proposed NAS-NeRF can generate architectures up to 5.74$\times$ smaller, with 4.19$\times$ fewer FLOPs, and 1.93$\times$ faster on a GPU than baseline NeRFs, without suffering a drop in SSIM. Furthermore, we illustrate that NAS-NeRF can also achieve architectures up to 23$\times$ smaller, with 22$\times$ fewer FLOPs, and 4.7$\times$ faster than baseline NeRFs with only a 5.3% average SSIM drop. Our source code is also made publicly available at https://saeejithnair.github.io/NAS-NeRF.


title: AspGap: Augmented Stellar Parameters and Abundances for 23 million RGB stars from Gaia XP low-resolution spectra

abstract: We present AspGap, a new approach to infer stellar labels from low-resolution Gaia XP spectra, including precise [$\alpha$/M] estimates for the first time. AspGap is a neural-network based regression model trained on APOGEE spectra. In the training step, AspGap learns to use XP spectra not only to predict stellar labels but also the high-resolution APOGEE spectra that lead to the same stellar labels. The inclusion of this last model component -- dubbed the hallucinator -- creates a more physically motivated mapping and significantly improves the prediction of stellar labels in the validation, particularly of [$\alpha$/M]. For giant stars, we find cross-validated rms accuracies for Teff, log g, [M/H], [$\alpha$/M] of ~1%, 0.12 dex, 0.07 dex, 0.03 dex, respectively. We also validate our labels through comparison with external datasets and through a range of astrophysical tests that demonstrate that we are indeed determining [$\alpha$/M] from the XP spectra, rather than just inferring it indirectly from correlations with other labels. We publicly release the AspGap codebase, along with our stellar parameter catalog for all giants observed by Gaia XP. AspGap enables new insights into the formation and chemo-dynamics of our Galaxy by providing precise [$\alpha$/M] estimates for 23 million giant stars, including 12 million with radial velocities from Gaia.


title: Unwieldy Object Delivery with Nonholonomic Mobile Base: A Stable Pushing Approach

abstract: This paper addresses the problem of pushing manipulation with nonholonomic mobile robots. Pushing is a fundamental skill that enables robots to move unwieldy objects that cannot be grasped. We propose a stable pushing method that maintains stiff contact between the robot and the object to avoid consuming repositioning actions. We prove that a line contact, rather than a single point contact, is necessary for nonholonomic robots to achieve stable pushing. We also show that the stable pushing constraint and the nonholonomic constraint of the robot can be simplified as a concise linear motion constraint. Then the pushing planning problem can be formulated as a constrained optimization problem using nonlinear model predictive control (NMPC). According to the experiments, our NMPC-based planner outperforms a reactive pushing strategy in terms of efficiency, reducing the robot's traveled distance by 23.8\% and time by 77.4\%. Furthermore, our method requires four fewer hyperparameters and decision variables than the Linear Time-Varying (LTV) MPC approach, making it easier to implement. Real-world experiments are carried out to validate the proposed method with two differential-drive robots, Husky and Boxer, under different friction conditions.


title: Rapid Quantification of Dynamic and Spall Strength of Metals Across Strain Rates

abstract: The response of metals and their microstructures under extreme dynamic conditions can be markedly different from that under quasistatic conditions. Traditionally, high strain rates and shock stresses are measured using cumbersome and expensive methods such as the Kolsky bar or large spall experiments. These methods are low throughput and do not facilitate high-fidelity microstructure-property linkages. In this work, we combine two powerful small-scale testing methods, custom nanoindentation, and laser-driven micro-flyer shock, to measure the dynamic and spall strength of metals. The nanoindentation system is configured to test samples from quasistatic to dynamic strain rate regimes (10$^{-3}$ s$^{-1}$ to 10$^{+4}$ s$^{-1}$). The laser-driven micro-flyer shock system can test samples through impact loading between 10$^{+5}$ s$^{-1}$ to 10$^{+7}$ s$^{-1}$ strain rates, triggering spall failure. The model material used for testing is Magnesium alloys, which are lightweight, possess high-specific strengths and have historically been challenging to design and strengthen due to their mechanical anisotropy. Here, we modulate their microstructure by adding or removing precipitates to demonstrate interesting upticks in strain rate sensitivity and evolution of dynamic strength. At high shock loading rates, we unravel an interesting paradigm where the spall strength of these materials converges, but the failure mechanisms are markedly different. Peak aging, considered to be a standard method to strengthen metallic alloys, causes catastrophic failure, faring much worse than solutionized alloys. Our high throughput testing framework not only quantifies strength but also teases out unexplored failure mechanisms at extreme strain rates, providing valuable insights for the rapid design and improvement of metals for extreme environments.


title: Leveraging Uncertainties to Infer Preferences: Robust Analysis of School Choice

abstract: Inferring applicant preferences is fundamental in many analyses of school-choice data. Application mistakes make this task challenging. We propose a novel approach to deal with the mistakes in a deferred-acceptance matching environment. The key insight is that the uncertainties faced by applicants, e.g., due to tie-breaking lotteries, render some mistakes costly, allowing us to reliably infer relevant preferences. Our approach extracts all information on preferences robustly to payoff-insignificant mistakes. We apply it to school-choice data from Staten Island, NYC. Counterfactual analysis suggests that we underestimate the effects of proposed desegregation reforms when applicants' mistakes are not accounted for in preference inference and estimation.


title: Improved Algorithms for Stochastic Linear Bandits Using Tail Bounds for Martingale Mixtures

abstract: We present improved algorithms with worst-case regret guarantees for the stochastic linear bandit problem. The widely used "optimism in the face of uncertainty" principle reduces a stochastic bandit problem to the construction of a confidence sequence for the unknown reward function. The performance of the resulting bandit algorithm depends on the size of the confidence sequence, with smaller confidence sets yielding better empirical performance and stronger regret guarantees. In this work, we use a novel tail bound for adaptive martingale mixtures to construct confidence sequences which are suitable for stochastic bandits. These confidence sequences allow for efficient action selection via convex programming. We prove that a linear bandit algorithm based on our confidence sequences is guaranteed to achieve competitive worst-case regret. We show that our confidence sequences are tighter than competitors, both empirically and theoretically. Finally, we demonstrate that our tighter confidence sequences give improved performance in several hyperparameter tuning tasks.


title: Intraday variations of polarization vector in blazars: a key to the optical jet structure?

abstract: This report presents the results of optical polarimetric observations carried out with 6-m and 1-m telescopes at SAO RAS. The study of the blazar S5 0716+714 radiation showed the presence of a period of the variability of brightness and polarization vector variations on scales of $\sim$1.5 hours, constant on a long time scale; multi-colour monitoring of BL Lac polarization before, during and after the flare demonstrates the difference in the patterns of polarization vector variability depending on the wavelength. Several geometrical models and physical descriptions are discussed.


title: Adaptive least-squares space-time finite element methods

abstract: We consider the numerical solution of an abstract operator equation $Bu=f$ by using a least-squares approach. We assume that $B: X \to Y^*$ is an isomorphism, and that $A : Y \to Y^*$ implies a norm in $Y$, where $X$ and $Y$ are Hilbert spaces. The minimizer of the least-squares functional $\frac{1}{2} \, \| Bu-f \|_{A^{-1}}^2$, i.e., the solution of the operator equation, is then characterized by the gradient equation $Su=B^* A^{-1}f$ with an elliptic and self-adjoint operator $S:=B^* A^{-1} B : X \to X^*$. When introducing the adjoint $p = A^{-1}(f-Bu)$ we end up with a saddle point formulation to be solved numerically by using a mixed finite element method. Based on a discrete inf-sup stability condition we derive related a priori error estimates. While the adjoint $p$ is zero by construction, its approximation $p_h$ serves as a posteriori error indicator to drive an adaptive scheme when discretized appropriately. While this approach can be applied to rather general equations, here we consider second order linear partial differential equations, including the Poisson equation, the heat equation, and the wave equation, in order to demonstrate its potential, which allows to use almost arbitrary space-time finite element methods for the adaptive solution of time-dependent partial differential equations.


title: Existence of Eigenvalues for Anisotropic and Fractional Anisotropic Problems via Ljusternik-Schnirelmann Theory

abstract: In this work, our interest lies in proving the existence of critical values of the following Rayleigh-type quotients $$Q_{\mathbf p}(u) = \frac{\|\nabla u\|_{\mathbf p}}{\|u\|_{\mathbf p}},\quad\text{and}\quad Q_{\mathbf s,\mathbf p}(u) = \frac{[u]_{\mathbf s,\mathbf p}}{\|u\|_{\mathbf p}}, $$ where $\mathbf p = (p_1,\dots,p_n)$, $\mathbf s=(s_1,\dots,s_n)$ and $$ \|\nabla u\|_{\mathbf p} = \sum_{i=1}^n \|u_{x_i}\|_{p_i} $$ is an anisotropic Sobolev norm, $[u]_{\mathbf s,\mathbf p}$ is a fractional version of the same anisotropic norm, and $\|u\|_{\mathbf p}$ is an anisotropic Lebesgue norm. Using the Ljusternik-Schnirelmann theory, we prove the existence of a sequence of critical values and we also find an associated Euler-Lagrange equation for critical points. Additionally, we analyze the connection between the fractional critical values and its local counterparts.


title: Bayesian parameter estimation for characterising mobile ion vacancies in perovskite solar cells

abstract: To overcome the challenges associated with poor temporal stability of perovskite solar cells, methods are required that allow for fast iteration of fabrication and characterisation, such that optimal device performance and stability may be actively pursued. Currently, establishing the causes of underperformance is both complex and time-consuming, and optimisation of device fabrication thus inherently slow. Here, we present a means of computational device characterisation of mobile halide ion parameters from room temperature current-voltage (J-V) measurements only, requiring $\sim 2$ hours of computation on basic computing resources. With our approach, the physical parameters of the device may be reverse modelled from experimental J-V measurements. In a drift-diffusion model, the set of coupled drift-diffusion partial differential equations cannot be inverted explicitly, so a method for inverting the drift-diffusion simulation is required. We show how Bayesian Parameter Estimation (BPE) coupled with a drift-diffusion perovskite solar cell model can determine the extent to which device parameters affect performance measured by J-V characteristics. Our method is demonstrated by investigating the extent to which device performance is influenced by mobile halide ions for a specific fabricated device. The ion vacancy density $N_0$ and diffusion coefficient $D_I$ were found to be precisely characterised for both simulated and fabricated devices. This result opens up the possibility of pinpointing origins of degradation by finding which parameters most influence device J-V curves as the cell degrades.


title: Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentation

abstract: Preparing training data for deep vision models is a labor-intensive task. To address this, generative models have emerged as an effective solution for generating synthetic data. While current generative models produce image-level category labels, we propose a novel method for generating pixel-level semantic segmentation labels using the text-to-image generative model Stable Diffusion (SD). By utilizing the text prompts, cross-attention, and self-attention of SD, we introduce three new techniques: class-prompt appending, class-prompt cross-attention, and self-attention exponentiation. These techniques enable us to generate segmentation maps corresponding to synthetic images. These maps serve as pseudo-labels for training semantic segmenters, eliminating the need for labor-intensive pixel-wise annotation. To account for the imperfections in our pseudo-labels, we incorporate uncertainty regions into the segmentation, allowing us to disregard loss from those regions. We conduct evaluations on two datasets, PASCAL VOC and MSCOCO, and our approach significantly outperforms concurrent work. Our benchmarks and code will be released at https://github.com/VinAIResearch/Dataset-Diffusion


title: Overview of Class Activation Maps for Visualization Explainability

abstract: Recent research in deep learning methodology has led to a variety of complex modelling techniques in computer vision (CV) that reach or even outperform human performance. Although these black-box deep learning models have obtained astounding results, they are limited in their interpretability and transparency which are critical to take learning machines to the next step to include them in sensitive decision-support systems involving human supervision. Hence, the development of explainable techniques for computer vision (XCV) has recently attracted increasing attention. In the realm of XCV, Class Activation Maps (CAMs) have become widely recognized and utilized for enhancing interpretability and insights into the decision-making process of deep learning models. This work presents a comprehensive overview of the evolution of Class Activation Map methods over time. It also explores the metrics used for evaluating CAMs and introduces auxiliary techniques to improve the saliency of these methods. The overview concludes by proposing potential avenues for future research in this evolving field.


title: Future Challenges For Event Generators

abstract: In this talk I present a personal perspective on what the current and future challenges are for Monte Carlo event generators. I focus in particular on those aspects of Monte Carlo event generators that have not, historically, received the same scrutiny and level of advancements which will be mandatory in future, cleaner and more precise experimental set-ups than current day LHC.


title: DeepMesh: Mesh-based Cardiac Motion Tracking using Deep Learning

abstract: 3D motion estimation from cine cardiac magnetic resonance (CMR) images is important for the assessment of cardiac function and the diagnosis of cardiovascular diseases. Current state-of-the art methods focus on estimating dense pixel-/voxel-wise motion fields in image space, which ignores the fact that motion estimation is only relevant and useful within the anatomical objects of interest, e.g., the heart. In this work, we model the heart as a 3D mesh consisting of epi- and endocardial surfaces. We propose a novel learning framework, DeepMesh, which propagates a template heart mesh to a subject space and estimates the 3D motion of the heart mesh from CMR images for individual subjects. In DeepMesh, the heart mesh of the end-diastolic frame of an individual subject is first reconstructed from the template mesh. Mesh-based 3D motion fields with respect to the end-diastolic frame are then estimated from 2D short- and long-axis CMR images. By developing a differentiable mesh-to-image rasterizer, DeepMesh is able to leverage 2D shape information from multiple anatomical views for 3D mesh reconstruction and mesh motion estimation. The proposed method estimates vertex-wise displacement and thus maintains vertex correspondences between time frames, which is important for the quantitative assessment of cardiac function across different subjects and populations. We evaluate DeepMesh on CMR images acquired from the UK Biobank. We focus on 3D motion estimation of the left ventricle in this work. Experimental results show that the proposed method quantitatively and qualitatively outperforms other image-based and mesh-based cardiac motion tracking methods.


title: A post-selection algorithm for improving dynamic ensemble selection methods

abstract: Dynamic Ensemble Selection (DES) is a Multiple Classifier Systems (MCS) approach that aims to select an ensemble for each query sample during the selection phase. Even with the proposal of several DES approaches, no particular DES technique is the best choice for different problems. Thus, we hypothesize that selecting the best DES approach per query instance can lead to better accuracy. To evaluate this idea, we introduce the Post-Selection Dynamic Ensemble Selection (PS-DES) approach, a post-selection scheme that evaluates ensembles selected by several DES techniques using different metrics. Experimental results show that using accuracy as a metric to select the ensembles, PS-DES performs better than individual DES techniques. PS-DES source code is available in a GitHub repository


title: Heart rate measurement using the built-in triaxial accelerometer from a commercial digital writing device

abstract: Wearable devices are on the rise. Smart watches and phones, fitness trackers or smart textiles now provide unprecedented access to our own personal data. As such, wearable devices can enable health monitoring without disrupting our daily routines. In clinical settings, electrocardiograms (ECGs) and photoplethysmographies (PPGs) are used to monitor the heart's and respiratory behaviors. In more practical settings, accelerometers can be used to estimate the heartrate when they are attached to the chest. They can also help filter out some noise in ECG signal from movement. In this work, we compare the heart rate data extracted from the built-in accelerometer of a commercial smart pen equipped with sensors (STABILO's DigiPen), with a standard ECG monitor readouts. We demonstrate that it is possible to accurately predict the heart rate from the smart pencil. The data collection is done with eight volunteers, writing the alphabet continuously for five minutes. The signal is processed with a Butterworth filter to cut off noise. We achieve a mean-squared error (MSE) better than 6.685x10$^{-3}$ comparing the DigiPen's computed ${\Delta}$t (time between pulses) with the reference ECG data. The peaks' timestamps for both signals all maintain a correlation higher than 0.99. All computed heart rates from the pen accurately correlate with the reference ECG signals.


title: Multiple Different Black Box Explanations for Image Classifiers

abstract: Existing explanation tools for image classifiers usually give only a single explanation for an image's classification. For many images, however, both humans and image classifiers accept more than one explanation for the image label. Thus, restricting the number of explanations to just one is arbitrary and severely limits the insight into the behavior of the classifier. In this paper, we describe an algorithm and a tool, MultiReX, for computing multiple explanations of the output of a black-box image classifier for a given image. Our algorithm uses a principled approach based on causal theory. We analyse its theoretical complexity and provide experimental results showing that MultiReX finds multiple explanations on 96% of the images in the ImageNet-mini benchmark, whereas previous work finds multiple explanations only on 11%.


title: Properties and Behaviors of Heavy Quarkonia: Insights Through Fractional Model and Topological Defects

abstract: In this study, we investigated the impact of a topological defect on the properties of heavy quarkonia using the extended Cornell potential. We solved the fractional radial Schrodinger equation (SE) using the extended Nikorov-Uvarov (ENU) method to obtain the eigen energy, which allowed us to calculate the masses of charmonium and bottomonium. One significant observation was the splitting between np and nd states, which we attributed to the presence of the topological defect. We discovered that the excited states were divided into components corresponding to 2l + 1, indicating that the gravity field induced by the topological defect interacts with energy levels in a manner similar to the Zeeman effect caused by a magnetic field. Additionally, we derived the wave function and calculated the root mean radii for charmonium and bottomonium. A comparison with classical models was performed, resulting in better results being obtained. Furthermore, we investigated the thermodynamic properties of charmonium and bottomonium, determining quantities such as energy, partition function, free energy, mean energy, and specific heat for p-states. The obtained results were found to be consistent with experimental data and previous works. In conclusion, the fractional model used in this work proved essential in understanding the various properties and behaviors of heavy quarkonia in the presence of topological defects.


title: Parallelizing a 1-Dim Nagel-Schreckenberg Traffic Model

abstract: The Nagel-Schreckenberg model is a stochastic one-dimensional traffic model. In this assignment, we guide students through the process of implementing a shared-memory parallel and reproducible version of an existing serial code that implements this model, and to analyze its scaling behavior. One of the key elements in this traffic model is the presence of randomness, without which it would lack realistic phenomena such as traffic jams. Its implementation thus requires techniques associated with Monte Carlo simulations and pseudo-random number generation (PRNG). PRNGs are notoriously tricky to deal with in parallel when combined with the requirement of reproducibility. This assignment was created for the graduate course PHY1610 Scientific Computing for Physicists at the University of Toronto, which had its origin in the training program of the SciNet HPC Consortium, and is also very suitable for other scientific disciplines. Several variations of the assignment have been used over the years.


title: Chow Rings of Matroids as Permutation Representations

abstract: Given a matroid and a group of its matroid automorphisms, we study the induced group action on the Chow ring of the matroid. This turns out to always be a permutation action. Work of Adiprasito, Huh and Katz showed that the Chow ring satisfies Poincar\'e duality and the Hard Lefschetz theorem. We lift these to statements about this permutation action, and suggest further conjectures in this vein.


title: Random Growth via Gradient Flow Aggregation

abstract: We introduce Gradient Flow Aggregation (GFA), a random growth model. Given a set of existing particles $\left\{x_1, \dots, x_n\right\} \subset \mathbb{R}^2$, a new particle arrives from a random direction at $\infty$ and flows in direction $\nabla E$ where $$ E(x) = \sum_{i=1}^{n} \frac{1}{\|x-x_i\|^{\alpha}} \qquad \mbox{where} ~0 < \alpha < \infty.$$ The case $\alpha = 0$ will refer to the logarithmic energy $- \sum\log \|x-x_i\|$. Particles stop once they are at distance 1 of one of the existing particles at which point they are added to the set and remain fixed for all time. We prove, under a non-degeneracy assumption, a Beurling-type estimate which, via Kesten's method, can be used to deduce sub-ballistic growth for $0 \leq \alpha < 1$ $$\mbox{diam}(\left\{x_1, \dots, x_n\right\}) \leq c_{\alpha} \cdot n^{\frac{3 \alpha +1}{2\alpha + 2}}.$$ This is optimal when $\alpha =0$. The case $\alpha = 0$ leads to a `round' full-dimensional tree. The larger the value of $\alpha$ the sparser the tree. Some instances of the higher-dimensional setting are also discussed.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Symmetry breaking and ascending in the magnetic kagome metal FeGe

abstract: Spontaneous symmetry breaking-the phenomenon where an infinitesimal perturbation can cause the system to break the underlying symmetry-is a cornerstone concept in the understanding of interacting solid-state systems. In a typical series of temperature-driven phase transitions, higher temperature phases are more symmetric due to the stabilizing effect of entropy that becomes dominant as the temperature is increased. However, the opposite is rare but possible when there are multiple degrees of freedom in the system. Here, we present such an example of a symmetry-ascending phenomenon in a magnetic kagome metal FeGe by utilizing neutron Larmor diffraction and Raman spectroscopy. In the paramagnetic state at 460K, we confirm that the crystal structure is indeed hexagonal kagome lattice. On cooling to TN, the crystal structure changes from hexagonal to monoclinic with in-plane lattice distortions on the order of 10^(-4) and the associated splitting of the double degenerate phonon mode of the pristine kagome lattice. Upon further cooling to TCDW, the kagome lattice shows a small negative thermal expansion, and the crystal structure becomes more symmetric gradually upon further cooling. Increasing the crystalline symmetry upon cooling is unusual, it originates from an extremely weak structural instability that coexists and competes with the CDW and magnetic orders. These observations are against the expectations for a simple model with a single order parameter, hence can only be explained by a Landau free energy expansion that takes into account multiple lattice, charge, and spin degrees of freedom. Thus, the determination of the crystalline lattice symmetry as well as the unusual spin-lattice coupling is a first step towards understanding the rich electronic and magnetic properties of the system and sheds new light on intertwined orders where the lattice degree of freedom is no longer dominant.


title: Structured random matrices and cyclic cumulants: A free probability approach

abstract: We introduce a new class of large structured random matrices characterized by four fundamental properties which we discuss. We prove that this class is stable under matrix-valued and pointwise non-linear operations. We then formulate an efficient method, based on an extremization problem, for computing the spectrum of subblocks of such large structured random matrices. We present different proofs -- combinatorial or algebraic -- of the validity of this method, which all have some connection with free probability. We illustrate this method with well known examples of unstructured matrices, including Haar randomly rotated matrices, as well as with the example of structured random matrices arising in the quantum symmetric simple exclusion process. tured random matrices arising in the quantum symmetric simple exclusion process.


title: Physics of Language Models: Part 3.1, Knowledge Storage and Extraction

abstract: Large language models (LLMs) can store a vast amount of world knowledge, often extractable via question-answering (e.g., "What is Abraham Lincoln's birthday?"). However, do they answer such questions based on exposure to similar questions during training (i.e., cheating), or by genuinely learning to extract knowledge from sources like Wikipedia? In this paper, we investigate this issue using a controlled biography dataset. We find a strong correlation between the model's ability to extract knowledge and various diversity measures of the training data. $\textbf{Essentially}$, for knowledge to be reliably extracted, it must be sufficiently augmented (e.g., through paraphrasing, sentence shuffling) $\textit{during pretraining}$. Without such augmentation, knowledge may be memorized but not extractable, leading to 0% accuracy, regardless of subsequent instruction fine-tuning. To understand why this occurs, we employ (nearly) linear probing to demonstrate a strong connection between the observed correlation and how the model internally encodes knowledge -- whether it is linearly encoded in the hidden embeddings of entity names or distributed across other token embeddings in the training text. This paper provides $\textbf{several key recommendations for LLM pretraining in the industry}$: (1) rewrite the pretraining data -- using small, auxiliary models -- to provide knowledge augmentation, and (2) incorporate more instruction-finetuning data into the pretraining stage before it becomes too late.


title: Online and Offline Dynamic Influence Maximization Games Over Social Networks

abstract: In this work, we consider dynamic influence maximization games over social networks with multiple players (influencers). The goal of each influencer is to maximize their own reward subject to their limited total budget rate constraints. Thus, influencers need to carefully design their investment policies considering individuals' opinion dynamics and other influencers' investment strategies, leading to a dynamic game problem. We first consider the case of a single influencer who wants to maximize its utility subject to a total budget rate constraint. We study both offline and online versions of the problem where the opinion dynamics are either known or not known a priori. In the singe-influencer case, we propose an online no-regret algorithm, meaning that as the number of campaign opportunities grows, the average utilities obtained by the offline and online solutions converge. Then, we consider the game formulation with multiple influencers in offline and online settings. For the offline setting, we show that the dynamic game admits a unique Nash equilibrium policy and provide a method to compute it. For the online setting and with two influencers, we show that if each influencer applies the same no-regret online algorithm proposed for the single-influencer maximization problem, they will converge to the set of $\epsilon$-Nash equilibrium policies where $\epsilon=O(\frac{1}{\sqrt{K}})$ scales in average inversely with the number of campaign times $K$ considering the average utilities of the influencers. Moreover, we extend this result to any finite number of influencers under more strict requirements on the information structure. Finally, we provide numerical analysis to validate our results under various settings.


title: Distorted static photon surfaces in perturbed Reissner-Nordstr\"om spacetimes

abstract: The photon surface is defined as a timelike surface $S$ such that any photon emitted in arbitrary tangential direction to $S$ from an arbitrary point on $S$ continues to propagate on $S$. In this paper, we examine whether a static photon surface can be present in distorted electrovacuum spacetimes with perturbative approach, by constructing analytic solutions to the equations for static perturbations of a Reissner-Nordstr\"om spacetime that are regular outside the background photon surface. For each of the $\ell\ge 2$ modes, there are two physical solutions to the perturbative equations that correspond to adding the multipole moments of mass and electric charge, respectively. By adjusting the ratio of the amplitudes of the two solutions appropriately, it is possible to realize a distorted photon surface. In the case of $\ell=1$, although there is only one physical solution to the perturbative equations, there is also a degree of freedom to shift the coordinate position of the photon surface, and this enables the formation of a photon surface. Such a photon surface has a spherically symmetric spatial section, but it is also distorted in the three-dimensional sense. Our results show that distorted static photon surfaces can be formed at least at the level of the first-order perturbations, and imply that the uniqueness of the photon surface may not hold in electrovacuum spacetimes.


title: Regularity theory for parabolic operators in the half-space with boundary degeneracy

abstract: We study elliptic and parabolic problems governed by the singular elliptic operators \begin{align*} \mathcal L=y^{\alpha_1}\mbox{Tr }\left(QD^2_xu\right)+2y^{\frac{\alpha_1+\alpha_2}{2}}q\cdot \nabla_xD_y+\gamma y^{\alpha_2} D_{yy}+Cy^{\alpha_2-1}D_y \end{align*} under Neumann boundary condition, in the half-space $\mathbb{R}^{N+1}_+=\{(x,y): x \in \mathbb{R}^N, y>0\}$. We prove elliptic and parabolic $L^p$-estimates and solvability for the associated problems. In the language of semigroup theory, we prove that $\mathcal L$ generates an analytic semigroup, characterize its domain as a weighted Sobolev space and show that it has maximal regularity.


title: MUTEX: Learning Unified Policies from Multimodal Task Specifications

abstract: Humans use different modalities, such as speech, text, images, videos, etc., to communicate their intent and goals with teammates. For robots to become better assistants, we aim to endow them with the ability to follow instructions and understand tasks specified by their human partners. Most robotic policy learning methods have focused on one single modality of task specification while ignoring the rich cross-modal information. We present MUTEX, a unified approach to policy learning from multimodal task specifications. It trains a transformer-based architecture to facilitate cross-modal reasoning, combining masked modeling and cross-modal matching objectives in a two-stage training procedure. After training, MUTEX can follow a task specification in any of the six learned modalities (video demonstrations, goal images, text goal descriptions, text instructions, speech goal descriptions, and speech instructions) or a combination of them. We systematically evaluate the benefits of MUTEX in a newly designed dataset with 100 tasks in simulation and 50 tasks in the real world, annotated with multiple instances of task specifications in different modalities, and observe improved performance over methods trained specifically for any single modality. More information at https://ut-austin-rpl.github.io/MUTEX/


title: Lifelong Robot Learning with Human Assisted Language Planners

abstract: Large Language Models (LLMs) have been shown to act like planners that can decompose high-level instructions into a sequence of executable instructions. However, current LLM-based planners are only able to operate with a fixed set of skills. We overcome this critical limitation and present a method for using LLM-based planners to query new skills and teach robots these skills in a data and time-efficient manner for rigid object manipulation. Our system can re-use newly acquired skills for future tasks, demonstrating the potential of open world and lifelong learning. We evaluate the proposed framework on multiple tasks in simulation and the real world. Videos are available at: https://sites.google.com/mit.edu/halp-robot-learning.


title: Small-scale proxies for large-scale Transformer training instabilities

abstract: Teams that have trained large Transformer-based models have reported training instabilities at large scale that did not appear when training with the same hyperparameters at smaller scales. Although the causes of such instabilities are of scientific interest, the amount of resources required to reproduce them has made investigation difficult. In this work, we seek ways to reproduce and study training stability and instability at smaller scales. First, we focus on two sources of training instability described in previous work: the growth of logits in attention layers (Dehghani et al., 2023) and divergence of the output logits from the log probabilities (Chowdhery et al., 2022). By measuring the relationship between learning rate and loss across scales, we show that these instabilities also appear in small models when training at high learning rates, and that mitigations previously employed at large scales are equally effective in this regime. This prompts us to investigate the extent to which other known optimizer and model interventions influence the sensitivity of the final loss to changes in the learning rate. To this end, we study methods such as warm-up, weight decay, and the $\mu$Param (Yang et al., 2022), and combine techniques to train small models that achieve similar losses across orders of magnitude of learning rate variation. Finally, to conclude our exploration we study two cases where instabilities can be predicted before they emerge by examining the scaling behavior of model activation and gradient norms.


title: Cluster Language Model for Improved E-Commerce Retrieval and Ranking: Leveraging Query Similarity and Fine-Tuning for Personalized Results

abstract: This paper proposes a novel method to improve the accuracy of product search in e-commerce by utilizing a cluster language model. The method aims to address the limitations of the bi-encoder architecture while maintaining a minimal additional training burden. The approach involves labeling top products for each query, generating semantically similar query clusters using the K-Means clustering algorithm, and fine-tuning a global language model into cluster language models on individual clusters. The parameters of each cluster language model are fine-tuned to learn local manifolds in the feature space efficiently, capturing the nuances of various query types within each cluster. The inference is performed by assigning a new query to its respective cluster and utilizing the corresponding cluster language model for retrieval. The proposed method results in more accurate and personalized retrieval results, offering a superior alternative to the popular bi-encoder based retrieval models in semantic search.


title: Towards General-Purpose Text-Instruction-Guided Voice Conversion

abstract: This paper introduces a novel voice conversion (VC) model, guided by text instructions such as "articulate slowly with a deep tone" or "speak in a cheerful boyish voice". Unlike traditional methods that rely on reference utterances to determine the attributes of the converted speech, our model adds versatility and specificity to voice conversion. The proposed VC model is a neural codec language model which processes a sequence of discrete codes, resulting in the code sequence of converted speech. It utilizes text instructions as style prompts to modify the prosody and emotional information of the given speech. In contrast to previous approaches, which often rely on employing separate encoders like prosody and content encoders to handle different aspects of the source speech, our model handles various information of speech in an end-to-end manner. Experiments have demonstrated the impressive capabilities of our model in comprehending instructions and delivering reasonable results.


title: Exel-Pardo algebras with a twist

abstract: Katsura associated a $C^*$-algebra $C^*_{A,B}$ to integral matrices $A\ge 0$ and $B$ of the same size, gave sufficient conditions on $(A,B)$ making it simple purely infinite (SPI), and proved that any separable $C^*$-algebra $KK$-isomorphic to a cone of an element $\xi\in KK(C(S^1)^n,C(S^1)^n)$ in Kasparov's $KK$ is $KK$-isomorphic to an SPI $C^*_{A,B}$. Here we introduce, for the data of a commutative ring $\ell$, matrices $A,B$ as above and $C$ of the same size with coefficients in the group $\mathcal{U}(\ell)$ of invertible elements, an $\ell$-algebra $\mathcal{O}_{A,B}^C$, the twisted Katsura algebra of the triple $(A,B,C)$, show it is SPI whenever $\ell\supset\mathbb{Q}$ is a field and $(A,B)$ satisfy Katsura conditions, and that any $\ell$-algebra which is a cone of a map $\xi\in kk(\ell[t,t^{-1}]^n,\ell[t,t^{-1}]^n)$ in the bivariant algebraic $K$-theory category $kk$ is $kk$-isomorphic to an SPI $\mathcal{O}_{A,B}^C$. Twisted Katsura $\ell$-algebras are twisted Exel-Pardo algebras $L(G,E,\phi_c)$ associated to a group $G$ acting on a graph $E$, and $1$-cocycles $\phi:G\times E^1\to G$ and $c:G\times E^1\to \mathcal{U}(\ell)$. We describe $L(G,E,\phi_c)$ by generators and relations, as a quotient of a twisted semigroup algebra, as a twisted Steinberg algebra, as a corner skew Laurent polynomial algebra, and as a universal localization of a tensor algebra. We use each of these guises of $L(G,E,\phi_c)$ to study its $K$-theoretic, regularity and simplicity properties. For example we show that if $\ell\supset \mathbb{Q}$ is a field, $G$ and $E$ are countable and $E$ is regular, then $L(G,E,\phi_c)$ is simple whenever the Exel-Pardo $C^*$-algebra $C^*(G,E,\phi)$ is, and is SPI if in addition the Leavitt path algebra $L(E)$ is SPI.


title: Efficient Pauli channel estimation with logarithmic quantum memory

abstract: Here we revisit one of the prototypical tasks for characterizing the structure of noise in quantum devices: estimating every eigenvalue of an $n$-qubit Pauli noise channel to error $\epsilon$. Prior work (Chen et al., 2022) proved no-go theorems for this task in the practical regime where one has a limited amount of quantum memory, e.g. any protocol with $\le 0.99n$ ancilla qubits of quantum memory must make exponentially many measurements, provided it is non-concatenating. Such protocols can only interact with the channel by repeatedly preparing a state, passing it through the channel, and measuring immediately afterward. This left open a natural question: does the lower bound hold even for general protocols, i.e. ones which chain together many queries to the channel, interleaved with arbitrary data-processing channels, before measuring? Surprisingly, in this work we show the opposite: there is a protocol that can estimate the eigenvalues of a Pauli channel to error $\epsilon$ using only $O(\log n/\epsilon^2)$ ancilla qubits and $\tilde{O}(n^2/\epsilon^2)$ measurements. In contrast, we show that any protocol with zero ancilla, even a concatenating one, must make $\Omega(2^n/\epsilon^2)$ measurements, which is tight. Our results imply, to our knowledge, the first quantum learning task where logarithmically many qubits of quantum memory suffice for an exponential statistical advantage.

categories: quant-ph cs.CC cs.IT cs.LG math.IT math.ST stat.TH


title: DeepSpeed-VisualChat: Multi-Round Multi-Image Interleave Chat via Multi-Modal Causal Attention

abstract: Most of the existing multi-modal models, hindered by their incapacity to adeptly manage interleaved image-and-text inputs in multi-image, multi-round dialogues, face substantial constraints in resource allocation for training and data accessibility, impacting their adaptability and scalability across varied interaction realms. To address this, we present the DeepSpeed-VisualChat framework, designed to optimize Large Language Models (LLMs) by incorporating multi-modal capabilities, with a focus on enhancing the proficiency of Large Vision and Language Models in handling interleaved inputs. Our framework is notable for (1) its open-source support for multi-round and multi-image dialogues, (2) introducing an innovative multi-modal causal attention mechanism, and (3) utilizing data blending techniques on existing datasets to assure seamless interactions in multi-round, multi-image conversations. Compared to existing frameworks, DeepSpeed-VisualChat shows superior scalability up to 70B parameter language model size, representing a significant advancement in multi-modal language models and setting a solid foundation for future explorations.


title: pyParaOcean: A System for Visual Analysis of Ocean Data

abstract: Visual analysis is well adopted within the field of oceanography for the analysis of model simulations, detection of different phenomena and events, and tracking of dynamic processes. With increasing data sizes and the availability of multivariate dynamic data, there is a growing need for scalable and extensible tools for visualization and interactive exploration. We describe pyParaOcean, a visualization system that supports several tasks routinely used in the visual analysis of ocean data. The system is available as a plugin to Paraview and is hence able to leverage its distributed computing capabilities and its rich set of generic analysis and visualization functionalities. pyParaOcean provides modules to support different visual analysis tasks specific to ocean data, such as eddy identification and salinity movement tracking. These modules are available as Paraview filters and this seamless integration results in a system that is easy to install and use. A case study on the Bay of Bengal illustrates the utility of the system for the study of ocean phenomena and processes.


title: Innovative Digital Storytelling with AIGC: Exploration and Discussion of Recent Advances

abstract: Digital storytelling, as an art form, has struggled with cost-quality balance. The emergence of AI-generated Content (AIGC) is considered as a potential solution for efficient digital storytelling production. However, the specific form, effects, and impacts of this fusion remain unclear, leaving the boundaries of AIGC combined with storytelling undefined. This work explores the current integration state of AIGC and digital storytelling, investigates the artistic value of their fusion in a sample project, and addresses common issues through interviews. Through our study, we conclude that AIGC, while proficient in image creation, voiceover production, and music composition, falls short of replacing humans due to the irreplaceable elements of human creativity and aesthetic sensibilities at present, especially in complex character animations, facial expressions, and sound effects. The research objective is to increase public awareness of the current state, limitations, and challenges arising from combining AIGC and digital storytelling.


title: Noise-in, Bias-out: Balanced and Real-time MoCap Solving

abstract: Real-time optical Motion Capture (MoCap) systems have not benefited from the advances in modern data-driven modeling. In this work we apply machine learning to solve noisy unstructured marker estimates in real-time and deliver robust marker-based MoCap even when using sparse affordable sensors. To achieve this we focus on a number of challenges related to model training, namely the sourcing of training data and their long-tailed distribution. Leveraging representation learning we design a technique for imbalanced regression that requires no additional data or labels and improves the performance of our model in rare and challenging poses. By relying on a unified representation, we show that training such a model is not bound to high-end MoCap training data acquisition, and exploit the advances in marker-less MoCap to acquire the necessary data. Finally, we take a step towards richer and affordable MoCap by adapting a body model-based inverse kinematics solution to account for measurement and inference uncertainty, further improving performance and robustness. Project page: https://moverseai.github.io/noise-tail


title: LinGCN: Structural Linearized Graph Convolutional Network for Homomorphically Encrypted Inference

abstract: The growth of Graph Convolution Network (GCN) model sizes has revolutionized numerous applications, surpassing human performance in areas such as personal healthcare and financial systems. The deployment of GCNs in the cloud raises privacy concerns due to potential adversarial attacks on client data. To address security concerns, Privacy-Preserving Machine Learning (PPML) using Homomorphic Encryption (HE) secures sensitive client data. However, it introduces substantial computational overhead in practical applications. To tackle those challenges, we present LinGCN, a framework designed to reduce multiplication depth and optimize the performance of HE based GCN inference. LinGCN is structured around three key elements: (1) A differentiable structural linearization algorithm, complemented by a parameterized discrete indicator function, co-trained with model weights to meet the optimization goal. This strategy promotes fine-grained node-level non-linear location selection, resulting in a model with minimized multiplication depth. (2) A compact node-wise polynomial replacement policy with a second-order trainable activation function, steered towards superior convergence by a two-level distillation approach from an all-ReLU based teacher model. (3) an enhanced HE solution that enables finer-grained operator fusion for node-wise activation functions, further reducing multiplication level consumption in HE-based inference. Our experiments on the NTU-XVIEW skeleton joint dataset reveal that LinGCN excels in latency, accuracy, and scalability for homomorphically encrypted inference, outperforming solutions such as CryptoGCN. Remarkably, LinGCN achieves a 14.2x latency speedup relative to CryptoGCN, while preserving an inference accuracy of 75% and notably reducing multiplication depth.


title: Hall conductivity pump

abstract: The Thouless charge pump represents a transfer of electric charge through a gapped one-dimensional system between its zero-dimensional boundaries under a periodic change of a parameter. The value of the passed charged during a single cycle is known to be a topological invariant. We construct an analogous topological invariant that measures a pump of Hall conductance inside of three-dimensional material between its two-dimensional boundaries.


title: Quantum-Enhanced Parameter Estimation Without Entanglement

abstract: Entanglement is generally considered necessary for achieving the Heisenberg limit in quantum metrology. We construct analogues of Dicke and GHZ states on a single $N+1$ dimensional qudit that achieve precision equivalent to symmetrically entangled states on $N$ qubits, showing that entanglement is not necessary for going beyond the standard quantum limit. We define a measure of non-classicality based on quantum Fisher information and estimate the achievable precision, suggesting a close relationship between non-classical states and metrological power of qudits. Our work offers an exponential reduction in the physical resources required for quantum-enhanced parameter estimation, making it accessible on any quantum system with a high-dimensional Hilbert space.


title: Tasks Makyth Models: Machine Learning Assisted Surrogates for Tipping Points

abstract: We present a machine learning (ML)-assisted framework bridging manifold learning, neural networks, Gaussian processes, and Equation-Free multiscale modeling, for (a) detecting tipping points in the emergent behavior of complex systems, and (b) characterizing probabilities of rare events (here, catastrophic shifts) near them. Our illustrative example is an event-driven, stochastic agent-based model (ABM) describing the mimetic behavior of traders in a simple financial market. Given high-dimensional spatiotemporal data -- generated by the stochastic ABM -- we construct reduced-order models for the emergent dynamics at different scales: (a) mesoscopic Integro-Partial Differential Equations (IPDEs); and (b) mean-field-type Stochastic Differential Equations (SDEs) embedded in a low-dimensional latent space, targeted to the neighborhood of the tipping point. We contrast the uses of the different models and the effort involved in learning them.


title: UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation

abstract: Human generation has achieved significant progress. Nonetheless, existing methods still struggle to synthesize specific regions such as faces and hands. We argue that the main reason is rooted in the training data. A holistic human dataset inevitably has insufficient and low-resolution information on local parts. Therefore, we propose to use multi-source datasets with various resolution images to jointly learn a high-resolution human generative model. However, multi-source data inherently a) contains different parts that do not spatially align into a coherent human, and b) comes with different scales. To tackle these challenges, we propose an end-to-end framework, UnitedHuman, that empowers continuous GAN with the ability to effectively utilize multi-source data for high-resolution human generation. Specifically, 1) we design a Multi-Source Spatial Transformer that spatially aligns multi-source images to full-body space with a human parametric model. 2) Next, a continuous GAN is proposed with global-structural guidance and CutMix consistency. Patches from different datasets are then sampled and transformed to supervise the training of this scale-invariant generative model. Extensive experiments demonstrate that our model jointly learned from multi-source data achieves superior quality than those learned from a holistic dataset.


title: Palomar discovery and initial characterization of naked-eye long period comet C/2022 E3 (ZTF)

abstract: Long-period comets are planetesimal remnants constraining the environment and volatiles of the protoplanetary disc. We report the discovery of hyperbolic long-period comet C/2022 E3 (ZTF), which has a perihelion $\sim$1.11 au, an eccentricity $\gtrsim$1 and an inclination $\sim$109$^{\circ}$, from images taken with the Palomar 48-inch telescope during morning twilight on 2022 Mar 2. Additionally, we report the characterization of C/2022 E3 (ZTF) from observations taken with the Palomar 200-inch, the Palomar 60-inch, and the NASA Infrared Telescope Facility in early 2023 February to 2023 March when the comet passed within $\sim$0.28 au of the Earth and reached a visible magnitude of $\sim$5. We measure g-r = 0.70$\pm$0.01, r-i = 0.20$\pm$0.01, i-z = 0.06$\pm$0.01, z-J = 0.90$\pm$0.01, J-H = 0.38$\pm$0.01 and H-K = 0.15$\pm$0.01 colours for the comet from observations. We measure the A(0$^\circ$)f$\rho$ (0.8~$\mu$m) in a 6500~km radius from the nucleus of 1483$\pm$40~cm, and CN, C$_3$, and C$_2$ production of 5.43$\pm0.11\times$10$^{25}$~mol/s, 2.01$\pm0.04\times$10$^{24}$, and 3.08$\pm0.5\times$10$^{25}$~mol/s, similar to other long period comets. We additionally observe the appearance of jet-like structures at a scale of $\sim$4,000 km in wide-field g-band images, which may be caused by the presence of CN gas in the near-nucleus coma.


title: The true fraction of repeating fast radio bursts revealed through CHIME source count evolution

abstract: Fast Radio Bursts (FRBs) are classified into repeaters and non-repeaters, with only a few percent of the observed FRB population from the Canadian Hydrogen Intensity Mapping Experiment (CHIME) confirmed as repeaters. However, this figure represents only a lower limit due to the observational biases, and the true fraction of repeaters remains unknown. Correcting for these biases uncovers a notable decline in apparently non-repeating FRB detection rate as the CHIME operational time increases. This finding suggests that a significant portion of apparently non-repeating FRBs could in fact exhibit repetition when observed over more extended periods. A simple population model infers that the true repeater fraction likely exceeds 50% with 99% confidence, a figure substantially larger than the observed face value, even consistent with 100%. This greater prevalence of repeaters had previously gone unnoticed due to their very low repetition rates ($\sim$10$^{-3.5}$ hr$^{-1}$ on average). Hence, theoretical FRB models must incorporate these low-rate repeaters. Furthermore, our results indicate a significantly higher repeater volume number density, potentially exceeding observed values by up to 10$^4$ times, which in turn impacts comparisons with potential FRB progenitors.


title: 3D Indoor Instance Segmentation in an Open-World

abstract: Existing 3D instance segmentation methods typically assume that all semantic classes to be segmented would be available during training and only seen categories are segmented at inference. We argue that such a closed-world assumption is restrictive and explore for the first time 3D indoor instance segmentation in an open-world setting, where the model is allowed to distinguish a set of known classes as well as identify an unknown object as unknown and then later incrementally learning the semantic category of the unknown when the corresponding category labels are available. To this end, we introduce an open-world 3D indoor instance segmentation method, where an auto-labeling scheme is employed to produce pseudo-labels during training and induce separation to separate known and unknown category labels. We further improve the pseudo-labels quality at inference by adjusting the unknown class probability based on the objectness score distribution. We also introduce carefully curated open-world splits leveraging realistic scenarios based on inherent object distribution, region-based indoor scene exploration and randomness aspect of open-world classes. Extensive experiments reveal the efficacy of the proposed contributions leading to promising open-world 3D instance segmentation performance.


title: Chop & Learn: Recognizing and Generating Object-State Compositions

abstract: Recognizing and generating object-state compositions has been a challenging task, especially when generalizing to unseen compositions. In this paper, we study the task of cutting objects in different styles and the resulting object state changes. We propose a new benchmark suite Chop & Learn, to accommodate the needs of learning objects and different cut styles using multiple viewpoints. We also propose a new task of Compositional Image Generation, which can transfer learned cut styles to different objects, by generating novel object-state images. Moreover, we also use the videos for Compositional Action Recognition, and show valuable uses of this dataset for multiple video tasks. Project website: https://chopnlearn.github.io.


title: Electronic properties, correlated topology and Green's function zeros

abstract: There is extensive current interest about electronic topology in correlated settings. In strongly correlated systems, contours of Green's function zeros may develop in frequency-momentum space, and their role in correlated topology has increasingly been recognized. However, whether and how the zeros contribute to electronic properties is a matter of uncertainty. Here we address the issue in an exactly solvable model for Mott insulator. We show that the Green's function zeros contribute to several physically measurable correlation functions, in a way that does not run into inconsistencies. In particular, the physical properties remain robust to chemical potential variations up to the Mott gap as it should be based on general considerations. Our work sets the stage for further understandings on the rich interplay among topology, symmetry and strong correlations.


title: Extreme Parkour with Legged Robots

abstract: Humans can perform parkour by traversing obstacles in a highly dynamic fashion requiring precise eye-muscle coordination and movement. Getting robots to do the same task requires overcoming similar challenges. Classically, this is done by independently engineering perception, actuation, and control systems to very low tolerances. This restricts them to tightly controlled settings such as a predetermined obstacle course in labs. In contrast, humans are able to learn parkour through practice without significantly changing their underlying biology. In this paper, we take a similar approach to developing robot parkour on a small low-cost robot with imprecise actuation and a single front-facing depth camera for perception which is low-frequency, jittery, and prone to artifacts. We show how a single neural net policy operating directly from a camera image, trained in simulation with large-scale RL, can overcome imprecise sensing and actuation to output highly precise control behavior end-to-end. We show our robot can perform a high jump on obstacles 2x its height, long jump across gaps 2x its length, do a handstand and run across tilted ramps, and generalize to novel obstacle courses with different physical properties. Parkour videos at https://extreme-parkour.github.io/


title: Groups of the nilpotency class $3$ of order $p^4$ as additive groups of local nearrings

abstract: We consider groups of the nilpotency class $3$ of order $p^4$ which are the additive groups of local nearrings. It was shown that, for $p>3$, there exist a local nearring on one of such 4 groups.


title: On matrices in finite free position

abstract: We study pairs $(A,B)$ of square matrices that are in additive (resp. multiplicative) finite free position, that is, the characteristic polynomial $\chi_{A+B}(x)$ (resp. $\chi_{AB}(x)$) equals the additive finite free convolution $\chi_{A}(x) \boxplus \chi_{B}(x)$ (resp. multiplicative finite free convolution $\chi_{A}(x) \boxtimes \chi_{B}(x)$), which equals the expected characteristic polynomial $\mathbb{E}_U \, [ \chi_{A+U^* BU}(x) ]$ (resp. $\mathbb{E}_U \, [ \chi_{AU^* BU}(x) ]$) over the set of unitary matrices $U$. We examine the lattice of algebraic varieties of matrices consisting of finite free complementary pairs with respect to the additive (resp. multiplicative) convolution. We show that these pairs include the diagonal matrices vs. the principally balanced matrices, the upper (lower) triangular matrices vs. the upper (lower) triangular matrices with a single eigenvalue, and the scalar matrices vs. the set of all square matrices.


title: Computing Common Eigenvectors and Simultaneous Triangulation

abstract: We propose an efficient algorithm for computing a common eigenvector of a finite set of square matrices. As an immediate consequence we obtain an algorithm for determining whether the matrices admit a simultaneous triangulation, and, if so, for computing a corresponding basis.


title: Bias Testing and Mitigation in LLM-based Code Generation

abstract: Utilizing state-of-the-art Large Language Models (LLMs), automatic code generation models play a pivotal role in enhancing the productivity of software development procedures. As the adoption of LLMs becomes more widespread in software coding ecosystems, a pressing issue has emerged: does the generated code contain social bias and unfairness, such as those related to age, gender, and race? This issue concerns the integrity, fairness, and ethical foundation of software applications that depend on the code generated by these models, yet is under-explored in the literature. This paper presents a novel bias testing framework that is specifically designed for code generation tasks. Based on this framework, we conduct an extensive evaluation of the bias in code generated by five state-of-the-art LLMs. Our findings reveal that 20.29% to 44.93% code functions generated by the models under study are biased when handling bias sensitive tasks (i.e., tasks that involve sensitive attributes such as age and gender). This indicates that the existing LLMs can be unfair in code generation, posing risks of unintended and harmful software behaviors. To mitigate bias for code generation models, we evaluate five bias mitigation prompt strategies, i.e., utilizing bias testing results to refine the code (zero-shot), one-, few-shot, and two Chain-of-Thought (CoT) prompts. Our evaluation results illustrate that these strategies are all effective in mitigating bias. Overall, one-shot and few-shot learning are the two most effective. For GPT-4, 80% to 90% code bias can be removed with one-shot learning.


title: Integration of Polyimide Flexible PCB Wings in Northeastern Aerobat

abstract: The principal aim of this Master's thesis is to propel the optimization of the membrane wing structure of the Northeastern Aerobat through origami techniques and enhancing its capacity for secure hovering within confined spaces. Bio-inspired drones offer distinctive capabilities that pave the way for innovative applications, encompassing wildlife monitoring, precision agriculture, search and rescue operations, as well as the augmentation of residential safety. The evolved noise-reduction mechanisms of birds and insects prove advantageous for drones utilized in tasks like surveillance and wildlife observation, ensuring operation devoid of disturbances. Traditional flying drones equipped with rotary or fixed wings encounter notable constraints when navigating narrow pathways. While rotary and fixed-wing systems are conventionally harnessed for surveillance and reconnaissance, the integration of onboard sensor suites within micro aerial vehicles (MAVs) has garnered interest in vigilantly monitoring hazardous scenarios in residential settings. Notwithstanding the agility and commendable fault tolerance exhibited by systems such as quadrotors in demanding conditions, their inflexible body structures impede collision tolerance, necessitating operational spaces free of collisions. Recent years have witnessed an upsurge in integrating soft and pliable materials into the design of such systems; however, the pursuit of aerodynamic efficiency curtails the utilization of excessively flexible materials for rotor blades or propellers. This thesis introduces a design that integrates polyimide flexible PCBs into the wings of the Aerobat and employs guard design incorporating feedback-driven stabilizers, enabling stable hovering flights within Northeastern's Robotics-Inspired Study and Experimentation (RISE) cage.