title: Influence of Prompting Strategies on Segment Anything Model (SAM) for Short-axis Cardiac MRI segmentation

abstract: The Segment Anything Model (SAM) has recently emerged as a significant breakthrough in foundation models, demonstrating remarkable zero-shot performance in object segmentation tasks. While SAM is designed for generalization, it exhibits limitations in handling specific medical imaging tasks that require fine-structure segmentation or precise boundaries. In this paper, we focus on the task of cardiac magnetic resonance imaging (cMRI) short-axis view segmentation using the SAM foundation model. We conduct a comprehensive investigation of the impact of different prompting strategies (including bounding boxes, positive points, negative points, and their combinations) on segmentation performance. We evaluate on two public datasets using the baseline model and models fine-tuned with varying amounts of annotated data, ranging from a limited number of volumes to a fully annotated dataset. Our findings indicate that prompting strategies significantly influence segmentation performance. Combining positive points with either bounding boxes or negative points shows substantial benefits, but little to no benefit when combined simultaneously. We further observe that fine-tuning SAM with a few annotated volumes improves segmentation performance when properly prompted. Specifically, fine-tuning with bounding boxes has a positive impact, while fine-tuning without bounding boxes leads to worse results compared to baseline.


title: Multi-Modal Learning-based Reconstruction of High-Resolution Spatial Wind Speed Fields

abstract: Wind speed at sea surface is a key quantity for a variety of scientific applications and human activities. Due to the non-linearity of the phenomenon, a complete description of such variable is made infeasible on both the small scale and large spatial extents. Methods relying on Data Assimilation techniques, despite being the state-of-the-art for Numerical Weather Prediction, can not provide the reconstructions with a spatial resolution that can compete with satellite imagery. In this work we propose a framework based on Variational Data Assimilation and Deep Learning concepts. This framework is applied to recover rich-in-time, high-resolution information on sea surface wind speed. We design our experiments using synthetic wind data and different sampling schemes for high-resolution and low-resolution versions of original data to emulate the real-world scenario of spatio-temporally heterogeneous observations. Extensive numerical experiments are performed to assess systematically the impact of low and high-resolution wind fields and in-situ observations on the model reconstruction performance. We show that in-situ observations with richer temporal resolution represent an added value in terms of the model reconstruction performance. We show how a multi-modal approach, that explicitly informs the model about the heterogeneity of the available observations, can improve the reconstruction task by exploiting the complementary information in spatial and local point-wise data. To conclude, we propose an analysis to test the robustness of the chosen framework against phase delay and amplitude biases in low-resolution data and against interruptions of in-situ observations supply at evaluation time


title: Accurate field-level weak lensing inference for precision cosmology

abstract: We present $\texttt{Miko}$, a catalog-to-cosmology pipeline for general flat-sky field-level inference, which provides access to cosmological information beyond the two-point statistics. In the context of weak lensing, we identify several new field-level analysis systematics (such as aliasing, Fourier mode-coupling, and density-induced shape noise), quantify their impact on cosmological constraints, and correct the biases to a percent level. Next, we find that model mis-specification can lead to both absolute bias and incorrect uncertainty quantification for the inferred cosmological parameters in realistic simulations. The Gaussian map prior infers unbiased cosmological parameters, regardless of the true data distribution, but it yields over-confident uncertainties. The log-normal map prior quantifies the uncertainties accurately, although it requires careful calibration of the shift parameters for unbiased cosmological parameters. We demonstrate systematics control down to the $2\%$ level for both models, making them suitable for ongoing weak lensing surveys.


title: Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations

abstract: In this paper, we present an innovative process-oriented math process reward model called \textbf{Math-Shepherd}, which assigns a reward score to each step of math problem solutions. The training of Math-Shepherd is achieved using automatically constructed process-wise supervision data, breaking the bottleneck of heavy reliance on manual annotation in existing work. We explore the effectiveness of Math-Shepherd in two scenarios: 1) \textit{Verification}: Math-Shepherd is utilized for reranking multiple outputs generated by Large Language Models (LLMs); 2) \textit{Reinforcement Learning}: Math-Shepherd is employed to reinforce LLMs with step-by-step Proximal Policy Optimization (PPO). With Math-Shepherd, a series of open-source LLMs demonstrates exceptional performance. For instance, the step-by-step PPO with Math-Shepherd significantly improves the accuracy of Mistral-7B (77.9\%$\to$84.1\% on GSM8K and 28.6\%$\to$33.0\% on MATH). The accuracy can be further enhanced to 89.1\% and 43.5\% on GSM8K and MATH with the verification of Math-Shepherd, respectively. We believe that automatic process supervision holds significant potential for the future evolution of LLMs.


title: MLMC: Machine Learning Monte Carlo for Lattice Gauge Theory

abstract: We present a trainable framework for efficiently generating gauge configurations, and discuss ongoing work in this direction. In particular, we consider the problem of sampling configurations from a 4D $SU(3)$ lattice gauge theory, and consider a generalized leapfrog integrator in the molecular dynamics update that can be trained to improve sampling efficiency. Code is available online at https://github.com/saforem2/l2hmc-qcd.


title: BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual Polynomials

abstract: Pretrained foundation models offer substantial benefits for a wide range of downstream tasks, which can be one of the most potential techniques to access artificial general intelligence. However, scaling up foundation transformers for maximal task-agnostic knowledge has brought about computational challenges, especially on resource-limited devices such as mobiles. This work proposes the first Binary Pretrained Foundation Transformer (BiPFT) for natural language understanding (NLU) tasks, which remarkably saves 56 times operations and 28 times memory. In contrast to previous task-specific binary transformers, BiPFT exhibits a substantial enhancement in the learning capabilities of binary neural networks (BNNs), promoting BNNs into the era of pre-training. Benefiting from extensive pretraining data, we further propose a data-driven binarization method. Specifically, we first analyze the binarization error in self-attention operations and derive the polynomials of binarization error. To simulate full-precision self-attention, we define binarization error as binarization residual polynomials, and then introduce low-rank estimators to model these polynomials. Extensive experiments validate the effectiveness of BiPFTs, surpassing task-specific baseline by 15.4% average performance on the GLUE benchmark. BiPFT also demonstrates improved robustness to hyperparameter changes, improved optimization efficiency, and reduced reliance on downstream distillation, which consequently generalize on various NLU tasks and simplify the downstream pipeline of BNNs. Our code and pretrained models are publicly available at https://github.com/Xingrun-Xing/BiPFT.


title: Quantitative weighted estimates for the multilinear pseudo-differential operators in function spaces

abstract: In this paper, the weighted estimates for multilinear pseudo-differential operators were systematically studied in rearrangement invariant Banach and quasi-Banach spaces. These spaces contain the Lebesgue space, the classical Lorentz space and Marcinkiewicz space as typical examples. More precisely, the weighted boundedness and weighted modular estimates, including the weak endpoint case, were established for multilinear pseudo-differential operators and their commutators. As applications, we show that the above results also hold for the multilinear Fourier multipliers, multilinear square functions, and a class of multilinear Calder\'{o}n-Zygmund operators.


title: EAT: Towards Long-Tailed Out-of-Distribution Detection

abstract: Despite recent advancements in out-of-distribution (OOD) detection, most current studies assume a class-balanced in-distribution training dataset, which is rarely the case in real-world scenarios. This paper addresses the challenging task of long-tailed OOD detection, where the in-distribution data follows a long-tailed class distribution. The main difficulty lies in distinguishing OOD data from samples belonging to the tail classes, as the ability of a classifier to detect OOD instances is not strongly correlated with its accuracy on the in-distribution classes. To overcome this issue, we propose two simple ideas: (1) Expanding the in-distribution class space by introducing multiple abstention classes. This approach allows us to build a detector with clear decision boundaries by training on OOD data using virtual labels. (2) Augmenting the context-limited tail classes by overlaying images onto the context-rich OOD data. This technique encourages the model to pay more attention to the discriminative features of the tail classes. We provide a clue for separating in-distribution and OOD data by analyzing gradient noise. Through extensive experiments, we demonstrate that our method outperforms the current state-of-the-art on various benchmark datasets. Moreover, our method can be used as an add-on for existing long-tail learning approaches, significantly enhancing their OOD detection performance. Code is available at: https://github.com/Stomach-ache/Long-Tailed-OOD-Detection .


title: A Decomposition Method for the Hybrid Quantum-Classical Solution of the Number Partitioning Problem

abstract: Current quantum computers can only solve optimization problems of a very limited size. For larger problems, decomposition methods are required in which the original problem is broken down into several smaller sub-problems. These are then solved on the quantum computer and their solutions are merged into a final solution for the original problem. Often, these decomposition methods do not take the specific problem structure into account. In this paper, we present a tailored method using a divide-and-conquer strategy to solve the number partitioning problem (NPP) with a large number of variables. The idea is to perform a specialized decomposition into smaller NPPs, which can be solved on a quantum computer, and then recombine the results into another small auxiliary NPP. Solving this auxiliary problem yields an approximate solution of the original larger problem. We experimentally verify that our method allows to solve NPPs with over a thousand variables using a D-Wave quantum annealer.


title: Boundedness of commutators for multilinear Calder\'{o}n-Zygmund operators on Generalized Morrey Spaces

abstract: Let $T$ be a $m$-linear Calder\'{o}n-Zygmund operator of type $\omega$ with $\omega$ being nondecreasing and $\omega \in$ Dini(1) and $[\vec{b},\,T]$ be the commutator generated by $T$ with symbols $\vec{b}=(b_1,\,\ldots,\,b_m)$ belonging to generalized Campanato spaces. We give necessary and sufficient conditions for the boundedness of $[\vec{b},\,T]$ on generalized Morrey spaces with variable growth condition.


title: Electron-correlation induced nonclassicallity of light from high-harmonic generation

abstract: We study the effect of electron-electron correlations on the quantum state of the light emitted from high-harmonic generation (HHG). The quantum state of the emitted light is obtained by using a fully quantum mechanical description of both the optical modes as well as the electronic system. This is different from the usual semiclassical description of HHG, which only treats the electronic target system quantum mechanically. Using the generic Fermi-Hubbard model, the strength of the electron-electron correlation can be treated as a parameter enabling us to investigate the two limiting cases of a completely uncorrelated phase and a correlated Mott-insulating phase. In the completely uncorrelated phase, the model reduces to a single-band tight-binding model in which only intraband currents contribute to the spectrum. In this limit, we analytically find that the emitted light is in a classical coherent state. In the Mott-insulating phase, a consideration of the photon statistics and squeezing of the emitted photonic state shows that the inter-Hubbard-subband current generates nonclassical light. In this sense, we show that electron-electron correlation can induce the generation of nonclassical states of light.


title: Revisiting RXTE observations of MXB 0656-072 during the type I outbursts in 2007-2008

abstract: We report on the timing characteristics of MXB 0656-072 throughout its 2007-2008 type I outbursts utilising RXTE/PCA and Fermi/GBM data. Using pulse timing technique, we explore the spin frequency evolution of the source during this interval. Subsequently, by examining the torque-luminosity relation, we show that the overall frequency evolution is substantially in line with the Ghosh-Lamb model. Furthermore, the residuals of the spin frequencies do not exhibit clear orbital modulations, which possibly indicate that the system is observed on a relatively top view. In the RXTE/PCA observations, the pulsed emission is found to be disappearing below $\sim$$5 \times 10^{36}$ erg s$^{-1}$, whereas the profiles maintain stability above this value within our analysis timeframe. In addition, we incorporate two novel methods along with the conventional Deeter method in order to generate higher-resolution power density spectra (PDS). A red noise pattern in the PDSs is also verified in these new methods, common in disk-fed sources, with a steepness of $\Gamma \sim -2$, reaching saturation at a time-scale of $\sim$150 d. Considering the models for spectral transitions, we discuss the possible scenarios for the dipolar magnetic field strength of MXB 0656-072 and its coherence with deductions from the cyclotron resonance scattering feature (CRSF).


title: What's Next? Predicting Hamiltonian Dynamics from Discrete Observations of a Vector Field

abstract: We present several methods for predicting the dynamics of Hamiltonian systems from discrete observations of their vector field. Each method is either informed or uninformed of the Hamiltonian property. We empirically and comparatively evaluate the methods and observe that information that the system is Hamiltonian can be effectively informed, and that different methods strike different trade-offs between efficiency and effectiveness for different dynamical systems.


title: A Comparative Gas Cost Analysis of Proxy and Diamond Patterns in EVM Blockchains for Trusted Smart Contract Engineering

abstract: Blockchain applications are witnessing rapid evolution, necessitating the integration of upgradeable smart contracts. Software patterns have been proposed to summarize upgradeable smart contract best practices. However, research is missing on the comparison of these upgradeable smart contract patterns, especially regarding gas costs related to deployment and execution. This study aims to provide an in-depth analysis of gas costs associated with two prevalent upgradeable smart contract patterns: the Proxy and diamond patterns. The Proxy pattern utilizes a Proxy pointing to a logic contract, while the diamond pattern enables a Proxy to point to multiple logic contracts. We conduct a comparative analysis of gas costs for both patterns in contrast to a traditional non-upgradeable smart contract. We derive from this analysis a theoretical contribution in the form of two consolidated blockchain patterns and a corresponding decision model. By so doing we hope to contribute to the broader understanding of upgradeable smart contract patterns.


title: Color Agnostic Cross-Spectral Disparity Estimation

abstract: Since camera modules become more and more affordable, multispectral camera arrays have found their way from special applications to the mass market, e.g., in automotive systems, smartphones, or drones. Due to multiple modalities, the registration of different viewpoints and the required cross-spectral disparity estimation is up to the present extremely challenging. To overcome this problem, we introduce a novel spectral image synthesis in combination with a color agnostic transform. Thus, any recently published stereo matching network can be turned to a cross-spectral disparity estimator. Our novel algorithm requires only RGB stereo data to train a cross-spectral disparity estimator and a generalization from artificial training data to camera-captured images is obtained. The theoretical examination of the novel color agnostic method is completed by an extensive evaluation compared to state of the art including self-recorded multispectral data and a reference implementation. The novel color agnostic disparity estimation improves cross-spectral as well as conventional color stereo matching by reducing the average end-point error by 41% for cross-spectral and by 22% for mono-modal content, respectively.


title: EWOCS-I: The catalog of X-ray sources in Westerlund 1 from the Extended Westerlund 1 and 2 Open Clusters Survey

abstract: Context. With a mass exceeding several 10^4 solar masses and a rich and dense population of massive stars, supermassive young star clusters represent the most massive star-forming environment that is dominated by the feedback from massive stars and gravitational interactions among stars. Aims. In this paper we present the "Extended Westerlund 1 and 2 Open Clusters Survey" (EWOCS) project, which aims to investigate the influence of the starburst environment on the formation of stars and planets, and on the evolution of both low and high mass stars. The primary targets of this project are Westerlund 1 and 2, the closest supermassive star clusters to the Sun. Methods. The project is based primarily on recent observations conducted with the Chandra and JWST observatories. Specifically, the Chandra survey of Westerlund 1 consists of 36 new ACIS-I observations, nearly co-pointed, for a total exposure time of 1 Msec. Additionally, we included 8 archival Chandra/ACIS-S observations. This paper presents the resulting catalog of X-ray sources within and around Westerlund 1. Sources were detected by combining various existing methods, and photon extraction and source validation were carried out using the ACIS-Extract software. Results. The EWOCS X-ray catalog comprises 5963 validated sources out of the 9420 initially provided to ACIS-Extract, reaching a photon flux threshold of approximately 2x10^-8 photons/cm^2/s. The X-ray sources exhibit a highly concentrated spatial distribution, with 1075 sources located within the central 1 arcminute. We have successfully detected X-ray emissions from 126 out of the 166 known massive stars of the cluster, and we have collected over 71000 photons from the magnetar CXO J164710.20-455217


title: LSTM Network Analysis of Vehicle-Type Fatalities on Great Britain's Roads

abstract: This study harnesses the predictive capabilities of Long Short-Term Memory (LSTM) networks to analyse and predict road traffic accidents in Great Britain. It addresses the challenge of traffic accident forecasting, which is paramount for devising effective preventive measures. We utilised an extensive dataset encompassing reported collisions, casualties, and vehicles involvements from 1926 to 2022, provided by the Department for Transport (DfT). The data underwent stringent processing to rectify missing values and normalise features, ensuring robust LSTM network input.


title: A Guided Upsampling Network for Short Wave Infrared Images Using Graph Regularization

abstract: Exploiting the infrared area of the spectrum for classification problems is getting increasingly popular, because many materials have characteristic absorption bands in this area. However, sensors in the short wave infrared (SWIR) area and even higher wavelengths have a very low spatial resolution in comparison to classical cameras that operate in the visible wavelength area. Thus, in this paper an upsampling method for SWIR images guided by a visible image is presented. For that, the proposed guided upsampling network (GUNet) uses a graph-regularized optimization problem based on learned affinities is presented. The evaluation is based on a novel synthetic near-field visible-SWIR stereo database. Different guided upsampling methods are evaluated, which shows an improvement of nearly 1 dB on this database for the proposed upsampling method in comparison to the second best guided upsampling network. Furthermore, a visual example of an upsampled SWIR image of a real-world scene is depicted for showing real-world applicability.


title: Detecting Active Attacks in Over-the-Air Computation using Dummy Samples

abstract: Over-the-Air (OtA) computation is a newly emerged concept for computing functions of data from distributed nodes by taking advantage of the wave superposition property of wireless channels. Despite its advantage in communication efficiency, OtA computation is associated with significant security and privacy concerns that have so far not been thoroughly investigated, especially in the case of active attacks. In this paper, we propose and evaluate a detection scheme against active attacks in OtA computation systems. More explicitly, we consider an active attacker which is an external node sending random or misleading data to alter the aggregated data received by the server. To detect the presence of the attacker, in every communication period, legitimate users send some dummy samples in addition to the real data. We propose a detector design that relies on the existence of a shared secret only known by the legitimate users and the server, that can be used to hide the transmitted signal in a secret subspace. After the server projects the received vector back to the original subspace, the dummy samples can be used to detect active attacks. We show that this design achieves good detection performance for a small cost in terms of channel resources.


title: Multi-Scene Generalized Trajectory Global Graph Solver with Composite Nodes for Multiple Object Tracking

abstract: The global multi-object tracking (MOT) system can consider interaction, occlusion, and other ``visual blur'' scenarios to ensure effective object tracking in long videos. Among them, graph-based tracking-by-detection paradigms achieve surprising performance. However, their fully-connected nature poses storage space requirements that challenge algorithm handling long videos. Currently, commonly used methods are still generated trajectories by building one-forward associations across frames. Such matches produced under the guidance of first-order similarity information may not be optimal from a longer-time perspective. Moreover, they often lack an end-to-end scheme for correcting mismatches. This paper proposes the Composite Node Message Passing Network (CoNo-Link), a multi-scene generalized framework for modeling ultra-long frames information for association. CoNo-Link's solution is a low-storage overhead method for building constrained connected graphs. In addition to the previous method of treating objects as nodes, the network innovatively treats object trajectories as nodes for information interaction, improving the graph neural network's feature representation capability. Specifically, we formulate the graph-building problem as a top-k selection task for some reliable objects or trajectories. Our model can learn better predictions on longer-time scales by adding composite nodes. As a result, our method outperforms the state-of-the-art in several commonly used datasets.


title: UCMCTrack: Multi-Object Tracking with Uniform Camera Motion Compensation

abstract: Multi-object tracking (MOT) in video sequences remains a challenging task, especially in scenarios with significant camera movements. This is because targets can drift considerably on the image plane, leading to erroneous tracking outcomes. Addressing such challenges typically requires supplementary appearance cues or Camera Motion Compensation (CMC). While these strategies are effective, they also introduce a considerable computational burden, posing challenges for real-time MOT. In response to this, we introduce UCMCTrack, a novel motion model-based tracker robust to camera movements. Unlike conventional CMC that computes compensation parameters frame-by-frame, UCMCTrack consistently applies the same compensation parameters throughout a video sequence. It employs a Kalman filter on the ground plane and introduces the Mapped Mahalanobis Distance (MMD) as an alternative to the traditional Intersection over Union (IoU) distance measure. By leveraging projected probability distributions on the ground plane, our approach efficiently captures motion patterns and adeptly manages uncertainties introduced by homography projections. Remarkably, UCMCTrack, relying solely on motion cues, achieves state-of-the-art performance across a variety of challenging datasets, including MOT17, MOT20, DanceTrack and KITTI. More details and code are available at https://github.com/corfyi/UCMCTrack


title: Single and Multi-Objective Optimization Benchmark Problems Focusing on Human-Powered Aircraft Design

abstract: This paper introduces a novel set of benchmark problems aimed at advancing research in both single and multi-objective optimization, with a specific focus on the design of human-powered aircraft. These benchmark problems are unique in that they incorporate real-world design considerations such as fluid dynamics and material mechanics, providing a more realistic simulation of engineering design optimization. We propose three difficulty levels and a wing segmentation parameter in these problems, allowing for scalable complexity to suit various research needs. The problems are designed to be computationally reasonable, ensuring short evaluation times, while still capturing the moderate multimodality of engineering design problems. Our extensive experiments using popular evolutionary algorithms for multi-objective problems demonstrate that the proposed benchmarks effectively replicate the diverse Pareto front shapes observed in real-world problems, including convex, linear, concave, and inverted triangular forms. The benchmark problems' source codes are publicly available for wider application in the optimization research community.


title: Quadratic Isoperimetric Inequality for Mapping Tori of Hyperbolic Groups

abstract: In this paper, we establish that the mapping torus of a one-ended torsion-free hyperbolic group exhibits a quadratic isoperimetric inequality.


title: Boundary value problems for adjoint pairs of operators

abstract: The notion of quasi boundary triples and their Weyl functions from extension theory of symmetric operators is extended to the general framework of adjoint pairs of operators under minimal conditions on the boundary maps. With the help of the corresponding abstract Titchmarsh-Weyl $M$-functions sufficient conditions for the unique solvability of the related boundary value problems are obtained and the solutions are expressed via Krein-type resolvent formulae. The abstract theory developed in this manuscript can be applied to a large class of elliptic differential operators.


title: A multi-pulse wakeup scheme for on-chip operation of devices based on ferroelectric doped HfO2 thin films

abstract: A wakeup scheme for ferroelectric thin Hf$_{0.5}$Zr$_{0.5}$O$_2$ films is presented, based on a gradual switching approach using multiple short pulses with a voltage amplitude roughly equal to the coercive voltage. This enables the on-chip wakeup and switching operation of ferroelectric devices such as tunnel junctions (FTJs) with identical pulses. After wakeup using alternating pulse trains which gradually switch the film polarization, FTJ operation is demonstrated to be as effective as after `normal' wakeup, with bipolar pulses of an amplitude larger than the coercive voltage. In this case the voltage applied during wakeup was reduced by 26\%, thereby lowering the required operating power.


title: Acceptance and Trust: Drivers' First Contact with Released Automated Vehicles in Naturalistic Traffic

abstract: This study investigates the impact of initial contact of drivers with an SAE Level 3 Automated Driving System (ADS) under real traffic conditions, focusing on the Mercedes-Benz Drive Pilot in the EQS. It examines Acceptance, Trust, Usability, and User Experience. Although previous studies in simulated environments provided insights into human-automation interaction, real-world experiences can differ significantly. The research was conducted on a segment of German interstate with 30 participants lacking familiarity with Level 3 ADS. Pre- and post-driving questionnaires were used to assess changes in acceptance and confidence. Supplementary metrics included post-driving ratings for usability and user experience. Findings reveal a significant increase in acceptance and trust following the first contact, confirming results from prior simulator studies. Factors such as Performance Expectancy, Effort Expectancy, Facilitating Condition, Self-Efficacy, and Behavioral Intention to use the vehicle were rated higher after initial contact with the ADS. However, inadequate communication from the ADS to the human driver was detected, highlighting the need for improved communication to prevent misuse or confusion about the operating mode. Contrary to prior research, we found no significant impact of general attitudes towards technological innovation on acceptance and trust. However, it's worth noting that most participants already had a high affinity for technology. Although overall reception was positive and showed an upward trend post first contact, the ADS was also perceived as demanding as manual driving. Future research should focus on a more diverse participant sample and include longer or multiple real-traffic trips to understand behavioral adaptations over time.


title: LiFT: Unsupervised Reinforcement Learning with Foundation Models as Teachers

abstract: We propose a framework that leverages foundation models as teachers, guiding a reinforcement learning agent to acquire semantically meaningful behavior without human feedback. In our framework, the agent receives task instructions grounded in a training environment from large language models. Then, a vision-language model guides the agent in learning the multi-task language-conditioned policy by providing reward feedback. We demonstrate that our method can learn semantically meaningful skills in a challenging open-ended MineDojo environment while prior unsupervised skill discovery methods struggle. Additionally, we discuss observed challenges of using off-the-shelf foundation models as teachers and our efforts to address them.


title: The kinematics of massive high-redshift dusty star-forming galaxies

abstract: We present a new method for modelling the kinematics of galaxies from interferometric observations by performing the optimization of the kinematic model parameters directly in visibility-space instead of the conventional approach of fitting velocity fields produced with the CLEAN algorithm in real-space. We demonstrate our method on ALMA observations of $^{12}$CO (2$-$1), (3$-$2) or (4$-$3) emission lines from an initial sample of 30 massive 850$\mu$m-selected dusty star-forming galaxies with far-infrared luminosities $\gtrsim$$\,10^{12}\,$L$_{\odot}$ in the redshift range $z \sim\,$1.2$-$4.7. Using the results from our modelling analysis for the 12 sources with the highest signal-to-noise emission lines and disk-like kinematics, we conclude the following: (i) Our sample prefers a CO-to-$H_2$ conversion factor, of $\alpha_{\rm CO} = 0.92 \pm 0.36$; (ii) These far-infrared luminous galaxies follow a similar Tully$-$Fisher relation between the circularized velocity, $V_{\rm circ}$, and baryonic mass, $M_{\rm b}$, as more typical star-forming samples at high redshift, but extend this relation to much higher masses $-$ showing that these are some of the most massive disk-like galaxies in the Universe; (iii) Finally, we demonstrate support for an evolutionary link between massive high-redshift dusty star-forming galaxies and the formation of local early-type galaxies using the both the distributions of the baryonic and kinematic masses of these two populations on the $M_{\rm b}\,-\,\sigma$ plane and their relative space densities.


title: DenRAM: Neuromorphic Dendritic Architecture with RRAM for Efficient Temporal Processing with Delays

abstract: An increasing number of neuroscience studies are highlighting the importance of spatial dendritic branching in pyramidal neurons in the brain for supporting non-linear computation through localized synaptic integration. In particular, dendritic branches play a key role in temporal signal processing and feature detection, using coincidence detection (CD) mechanisms, made possible by the presence of synaptic delays that align temporally disparate inputs for effective integration. Computational studies on spiking neural networks further highlight the significance of delays for CD operations, enabling spatio-temporal pattern recognition within feed-forward neural networks without the need for recurrent architectures. In this work, we present DenRAM, the first realization of a spiking neural network with analog dendritic circuits, integrated into a 130nm technology node coupled with resistive memory (RRAM) technology. DenRAM's dendritic circuits use the RRAM devices to implement both delays and synaptic weights in the network. By configuring the RRAM devices to reproduce bio-realistic timescales, and through exploiting their heterogeneity, we experimentally demonstrate DenRAM's capability to replicate synaptic delay profiles, and efficiently implement CD for spatio-temporal pattern recognition. To validate the architecture, we conduct comprehensive system-level simulations on two representative temporal benchmarks, highlighting DenRAM's resilience to analog hardware noise, and its superior accuracy compared to recurrent architectures with an equivalent number of parameters. DenRAM not only brings rich temporal processing capabilities to neuromorphic architectures, but also reduces the memory footprint of edge devices, provides high accuracy on temporal benchmarks, and represents a significant step-forward in low-power real-time signal processing technologies.


title: Contact-Implicit MPC: Controlling Diverse Quadruped Motions Without Pre-Planned Contact Modes or Trajectories

abstract: This paper presents a contact-implicit model predictive control (MPC) framework for the real-time discovery of multi-contact motions, without predefined contact mode sequences or foothold positions. This approach utilizes the contact-implicit differential dynamic programming (DDP) framework, merging the hard contact model with a linear complementarity constraint. We propose the analytical gradient of the contact impulse based on relaxed complementarity constraints to further the exploration of a variety of contact modes. By leveraging a hard contact model-based simulation and computation of search direction through a smooth gradient, our methodology identifies dynamically feasible state trajectories, control inputs, and contact forces while simultaneously unveiling new contact mode sequences. However, the broadened scope of contact modes does not always ensure real-world applicability. Recognizing this, we implemented differentiable cost terms to guide foot trajectories and make gait patterns. Furthermore, to address the challenge of unstable initial roll-outs in an MPC setting, we employ the multiple shooting variant of DDP. The efficacy of the proposed framework is validated through simulations and real-world demonstrations using a 45 kg HOUND quadruped robot, performing various tasks in simulation and showcasing actual experiments involving a forward trot and a front-leg rearing motion.


title: Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Models

abstract: We introduce a Depicted image Quality Assessment method (DepictQA), overcoming the constraints of traditional score-based methods. DepictQA allows for detailed, language-based, human-like evaluation of image quality by leveraging Multi-modal Large Language Models (MLLMs). Unlike conventional Image Quality Assessment (IQA) methods relying on scores, DepictQA interprets image content and distortions descriptively and comparatively, aligning closely with humans' reasoning process. To build the DepictQA model, we establish a hierarchical task framework, and collect a multi-modal IQA training dataset. To tackle the challenges of limited training data and multi-image processing, we propose to use multi-source training data and specialized image tags. These designs result in a better performance of DepictQA than score-based approaches on multiple benchmarks. Moreover, compared with general MLLMs, DepictQA can generate more accurate reasoning descriptive languages. Our work demonstrates the utility of our full-reference dataset in non-reference applications, and indicates that language-based IQA methods have the potential to be customized for individual preferences.


title: LEMON: Learning 3D Human-Object Interaction Relation from 2D Images

abstract: Learning 3D human-object interaction relation is pivotal to embodied AI and interaction modeling. Most existing methods approach the goal by learning to predict isolated interaction elements, e.g., human contact, object affordance, and human-object spatial relation, primarily from the perspective of either the human or the object. Which underexploit certain correlations between the interaction counterparts (human and object), and struggle to address the uncertainty in interactions. Actually, objects' functionalities potentially affect humans' interaction intentions, which reveals what the interaction is. Meanwhile, the interacting humans and objects exhibit matching geometric structures, which presents how to interact. In light of this, we propose harnessing these inherent correlations between interaction counterparts to mitigate the uncertainty and jointly anticipate the above interaction elements in 3D space. To achieve this, we present LEMON (LEarning 3D huMan-Object iNteraction relation), a unified model that mines interaction intentions of the counterparts and employs curvatures to guide the extraction of geometric correlations, combining them to anticipate the interaction elements. Besides, the 3D Interaction Relation dataset (3DIR) is collected to serve as the test bed for training and evaluation. Extensive experiments demonstrate the superiority of LEMON over methods estimating each element in isolation.


title: Layer topology of smectic grain boundaries

abstract: Grain boundaries in extremely confined colloidal smectics possess a topological fine structure with coexisting nematic and tetratic symmetry of the director field. An alternative way to approach the problem of smectic topology is via the layer structure, which is typically more accessible in experiments on molecular liquid crystals. Here, we consider exemplary density functional theory results for two-dimensional hard rods to illustrate how the concept of endpoint defects, which appear as tetratic disclinations of quarter charge in director topology, translates to smectic layer topology built around the networks formed by density maxima and minima. By doing so, we elaborate on further advantages of a topological concept evolving around the layer structure rather than the director field, such as providing insight in the structure of edge dislocations or virtual defects at the confining walls.


title: Ghostbuster: a phase retrieval diffraction tomography algorithm for cryo-EM

abstract: Ewald sphere curvature correction, which extends beyond the projection approximation, stretches the shallow depth of field in cryo-EM reconstructions of thick particles. Here we show that even for previously assumed thin particles, reconstruction artifacts which we refer to as ghosts can appear. By retrieving the lost phases of the electron exitwaves and accounting for the first Born approximation scattering within the particle, we show that these ghosts can be effectively eliminated. Our simulations demonstrate how such ghostbusting can improve reconstructions as compared to existing state-of-the-art software. Like ptychographic cryo-EM, our Ghostbuster algorithm uses phase retrieval to improve reconstructions, but unlike the former, we do not need to modify the existing data acquisition pipelines.


title: Noctilucent Clouds Altitude and Particle Size Mapping Based on Spread Observations by Ground-based All-sky Cameras

abstract: We suggest the procedure of building the maps of noctilucent clouds (NLC) zonal and meridional velocity, mean altitude and particle size based on three-color photometry by identical all-sky RGB-cameras separated by 115 km in a close-meridional direction. The procedure is applied to the bright NLC event on July 3, 2023. The altitude is measured by precise triangulation technique, and effective particle radius is estimated by comparison of each definite NLC fragment intensity and colors at different scattering angles as it is registered from different observation sites. The results are compared with existing photometric methods for average altitude and particle size measurements. A significant difference in evening and morning twilight NLC parameters is found, which is discussed in comparison with existing analysis of diurnal NLC variations.


title: Strongly Coupled Spins of Silicon-Vacancy Centers Inside a Nanodiamond with Sub-Megahertz Linewidth

abstract: The search for long-lived quantum memories, which can be efficiently interfaced with flying qubits is longstanding. One possible solution is to use the electron spin of a color center in diamond to mediate interaction between a long-lived nuclear spin and a photon. Realizing this in a nanodiamond furthermore facilitates the integration into photonic devices and enables the realization of hybrid quantum systems with access to quantum memories. Here, we investigated the spin environment of negatively-charged Silicon-Vacancy centers in a nanodiamond and demonstrate strong coupling of its electron spin, while the electron spin's decoherence rate remained below 1 MHz. We furthermore demonstrate multi-spin coupling with the potential to establish registers of quantum memories in nanodiamonds.


title: Detecting value-expressive text posts in Russian social media

abstract: Basic values are concepts or beliefs which pertain to desirable end-states and transcend specific situations. Studying personal values in social media can illuminate how and why societal values evolve especially when the stimuli-based methods, such as surveys, are inefficient, for instance, in hard-to-reach populations. On the other hand, user-generated content is driven by the massive use of stereotyped, culturally defined speech constructions rather than authentic expressions of personal values. We aimed to find a model that can accurately detect value-expressive posts in Russian social media VKontakte. A training dataset of 5,035 posts was annotated by three experts, 304 crowd-workers and ChatGPT. Crowd-workers and experts showed only moderate agreement in categorizing posts. ChatGPT was more consistent but struggled with spam detection. We applied an ensemble of human- and AI-assisted annotation involving active learning approach, subsequently trained several LLMs and selected a model based on embeddings from pre-trained fine-tuned rubert-tiny2, and reached a high quality of value detection with F1 = 0.75 (F1-macro = 0.80). This model provides a crucial step to a study of values within and between Russian social media users.


title: Dark breathers on a snoidal wave background in the defocusing MKDV equation

abstract: We present a new exact solution to the defocusing modified Korteweg-de Vries equation to describe the interaction of a dark soliton and a traveling periodic wave. The solution (which we refer to as to the dark breather) is obtained by using the Darboux transformation with the eigenfunctions of the Lax system expressed in terms of the Jacobi theta functions. Properties of elliptic functions including the quarter-period translations in the complex plane are applied to transform the solution to the simplest form. We explore the characteristic properties of these dark breathers and show that they propagate faster than the periodic wave (in the same direction) and attain maximal localization at a specific parameter value which is explicitly computed.

categories: nlin.SI math-ph math.AP math.DS math.MP nlin.PS


title: Search for strongly interacting dark matter at Belle II

abstract: A small component of dark matter (DM) that is strongly interacting with the standard model sector is consistent with various experimental observations. Despite the small abundance, strongly-interacting DM can lead to pronounced signals in DM direct detection experiments. We study Belle II sensitivity on strongly-interacting DM that has a MeV-GeV mass and couples with electrons. By taking into account the substantial interactions between DM and electrons within detectors, we compute the ``ceiling'' of the mono-photon signature at Belle II, beyond which the mono-photon channel loses its sensitivity, and visible ECL clusters due to DM scatterings assume significance. We study two ECL signatures for strongly-interacting DM: the mono-cluster and the di-cluster channels. To carry out detailed calculations and to compare with other constraints, we consider DM models with light mediators, as they naturally lead to sizable interaction cross sections. We compute exclusion regions for the di-cluster, mono-cluster, and mono-photon channels. We find that Belle II (with currently accumulated data of 362 fb$^{-1}$) can rule out a significant portion of the parameter space above the ceilings of the constraints from various DM direct detection and neutrino experiments, for the vector mediator case with mass $\gtrsim 10$ MeV. Belle II also offers superior constraints on new light particles compared to PBH for the scalar mediator with mass $\gtrsim 10$ MeV.


title: Stability of Axion-Dilaton Wormholes

abstract: We study the perturbative stability of Euclidean axion-dilaton wormholes that asymptotically approach flat space, both with a massless and a massive dilaton, and focussing on homogeneous perturbations. We find massless wormholes to always be perturbatively stable. The phenomenologically more relevant case of a massive dilaton presents us with a wide variety of wormhole solutions, depending on the dilaton coupling and mass, and on the axion charge. We find that the solutions with the smallest dilaton potential are perturbatively stable and dominant, even in cases where the wormhole solutions are not continuously connected to the massless case by decreasing the mass. For branches of solutions emanating from a bifurcation point, one side of the branch always contains a negative mode in its spectrum, rendering such solutions unstable. The existence of classes of perturbatively stable wormhole solutions with massive dilaton sharpens the puzzles associated with Euclidean wormholes.


title: Hutch++ and XTrace to Improve Stochastic Trace Estimation

abstract: We present the analysis of two recently proposed noise reduction techniques, Hutch++ and XTrace, both based on inexact deflation. These methods were proven to have a better asymptotic convergence to the solution than the classical Girard-Hutchinson stochastic method. We applied these methods to the computation of the trace of the inverse of the Dirac operator with $O(a)$ improved Wilson fermions on the QCD ensemble generated by the RC$^{\star}$ collaboration with $m_{\pi}\approx 400$ MeV and $V = 64\times 32^3$. Unfortunately, we see no noise reduction with a moderate number of sources, and we attempt an explanation of why this is the case. This study was part of the effort to evaluate isospin-breaking effects using the RM123 with C$^{\star}$ boundary conditions in an unquenched set-up.


title: Control of the damage threshold of Si via a SiO2 coating upon irradiation with Mid-IR femtosecond laser pulses

abstract: A key issue in the use of high-power mid-infrared (Mid-IR) laser sources for a plethora of applications is the investigation of the exciting laser driven physical phenomena taking place in materials coated with dielectric films. Here, we present a theoretical investigation of the ultrafast processes and thermal response upon excitation of two-layered complexes consisting of fused silica thin films placed on silicon substrates with ultrashort pulsed lasers in the Mid-IR spectral regime. Through the development of a theoretical model, we demonstrate that the control of the underlying ultrafast phenomena and the damage threshold (DT) of the substrate are achieved via an appropriate modulation of the thickness of the SiO2 film. It is shown that a decrease of DT by up to 27% compared to the absence of coating is feasible emphasising the impact of coatings of a lower refractive index than the substrate. Besides this, it is demonstrated that no absorption of energy occurs within the SiO2 layer, therefore the dynamics of the reflectivity of the two-layered complex is directly associated with the electron excitation in the substrate. These remarkable predictions can be employed for the development of new optical coatings and components for nonlinear optics and photonics for a large range of Mid-IR laser-based applications.

categories: physics.optics cond-mat.mtrl-sci physics.app-ph physics.comp-ph


title: Multifractal analysis via Lagrange duality

abstract: We provide a self-contained exposition of the well-known multifractal formalism for self-similar measures satisfying the strong separation condition. At the heart of our method lies a pair of quasiconvex optimization problems which encode the parametric geometry of the Lagrange dual associated with the constrained variational principle. We also give a direct derivation of the Hausdorff dimension of the level sets of the upper and lower local dimensions by exploiting certain weak uniformity properties of the space of Bernoulli measures.


title: On Mask-based Image Set Desensitization with Recognition Support

abstract: In recent years, Deep Neural Networks (DNN) have emerged as a practical method for image recognition. The raw data, which contain sensitive information, are generally exploited within the training process. However, when the training process is outsourced to a third-party organization, the raw data should be desensitized before being transferred to protect sensitive information. Although masks are widely applied to hide important sensitive information, preventing inpainting masked images is critical, which may restore the sensitive information. The corresponding models should be adjusted for the masked images to reduce the degradation of the performance for recognition or classification tasks due to the desensitization of images. In this paper, we propose a mask-based image desensitization approach while supporting recognition. This approach consists of a mask generation algorithm and a model adjustment method. We propose exploiting an interpretation algorithm to maintain critical information for the recognition task in the mask generation algorithm. In addition, we propose a feature selection masknet as the model adjustment method to improve the performance based on the masked images. Extensive experimentation results based on multiple image datasets reveal significant advantages (up to 9.34% in terms of accuracy) of our approach for image desensitization while supporting recognition.


title: Dynamic Retrieval-Augmented Generation

abstract: Current state-of-the-art large language models are effective in generating high-quality text and encapsulating a broad spectrum of world knowledge. These models, however, often hallucinate and lack locally relevant factual data. Retrieval-augmented approaches were introduced to overcome these problems and provide more accurate responses. Typically, the retrieved information is simply appended to the main request, restricting the context window size of the model. We propose a novel approach for the Dynamic Retrieval-Augmented Generation (DRAG), based on the entity-augmented generation, which injects compressed embeddings of the retrieved entities into the generative model. The proposed pipeline was developed for code-generation tasks, yet can be transferred to some domains of natural language processing. To train the model, we collect and publish a new project-level code generation dataset. We use it for the evaluation along with publicly available datasets. Our approach achieves several targets: (1) lifting the length limitations of the context window, saving on the prompt size; (2) allowing huge expansion of the number of retrieval entities available for the context; (3) alleviating the problem of misspelling or failing to find relevant entity names. This allows the model to beat all baselines (except GPT-3.5) with a strong margin.


title: Weighted Ensemble Models Are Strong Continual Learners

abstract: In this work, we study the problem of continual learning (CL) where the goal is to learn a model on a sequence of tasks, such that the data from the previous tasks becomes unavailable while learning on the current task data. CL is essentially a balancing act between being able to learn on the new task (i.e., plasticity) and maintaining the performance on the previously learned concepts (i.e., stability). Intending to address the stability-plasticity trade-off, we propose to perform weight-ensembling of the model parameters of the previous and current tasks. This weighted-ensembled model, which we call Continual Model Averaging (or CoMA), attains high accuracy on the current task by leveraging plasticity, while not deviating too far from the previous weight configuration, ensuring stability. We also propose an improved variant of CoMA, named Continual Fisher-weighted Model Averaging (or CoFiMA), that selectively weighs each parameter in the weights ensemble by leveraging the Fisher information of the weights of the model. Both variants are conceptually simple, easy to implement, and effective in attaining state-of-the-art performance on several standard CL benchmarks. Code is available at: https://github.com/IemProg/CoFiMA.


title: On the Uplink and Downlink EMF Exposure and Coverage in Dense Cellular Networks: A Stochastic Geometry Approach

abstract: Existing studies analyzing electromagnetic field (EMFE) in wireless networks have primarily considered downlink communications. In the uplink, the EMFE caused by the user's smartphone is usually the only considered source of radiation, thereby ignoring contributions caused by other active neighboring devices. In addition, the network coverage and EMFE are typically analyzed independently for both the uplink and downlink, while a joint analysis would be necessary to fully understand the network performance and answer various questions related to optimal network deployment. This paper bridges these gaps by presenting an enhanced stochastic geometry framework that includes the above aspects. The proposed topology features base stations modeled via a homogeneous Poisson point process. The users active during a same time slot are distributed according to a mixture of a Mat\'ern cluster process and a Gauss-Poisson process, featuring groups of users possibly carrying several equipments. In this paper, we derive the marginal and meta distributions of the downlink and uplink EMFE and we characterize the uplink to downlink EMFE ratio. Moreover, we derive joint probability metrics considering the uplink and downlink coverage and EMFE. These metrics are evaluated in four scenarios considering BS, cluster and/or intracluster densifications. Our numerical results highlight the existence of optimal node densities maximizing these joint probabilities.


title: Multi-CMGAN+/+: Leveraging Multi-Objective Speech Quality Metric Prediction for Speech Enhancement

abstract: Neural network based approaches to speech enhancement have shown to be particularly powerful, being able to leverage a data-driven approach to result in a significant performance gain versus other approaches. Such approaches are reliant on artificially created labelled training data such that the neural model can be trained using intrusive loss functions which compare the output of the model with clean reference speech. Performance of such systems when enhancing real-world audio often suffers relative to their performance on simulated test data. In this work, a non-intrusive multi-metric prediction approach is introduced, wherein a model trained on artificial labelled data using inference of an adversarially trained metric prediction neural network. The proposed approach shows improved performance versus state-of-the-art systems on the recent CHiME-7 challenge \ac{UDASE} task evaluation sets.


title: Random Problems in Mathematical Physics

abstract: This PhD thesis deals with a number of different problems in mathematical physics with the common thread that they have probabilistic aspects. The problems all stem from mathematical studies of lattice systems in statistical and quantum physics; however beyond that, the selection of the concrete problems is to a certain extent arbitrary. This thesis consists of an introduction and seven papers.


title: Matching Noisy Keys for Obfuscation

abstract: Data sketching has emerged as a key infrastructure for large-scale data analysis on streaming and distributed data. Merging sketches enables efficient estimation of cardinalities and frequency histograms over distributed data. However, merging sketches can require that each sketch stores hash codes for identifiers in different data sets or partitions, in order to perform effective matching. This can reveal identifiers during merging or across different data set or partition owners. This paper presents a framework to use noisy hash codes, with the noise level selected to obfuscate identifiers while allowing matching, with high probability. We give probabilistic error bounds on simultaneous obfuscation and matching, concluding that this is a viable approach.


title: Macro-flickering of AQ Mensae on the daily time-scales: Parameters and quasi-period modes

abstract: We analyzed TESS photometric data of the flickering-active cataclysmic star AQ Men in 2018--2019. We processed 7 sectors with 14 light curves (LCs) inside them, with a time resolution of 2 min. Aiming to study the "macro-flickering", with quasi periods (QPs) between 10 and 100 hours, we processed LCs after 55 time reduced, with a time resolution of 1.83 hours. The method, developed earlier by us, includes comparing the LCs by their statistical and fractal parameters, as well as revealing QPs by minima of structure functions and relevant maxima of autocorrelation functions. We distinguish the known high state of AQ Men, in the sectors ## 01, 05, 08, 12, 13, as well as the low state, in sectors #19, #20. In the low state the LCs show noticeable eclipses with period 3.4 h, lower average fluxes, higher scatters, and additional QPs. By its statistical and fractal parameters, the macro-flickering of AQ Men in the high state is similar to the ordinary flickering of 3 symbiotic binaries, studied by us earlier (see below). We found 92 QPs in the range of 20--70 h. We reveal 3 QP modes, at 20.9 h, 32.5 h and 54.1 h (1.149, 0.738 and 0.434 c/d; Fig. 7) within a standard error about 10%. The last mode is the most populated one and seems to be a manifestation of the superorbital period. Other 4 QP modes of AQ Men are added from the literature. The regularity of these 7 QP modes follows a power function with a base 1.57 and standard deviation 6.4% (Fig. 8). This power model prognosticates 5 other QP modes: 3 internal and 2 external (Table 2). The bases of the power regularity models for the flickering of the symbiotic binaries RS Oph, T CrB, and MWC 560 (however in the time scale of minutes) are 1.55, 2.0, and 1.34, respectively (Table 1). For unknown reasons in these 4 cases we find (i) regularities with (ii) different bases.


title: Interactive Humanoid: Online Full-Body Motion Reaction Synthesis with Social Affordance Canonicalization and Forecasting

abstract: We focus on the human-humanoid interaction task optionally with an object. We propose a new task named online full-body motion reaction synthesis, which generates humanoid reactions based on the human actor's motions. The previous work only focuses on human interaction without objects and generates body reactions without hand. Besides, they also do not consider the task as an online setting, which means the inability to observe information beyond the current moment in practical situations. To support this task, we construct two datasets named HHI and CoChair and propose a unified method. Specifically, we propose to construct a social affordance representation. We first select a social affordance carrier and use SE(3)-Equivariant Neural Networks to learn the local frame for the carrier, then we canonicalize the social affordance. Besides, we propose a social affordance forecasting scheme to enable the reactor to predict based on the imagined future. Experiments demonstrate that our approach can effectively generate high-quality reactions on HHI and CoChair. Furthermore, we also validate our method on existing human interaction datasets Interhuman and Chi3D.


title: CL2CM: Improving Cross-Lingual Cross-Modal Retrieval via Cross-Lingual Knowledge Transfer

abstract: Cross-lingual cross-modal retrieval has garnered increasing attention recently, which aims to achieve the alignment between vision and target language (V-T) without using any annotated V-T data pairs. Current methods employ machine translation (MT) to construct pseudo-parallel data pairs, which are then used to learn a multi-lingual and multi-modal embedding space that aligns visual and target-language representations. However, the large heterogeneous gap between vision and text, along with the noise present in target language translations, poses significant challenges in effectively aligning their representations. To address these challenges, we propose a general framework, Cross-Lingual to Cross-Modal (CL2CM), which improves the alignment between vision and target language using cross-lingual transfer. This approach allows us to fully leverage the merits of multi-lingual pre-trained models (e.g., mBERT) and the benefits of the same modality structure, i.e., smaller gap, to provide reliable and comprehensive semantic correspondence (knowledge) for the cross-modal network. We evaluate our proposed approach on two multilingual image-text datasets, Multi30K and MSCOCO, and one video-text dataset, VATEX. The results clearly demonstrate the effectiveness of our proposed method and its high potential for large-scale retrieval.


title: OMG: Towards Open-vocabulary Motion Generation via Mixture of Controllers

abstract: We have recently seen tremendous progress in realistic text-to-motion generation. Yet, the existing methods often fail or produce implausible motions with unseen text inputs, which limits the applications. In this paper, we present OMG, a novel framework, which enables compelling motion generation from zero-shot open-vocabulary text prompts. Our key idea is to carefully tailor the pretrain-then-finetune paradigm into the text-to-motion generation. At the pre-training stage, our model improves the generation ability by learning the rich out-of-domain inherent motion traits. To this end, we scale up a large unconditional diffusion model up to 1B parameters, so as to utilize the massive unlabeled motion data up to over 20M motion instances. At the subsequent fine-tuning stage, we introduce motion ControlNet, which incorporates text prompts as conditioning information, through a trainable copy of the pre-trained model and the proposed novel Mixture-of-Controllers (MoC) block. MoC block adaptively recognizes various ranges of the sub-motions with a cross-attention mechanism and processes them separately with the text-token-specific experts. Such a design effectively aligns the CLIP token embeddings of text prompts to various ranges of compact and expressive motion features. Extensive experiments demonstrate that our OMG achieves significant improvements over the state-of-the-art methods on zero-shot text-to-motion generation. Project page: https://tr3e.github.io/omg-page.


title: Melting of unidirectional charge density waves across twin domain boundaries in GdTe$_{3}$

abstract: Solids undergoing a transition from order to disorder experience the proliferation of topological defects. The melting process generates transient quantum states. However, their dynamical nature with femtosecond lifetime hinders exploration with atomic precision. Here, we suggest an alternative approach to the dynamical melting process by focusing on the interface created by competing degenerate quantum states. We use a scanning tunneling microscope (STM) to visualize the unidirectional charge density wave (CDW) and its spatial progression ("static melting") across a twin domain boundary (TDB) in the layered material GdTe$_{3}$. Combining STM with a spatial lock-in technique, we reveal that the order parameter amplitude attenuates with the formation of dislocations and thus two different unidirectional CDWs coexist near the TDB, reducing the CDW anisotropy. Notably, we discover a correlation between this anisotropy and the CDW gap. Our study provides valuable insight into the behavior of topological defects and transient quantum states.


title: Unbiased organism-agnostic and highly sensitive signal peptide predictor with deep protein language model

abstract: Signal peptide (SP) is a short peptide located in the N-terminus of proteins. It is essential to target and transfer transmembrane and secreted proteins to correct positions. Compared with traditional experimental methods to identify signal peptides, computational methods are faster and more efficient, which are more practical for analyzing thousands or even millions of protein sequences, especially for metagenomic data. Here we present Unbiased Organism-agnostic Signal Peptide Network (USPNet), a signal peptide classification and cleavage site prediction deep learning method that takes advantage of protein language models. We propose to apply label distribution-aware margin loss to handle data imbalance problems and use evolutionary information of protein to enrich representation and overcome species information dependence.


title: Of model completeness and algebraic groups

abstract: We show that if G is a simply connected semi-simple algebraic group and K is a model complete field, then the theory of the group G(K) is model complete as well.


title: Improving HAWC dark matter constraints with Inverse-Compton Emission

abstract: The particle nature of dark matter (DM) has been a long-lasting mystery. Many models suggest that DM could decay or self annihilate into standard model particles, and thus could be a source of gamma rays in the sky. The High Altitude Water Cherenkov (HAWC) observatory has yielded some of the strongest limits in searches of DM decay or annihilation. Building on the flux limits provided by the HAWC collaboration in 2018, we consider the effects of additional components from Galactic secondary Inverse-Compton scatterings and extragalactic DM distributions. We find that these effects can significantly improve the DM constraints, up to an order of magnitude in some cases. This highlights the importance of considering secondary effects in detail in LHAASO-WCDA and SWGO in the future.


title: Proving Conjectures Acquired by Composing Multiple Biases

abstract: We present the proofs of the conjectures mentioned in the paper published in the proceedings of the 2024 AAAI conference [1], and discovered by the decomposition methods presented in the same paper.


title: A Sim-to-Real Deep Learning-based Framework for Autonomous Nano-drone Racing

abstract: Autonomous drone racing competitions are a proxy to improve unmanned aerial vehicles' perception, planning, and control skills. The recent emergence of autonomous nano-sized drone racing imposes new challenges, as their ~10cm form factor heavily restricts the resources available onboard, including memory, computation, and sensors. This paper describes the methodology and technical implementation of the system winning the first autonomous nano-drone racing international competition: the IMAV 2022 Nanocopter AI Challenge. We developed a fully onboard deep learning approach for visual navigation trained only on simulation images to achieve this goal. Our approach includes a convolutional neural network for obstacle avoidance, a sim-to-real dataset collection procedure, and a navigation policy that we selected, characterized, and adapted through simulation and actual in-field experiments. Our system ranked 1st among seven competing teams at the competition. In our best attempt, we scored 115m of traveled distance in the allotted 5-minute flight, never crashing while dodging static and dynamic obstacles. Sharing our knowledge with the research community, we aim to provide a solid groundwork to foster future development in this field.


title: QQESPM: A Quantitative and Qualitative Spatial Pattern Matching Algorithm

abstract: The Spatial Pattern Matching (SPM) query allows for the retrieval of Points of Interest (POIs) based on spatial patterns defined by keywords and distance criteria. However, it does not consider the connectivity between POIs. In this study, we introduce the Qualitative and Quantitative Spatial Pattern Matching (QQ-SPM) query, an extension of the SPM query that incorporates qualitative connectivity constraints. To answer the proposed query type, we propose the QQESPM algorithm, which adapts the state-of-the-art ESPM algorithm to handle connectivity constraints. Performance tests comparing QQESPM to a baseline approach demonstrate QQESPM's superiority in addressing the proposed query type.


title: Modeling and Experimental Validation of the Intrinsic SNR in Spin Qubit Gate-Based Readout and Its Impacts on Readout Electronics

abstract: In semiconductor spin quantum bits (qubits), the radio-frequency (RF) gate-based readout is a promising solution for future large-scale integration, as it allows for a fast, frequency-multiplexed readout architecture, enabling multiple qubits to be read out simultaneously. This paper introduces a theoretical framework to evaluate the effect of various parameters, such as the readout probe power, readout chain's noise performance, and integration time on the intrinsic readout signal-to-noise ratio (SNR), and thus readout fidelity of RF gate-based readout systems. By analyzing the underlying physics of spin qubits during readout, this work proposes a qubit readout model that takes into account the qubit's quantum mechanical properties, providing a way to evaluate the trade-offs among the aforementioned parameters. The validity of the proposed model is evaluated by comparing the simulation and experimental results. The proposed analytical approach, the developed model, and the experimental results enable designers to optimize the entire readout chain effectively, thus leading to a faster, lower-power readout system with integrated cryogenic electronics.


title: PANDA: Architecture-Level Power Evaluation by Unifying Analytical and Machine Learning Solutions

abstract: Power efficiency is a critical design objective in modern microprocessor design. To evaluate the impact of architectural-level design decisions, an accurate yet efficient architecture-level power model is desired. However, widely adopted data-independent analytical power models like McPAT and Wattch have been criticized for their unreliable accuracy. While some machine learning (ML) methods have been proposed for architecture-level power modeling, they rely on sufficient known designs for training and perform poorly when the number of available designs is limited, which is typically the case in realistic scenarios. In this work, we derive a general formulation that unifies existing architecture-level power models. Based on the formulation, we propose PANDA, an innovative architecture-level solution that combines the advantages of analytical and ML power models. It achieves unprecedented high accuracy on unknown new designs even when there are very limited designs for training, which is a common challenge in practice. Besides being an excellent power model, it can predict area, performance, and energy accurately. PANDA further supports power prediction for unknown new technology nodes. In our experiments, besides validating the superior performance and the wide range of functionalities of PANDA, we also propose an application scenario, where PANDA proves to identify high-performance design configurations given a power constraint.


title: FrameFinder: Explorative Multi-Perspective Framing Extraction from News Headlines

abstract: Revealing the framing of news articles is an important yet neglected task in information seeking and retrieval. In the present work, we present FrameFinder, an open tool for extracting and analyzing frames in textual data. FrameFinder visually represents the frames of text from three perspectives, i.e., (i) frame labels, (ii) frame dimensions, and (iii) frame structure. By analyzing the well-established gun violence frame corpus, we demonstrate the merits of our proposed solution to support social science research and call for subsequent integration into information interactions.


title: Decremental Matching in General Weighted Graphs

abstract: In this paper, we consider the problem of maintaining a $(1-\varepsilon)$-approximate maximum weight matching in a dynamic graph $G$, while the adversary makes changes to the edges of the graph. In the fully dynamic setting, where both edge insertions and deletions are allowed, Gupta and Peng gave an algorithm for this problem with an update time of $\tilde{O}_{\varepsilon}(\sqrt{m})$. We study a natural relaxation of this problem, namely the decremental model, where the adversary is only allowed to delete edges. For the cardinality version of this problem in general (possibly, non-bipartite) graphs, Assadi, Bernstein, and Dudeja gave a decremental algorithm with update time $O_{\varepsilon}(\text{poly}(\log n))$. However, beating $\tilde{O}_{\varepsilon}(\sqrt{m})$ update time remained an open problem for the \emph{weighted} version in \emph{general graphs}. In this paper, we bridge the gap between unweighted and weighted general graphs for the decremental setting. We give a $O_{\varepsilon}(\text{poly}(\log n))$ update time algorithm that maintains a $(1-\varepsilon)$-approximate maximum weight matching under adversarial deletions. Like the decremental algorithm of Assadi, Bernstein, and Dudeja, our algorithm is randomized, but works against an adaptive adversary. It also matches the time bound for the cardinality version upto dependencies on $\varepsilon$ and a $\log R$ factor, where $R$ is the ratio between the maximum and minimum edge weight in $G$.


title: Perfect powers in elliptic divisibility sequences

abstract: Let $E$ be an elliptic curve over the rationals given by an integral Weierstrass model and let $P$ be a rational point of infinite order. The multiple $nP$ has the form $(A_n/B_n^2,C_n/B_n^3)$ where $A_n$, $B_n$, $C_n$ are integers with $A_n C_n$ and $B_n$ coprime, and $B_n$ positive. The sequence $(B_n)$ is called the elliptic divisibility sequence generated by $P$. This paper is concerned with a question posed in 2007 by Everest, Reynolds and Stevens: does the sequence $(B_n)$ contain only finitely many perfect powers? We answer this question positively under three additional assumptions: $P$ is non-integral, the discriminant of $E$ is positive, and $P$ belongs to the connected real component of the identity on $E$. Our method attaches to the problem a Frey curve that is defined over a totally real field of degree at most $24$, and then makes use of modularity and level lowering arguments. We can deduce the same theorem without assuming that the discriminant of $E$ is positive, or assuming that $P$ belongs to the connected real component of the identity, provided we assume some standard conjectures from the Langlands programme.


title: Design, construction and evaluation of emotional multimodal pathological speech database

abstract: The lack of an available emotion pathology database is one of the key obstacles in studying the emotion expression status of patients with dysarthria. The first Chinese multimodal emotional pathological speech database containing multi-perspective information is constructed in this paper. It includes 29 controls and 39 patients with different degrees of motor dysarthria, expressing happy, sad, angry and neutral emotions. All emotional speech was labeled for intelligibility, types and discrete dimensional emotions by developed WeChat mini-program. The subjective analysis justifies from emotion discrimination accuracy, speech intelligibility, valence-arousal spatial distribution, and correlation between SCL-90 and disease severity. The automatic recognition tested on speech and glottal data, with average accuracy of 78% for controls and 60% for patients in audio, while 51% for controls and 38% for patients in glottal data, indicating an influence of the disease on emotional expression.


title: Conformalised data synthesis with statistical quality guarantees

abstract: With the proliferation of ever more complicated Deep Learning architectures, data synthesis is a highly promising technique to address the demand of data-hungry models. However, reliably assessing the quality of a 'synthesiser' model's output is an open research question with significant associated risks for high-stake domains. To address this challenge, we have designed a unique confident data synthesis algorithm that introduces statistical confidence guarantees through a novel extension of the Conformal Prediction framework. We support our proposed algorithm with theoretical proofs and an extensive empirical evaluation of five benchmark datasets. To show our approach's versatility on ubiquitous real-world challenges, the datasets were carefully selected for their variety of difficult characteristics: low sample count, class imbalance and non-separability, and privacy-sensitive data. In all trials, training sets extended with our confident synthesised data performed at least as well as the original, and frequently significantly improved Deep Learning performance by up to +65% F1-score.


title: ComOM at VLSP 2023: A Dual-Stage Framework with BERTology and Unified Multi-Task Instruction Tuning Model for Vietnamese Comparative Opinion Mining

abstract: The ComOM shared task aims to extract comparative opinions from product reviews in Vietnamese language. There are two sub-tasks, including (1) Comparative Sentence Identification (CSI) and (2) Comparative Element Extraction (CEE). The first task is to identify whether the input is a comparative review, and the purpose of the second task is to extract the quintuplets mentioned in the comparative review. To address this task, our team proposes a two-stage system based on fine-tuning a BERTology model for the CSI task and unified multi-task instruction tuning for the CEE task. Besides, we apply the simple data augmentation technique to increase the size of the dataset for training our model in the second stage. Experimental results show that our approach outperforms the other competitors and has achieved the top score on the official private test.


title: Impact of beam far side-lobe knowledge in the presence of foregrounds for LiteBIRD

abstract: We present a study of the impact of an uncertainty in the beam far side-lobe knowledge on the measurement of the Cosmic Microwave Background $B$-mode signal at large scale. It is expected to be one of the main source of systematic effects in future CMB observations. Because it is crucial for all-sky survey missions to take into account the interplays between beam systematic effects and all the data analysis steps, the primary goal of this paper is to provide the methodology to carry out the end-to-end study of their effect for a space-borne CMB polarization experiment, up to the cosmological results in the form of a bias $\delta r$ on the tensor-to-scalar ratio $r$. LiteBIRD is dedicated to target the measurement of CMB primordial $B$ modes by reaching a sensitivity of $\sigma \left( r \right) \leq 10^{-3}$ assuming $r=0$. As a demonstration of our framework, we derive the relationship between the knowledge of the beam far side-lobes and the tentatively allocated error budget under given assumptions on design, simulation and component separation method. We assume no mitigation of the far side-lobes effect at any stage of the analysis pipeline. We show that $\delta r$ is mostly due to the integrated fractional power difference between the estimated beams and the true beams in the far side-lobes region, with little dependence on the actual shape of the beams, for low enough $\delta r$. Under our set of assumptions, in particular considering the specific foreground cleaning method we used, we find that the integrated fractional power in the far side-lobes should be known at a level as tight as $\sim 10^{-4}$, to achieve the required limit on the bias $\delta r < 1.9 \times 10^{-5}$. The framework and tools developed for this study can be easily adapted to provide requirements under different design, data analysis frameworks and for other future space-borne experiments beyond LiteBIRD.


title: Localization with Reconfigurable Intelligent Surface: An Active Sensing Approach

abstract: This paper addresses an uplink localization problem in which a base station (BS) aims to locate a remote user with the help of reconfigurable intelligent surfaces (RISs). We propose a strategy in which the user transmits pilots sequentially and the BS adaptively adjusts the sensing vectors, including the BS beamforming vector and multiple RIS reflection coefficients based on the observations already made, to eventually produce an estimated user position. This is a challenging active sensing problem for which finding an optimal solution involves searching through a complicated functional space whose dimension increases with the number of measurements. We show that the long short-term memory (LSTM) network can be used to exploit the latent temporal correlation between measurements to automatically construct scalable state vectors. Subsequently, the state vector is mapped to the sensing vectors for the next time frame via a deep neural network (DNN). A final DNN is used to map the state vector to the estimated user position. Numerical result illustrates the advantage of the active sensing design as compared to non-active sensing methods. The proposed solution produces interpretable results and is generalizable in the number of sensing stages. Remarkably, we show that a network with one BS and multiple RISs can outperform a comparable setting with multiple BSs.


title: The Arithmetic of the Fourier Coefficients of Automorphic Forms

abstract: This thesis studies modular forms from a classical and adelic viewpoint. We use this interplay to obtain results about the arithmetic of the Fourier coefficients of modular forms and their generalisations. In Chapter 2, we compute lower bounds for the $p$-adic valuation of local Whittaker newforms with non-trivial central character. We obtain these bounds by using the local Fourier analysis of these local Whittaker newforms and the $p$-adic properties of $\eps$-factors for $\GL_1$. In Chapter 3, we study the fields generated by the Fourier coefficients of Hilbert newforms at arbitrary cusps. Precisely, given a cuspidal Hilbert newform $f$ and a matrix $\sigma$ in (a suitable conjugate of) the Hilbert modular group, we give a cyclotomic extension of the field generated by the Fourier coefficients at infinity which contains all the Fourier coefficients of $f||_k\sigma$. Chapters 2 and 3 are independent of each other and can be read in either order. In Chapter 4, we briefly discuss the relation between these two chapters and mention potential future work.


title: Holistic chemical evaluation reveals pitfalls in reaction prediction models

abstract: The prediction of chemical reactions has gained significant interest within the machine learning community in recent years, owing to its complexity and crucial applications in chemistry. However, model evaluation for this task has been mostly limited to simple metrics like top-k accuracy, which obfuscates fine details of a model's limitations. Inspired by progress in other fields, we propose a new assessment scheme that builds on top of current approaches, steering towards a more holistic evaluation. We introduce the following key components for this goal: CHORISO, a curated dataset along with multiple tailored splits to recreate chemically relevant scenarios, and a collection of metrics that provide a holistic view of a model's advantages and limitations. Application of this method to state-of-the-art models reveals important differences on sensitive fronts, especially stereoselectivity and chemical out-of-distribution generalization. Our work paves the way towards robust prediction models that can ultimately accelerate chemical discovery.


title: Scene 3-D Reconstruction System in Scattering Medium

abstract: The research on neural radiance fields for new view synthesis has experienced explosive growth with the development of new models and extensions. The NERF algorithm, suitable for underwater scenes or scattering media, is also evolving. Existing underwater 3D reconstruction systems still face challenges such as extensive training time and low rendering efficiency. This paper proposes an improved underwater 3D reconstruction system to address these issues and achieve rapid, high-quality 3D reconstruction.To begin with, we enhance underwater videos captured by a monocular camera to correct the poor image quality caused by the physical properties of the water medium while ensuring consistency in enhancement across adjacent frames. Subsequently, we perform keyframe selection on the video frames to optimize resource utilization and eliminate the impact of dynamic objects on the reconstruction results. The selected keyframes, after pose estimation using COLMAP, undergo a three-dimensional reconstruction improvement process using neural radiance fields based on multi-resolution hash coding for model construction and rendering.


title: FedSSA: Semantic Similarity-based Aggregation for Efficient Model-Heterogeneous Personalized Federated Learning

abstract: Federated learning (FL) is a privacy-preserving collaboratively machine learning paradigm. Traditional FL requires all data owners (a.k.a. FL clients) to train the same local model. This design is not well-suited for scenarios involving data and/or system heterogeneity. Model-Heterogeneous Personalized FL (MHPFL) has emerged to address this challenge. Existing MHPFL approaches often rely on a public dataset with the same nature as the learning task, or incur high computation and communication costs. To address these limitations, we propose the Federated Semantic Similarity Aggregation (FedSSA) approach for supervised classification tasks, which splits each client's model into a heterogeneous (structure-different) feature extractor and a homogeneous (structure-same) classification header. It performs local-to-global knowledge transfer via semantic similarity-based header parameter aggregation. In addition, global-to-local knowledge transfer is achieved via an adaptive parameter stabilization strategy which fuses the seen-class parameters of historical local headers with that of the latest global header for each client. FedSSA does not rely on public datasets, while only requiring partial header parameter transmission to save costs. Theoretical analysis proves the convergence of FedSSA. Extensive experiments present that FedSSA achieves up to 3.62% higher accuracy, 15.54 times higher communication efficiency, and 15.52 times higher computational efficiency compared to 7 state-of-the-art MHPFL baselines.


title: LLMind: Orchestrating AI and IoT with LLM for Complex Task Execution

abstract: The exploration of large language models (LLMs) for task planning and IoT automation has recently gained significant attention. However, existing works suffer from limitations in terms of resource accessibility, complex task planning, and efficiency. In this paper, we present LLMind, an LLM-based AI agent framework that enables effective collaboration among IoT devices for executing complex tasks. Inspired by the functional specialization theory of the brain, our framework integrates an LLM with domain-specific AI modules, enhancing its capabilities. Complex tasks, which may involve collaborations of multiple domain-specific AI modules and IoT devices, are executed through a control script generated by the LLM using a Language-Code transformation approach, which first converts language descriptions to an intermediate finite-state machine (FSM) before final precise transformation to code. Furthermore, the framework incorporates a novel experience accumulation mechanism to enhance response speed and effectiveness, allowing the framework to evolve and become progressively sophisticated through continuing user and machine interactions.


title: Style Injection in Diffusion: A Training-free Approach for Adapting Large-scale Diffusion Models for Style Transfer

abstract: Despite the impressive generative capabilities of diffusion models, existing diffusion model-based style transfer methods require inference-stage optimization (e.g. fine-tuning or textual inversion of style) which is time-consuming, or fails to leverage the generative ability of large-scale diffusion models. To address these issues, we introduce a novel artistic style transfer method based on a pre-trained large-scale diffusion model without any optimization. Specifically, we manipulate the features of self-attention layers as the way the cross-attention mechanism works; in the generation process, substituting the key and value of content with those of style image. This approach provides several desirable characteristics for style transfer including 1) preservation of content by transferring similar styles into similar image patches and 2) transfer of style based on similarity of local texture (e.g. edge) between content and style images. Furthermore, we introduce query preservation and attention temperature scaling to mitigate the issue of disruption of original content, and initial latent Adaptive Instance Normalization (AdaIN) to deal with the disharmonious color (failure to transfer the colors of style). Our experimental results demonstrate that our proposed method surpasses state-of-the-art methods in both conventional and diffusion-based style transfer baselines.


title: Adaptive parameter sharing for multi-agent reinforcement learning

abstract: Parameter sharing, as an important technique in multi-agent systems, can effectively solve the scalability issue in large-scale agent problems. However, the effectiveness of parameter sharing largely depends on the environment setting. When agents have different identities or tasks, naive parameter sharing makes it difficult to generate sufficiently differentiated strategies for agents. Inspired by research pertaining to the brain in biology, we propose a novel parameter sharing method. It maps each type of agent to different regions within a shared network based on their identity, resulting in distinct subnetworks. Therefore, our method can increase the diversity of strategies among different agents without introducing additional training parameters. Through experiments conducted in multiple environments, our method has shown better performance than other parameter sharing methods.


title: Orbifold Modular GUT of Flavour

abstract: We discuss an $SU(5)$ Grand Unified Theory (GUT) based on the 10d orbifold $(\mathbb{T}^2)^3/(\mathbb{Z}_4\times\mathbb{Z}_2)$ plus three modular $S_4$ groups with moduli at respective fixed points $i,i+2,\omega=e^{2i\pi/3}$. The resulting model has hierarchical quark and charged lepton mass matrices, arising from a double weighton mechanism, and reproduces the highly predictive Littlest Seesaw Mechanism in the neutrino sector. The down quark mass matrix has an upper triangular form, contributing to CKM mixing, while the charged lepton mass matrix has a lower triangular form with suppressed contributions to PMNS mixing. The orbifold yields successful $SU(5)$ breaking with doublet-triplet splitting of the Higgs multiplets.


title: Phanerozoic biological reworking of the continental carbonate rock reservoir

abstract: Understanding the co-evolution of complex life with Earth's geology is an enduring challenge. The rock record evidences remarkable correlations between changes in biology and the wider Earth system, yet cause and effect remain unclear. Here, we link the evolutionary history of eukaryotes with the rise and fall of carbonate rock fraction within continental crust - a key variable in controlling the efficiency of carbon drawdown during weathering, solid Earth degassing rates, and ultimately nutrient supply to life. We use geospatial database analyses to demonstrate a strongly non-linear growth and then collapse in Earth's continental crust carbonate reservoir. Biomineralisers reshaped Earth's surface in their image; armouring continental margins with carbonate platforms, such that the continental carbonate reservoir increased in size by 5-fold in under 100 Myr after the Cambrian Radiation of animal life. This Paleozoic carbonate revolution represents among the most dramatic crustal evolutionary events in Earth's history. The Permo-Triassic extinction event coupled to the rise of open ocean calcifiers initiated a steady decline in continental crustal carbonate content; one that still continues today, which unabated would produce Precambrian-style crustal carbonate distributions in around 500-1000 Myr. Our results demonstrate strongly non-linear crustal evolution after the rise of the complex Phanerozoic biosphere. This outcome suggests that complex life may generate unique biogeochemical trajectories on otherwise geologically similar worlds, posing a new challenge in the hunt for life beyond Earth.


title: Impairments-Aware Receiver Design for IRS-Aided Multi-cell Massive MIMO Systems With Channel Aging and Non-Ideal Hardware

abstract: We consider the uplink of a hardware-impaired intelligent reflective surfaces (IRS) aided multi-cell massive multiple-input multiple-output (mMIMO) system with mobile user equipments, whose channel age with time. For this system, we analyze the distortion due to hardware impairments, and the effect of channel aging, and propose a novel distortion-and-aging-aware MMSE (DAA-MMSE) receiver that not only provides a higher spectral efficiency (SE) than conventional maximal ratio and distortion-unaware MMSE (DU-MMSE) receivers, but also reduces the pilot overhead. By considering non-ideal hardware and spatially-correlated Rician fading channels with phase shifts, we also derive the SE lower bound for this system. We show that the SE gain of the DAA-MMSE receiver over DU-MMSE receiver increases with hardware impairments, and channel aging. Along with DAA-MMSE receiver, the IRS is also shown to reduce the pilot overhead in a mMIMO system with channel aging.


title: ExROPPP: Fast, Accurate and Spin-Pure Calculation of the Electronically Excited States of Organic Hydrocarbon Radicals

abstract: Recent years have seen an explosion of interest in organic radicals due to their promise for highly efficient organic light-emitting diodes (OLEDs) and molecular qubits. However, accurately and inexpensively computing their electronic structure has been challenging, especially for excited states, due to the spin-contamination problem. Furthermore, while alternacy or `pseudoparity' rules have guided the interpretation and prediction of the excited states of closed-shell hydrocarbons since the 1950s, similarly general rules for hydrocarbon radicals have not to our knowledge yet been found. In this article we present solutions to both of these challenges. We firstly combine the extended configuration interaction singles (XCIS) method with Pariser-Parr-Pople (PPP) theory to obtain a method which we call ExROPPP (Extended Restricted Open-shell PPP theory). We find that ExROPPP computes spin-pure excited states of hydrocarbon radicals with comparable accuracy to experiment as high-level GMC-QDPT calculations but at a computational cost that is at least two orders of magnitude lower. We then use ExROPPP to derive widely-applicable rules for the spectra of alternant hydrocarbon radicals which are completely consistent with our computed results. These findings pave the way for the highly accurate and efficient computation and prediction of the excited states of organic radicals.