title: Scaling Laws for Data Filtering -- Data Curation cannot be Compute Agnostic

abstract: Vision-language models (VLMs) are trained for thousands of GPU hours on carefully curated web datasets. In recent times, data curation has gained prominence with several works developing strategies to retain 'high-quality' subsets of 'raw' scraped data. For instance, the LAION public dataset retained only 10% of the total crawled data. However, these strategies are typically developed agnostic of the available compute for training. In this paper, we first demonstrate that making filtering decisions independent of training compute is often suboptimal: the limited high-quality data rapidly loses its utility when repeated, eventually requiring the inclusion of 'unseen' but 'lower-quality' data. To address this quality-quantity tradeoff ($\texttt{QQT}$), we introduce neural scaling laws that account for the non-homogeneous nature of web data, an angle ignored in existing literature. Our scaling laws (i) characterize the $\textit{differing}$ 'utility' of various quality subsets of web data; (ii) account for how utility diminishes for a data point at its 'nth' repetition; and (iii) formulate the mutual interaction of various data pools when combined, enabling the estimation of model performance on a combination of multiple data pools without ever jointly training on them. Our key message is that data curation $\textit{cannot}$ be agnostic of the total compute that a model will be trained for. Our scaling laws allow us to curate the best possible pool for achieving top performance on Datacomp at various compute budgets, carving out a pareto-frontier for data curation. Code is available at https://github.com/locuslab/scaling_laws_data_filtering.


title: Move Anything with Layered Scene Diffusion

abstract: Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but these methods do not apply to diffusion models due to their fixed forward process. In this work, we propose SceneDiffusion to optimize a layered scene representation during the diffusion sampling process. Our key insight is that spatial disentanglement can be obtained by jointly denoising scene renderings at different spatial layouts. Our generated scenes support a wide range of spatial editing operations, including moving, resizing, cloning, and layer-wise appearance editing operations, including object restyling and replacing. Moreover, a scene can be generated conditioned on a reference image, thus enabling object moving for in-the-wild images. Notably, this approach is training-free, compatible with general text-to-image diffusion models, and responsive in less than a second.


title: Machine learning-based similarity measure to forecast M&A from patent data

abstract: Defining and finalizing Mergers and Acquisitions (M&A) requires complex human skills, which makes it very hard to automatically find the best partner or predict which firms will make a deal. In this work, we propose the MASS algorithm, a specifically designed measure of similarity between companies and we apply it to patenting activity data to forecast M&A deals. MASS is based on an extreme simplification of tree-based machine learning algorithms and naturally incorporates intuitive criteria for deals; as such, it is fully interpretable and explainable. By applying MASS to the Zephyr and Crunchbase datasets, we show that it outperforms LightGCN, a "black box" graph convolutional network algorithm. When similar companies have disjoint patenting activities, on the contrary, LightGCN turns out to be the most effective algorithm. This study provides a simple and powerful tool to model and predict M&A deals, offering valuable insights to managers and practitioners for informed decision-making.


title: Good bounds for sets lacking skew corners

abstract: A skew corner is a triple of points in $\mathbb{Z} \times \mathbb{Z}$ of the form $(x,y), (x, y + a)$ and $(x + a, y')$. Pratt posed the following question: how large can a set $A \subseteq [n] \times [n]$ be, provided it contains no non-trivial skew corner (i.e. one for which $a\not=0$)? We prove that $|A| \leq \exp(- c\log^c n) n^2$, for an absolute constant $c > 0$, which, along with a construction of Beker, essentially resolves Pratt's question. Our argument is represents a two-dimensional variant of the method of Kelley and Meka, which they used to prove Behrend-type bounds in Roth's theorem. A very similar result was obtained independently and simultaneously by Jaber, Lovett and Ostuni.


title: BAMBOO: a predictive and transferable machine learning force field framework for liquid electrolyte development

abstract: Despite the widespread applications of machine learning force field (MLFF) on solids and small molecules, there is a notable gap in applying MLFF to complex liquid electrolytes. In this work, we introduce BAMBOO (ByteDance AI Molecular Simulation Booster), a novel framework for molecular dynamics (MD) simulations, with a demonstration of its capabilities in the context of liquid electrolytes for lithium batteries. We design a physics-inspired graph equivariant transformer architecture as the backbone of BAMBOO to learn from quantum mechanical simulations. Additionally, we pioneer an ensemble knowledge distillation approach and apply it on MLFFs to improve the stability of MD simulations. Finally, we propose the density alignment algorithm to align BAMBOO with experimental measurements. BAMBOO demonstrates state-of-the-art accuracy in predicting key electrolyte properties such as density, viscosity, and ionic conductivity across various solvents and salt combinations. Our current model, trained on more than 15 chemical species, achieves the average density error of 0.01 g/cm$^3$ on various compositions compared with experimental data. Moreover, our model demonstrates transferability to molecules not included in the quantum mechanical dataset. We envision this work as paving the way to a "universal MLFF" capable of simulating properties of common organic liquids.


title: Studying the Supernova Absolute Magnitude Constancy with Baryonic Acoustic Oscillations

abstract: In this proceeding we review and expand on our recent work investigating the constancy of the absolute magnitude $M_B$ of Type Ia supernovae. In it, we used baryonic acoustic oscillations (BAO) to calibrate the supernova data and to check whether the resulting $M_B$ is constant. We used non-parametric methods like Gaussian processes and artificial neural networks to reconstruct $M_B(z)$. Here we elaborate on the results by putting them in the context of other studies investigating possible non-constant $M_B$ and the impact of the distance-duality relation. We also present some numerical details on the calculations in the original paper and new non-parametric reconstructions, including a conservative model-independent fit, confirming its main results. Notably, we see that $M_B$ remains constant within $1\sigma$, with a possible jump around $z = 0.01 - 0.15$. Furthermore, the observed distribution of $M_B(z)$ cannot be described by a single Gaussian, displaying multiple peaks and tails. The choice of the only remaining parameter -- the sound horizon $r_d$ leads to a tension in the $M_B-r_d$ plane. Fitting different non-constant $M_B(z)$ models does not significantly improve the fit and there is no preference for any of the models by the statistical measures we employ.


title: Massively Parallel Computation of Similarity Matrices from Piecewise Constant Invariants

abstract: We present a computational framework for piecewise constant functions (PCFs) and use this for several types of computations that are useful in statistics, e.g., averages, similarity matrices, and so on. We give a linear-time, allocation-free algorithm for working with pairs of PCFs at machine precision. From this, we derive algorithms for computing reductions of several PCFs. The algorithms have been implemented in a highly scalable fashion for parallel execution on CPU and, in some cases, (multi-)GPU, and are provided in a \proglang{Python} package. In addition, we provide support for multidimensional arrays of PCFs and vectorized operations on these. As a stress test, we have computed a distance matrix from 500,000 PCFs using 8 GPUs.


title: Homology of Moment Frames

abstract: Using homological techniques we show that a pin-anchored frame that involves only moments and shears provides a conceptual bridge between the statics of moment frames and the kinematics of pin-jointed trusses. One immediate result is a long exact sequence whose alternating sum of dimensions gives a novel counting rule for self-stresses and mechanisms. This combines the Maxwell-Calladine count for pin-jointed trusses with the circuit rank (first Betti number) associated with self-stresses in moment frames. These relations apply to frames in 2, 3 or any dimensions. This work heralds a shift towards a deeper study of the relationships and dualities that exist between structural equilibria and kinematics.


title: Reward Learning from Suboptimal Demonstrations with Applications in Surgical Electrocautery

abstract: Automating robotic surgery via learning from demonstration (LfD) techniques is extremely challenging. This is because surgical tasks often involve sequential decision-making processes with complex interactions of physical objects and have low tolerance for mistakes. Prior works assume that all demonstrations are fully observable and optimal, which might not be practical in the real world. This paper introduces a sample-efficient method that learns a robust reward function from a limited amount of ranked suboptimal demonstrations consisting of partial-view point cloud observations. The method then learns a policy by optimizing the learned reward function using reinforcement learning (RL). We show that using a learned reward function to obtain a policy is more robust than pure imitation learning. We apply our approach on a physical surgical electrocautery task and demonstrate that our method can perform well even when the provided demonstrations are suboptimal and the observations are high-dimensional point clouds. Code and videos available here: https://sites.google.com/view/lfdinelectrocautery


title: Wave optics lensing of gravitational waves: theory and phenomenology of triple systems in the LISA band

abstract: We study lensing of gravitational waves by a black hole in the deep wave optics regime, i.e. when the wavelength is much larger than the black hole Schwarzschild radius. We apply it to triple systems, with a binary of stellar mass objects in the inspiraling phase orbiting around a central massive black hole. We describe the full polarisation structure of the wave and derive predictions for the polarisation modes of the scattered wave measured by the observer. We show that lensing in the wave optics regime is not helicity preserving, as opposed to lensing in the geometric optics regime. The amplitude of the total wave is modulated due to interference between the directly transmitted and lensed components. The relative amplitude of the modulation is fixed by the lensing geometry and can reach unity in the most favourable settings. This indicates that wave optics lensing is potentially detectable by LISA for sufficiently high SNR systems. Our findings show that in the wave optics regime it is necessary to go beyond the usual lensing description where the amplification factor is assumed to be the same for both helicity modes. While motivated by GW190521 and the AGN formation scenario, our results apply more broadly to stellar-mass binaries orbiting a third body described as a Schwarzschild black hole, with a period comparable to the GW observation time.


title: Constraining Bosonic Dark Matter-Baryon Interactions from Neutron Star Collapse

abstract: Dark matter (DM) may be captured around a neutron star (NS) through DM-nucleon interactions. We observe that the enhancement of such capturing is particularly significant when the DM velocity and/or momentum transfer depend on the DM-nucleon scattering cross-section. This could potentially lead to the formation of a black hole within the typical lifetime of the NS. As the black hole expands through the accretion of matter from the NS, it ultimately results in the collapse of the host. Utilizing the existing pulsar data J0437-4715 and J2124-3858, we derive the stringent constraints on the DM-nucleon scattering cross-section across a broad range of DM masses.


title: GCV-Turbo: End-to-end Acceleration of GNN-based Computer Vision Tasks on FPGA

abstract: Graph neural networks (GNNs) have recently empowered various novel computer vision (CV) tasks. In GNN-based CV tasks, a combination of CNN layers and GNN layers or only GNN layers are employed. This paper introduces GCV-Turbo, a domain-specific accelerator on FPGA for end-to-end acceleration of GNN-based CV tasks. GCV-Turbo consists of two key components: (1) a \emph{novel} hardware architecture optimized for the computation kernels in both CNNs and GNNs using the same set of computation resources. (2) a PyTorch-compatible compiler that takes a user-defined model as input, performs end-to-end optimization for the computation graph of a given GNN-based CV task, and produces optimized code for hardware execution. The hardware architecture and the compiler work synergistically to support a variety of GNN-based CV tasks. We implement GCV-Turbo on a state-of-the-art FPGA and evaluate its performance across six representative GNN-based CV tasks with diverse input data modalities (e.g., image, human skeleton, point cloud). Compared with state-of-the-art CPU (GPU) implementations, GCV-Turbo achieves an average latency reduction of $68.4\times$ ($4.1\times$) on these six GNN-based CV tasks. Moreover, GCV-Turbo supports the execution of the standalone CNNs or GNNs, achieving performance comparable to that of state-of-the-art CNN (GNN) accelerators for widely used CNN-only (GNN-only) models.


title: Well-covered Unit Graphs of Finite Rings

abstract: Let $R$ be a finite ring with identity. The unit graph (unitary Cayley graph) of $R$ is the graph with vertex set $R$, where two distinct vertices $x$ and $y$ are adjacent exactly whenever $x+y$ is a unit in $R$ ($x-y$ is a unit in $R$). Here, we study independent sets of unit graphs of matrix rings over finite fields and use them to characterize all finite rings for which the unit graph is well-covered or Cohen-Macaulay. Moreover, we show that the unit graph of $R$ is well-covered if and only if the unitary Cayley graph of $R$ is well-covered and the characteristic of $R/J(R)$


title: Edge-disjoint cycles with the same vertex set

abstract: In 1975, Erd\H{o}s asked for the maximum number of edges that an $n$-vertex graph can have if it does not contain two edge-disjoint cycles on the same vertex set. It is known that Tur\'an-type results can be used to prove an upper bound of $n^{3/2+o(1)}$. However, this approach cannot give an upper bound better than $\Omega(n^{3/2})$. We show that, for any $k\geq 2$, every $n$-vertex graph with at least $n \cdot \mathrm{polylog}(n)$ edges contains $k$ pairwise edge-disjoint cycles with the same vertex set, resolving this old problem in a strong form up to a polylogarithmic factor. The well-known construction of Pyber, R\"odl and Szemer\'edi of graphs without $4$-regular subgraphs shows that there are $n$-vertex graphs with $\Omega(n\log \log n)$ edges which do not contain two cycles with the same vertex set, so the polylogarithmic term in our result cannot be completely removed. Our proof combines a variety of techniques including sublinear expanders, absorption and a novel tool for regularisation, which is of independent interest. Among other applications, this tool can be used to regularise an expander while still preserving certain key expansion properties.


title: InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models

abstract: We present InstantMesh, a feed-forward framework for instant 3D mesh generation from a single image, featuring state-of-the-art generation quality and significant training scalability. By synergizing the strengths of an off-the-shelf multiview diffusion model and a sparse-view reconstruction model based on the LRM architecture, InstantMesh is able to create diverse 3D assets within 10 seconds. To enhance the training efficiency and exploit more geometric supervisions, e.g, depths and normals, we integrate a differentiable iso-surface extraction module into our framework and directly optimize on the mesh representation. Experimental results on public datasets demonstrate that InstantMesh significantly outperforms other latest image-to-3D baselines, both qualitatively and quantitatively. We release all the code, weights, and demo of InstantMesh, with the intention that it can make substantial contributions to the community of 3D generative AI and empower both researchers and content creators.


title: Quantum Charged Black Holes

abstract: In the framework of braneworld holography, we construct a quantum charged black hole that is localized on a three-dimensional anti-de Sitter brane and incorporates quantum backreaction effects from the boundary field theory. The field on the brane consists of higher curvature gravitation coupled with a nonlinear electromagnetic field, and it does not exhibit conformal symmetry. We also investigate the thermodynamics of these quantum charged black holes from three distinct perspectives: a pure bulk description, where the bulk gravitation interacts with a brane; a brane description, where local dynamical gravitation is subject to quantum backreaction from the dual quantum conformal field; a boundary description, where the degrees of freedom for defect quantum conformal matters are considered. In so doing we obtain doubly holographic formulations of both the first law of thermodynamics and the Smarr (energy) relations.


title: Optimal Reeb graphs on two- and three-connected planar polygon

abstract: To investigate the topological structure of planar polygon decomposition on trapezoids, which is formed by height functions. We use the oriented Reeb graph of the function with a marked vertex. We describe all possible optimal Reeb graphs in the case of polygon in general position with one local minimum and one local maximum. By optimal Reeb graph we mean Reeb graph, which cann't be obtaned from other Reeb graph by subdivision of an edge or a leaf attaching. In this case polygon is a triangle with triangle holes. Constructed Reeb graphs give topological structures of trapezoid maps on two-connected polygon with six vertexes and three-connected polygon with nine vertexes.


title: VN-EGNN: E(3)-Equivariant Graph Neural Networks with Virtual Nodes Enhance Protein Binding Site Identification

abstract: Being able to identify regions within or around proteins, to which ligands can potentially bind, is an essential step to develop new drugs. Binding site identification methods can now profit from the availability of large amounts of 3D structures in protein structure databases or from AlphaFold predictions. Current binding site identification methods heavily rely on graph neural networks (GNNs), usually designed to output E(3)-equivariant predictions. Such methods turned out to be very beneficial for physics-related tasks like binding energy or motion trajectory prediction. However, the performance of GNNs at binding site identification is still limited potentially due to the lack of dedicated nodes that model hidden geometric entities, such as binding pockets. In this work, we extend E(n)-Equivariant Graph Neural Networks (EGNNs) by adding virtual nodes and applying an extended message passing scheme. The virtual nodes in these graphs are dedicated quantities to learn representations of binding sites, which leads to improved predictive performance. In our experiments, we show that our proposed method VN-EGNN sets a new state-of-the-art at locating binding site centers on COACH420, HOLO4K and PDBbind2020.


title: Laser driven melt pool resonances through dynamically oscillating energy inputs

abstract: Spatially selective melting of metal materials by laser irradiation allows for the precise welding as well as the 3D printing of complex metal parts. However, the simple scanning of a conventional Gaussian beam typically results in a melt track with randomly distributed surface features due to the complex and dynamic behavior of the melt pool. In this study, the implications of utilizing a dynamically oscillating energy input on driving melt track fluctuations is investigated. Specifically, the laser intensity and/or intensity distribution is sinusoidally modulated at different scan speeds, and the effect of modulation frequency on the resulting surface features of the melt track is examined. The formation of periodically oriented surface features indicates an evident frequency coupling between the melt pool and the modulation frequency. Moreover, such a frequency coupling becomes most prominent under a specific modulation frequency, suggesting resonant behavior. The insights provided in this study will enable the development of novel methods, allowing for the control and/or mitigation of inherent fluctuations in the melt pool through laser-driven resonances.


title: One-loop power spectrum in ultra slow-roll inflation and implications for primordial black hole dark matter

abstract: We apply the in-in formalism to address the question of whether the size of the one-loop spectrum of curvature fluctuations in ultra-slow-roll inflation models designed for producing a large population of primordial black holes implies a breakdown of perturbation theory. We consider a simplified piece-wise description of inflation, in which the ultra-slow-roll phase is preceded and followed by slow-roll phases linked by transitional periods. We work in the $\delta\phi$-gauge, including all relevant cubic and quartic interactions and the necessary counterterms to renormalize the ultraviolet divergences, regularized by a cutoff. The ratio of the one-loop to the tree-level contributions to the spectrum of curvature perturbations is controlled by the duration of the ultra-slow-roll phase and of the transitions. Our results indicate that perturbation theory does not necessarily break in well-known models proposed to account for all the dark matter in the form of primordial black holes.


title: An indeterminacy-based ontology for quantum theory

abstract: I present and defend a new ontology for quantum theories (or "interpretations" of quantum theory) called Generative Quantum Theory (GQT). GQT postulates different sets of features, and the combination of these different features can help generate different quantum theories. Furthermore, this ontology makes quantum indeterminacy and determinacy play an important explanatory role in accounting for when quantum systems whose values of their properties are indeterminate become determinate. The process via which determinate values arise varies between the different quantum theories. Moreover, quantum states represent quantum properties and structures that give rise to determinacy, and each quantum theory specifies a structure with certain features. I will focus on the following quantum theories: GRW, the Many-Worlds Interpretation, single-world relationalist theories such as Relational Quantum Mechanics, Bohmian Mechanics, hybrid classical-quantum theories, and Environmental Determinacy-based (EnD) Quantum Theory. I will argue that GQT should be taken seriously because it provides a series of important benefits that current widely discussed ontologies lack, namely, wavefunction realism and primitive ontology, without some of their costs. For instance, it helps generate quantum theories that are clearly compatible with relativistic causality, such as EnD Quantum Theory. Also, GQT has the benefit of providing new ways to compare and evaluate quantum theories, which may lead to philosophical and scientific progress on these issues.


title: Zero-shot Logical Query Reasoning on any Knowledge Graph

abstract: Complex logical query answering (CLQA) in knowledge graphs (KGs) goes beyond simple KG completion and aims at answering compositional queries comprised of multiple projections and logical operations. Existing CLQA methods that learn parameters bound to certain entity or relation vocabularies can only be applied to the graph they are trained on which requires substantial training time before being deployed on a new graph. Here we present UltraQuery, an inductive reasoning model that can zero-shot answer logical queries on any KG. The core idea of UltraQuery is to derive both projections and logical operations as vocabulary-independent functions which generalize to new entities and relations in any KG. With the projection operation initialized from a pre-trained inductive KG reasoning model, UltraQuery can solve CLQA on any KG even if it is only finetuned on a single dataset. Experimenting on 23 datasets, UltraQuery in the zero-shot inference mode shows competitive or better query answering performance than best available baselines and sets a new state of the art on 14 of them.


title: RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion

abstract: We introduce RealmDreamer, a technique for generation of general forward-facing 3D scenes from text descriptions. Our technique optimizes a 3D Gaussian Splatting representation to match complex text prompts. We initialize these splats by utilizing the state-of-the-art text-to-image generators, lifting their samples into 3D, and computing the occlusion volume. We then optimize this representation across multiple views as a 3D inpainting task with image-conditional diffusion models. To learn correct geometric structure, we incorporate a depth diffusion model by conditioning on the samples from the inpainting model, giving rich geometric structure. Finally, we finetune the model using sharpened samples from image generators. Notably, our technique does not require video or multi-view data and can synthesize a variety of high-quality 3D scenes in different styles, consisting of multiple objects. Its generality additionally allows 3D synthesis from a single image.


title: Toward a Better Understanding of Fourier Neural Operators: Analysis and Improvement from a Spectral Perspective

abstract: In solving partial differential equations (PDEs), Fourier Neural Operators (FNOs) have exhibited notable effectiveness compared to Convolutional Neural Networks (CNNs). This paper presents clear empirical evidence through spectral analysis to elucidate the superiority of FNO over CNNs: FNO is significantly more capable of learning low-frequencies. This empirical evidence also unveils FNO's distinct low-frequency bias, which limits FNO's effectiveness in learning high-frequency information from PDE data. To tackle this challenge, we introduce SpecBoost, an ensemble learning framework that employs multiple FNOs to better capture high-frequency information. Specifically, a secondary FNO is utilized to learn the overlooked high-frequency information from the prediction residual of the initial FNO. Experiments demonstrate that SpecBoost noticeably enhances FNO's prediction accuracy on diverse PDE applications, achieving an up to 71% improvement.


title: Fractional decoding of algebraic geometry codes over extension fields

abstract: In this paper, we study algebraic geometry codes from curves over $\mathbb{F}_{q^\ell}$ through their virtual projections which are algebraic geometric codes over $\mathbb{F}_q$. We use the virtual projections to provide fractional decoding algorithms for the codes over $\mathbb{F}_{q^\ell}$. Fractional decoding seeks to perform error correction using a smaller fraction of $\mathbb{F}_q$-symbols than a typical decoding algorithm. In one instance, the bound on the number of correctable errors differs from the usual lower bound by the degree of a pole divisor of an annihilator function. In another, we view the virtual projections as interleaved codes to, with high probability, correct more errors than anticipated.


title: UMBRAE: Unified Multimodal Decoding of Brain Signals

abstract: We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose UMBRAE, a unified multimodal decoding of brain signals. First, to extract instance-level conceptual and spatial details from neural signals, we introduce an efficient universal brain encoder for multimodal-brain alignment and recover object descriptions at multiple levels of granularity from subsequent multimodal large language model (MLLM). Second, we introduce a cross-subject training strategy mapping subject-specific features to a common feature space. This allows a model to be trained on multiple subjects without extra resources, even yielding superior results compared to subject-specific models. Further, we demonstrate this supports weakly-supervised adaptation to new subjects, with only a fraction of the total training data. Experiments demonstrate that UMBRAE not only achieves superior results in the newly introduced tasks but also outperforms methods in well established tasks. To assess our method, we construct and share with the community a comprehensive brain understanding benchmark BrainHub. Our code and benchmark are available at https://weihaox.github.io/UMBRAE.


title: Searching for Cosmological Collider in the Planck CMB Data

abstract: In this paper, we present the first comprehensive CMB data analysis of cosmological collider physics. New heavy particles during inflation can leave imprints in the primordial correlators which are observable in today's cosmological surveys. This remarkable detection channel provides an unsurpassed opportunity to probe new physics at extremely high energies. Here we initiate the search for these relic signals in the cosmic microwave background (CMB) data from the Planck legacy release. On the theory side, guided by recent progress from the cosmological bootstrap, we first propose a family of analytic bispectrum templates that incorporate the distinctive signatures of cosmological collider physics. Our consideration includes the oscillatory signals in the squeezed limit, the angular dependence from spinning fields, and several new shapes from nontrivial sound speed effects. On the observational side, we apply the recently developed pipeline, CMB Bispectrum Estimator (CMB-BEST), to efficiently analyze the three-point statistics and search directly for these new templates in the Planck 2018 temperature and polarization data. We report stringent CMB constraints on these new templates. Furthermore, we perform parameter scans to search for the best-fit values with maximum significance. For a benchmark example of collider templates, we find $f_{NL}=-91\pm40$ at the $68\%$ confidence level. After accounting for the look-elsewhere effect, the biggest adjusted significance we get is $1.8\sigma$. In general, we find no significant evidence of cosmological collider signals in the Planck data. However, this innovative analysis demonstrates the potential for discovering new heavy particles during inflation in forthcoming cosmological surveys.


title: BRAVE: Broadening the visual encoding of vision-language models

abstract: Vision-language models (VLMs) are typically composed of a vision encoder, e.g. CLIP, and a language model (LM) that interprets the encoded features to solve downstream tasks. Despite remarkable progress, VLMs are subject to several shortcomings due to the limited capabilities of vision encoders, e.g. "blindness" to certain image features, visual hallucination, etc. To address these issues, we study broadening the visual encoding capabilities of VLMs. We first comprehensively benchmark several vision encoders with different inductive biases for solving VLM tasks. We observe that there is no single encoding configuration that consistently achieves top performance across different tasks, and encoders with different biases can perform surprisingly similarly. Motivated by this, we introduce a method, named BRAVE, that consolidates features from multiple frozen encoders into a more versatile representation that can be directly fed as the input to a frozen LM. BRAVE achieves state-of-the-art performance on a broad range of captioning and VQA benchmarks and significantly reduces the aforementioned issues of VLMs, while requiring a smaller number of trainable parameters than existing methods and having a more compressed representation. Our results highlight the potential of incorporating different visual biases for a more broad and contextualized visual understanding of VLMs.


title: Quasars as standard candles VI: spectroscopic validation of the cosmological sample

abstract: A sample of quasars has been recently assembled to investigate the non-linear relation between their monochromatic luminosities at 2500{\AA}, and 2 keV and to exploit quasars as a new class of standardized candles. The use of this technique for cosmological purposes relies on the non-evolution with redshift of the UV-optical spectral properties of quasars, as well as on the absence of possible contaminants such as dust extinction and host-galaxy contribution. We address these possible issues by analysing the spectral properties of our cosmological quasar sample. We produced composite spectra in different bins of redshift and accretion parameters (black hole mass, bolometric luminosity), to investigate any possible evolution of the spectral properties of the continuum of the composites with these parameters. We found a remarkable similarity amongst the various stacked spectra. The overall shape of the continuum does not show any statistically significant trend with the accretion parameters nor with the redshift. The composite spectrum of our quasar sample is consistent with negligible levels of both intrinsic reddening (with a colour excess E(B-V)< 0.01) and host-galaxy emission (less than 10%) in the optical. We tested whether unaccounted dust extinction could explain the discrepancy between our cosmographic fit of the Hubble-Lemaitre diagram and the concordance {\Lambda}CDM model. The average colour excess required to solve the tension should increase with redshift up to unphysically high values (E(B-V)=0.1 at z>3) that would imply that the intrinsic emission of quasars is much bluer and more luminous than ever reported in observed spectra. The similarity of quasar spectra across the parameter space excludes a significant evolution of the average continuum properties with any of the explored parameters, confirming the reliability of our sample for cosmological applications.


title: GoodDrag: Towards Good Practices for Drag Editing with Diffusion Models

abstract: In this paper, we introduce GoodDrag, a novel approach to improve the stability and image quality of drag editing. Unlike existing methods that struggle with accumulated perturbations and often result in distortions, GoodDrag introduces an AlDD framework that alternates between drag and denoising operations within the diffusion process, effectively improving the fidelity of the result. We also propose an information-preserving motion supervision operation that maintains the original features of the starting point for precise manipulation and artifact reduction. In addition, we contribute to the benchmarking of drag editing by introducing a new dataset, Drag100, and developing dedicated quality assessment metrics, Dragging Accuracy Index and Gemini Score, utilizing Large Multimodal Models. Extensive experiments demonstrate that the proposed GoodDrag compares favorably against the state-of-the-art approaches both qualitatively and quantitatively. The project page is https://gooddrag.github.io.


title: Evolving Military Broadband Wireless Communication Systems: WiMAX, LTE and WLAN

abstract: Emerging technologies for mobile broadband wireless are being considered as a Commercial Off-The-Shelf solution to cover the operational requirements of the future warfare. The capabilities of these technologies are being enhanced to meet the growing market demands on performance. In this context, several standards such as WiMAX, LTE or WLAN are introducing themselves as strong candidates to fulfill these requirements. This paper presents an innovative scenario-based approach to develop a Military Broadband Wireless Communication System (MBWCS). Its main objective is to analyze how similar a military MBWCS can be to the identified civil standards, taking operational and high level technical requirements into account. This specification will be used for analyzing the applicability and the modifications of each of the standards layers individually. Proving the feasibility and aptitude of each standard provides strong foundations to address a MBWCS in the most efficient way.


title: Uncertainty-guided annotation enhances segmentation with the human-in-the-loop

abstract: Deep learning algorithms, often critiqued for their 'black box' nature, traditionally fall short in providing the necessary transparency for trusted clinical use. This challenge is particularly evident when such models are deployed in local hospitals, encountering out-of-domain distributions due to varying imaging techniques and patient-specific pathologies. Yet, this limitation offers a unique avenue for continual learning. The Uncertainty-Guided Annotation (UGA) framework introduces a human-in-the-loop approach, enabling AI to convey its uncertainties to clinicians, effectively acting as an automated quality control mechanism. UGA eases this interaction by quantifying uncertainty at the pixel level, thereby revealing the model's limitations and opening the door for clinician-guided corrections. We evaluated UGA on the Camelyon dataset for lymph node metastasis segmentation which revealed that UGA improved the Dice coefficient (DC), from 0.66 to 0.76 by adding 5 patches, and further to 0.84 with 10 patches. To foster broader application and community contribution, we have made our code accessible at


title: Deep Reinforcement Learning Based Toolpath Generation for Thermal Uniformity in Laser Powder Bed Fusion Process

abstract: Laser powder bed fusion (LPBF) is a widely used metal additive manufacturing technology. However, the accumulation of internal residual stress during printing can cause significant distortion and potential failure. Although various scan patterns have been studied to reduce possible accumulated stress, such as zigzag scanning vectors with changing directions or a chessboard-based scan pattern with divided small islands, most conventional scan patterns cannot significantly reduce residual stress. The proposed adaptive toolpath generation (ATG) algorithms, aiming to minimize the thermal gradients, may result in extremely accumulated temperature fields in some cases. To address these issues, we developed a deep reinforcement learning (DRL)-based toolpath generation framework, with the goal of achieving uniformly distributed heat and avoiding extremely thermal accumulation regions during the LPBF process. We first developed an overall pipeline for the DRL-based toolpath generation framework, which includes uniformly sampling, agent moving and environment observation, action selection, moving constraints, rewards calculation, and the training process. To accelerate the training process, we simplified the data-intensive numerical model by considering the turning angles on the toolpath. We designed the action spaces with three options, including the minimum temperature value, the smoothest path, and the second smoothest path. The reward function was designed to minimize energy density to ensure the temperature field remains relatively stable. To verify the effectiveness of the proposed DRL-based toolpath generation framework, we performed numerical simulations of polygon shape printing domains. In addition, four groups of thin plate samples with different scan patterns were compared using the LPBF process.


title: Sampling recovery on function classes with a structural condition

abstract: Sampling recovery on some function classes is studied in this paper. Typically, function classes are defined by imposing smoothness conditions. It was understood in nonlinear approximation that structural conditions in the form of control of the number of big coefficients of an expansion of a function with respect to a given system of functions plays an important role. Sampling recovery on smoothness classes is an area of active research, some problems, especially in the case of mixed smoothness classes, are still open. It was discovered recently that universal sampling discretization and nonlinear sparse approximations are useful in the sampling recovery problem. This motivated us to systematically study sampling recovery on function classes with a structural condition. Some results in this direction are already known. In particular, the classes defined by conditions on coefficients with indices from the domains, which are differences of two dyadic cubes are studied in the recent author's papers. In this paper we concentrate on studying function classes defined by conditions on coefficients with indices from the domains, which are differences of two dyadic hyperbolic crosses.


title: A real-time Artificial Intelligence system for learning Sign Language

abstract: A primary challenge for the deaf and hearing-impaired community stems from the communication gap with the hearing society, which can greatly impact their daily lives and result in social exclusion. To foster inclusivity in society, our endeavor focuses on developing a cost-effective, resource-efficient, and open technology based on Artificial Intelligence, designed to assist people in learning and using Sign Language for communication. The analysis presented in this research paper intends to enrich the recent academic scientific literature on Sign Language solutions based on Artificial Intelligence, with a particular focus on American Sign Language (ASL). This research has yielded promising preliminary results and serves as a basis for further development.


title: Hybrid Training of Denoising Networks to Improve the Texture Acutance of Digital Cameras

abstract: In order to evaluate the capacity of a camera to render textures properly, the standard practice, used by classical scoring protocols, is to compute the frequential response to a dead leaves image target, from which is built a texture acutance metric. In this work, we propose a mixed training procedure for image restoration neural networks, relying on both natural and synthetic images, that yields a strong improvement of this acutance metric without impairing fidelity terms. The feasibility of the approach is demonstrated both on the denoising of RGB images and the full development of RAW images, opening the path to a systematic improvement of the texture acutance of real imaging devices.


title: Evolving Genetic Programming Tree Models for Predicting the Mechanical Properties of Green Fibers for Better Biocomposite Materials

abstract: Advanced modern technology and industrial sustainability theme have contributed implementing composite materials for various industrial applications. Green composites are among the desired alternatives for the green products. However, to properly control the performance of the green composites, predicting their constituents properties are of paramount importance. This work presents an innovative evolving genetic programming tree models for predicting the mechanical properties of natural fibers based upon several inherent chemical and physical properties. Cellulose, hemicellulose, lignin and moisture contents as well as the Microfibrillar angle of various natural fibers were considered to establish the prediction models. A one-hold-out methodology was applied for training/testing phases. Robust models were developed to predict the tensile strength, Young's modulus, and the elongation at break properties of the natural fibers. It was revealed that Microfibrillar angle was dominant and capable of determining the ultimate tensile strength of the natural fibers by 44.7% comparable to other considered properties, while the impact of cellulose content in the model was only 35.6%. This in order would facilitate utilizing artificial intelligence in predicting the overall mechanical properties of natural fibers without experimental efforts and cost to enhance developing better green composite materials for various industrial applications.


title: Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions

abstract: The advent of Large Language Models (LLMs) has significantly reshaped the trajectory of the AI revolution. Nevertheless, these LLMs exhibit a notable limitation, as they are primarily adept at processing textual information. To address this constraint, researchers have endeavored to integrate visual capabilities with LLMs, resulting in the emergence of Vision-Language Models (VLMs). These advanced models are instrumental in tackling more intricate tasks such as image captioning and visual question answering. In our comprehensive survey paper, we delve into the key advancements within the realm of VLMs. Our classification organizes VLMs into three distinct categories: models dedicated to vision-language understanding, models that process multimodal inputs to generate unimodal (textual) outputs and models that both accept and produce multimodal inputs and outputs.This classification is based on their respective capabilities and functionalities in processing and generating various modalities of data.We meticulously dissect each model, offering an extensive analysis of its foundational architecture, training data sources, as well as its strengths and limitations wherever possible, providing readers with a comprehensive understanding of its essential components. We also analyzed the performance of VLMs in various benchmark datasets. By doing so, we aim to offer a nuanced understanding of the diverse landscape of VLMs. Additionally, we underscore potential avenues for future research in this dynamic domain, anticipating further breakthroughs and advancements.


title: Computation Offloading for Multi-server Multi-access Edge Vehicular Networks: A DDQN-based Method

abstract: In this paper, we investigate a multi-user offloading problem in the overlapping domain of a multi-server mobile edge computing system. We divide the original problem into two stages: the offloading decision making stage and the request scheduling stage. To prevent the terminal from going out of service area during offloading, we consider the mobility parameter of the terminal according to the human behaviour model when making the offloading decision, and then introduce a server evaluation mechanism based on both the mobility parameter and the server load to select the optimal offloading server. In order to fully utilise the server resources, we design a double deep Q-network (DDQN)-based reward evaluation algorithm that considers the priority of tasks when scheduling offload requests. Finally, numerical simulations are conducted to verify that our proposed method outperforms traditional mathematical computation methods as well as the DQN algorithm.


title: A Bio-Medical Snake Optimizer System Driven by Logarithmic Surviving Global Search for Optimizing Feature Selection and its application for Disorder Recognition

abstract: It is of paramount importance to enhance medical practices, given how important it is to protect human life. Medical therapy can be accelerated by automating patient prediction using machine learning techniques. To double the efficiency of classifiers, several preprocessing strategies must be adopted for their crucial duty in this field. Feature selection (FS) is one tool that has been used frequently to modify data and enhance classification outcomes by lowering the dimensionality of datasets. Excluded features are those that have a poor correlation coefficient with the label class, that is, they have no meaningful correlation with classification and do not indicate where the instance belongs. Along with the recurring features, which show a strong association with the remainder of the features. Contrarily, the model being produced during training is harmed, and the classifier is misled by their presence. This causes overfitting and increases algorithm complexity and processing time. These are used in exploration to allow solutions to be found more thoroughly and in relation to a chosen solution than at random. TLSO, PLSO, and LLSO stand for Tournament Logarithmic Snake Optimizer, Proportional Logarithmic Snake Optimizer, and Linear Order Logarithmic Snake Optimizer, respectively. A number of 22 reference medical datasets were used in experiments. The findings indicate that, among 86 % of the datasets, TLSO attained the best accuracy, and among 82 % of the datasets, the best feature reduction. In terms of the standard deviation, the TLSO also attained noteworthy reliability and stability. On the basis of running duration, it is, nonetheless, quite effective.


title: Attention-aware Semantic Communications for Collaborative Inference

abstract: We propose a communication-efficient collaborative inference framework in the domain of edge inference, focusing on the efficient use of vision transformer (ViT) models. The partitioning strategy of conventional collaborative inference fails to reduce communication cost because of the inherent architecture of ViTs maintaining consistent layer dimensions across the entire transformer encoder. Therefore, instead of employing the partitioning strategy, our framework utilizes a lightweight ViT model on the edge device, with the server deploying a complicated ViT model. To enhance communication efficiency and achieve the classification accuracy of the server model, we propose two strategies: 1) attention-aware patch selection and 2) entropy-aware image transmission. Attention-aware patch selection leverages the attention scores generated by the edge device's transformer encoder to identify and select the image patches critical for classification. This strategy enables the edge device to transmit only the essential patches to the server, significantly improving communication efficiency. Entropy-aware image transmission uses min-entropy as a metric to accurately determine whether to depend on the lightweight model on the edge device or to request the inference from the server model. In our framework, the lightweight ViT model on the edge device acts as a semantic encoder, efficiently identifying and selecting the crucial image information required for the classification task. Our experiments demonstrate that the proposed collaborative inference framework can reduce communication overhead by 68% with only a minimal loss in accuracy compared to the server model on the ImageNet dataset.


title: Miniaturized time-correlated single-photon counting module for time-of-flight non-line-of-sight imaging applications

abstract: Single-photon time-of-flight (TOF) non-line-of-sight (NLOS) imaging enables the high-resolution reconstruction of objects outside the field of view. The compactness of TOF NLOS imaging systems, entailing the miniaturization of key components within such systems is crucial for practical applications. Here, we present a miniaturized four-channel time-correlated single-photon counting module dedicated to TOF NLOS imaging applications. The module achieves excellent performance with a 10 ps bin size and 27.4 ps minimum root-mean-square time resolution. We present the results of TOF NLOS imaging experiment using an InGaAs/InP single-photon detector and the time-correlated single-photon counting module, and show that a 6.3 cm lateral resolution and 2.3 cm depth resolution can be achieved under the conditions of 5 m imaging distance and 1 ms pixel dwell time.


title: Leave No One Behind: Online Self-Supervised Self-Distillation for Sequential Recommendation

abstract: Sequential recommendation methods play a pivotal role in modern recommendation systems. A key challenge lies in accurately modeling user preferences in the face of data sparsity. To tackle this challenge, recent methods leverage contrastive learning (CL) to derive self-supervision signals by maximizing the mutual information of two augmented views of the original user behavior sequence. Despite their effectiveness, CL-based methods encounter a limitation in fully exploiting self-supervision signals for users with limited behavior data, as users with extensive behaviors naturally offer more information. To address this problem, we introduce a novel learning paradigm, named Online Self-Supervised Self-distillation for Sequential Recommendation ($S^4$Rec), effectively bridging the gap between self-supervised learning and self-distillation methods. Specifically, we employ online clustering to proficiently group users by their distinct latent intents. Additionally, an adversarial learning strategy is utilized to ensure that the clustering procedure is not affected by the behavior length factor. Subsequently, we employ self-distillation to facilitate the transfer of knowledge from users with extensive behaviors (teachers) to users with limited behaviors (students). Experiments conducted on four real-world datasets validate the effectiveness of the proposed method.


title: Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers

abstract: Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly challenging as the corpus of documents scales up, with Retrievers playing an outsized role in the overall RAG accuracy by extracting the most relevant document from the corpus to provide context to the LLM. In this paper, we propose the 'Blended RAG' method of leveraging semantic search techniques, such as Dense Vector indexes and Sparse Encoder indexes, blended with hybrid query strategies. Our study achieves better retrieval results and sets new benchmarks for IR (Information Retrieval) datasets like NQ and TREC-COVID datasets. We further extend such a 'Blended Retriever' to the RAG system to demonstrate far superior results on Generative Q\&A datasets like SQUAD, even surpassing fine-tuning performance.


title: Improving Retrieval for RAG based Question Answering Models on Financial Documents

abstract: The effectiveness of Large Language Models (LLMs) in generating accurate responses relies heavily on the quality of input provided, particularly when employing Retrieval Augmented Generation (RAG) techniques. RAG enhances LLMs by sourcing the most relevant text chunk(s) to base queries upon. Despite the significant advancements in LLMs' response quality in recent years, users may still encounter inaccuracies or irrelevant answers; these issues often stem from suboptimal text chunk retrieval by RAG rather than the inherent capabilities of LLMs. To augment the efficacy of LLMs, it is crucial to refine the RAG process. This paper explores the existing constraints of RAG pipelines and introduces methodologies for enhancing text retrieval. It delves into strategies such as sophisticated chunking techniques, query expansion, the incorporation of metadata annotations, the application of re-ranking algorithms, and the fine-tuning of embedding algorithms. Implementing these approaches can substantially improve the retrieval quality, thereby elevating the overall performance and reliability of LLMs in processing and responding to queries.


title: Liquidity Jump, Liquidity Diffusion, and Treatment on Wash Trading of Crypto Assets

abstract: We propose that the liquidity of an asset includes two components: liquidity jump and liquidity diffusion. We show that liquidity diffusion has a higher correlation with crypto wash trading than liquidity jump and demonstrate that treatment on wash trading significantly reduces the level of liquidity diffusion, but only marginally reduces that of liquidity jump. We confirm that the autoregressive models are highly effective in modeling the liquidity-adjusted return with and without the treatment on wash trading. We argue that treatment on wash trading is unnecessary in modeling established crypto assets that trade in unregulated but mainstream exchanges.


title: Stock Recommendations for Individual Investors: A Temporal Graph Network Approach with Diversification-Enhancing Contrastive Learning

abstract: In complex financial markets, recommender systems can play a crucial role in empowering individuals to make informed decisions. Existing studies predominantly focus on price prediction, but even the most sophisticated models cannot accurately predict stock prices. Also, many studies show that most individual investors do not follow established investment theories because they have their own preferences. Hence, the tricky point in stock recommendation is that recommendations should give good investment performance but also should not ignore individual preferences. To develop effective stock recommender systems, it is essential to consider three key aspects: 1) individual preferences, 2) portfolio diversification, and 3) temporal aspect of both stock features and individual preferences. In response, we develop the portfolio temporal graph network recommender PfoTGNRec, which can handle time-varying collaborative signals and incorporates diversification-enhancing contrastive learning. As a result, our model demonstrated superior performance compared to various baselines, including cutting-edge dynamic embedding models and existing stock recommendation models, in a sense that our model exhibited good investment performance while maintaining competitive in capturing individual preferences. The source code and data are available at https://anonymous.4open.science/r/IJCAI2024-12F4.


title: Detection of financial opportunities in micro-blogging data with a stacked classification system

abstract: Micro-blogging sources such as the Twitter social network provide valuable real-time data for market prediction models. Investors' opinions in this network follow the fluctuations of the stock markets and often include educated speculations on market opportunities that may have impact on the actions of other investors. In view of this, we propose a novel system to detect positive predictions in tweets, a type of financial emotions which we term "opportunities" that are akin to "anticipation" in Plutchik's theory. Specifically, we seek a high detection precision to present a financial operator a substantial amount of such tweets while differentiating them from the rest of financial emotions in our system. We achieve it with a three-layer stacked Machine Learning classification system with sophisticated features that result from applying Natural Language Processing techniques to extract valuable linguistic information. Experimental results on a dataset that has been manually annotated with financial emotion and ticker occurrence tags demonstrate that our system yields satisfactory and competitive performance in financial opportunity detection, with precision values up to 83%. This promising outcome endorses the usability of our system to support investors' decision making.


title: Unveiling the Impact of Macroeconomic Policies: A Double Machine Learning Approach to Analyzing Interest Rate Effects on Financial Markets

abstract: This study examines the effects of macroeconomic policies on financial markets using a novel approach that combines Machine Learning (ML) techniques and causal inference. It focuses on the effect of interest rate changes made by the US Federal Reserve System (FRS) on the returns of fixed income and equity funds between January 1986 and December 2021. The analysis makes a distinction between actively and passively managed funds, hypothesizing that the latter are less susceptible to changes in interest rates. The study contrasts gradient boosting and linear regression models using the Double Machine Learning (DML) framework, which supports a variety of statistical learning techniques. Results indicate that gradient boosting is a useful tool for predicting fund returns; for example, a 1% increase in interest rates causes an actively managed fund's return to decrease by -11.97%. This understanding of the relationship between interest rates and fund performance provides opportunities for additional research and insightful, data-driven advice for fund managers and investors


title: Houston we have a Divergence: A Subgroup Performance Analysis of ASR Models

abstract: The Fearless Steps APOLLO Community Resource provides unparalleled opportunities to explore the potential of multi-speaker team communications from NASA Apollo missions. This study focuses on discovering the characteristics that make Apollo recordings more or less intelligible to Automatic Speech Recognition (ASR) methods. We extract, for each audio recording, interpretable metadata on recordings (signal-to-noise ratio, spectral flatness, presence of pauses, sentence duration), transcript (number of words spoken, speaking rate), or known a priori (speaker). We identify subgroups of audio recordings based on combinations of these metadata and compute each subgroup's performance (e.g., Word Error Rate) and the difference in performance (''divergence'') w.r.t the overall population. We then apply the Whisper model in different sizes, trained on English-only or multilingual datasets, in zero-shot or after fine-tuning. We conduct several analyses to (i) automatically identify and describe the most problematic subgroups for a given model, (ii) examine the impact of fine-tuning w.r.t. zero-shot at the subgroup level, (iii) understand the effect of model size on subgroup performance, and (iv) analyze if multilingual models are more sensitive than monolingual to subgroup performance disparities. The insights enhance our understanding of subgroup-specific performance variations, paving the way for advancements in optimizing ASR systems for Earth-to-space communications.


title: Is Complexity an Illusion?

abstract: Simplicity is held by many to be the key to general intelligence. Simpler models tend to "generalise", identifying the cause or generator of data with greater sample efficiency. The implications of the correlation between simplicity and generalisation extend far beyond computer science, addressing questions of physics and even biology. Yet simplicity is a property of form, while generalisation is of function. In interactive settings, any correlation between the two depends on interpretation. In theory there could be no correlation and yet in practice, there is. Previous theoretical work showed generalisation to be a consequence of "weak" constraints implied by function, not form. Experiments demonstrated choosing weak constraints over simple forms yielded a 110-500% improvement in generalisation rate. Here we show that all constraints can take equally simple forms, regardless of weakness. However if forms are spatially extended, then function is represented using a finite subset of forms. If function is represented using a finite subset of forms, then we can force a correlation between simplicity and generalisation by making weak constraints take simple forms. If function is determined by a goal directed process that favours versatility (e.g. natural selection), then efficiency demands weak constraints take simple forms. Complexity has no causal influence on generalisation, but appears to due to confounding.


title: Block-SSD: A New Block-Based Blocking SSD Architecture

abstract: Computer science and related fields (e.g., computer engineering, computer hardware engineering, electrical engineering, electrical and computer engineering, computer systems engineering) often draw inspiration from other fields, areas, and the real world in order to describe topics in their area. One cross-domain example is the idea of a block. The idea of blocks comes in many flavors, including software (e.g., process control blocks, file system blocks, data blocks, basic blocks, blocking statements, blocking processes, blocker bugs) and hardware (e.g., NAND flash blocks, cache blocks, logic blocks); however, this makes it difficult to precisely discern what a "block" is. In this work, we make little (negative) effort to disambiguate these terms and propose our own set of overloaded terms to increase the complexity of this paper. To inspire new students to join their research groups, professors often hang posters or other publications along the walls adjacent to their offices. Regrettably, Saugata does not have any posters directly covering his door, leaving prime real estate. Therefore, this underutilized space in the Siebel Center for Computer Science offers substantial opportunities for renovations. To alleviate this concern, we propose Block-SSD. Block-SSD takes a basic block, formed out of a page, and physically combines these blocks into larger blocks. Those blocks are then formed into a larger door block, which cover most of the professor's door. To our knowledge, we are the first to design a block-based blocking Sabotaging Saugata's Door (SSD) architecture.


title: Personality-affected Emotion Generation in Dialog Systems

abstract: Generating appropriate emotions for responses is essential for dialog systems to provide human-like interaction in various application scenarios. Most previous dialog systems tried to achieve this goal by learning empathetic manners from anonymous conversational data. However, emotional responses generated by those methods may be inconsistent, which will decrease user engagement and service quality. Psychological findings suggest that the emotional expressions of humans are rooted in personality traits. Therefore, we propose a new task, Personality-affected Emotion Generation, to generate emotion based on the personality given to the dialog system and further investigate a solution through the personality-affected mood transition. Specifically, we first construct a daily dialog dataset, Personality EmotionLines Dataset (PELD), with emotion and personality annotations. Subsequently, we analyze the challenges in this task, i.e., (1) heterogeneously integrating personality and emotional factors and (2) extracting multi-granularity emotional information in the dialog context. Finally, we propose to model the personality as the transition weight by simulating the mood transition process in the dialog system and solve the challenges above. We conduct extensive experiments on PELD for evaluation. Results suggest that by adopting our method, the emotion generation performance is improved by 13% in macro-F1 and 5% in weighted-F1 from the BERT-base model.


title: Interval-valued fuzzy soft $\beta$-covering approximation spaces

abstract: The concept of interval-valued fuzzy soft $\beta$-covering approximation spaces (IFS$\beta$CASs) is introduced to combine the theories of soft sets, rough sets and interval-valued fuzzy sets, and some fundamental propositions concerning interval-valued fuzzy soft $\beta$-neighborhoods and soft $\beta$-neighborhoods of IFS$\beta$CASs are explored. And then four kinds of interval-valued fuzzy soft $\beta$-coverings based fuzzy rough sets are researched. Finally, the relationships of four kinds of interval-valued fuzzy soft $\beta$-coverings based fuzzy rough sets are investigated.


title: Bounds on the ground state energy of quantum $p$-spin Hamiltonians

abstract: We consider the problem of estimating the ground state energy of quantum $p$-local spin glass random Hamiltonians, the quantum analogues of widely studied classical spin glass models. Our main result shows that the maximum energy achievable by product states has a well-defined limit (for even $p$) as $n\to\infty$ and is $E_{\text{product}}^\ast=\sqrt{2 \log p}$ in the limit of large $p$. This value is interpreted as the maximal energy of a much simpler so-called Random Energy Model, widely studied in the setting of classical spin glasses. The proof of the limit existing follows from an extension of Fekete's Lemma after we demonstrate near super-additivity of the (normalized) quenched free energy. The proof of the value follows from a second moment method on the number of states achieving a given energy when restricting to an $\epsilon$-net of product states. Furthermore, we relate the maximal energy achieved over all states to a $p$-dependent constant $\gamma\left(p\right)$, which is defined by the degree of violation of a certain asymptotic independence ansatz over graph matchings. We show that the maximal energy achieved by all states $E^\ast\left(p\right)$ in the limit of large $n$ is at most $\sqrt{\gamma\left(p\right)}E_{\text{product}}^\ast$. We also prove using Lindeberg's interpolation method that the limiting $E^\ast\left(p\right)$ is robust with respect to the choice of the randomness and, for instance, also applies to the case of sparse random Hamiltonians. This robustness in the randomness extends to a wide range of random Hamiltonian models including SYK and random quantum max-cut.


title: Ideal Magnetohydrodynamics and Field Dislocation Mechanics

abstract: The fully nonlinear (geometric and material) system of Field Dislocation Mechanics is reviewed to establish an exact analogy with the equations of ideal magnetohydrodynamics (ideal MHD) under suitable physically simplifying circumstances. Weak solutions with various conservation properties have been established for ideal MHD recently by Faraco, Lindberg, and Szekelyhidi using the techniques of compensated compactness of Tartar and Murat and convex integration; by the established analogy, these results would seem to be transferable to the idealization of Field Dislocation Mechanics considered. A dual variational principle is designed and discussed for this system of PDE, with the technique transferable to the study of MHD as well.

categories: math.AP cond-mat.mtrl-sci math-ph math.MP


title: Structure of the codimesion one gradient flows with at most six singular points on the M\"obius strip

abstract: We describe all possible topological structures of Morse flows and typical one-parametric gradient bifurcation on the M\"obius strip in the case that the number of singular point of flows is at most six. To describe structures, we use the separatrix diagrams of flows. The saddle-node bifurcation is specified by selecting a separatrix in the diagram of the Morse flow befor the bifurcation and the saddle connection is specified by a separatrix, which connect two saddles on the diagram.


title: Goal-guided Generative Prompt Injection Attack on Large Language Models

abstract: Current large language models (LLMs) provide a strong foundation for large-scale user-oriented natural language tasks. A large number of users can easily inject adversarial text or instructions through the user interface, thus causing LLMs model security challenges. Although there is currently a large amount of research on prompt injection attacks, most of these black-box attacks use heuristic strategies. It is unclear how these heuristic strategies relate to the success rate of attacks and thus effectively improve model robustness. To solve this problem, we redefine the goal of the attack: to maximize the KL divergence between the conditional probabilities of the clean text and the adversarial text. Furthermore, we prove that maximizing the KL divergence is equivalent to maximizing the Mahalanobis distance between the embedded representation $x$ and $x'$ of the clean text and the adversarial text when the conditional probability is a Gaussian distribution and gives a quantitative relationship on $x$ and $x'$. Then we designed a simple and effective goal-guided generative prompt injection strategy (G2PIA) to find an injection text that satisfies specific constraints to achieve the optimal attack effect approximately. It is particularly noteworthy that our attack method is a query-free black-box attack method with low computational cost. Experimental results on seven LLM models and four datasets show the effectiveness of our attack method.


title: Explaining EDA synthesis errors with LLMs

abstract: Training new engineers in digital design is a challenge, particularly when it comes to teaching the complex electronic design automation (EDA) tooling used in this domain. Learners will typically deploy designs in the Verilog and VHDL hardware description languages to Field Programmable Gate Arrays (FPGAs) from Altera (Intel) and Xilinx (AMD) via proprietary closed-source toolchains (Quartus Prime and Vivado, respectively). These tools are complex and difficult to use -- yet, as they are the tools used in industry, they are an essential first step in this space. In this work, we examine how recent advances in artificial intelligence may be leveraged to address aspects of this challenge. Specifically, we investigate if Large Language Models (LLMs), which have demonstrated text comprehension and question-answering capabilities, can be used to generate novice-friendly explanations of compile-time synthesis error messages from Quartus Prime and Vivado. To perform this study we generate 936 error message explanations using three OpenAI LLMs over 21 different buggy code samples. These are then graded for relevance and correctness, and we find that in approximately 71% of cases the LLMs give correct & complete explanations suitable for novice learners.


title: Lightweight Deep Learning for Resource-Constrained Environments: A Survey

abstract: Over the past decade, the dominance of deep learning has prevailed across various domains of artificial intelligence, including natural language processing, computer vision, and biomedical signal processing. While there have been remarkable improvements in model accuracy, deploying these models on lightweight devices, such as mobile phones and microcontrollers, is constrained by limited resources. In this survey, we provide comprehensive design guidance tailored for these devices, detailing the meticulous design of lightweight models, compression methods, and hardware acceleration strategies. The principal goal of this work is to explore methods and concepts for getting around hardware constraints without compromising the model's accuracy. Additionally, we explore two notable paths for lightweight deep learning in the future: deployment techniques for TinyML and Large Language Models. Although these paths undoubtedly have potential, they also present significant challenges, encouraging research into unexplored areas.


title: Intricate magnetic interactions and topological Hall effect observed in itinerant room-temperature layered ferromagnet Cr0.83Te

abstract: We report the magnetic, electrical, and magnetotransport (Hall effect) properties of the hexagonal itinerant ferromagnet Cr$_{0.83}$Te. Further, a comprehensive study of the magneto-entropy scaling behavior has been done around the Curie temperature of $T_C \approx$ 338 K. A maximum entropy change (-$\Delta S_{m}^{max}$) of 2.77 $J/kg-K$ and relative cooling power (RCP) of 88.29 $J/kg$ near the T$_C$ have been achieved under an applied magnetic field of 5 Tesla. The critical exponents, $\beta$ = 0.4739(4), $\gamma$ = 1.2812(3), and $\delta$ = 3.7037(5), have been extracted using the magneto-entropy scaling analysis. The obtained critical exponents indicate the presence of intricate magnetic interactions in Cr$_{0.83}$Te. On the other hand, the magnetotransport study reveals a topological Hall effect attributed to the noncoplanar spin structure coexisting with a robust magnetocrystalline anisotropy. Further, we observe that the extrinsic skew-scattering mechanism originated anomalous Hall effect. Our experimental findings of the anomalous and topological Hall effect properties in the presence of intriguing high-temperature itinerant ferromagnetism and magnetocaloric effect in Cr$_{0.83}$Te can offer potential technological applications at room temperature.


title: Application of the chemical master equation and its analytical solution to the illness-death model

abstract: The aim of this article is relating the chemical master equation (CME) to the illness-death model for chronic diseases. We show that a recently developed differential equation for the prevalence directly follows from the CME. As an application, we use the theory of the CME in a simulation study about diabetes in Germany from a previous publication. We find a good agreement between the theory and the simulations.


title: Advancements in Radiomics and Artificial Intelligence for Thyroid Cancer Diagnosis

abstract: Thyroid cancer is an increasing global health concern that requires advanced diagnostic methods. The application of AI and radiomics to thyroid cancer diagnosis is examined in this review. A review of multiple databases was conducted in compliance with PRISMA guidelines until October 2023. A combination of keywords led to the discovery of an English academic publication on thyroid cancer and related subjects. 267 papers were returned from the original search after 109 duplicates were removed. Relevant studies were selected according to predetermined criteria after 124 articles were eliminated based on an examination of their abstract and title. After the comprehensive analysis, an additional six studies were excluded. Among the 28 included studies, radiomics analysis, which incorporates ultrasound (US) images, demonstrated its effectiveness in diagnosing thyroid cancer. Various results were noted, some of the studies presenting new strategies that outperformed the status quo. The literature has emphasized various challenges faced by AI models, including interpretability issues, dataset constraints, and operator dependence. The synthesized findings of the 28 included studies mentioned the need for standardization efforts and prospective multicenter studies to address these concerns. Furthermore, approaches to overcome these obstacles were identified, such as advances in explainable AI technology and personalized medicine techniques. The review focuses on how AI and radiomics could transform the diagnosis and treatment of thyroid cancer. Despite challenges, future research on multidisciplinary cooperation, clinical applicability validation, and algorithm improvement holds the potential to improve patient outcomes and diagnostic precision in the treatment of thyroid cancer.


title: Interactions Between Brauer Configuration Algebras and Classical Cryptanalysis to Analyze Bach's Canons

abstract: Since their introduction, Brauer configuration algebras (BCAs) and their specialized messages have helped research in several fields of mathematics and sciences. This paper deals with a new perspective on using such algebras as a theoretical framework in classical cryptography and music theory. It is proved that some block cyphers define labeled Brauer configuration algebras. Particularly, the dimension of the BCA associated with a ciphertext-only attack of the Vigenere cryptosystem is given by the corresponding key's length and the captured ciphertext's coincidence index. On the other hand, historically, Bach's canons have been considered solved music puzzles. However, due to how Bach posed such canons, the question remains whether their solutions are only limited to musical issues. This paper gives alternative solutions based on the theory of Brauer configuration algebras to some of the puzzle canons proposed by Bach in his Musical Offering (BWV 1079) and the canon \^a 4 Voc: Perpetuus (BWV 1073). Specifically to the canon \^a 6 Voc (BWV 1076), canon 1 \^a2 (also known as the crab canon), and canon \^a4 Quaerendo Invenietis. These solutions are obtained by interpreting such canons as ciphertexts (via route and transposition cyphers) of some specialized Brauer messages. In particular, it is noted that the structure or form of the notes used in such canons can be described via the shape of the most used symbols in Bach's works.


title: Introducing Quantum Information and Computation to a Broader Audience with MOOCs at OpenHPI

abstract: Quantum computing is an exciting field with high disruptive potential, but very difficult to access. For this reason, numerous concepts are being developed worldwide on how quantum computing can be taught. This always raises questions about the didactic concept, the content actually taught, and how to measure the success of the teaching concept. In 2022 and 2023, the authors gave a total of nine two-week MOOCs (massive open online courses) with different possible learning paths on the Hasso Plattner Institute's OpenHPI platform. The platform's purpose is to make computer science education available to everyone free of charge. The nine quantum courses form a self-contained curriculum. A total of 17157 course attendances have been taken by 7413 natural persons, and the number is still rising. This paper presents the course concept and then evaluates the anonymized data on the background of the participants, their behavior in the courses, and their learning success. In the present paper for the first time such a large dataset of MOOC-based quantum computing education is analyzed. The summarized results are a heterogeneous personal background of the participants biased towards IT professionals, a majority following the didactic recommendations, and a high success rate, which is strongly correlatatd to following the didactic recommendations. The amount of data from such a large group of quantum computing learners offers numerous starting points for further research in the field of quantum computing education.


title: Sandwich attack: Multi-language Mixture Adaptive Attack on LLMs

abstract: Large Language Models (LLMs) are increasingly being developed and applied, but their widespread use faces challenges. These include aligning LLMs' responses with human values to prevent harmful outputs, which is addressed through safety training methods. Even so, bad actors and malicious users have succeeded in attempts to manipulate the LLMs to generate misaligned responses for harmful questions such as methods to create a bomb in school labs, recipes for harmful drugs, and ways to evade privacy rights. Another challenge is the multilingual capabilities of LLMs, which enable the model to understand and respond in multiple languages. Consequently, attackers exploit the unbalanced pre-training datasets of LLMs in different languages and the comparatively lower model performance in low-resource languages than high-resource ones. As a result, attackers use a low-resource languages to intentionally manipulate the model to create harmful responses. Many of the similar attack vectors have been patched by model providers, making the LLMs more robust against language-based manipulation. In this paper, we introduce a new black-box attack vector called the \emph{Sandwich attack}: a multi-language mixture attack, which manipulates state-of-the-art LLMs into generating harmful and misaligned responses. Our experiments with five different models, namely Google's Bard, Gemini Pro, LLaMA-2-70-B-Chat, GPT-3.5-Turbo, GPT-4, and Claude-3-OPUS, show that this attack vector can be used by adversaries to generate harmful responses and elicit misaligned responses from these models. By detailing both the mechanism and impact of the Sandwich attack, this paper aims to guide future research and development towards more secure and resilient LLMs, ensuring they serve the public good while minimizing potential for misuse.


title: Interacting tachyon with varying mass dark matter

abstract: This paper presents an investigation of cosmological dynamics of tachyon fluid coupled to varyingmass dark matter particles in the background of spatially flat FLRW universe. The mechanism of varying mass particles scenario assumes the mass of the dark matter depends on time t through the scalar field ${\phi}$ in the sense that the decaying of dark matter reproduces the scalar field. First, we analyze the model from dynamical systems perspective by converting the cosmological evolution equations into an autonomous system of ordinary differential equations with a suitable transformation of variables. We choose the mass of dark matter as exponential function of scalar field and the exponential potential of the tachyon field is undertaken in such a way that the autonomous system is reduced in three dimensional form. The critical points obtained from the system are non-hyperbolic in nature. The center manifold theory is employed to discuss the nature of the critical points. Numerical investigation also carried out for some critical points. From this analysis, we obtain dust dominated decelerated transient phase of the universe followed by dark energy dominated scaling attractor alleviating the coincidence problem. Next, we perform the statefinder diagnostic approach to compare our model to ${\Lambda}$CDM and finally we study the evolution of the Hubble parameter and the distance modulus and compare this with observational data.


title: Smearing of primordial gravitational waves

abstract: A mechanism for smearing of the primordial gravitational waves during the radiation-dominated phase of the evolution of the Universe is considered. It is shown that the primordial gravitational waves can possess hyperbolicity features due to their propagation through the matter inhomogeneities. This mechanism of smearing can lead to the flattening of the original gravitational wave spectrum and hence has to be taken into account at the interpretation of the properties of primordial gravitational background on the detection of which are oriented ongoing and forthcoming experimental facilities.


title: Generative Resident Separation and Multi-label Classification for Multi-person Activity Recognition

abstract: This paper presents two models to address the problem of multi-person activity recognition using ambient sensors in a home. The first model, Seq2Res, uses a sequence generation approach to separate sensor events from different residents. The second model, BiGRU+Q2L, uses a Query2Label multi-label classifier to predict multiple activities simultaneously. Performances of these models are compared to a state-of-the-art model in different experimental scenarios, using a state-of-the-art dataset of two residents in a home instrumented with ambient sensors. These results lead to a discussion on the advantages and drawbacks of resident separation and multi-label classification for multi-person activity recognition.


title: Prospects of the multi-channel photometric survey telescope in the cosmological application of Type Ia supernovae

abstract: The Multi-channel Photometric Survey Telescope (Mephisto) is a real-time, three-color photometric system designed to capture the color evolution of stars and transients accurately. This telescope system can be crucial in cosmological distance measurements of low-redshift (low-$z$, $z$ $\lesssim 0.1$) Type Ia supernovae (SNe Ia). To optimize the capabilities of this instrument, we perform a comprehensive simulation study before its official operation is scheduled to start. By considering the impact of atmospheric extinction, weather conditions, and the lunar phase at the observing site involving the instrumental features, we simulate the light curves of SNe Ia obtained by the Mephisto. The best strategy in the case of SN Ia cosmology is to take the image at an exposure time of 130 s with a cadence of 3 days. In this condition, Mephisto can obtain hundreds of high-quality SNe Ia to achieve a distance measurement better than $4.5\%$. Given the on-time spectral classification and monitoring of the Lijiang 2.4 m Telescope at the same observatory, Mephisto, in the whole operation, can significantly enrich the well-calibrated sample of supernovae at low-$z$ and improve the calibration accuracy of high-$z$ SNe Ia.


title: Thermodynamic formalism for subsystems of expanding Thurston maps II

abstract: Expanding Thurston maps were introduced by M. Bonk and D. Meyer with motivation from complex dynamics and Cannon's conjecture from geometric group theory via Sullivan's dictionary. In this paper, we study subsystems of expanding Thurston maps motivated via Sullivan's dictionary as analogs of some subgroups of Kleinian groups. We prove the uniqueness and various ergodic properties of the equilibrium states for strongly primitive subsystems and real-valued H\"older continuous potentials, and establish the equidistribution of preimages of subsystems with respect to the equilibrium states. Here, the sphere $S^{2}$ is equipped with a natural metric, called a visual metric, introduced by M. Bonk and D. Meyer. As a result, for strongly primitive subsystems of expanding Thurston maps without periodic critical points, we obtain a level-$2$ large deviation principle for Birkhoff averages and iterated preimages.


title: Parametric estimation of conditional Archimedean copula generators for censored data

abstract: In this paper, we propose a novel approach for estimating Archimedean copula generators in a conditional setting, incorporating endogenous variables. Our method allows for the evaluation of the impact of the different levels of covariates on both the strength and shape of dependence by directly estimating the generator function rather than the copula itself. As such, we contribute to relaxing the simplifying assumption inherent in traditional copula modeling. We demonstrate the effectiveness of our methodology through applications in two diverse settings: a diabetic retinopathy study and a claims reserving analysis. In both cases, we show how considering the influence of covariates enables a more accurate capture of the underlying dependence structure in the data, thus enhancing the applicability of copula models, particularly in actuarial contexts.


title: PolyBin3D: A Suite of Optimal and Efficient Power Spectrum and Bispectrum Estimators for Large-Scale Structure

abstract: By measuring, modeling and interpreting cosmological datasets, one can place strong constraints on models of the Universe. Central to this effort are summary statistics such as power spectra and bispectra, which condense the high-dimensional dataset into low-dimensional representations. In this work, we introduce a modern set of estimators for computing such statistics from three-dimensional clustering data, and provide a flexible Python implementation; PolyBin3D. Working in a maximum-likelihood formalism, we derive general estimators for the two- and three-point functions, which yield unbiased spectra regardless of the survey mask, weighting scheme, and presence of holes in the window function. These can be directly compared to theory without the need for mask-convolution. Furthermore, we present a numerical scheme for computing the optimal (minimum-variance) estimators for a given survey, which is shown to reduce error-bars on large-scales. Our Python package includes both general "unwindowed'' estimators and idealized equivalents (appropriate for simulations), each of which are efficiently implemented using fast Fourier transforms and Monte Carlo summation tricks, and additionally supports GPU acceleration. These are extensively validated in this work, with Monte Carlo convergence (relevant for masked data) achieved using only a small number of iterations (typically $<10$ for bispectra). This will allow for fast and unified measurement of two- and three-point functions from current and upcoming survey data.

categories: astro-ph.CO astro-ph.GA hep-ex hep-ph hep-th


title: Reionization after JWST: a photon budget crisis?

abstract: New James Webb Space Telescope (JWST) observations are revealing the first galaxies to be prolific producers of ionizing photons, which we argue gives rise to a tension between different probes of reionization. For hydrogen reionization to proceed there must be enough ionizing photons for all of the hydrogen atoms, including their recombinations. Over the last two decades a consensus has emerged where star-forming galaxies are able to generate these photons, given reasonable values for their number densities, ionizing efficiencies $\xi_{\rm ion}$ (per unit UV luminosity), and escape fractions $f_{\rm esc}$. However, new JWST observations infer high values of $\xi_{\rm ion}$ during reionization and an enhanced abundance of earlier ($z\gtrsim 9$) galaxies, dramatically increasing the number of ionizing photons produced at high $z$. Simultaneously, recent low-$z$ studies predict significant escape fractions for faint reionization-era galaxies. Put together, we show that the galaxies we have directly observed ($M_{\rm UV} < -15$) not only can drive reionization, but would end it too early. That is, our current galaxy observations, taken at face value, imply an excess of ionizing photons and thus a process of reionization in tension with the cosmic microwave background (CMB) and Lyman-$\alpha$ forest. Considering galaxies down to $M_{\rm UV}\approx -11$, below current observational limits, only worsens this tension, requiring on average $f_{\rm esc}\approx 3\%$, far lower than expected for early galaxies from post-reionization studies. We discuss possible avenues to resolve this photon budget crisis, including missing astrophysical or observational selection effects, as well as enhanced recombinations.


title: Stability of mixed-state quantum phases via finite Markov length

abstract: For quantum phases of Hamiltonian ground states, the energy gap plays a central role in ensuring the stability of the phase as long as the gap remains finite. We propose Markov length, the length scale at which the quantum conditional mutual information (CMI) decays exponentially, as an equally essential quantity characterizing mixed-state phases and transitions. For a state evolving under a local Lindbladian, we argue that if its Markov length remains finite along the evolution, then it remains in the same phase, meaning there exists another quasi-local Lindbladian evolution that can reverse the former one. We apply this diagnostic to toric code subject to decoherence and show that the Markov length is finite everywhere except at its decodability transition, at which it diverges. CMI in this case can be mapped to the free energy cost of point defects in the random bond Ising model. This implies that the mixed state phase transition coincides with the decodability transition and also suggests a quasi-local decoding channel.


title: The Effects of Stellar and AGN Feedback on the Cosmic Star Formation History in the Simba Simulations

abstract: Using several variants of the cosmological Simba simulations, we investigate the impact of different feedback prescriptions on the cosmic star formation history. Adopting a global-to-local approach, we link signatures seen in global observables, such as the star formation rate density (SFRD) and the galaxy stellar mass function (GSMF), to feedback effects in individual galaxies. We find a consistent picture: stellar feedback mainly suppresses star formation below halo masses of $M_{\rm H} = 10^{12} \rm \, M_{\odot}$ and before $z = 2$, whereas AGN feedback quenches the more massive systems after $z = 2$. Among Simba's AGN feedback modes, AGN jets are the dominant quenching mechanism and set the shape of the SFRD and the GSMF at late times. AGN-powered winds only suppress the star formation rate in intermediate-mass galaxies ($M_{\rm \star} = 10^{9.5 - 10} \rm \, M_{\odot}$), without affecting the overall stellar mass-assembly significantly. At late times, the AGN X-ray feedback mode mainly quenches residual star formation in massive galaxies. Our analysis reveals that this mode is also necessary to produce the first fully quenched galaxies before $z=2$, where the jets alone are inefficient. These initially highly star-forming galaxies contain relatively large black holes, likely strengthening the X-ray-powered heating and ejection of gas from the dense, central region of galaxies. Such extra heating source quenches the local star formation and produces a more variable accretion rate. More generally, this effect also causes the break down of correlations between the specific star formation rate, the accretion rate and the black hole mass.


title: Topological Heavy Fermion Principle For Flat (Narrow) Bands With Concentrated Quantum Geometry

abstract: We propose a general principle for the low-energy theory of narrow bands with concentrated Berry curvature and Fubini-Study metric in the form of a map to Anderson-"+" models composed of heavy fermions hybridizing and interacting with semi-metallic modes. This map resolves the obstruction preventing topological bands from being realized in a local Hamiltonian acting on the low-energy degrees of freedom. The concentrated quantum geometry is reproduced through band inversion with a dispersive semi-metal, leaving a nearly flat, trivial band which becomes the heavy fermion. This representation is natural when the narrow band is not energetically isolated on the scale of the interaction and an enlarged Hilbert space is inescapable, but also provides analytical insight into the projected-interaction limit. First exemplified in twisted bilayer graphene (TBG), we extend it to (1) the twisted checkerboard, which we find has a chiral symmetric stable anomaly that forbids a lattice realization at all energies, and (2) the Lieb lattice with gapless flat bands, where we show the heavy fermions can be obtained by minimizing a Euclidean instanton action to saturate its BPS bound. The heavy fermion approach is widely applicable and physically transparent: heavy electrons carry the strong correlations and dispersive electrons carry the topology. This simple picture unifies the dichotomous phenomena observed in TBG and points to connections between moir\'e and stoichiometric materials.