title: A swimming bacterium in a two-fluid model of a polymer solution

abstract: We analyse the motion of a flagellated bacterium in a two-fluid medium using slender body theory. The two-fluid model is useful for describing a body moving through a complex fluid with a microstructure whose length scale is comparable to the characteristic scale of the body. This is true for bacterial motion in biological fluids (entangled polymer solutions), where the entanglement results in a porous microstructure with typical pore diameters comparable to or larger than the flagellar bundle diameter but smaller than the diameter of the bacterial head. Thus the polymer and solvent satisfy different boundary conditions on the flagellar bundle and move with different velocities close to it. This gives rise to a screening length $L_B$ within which the fluids exchange momentum and the relative velocity between the two fluids decays. In this work, both the solvent and polymer of the two-fluid medium are modeled as Newtonian fluids with different viscosities $\mu_s$ and $\mu_p$ (viscosity ratio $\lambda = \mu_p/\mu_s$), thereby capturing the effects solely introduced by the microstructure of the complex fluid. From our calculations, we observe an increased drag anisotropy for a rigid, slender flagellar bundle moving through this two-fluid medium, resulting in an enhanced swimming velocity of the organism. The results are sensitive to the interaction between the bundle and the polymer and we discuss two physical scenarios corresponding to two types of interaction. Our model provides an explanation for the experimentally observed enhancement of swimming velocity of bacteria in entangled polymer solutions and motivates further experimental investigations.


title: Segmentation-Guided Knee Radiograph Generation using Conditional Diffusion Models

abstract: Deep learning-based medical image processing algorithms require representative data during development. In particular, surgical data might be difficult to obtain, and high-quality public datasets are limited. To overcome this limitation and augment datasets, a widely adopted solution is the generation of synthetic images. In this work, we employ conditional diffusion models to generate knee radiographs from contour and bone segmentations. Remarkably, two distinct strategies are presented by incorporating the segmentation as a condition into the sampling and training process, namely, conditional sampling and conditional training. The results demonstrate that both methods can generate realistic images while adhering to the conditioning segmentation. The conditional training method outperforms the conditional sampling method and the conventional U-Net.


title: Physics Informed Neural Networks for Free Shear Flows

abstract: The transformative impact of machine learning, particularly Deep Learning (DL), on scientific and engineering domains is evident. In the context of computational fluid dynamics (CFD), Physics-Informed Neural Networks (PINNs) represent a significant innovation, enabling data-driven fluid simulations while incorporating physics-based laws described by partial differential equations (PDEs). While PINNs have demonstrated efficacy in various fluid flow scenarios, a noticeable gap exists in their application to simulate jet flows - an essential category in engineering. Jets, crucial for downburst outflow, ventilation, and heat transfer, lack comprehensive exploration through PINNs in existing literature. This study addresses this gap by focusing on the application of PINNs to simulate steady jet flows, specifically 2D planar turbulent jet flow scenarios. The novelty lies not only in adapting PINNs for simulating jet flows but also in overcoming challenges such as poor convergence during training, attributed to imbalances in loss terms. We propose a novel PINN architecture for Reynolds-Averaged Navier-Stokes (RANS) simulation of steady turbulent jet flows, without the need for turbulence models and simulation data. Additionally, an extended dynamic weighting strategy is introduced to enhance the balance of loss term contributions in the PINN, resulting in improved convergence and more accurate predictions.


title: CodeEditorBench: Evaluating Code Editing Capability of Large Language Models

abstract: Large Language Models (LLMs) for code are rapidly evolving, with code editing emerging as a critical capability. We introduce CodeEditorBench, an evaluation framework designed to rigorously assess the performance of LLMs in code editing tasks, including debugging, translating, polishing, and requirement switching. Unlike existing benchmarks focusing solely on code generation, CodeEditorBench emphasizes real-world scenarios and practical aspects of software development. We curate diverse coding challenges and scenarios from five sources, covering various programming languages, complexity levels, and editing tasks. Evaluation of 19 LLMs reveals that closed-source models (particularly Gemini-Ultra and GPT-4), outperform open-source models in CodeEditorBench, highlighting differences in model performance based on problem types and prompt sensitivities. CodeEditorBench aims to catalyze advancements in LLMs by providing a robust platform for assessing code editing capabilities. We will release all prompts and datasets to enable the community to expand the dataset and benchmark emerging LLMs. By introducing CodeEditorBench, we contribute to the advancement of LLMs in code editing and provide a valuable resource for researchers and practitioners.


title: Quantum querying based on multicontrolled Toffoli gates for causal Feynman loop configurations and directed acyclic graphs

abstract: Quantum algorithms are a promising framework for a proper treatment of Feynman loop integrals due to the existence of a manifestly causal representation scenario. Particularly, unfolding causal configurations of multiloop Feynman diagrams is understood as querying \textit{directed acyclic graph} (DAG) configurations of undirected graphs in graph theory. In this paper we present a quantum algorithm for querying causality of multiloop Feynman diagrams using an ingenious change in the logic of the design of the oracle operator. The construction of the quantum oracle is surprisingly based exclusively on multicontrolled Toffoli gates and XNOT gates. The efficiency of the algorithm is evaluated performing a comparison with a quantum algorithm based on binary clauses. Additionally, we explicitly analise several three-, four- and five-eloop topologies, which have not been previously explored due to their higher complexity.


title: Temperature-dependent optical and magneto-optical spectra of ferromagnetic BCC Fe

abstract: Optical and magneto-optical properties of magnetic materials have been widely exploited to characterize magnetic structures and phenomena, however, their temperature dependence is not well understood. This study implements the supercell approach with thermal lattice and magnetic disorders to obtain optical and magneto-optical spectra at finite temperatures based on Williams-Lax theory. Our results show that large optical spectrum signals are generated at photon energies below 1 eV, originating from the phonon- and magnon-assisted intraband transitions as lattice and magnetic temperatures increase. In addition, the prominent peak near 2.7 eV is redshifted proportionally to magnetic temperature but depends much less on lattice temperature. By analyzing unfolded bands, we show that the reduction of exchange splitting due to the thermal demagnetization causes this redshift. Our unfolded electronic band structure with magnetic disorder shows band kinks, which are characteristic evidence of the coupling between electrons and magnetic excitations. First-order magneto-optical spectra at finite temperature are also predicted, but due to their small magnitude suffer more from sampling errors. We discuss the effect of zero-point vibrations and the connection of these simulations to the Drude model for intraband transitions.


title: Constraints on the Dirac spectrum from chiral symmetry restoration

abstract: I derive constraints on the Dirac spectrum in the chirally symmetric phase of a gauge theory with two massless fermion flavors. Using only general properties of correlation functions of scalar and pseudoscalar bilinears, I prove that in the chiral limit of vanishing quark mass $m$ all the corresponding susceptibilities must be power series in $m^2$ with finite coefficients, from which spectral constraints follow. I then use them to show that effective breaking of the anomalous $\mathrm{U}(1)_A$ symmetry is allowed in the $\mathrm{SU}(2)_A$ symmetric phase in the chiral limit, and leads to distinctive spectral features: (i) the spectral density must develop a singular $m^4/\lambda$ peak as $m\to 0$, (ii) the two-point eigenvalue correlator of near-zero modes must be singular, and (iii) near-zero modes cannot be localized. Moreover, in the symmetric phase the topological charge distribution must be indistinguishable from that of an ideal gas of instantons and anti-instantons of vanishing density, to leading order in the fermion mass.


title: Towards Transcranial 3D Ultrasound Localization Microscopy of the Nonhuman Primate Brain

abstract: Hemodynamic changes occur in stroke and neurodegenerative diseases. Developing imaging techniques allowing the in vivo visualization and quantification of cerebral blood flow would help better understand the underlying mechanism of those cerebrovascular diseases. 3D ultrasound localization microscopy (ULM) is a novel technology that can map the microvasculature of the brain at large depth and has been mainly used until now in rodents. Here, we demonstrated the feasibility of 3D ULM of the nonhuman primate (NHP) brain with a single 256-channels programmable ultrasound scanner. We achieved a highly resolved vascular map of the macaque brain at large depth in presence of craniotomy and durectomy using an 8-MHz multiplexed matrix probe. We were able to distinguish vessels as small as 26.9 {\mu}m. We also demonstrated that transcranial imaging of the macaque brain at similar depth was feasible using a 3-MHz probe and achieved a resolution of 60.4 {\mu}m. This work paves the way to clinical application of 3D ULM.


title: Generalized R\'enyi statistics

abstract: In R\'enyi's representation for exponential order statistics, we change the iid exponential sequence to any iid sequence, and call the resulting order statistic \emph{generalized R\'enyi statistic}. We prove that randomly reordering the variables in the generalized R\'enyi statistic, in the limit we obtain a sequence of iid exponentials. This result allows us to propose a new model for heavy-tailed data. We investigate the problem of estimation of the tail index in the new model.


title: Alzheimer's disease detection in PSG signals

abstract: Alzheimer's disease (AD) and sleep disorders exhibit a close association, where disruptions in sleep patterns often precede the onset of Mild Cognitive Impairment (MCI) and early-stage AD. This study delves into the potential of utilizing sleep-related electroencephalography (EEG) signals acquired through polysomnography (PSG) for the early detection of AD. Our primary focus is on exploring semi-supervised Deep Learning techniques for the classification of EEG signals due to the clinical scenario characterized by the limited data availability. The methodology entails testing and comparing the performance of semi-supervised SMATE and TapNet models, benchmarked against the supervised XCM model, and unsupervised Hidden Markov Models (HMMs). The study highlights the significance of spatial and temporal analysis capabilities, conducting independent analyses of each sleep stage. Results demonstrate the effectiveness of SMATE in leveraging limited labeled data, achieving stable metrics across all sleep stages, and reaching 90% accuracy in its supervised form. Comparative analyses reveal SMATE's superior performance over TapNet and HMM, while XCM excels in supervised scenarios with an accuracy range of 92 - 94%. These findings underscore the potential of semi-supervised models in early AD detection, particularly in overcoming the challenges associated with the scarcity of labeled data. Ablation tests affirm the critical role of spatio-temporal feature extraction in semi-supervised predictive performance, and t-SNE visualizations validate the model's proficiency in distinguishing AD patterns. Overall, this research contributes to the advancement of AD detection through innovative Deep Learning approaches, highlighting the crucial role of semi-supervised learning in addressing data limitations.


title: Twisted tensor products of quantum affine vertex algebras and coproducts

abstract: Let $\mathfrak g$ be a symmetrizable Kac-Moody Lie algebra, and let $V_{\hat{\mathfrak g},\hbar}^\ell$, $L_{\hat{\mathfrak g},\hbar}^\ell$ be the quantum affine vertex algebras constructed in [11]. For any complex numbers $\ell$ and $\ell'$, we present an $\hbar$-adic quantum vertex algebra homomorphism $\Delta$ from $V_{\hat{\mathfrak g},\hbar}^{\ell+\ell'}$ to the twisted tensor product $\hbar$-adic quantum vertex algebra $V_{\hat{\mathfrak g},\hbar}^\ell\widehat\otimes V_{\hat{\mathfrak g},\hbar}^{\ell'}$. In addition, if both $\ell$ and $\ell'$ are positive integers, we show that $\Delta$ induces an $\hbar$-adic quantum vertex algebra homomorphism from $L_{\hat{\mathfrak g},\hbar}^{\ell+\ell'}$ to the twisted tensor product $\hbar$-adic quantum vertex algebra $L_{\hat{\mathfrak g},\hbar}^\ell\widehat\otimes L_{\hat{\mathfrak g},\hbar}^{\ell'}$. Moreover, we prove the coassociativity of $\Delta$.


title: Streamlining CXL Adoption for Hyperscale Efficiency

abstract: In our exploration of Composable Memory systems utilizing CXL, we focus on overcoming adoption barriers at Hyperscale, underscored by economic models demonstrating Total Cost of Ownership (TCO). While CXL addresses the pressing memory capacity needs of emerging Hyperscale applications, the escalating demands from evolving use cases such as AI outpace the capabilities of current CXL solutions. Hyperscalers resort to software-based memory (de)compression technology, alleviating memory capacity, storage, and network constraints but incurring a notable "Tax" on Compute CPU cycles. As a pivotal guide to the CXL community, Hyperscalers have formulated the groundbreaking Open Compute Project (OCP) Hyperscale CXL Tiered Memory Expander specification. If implemented, this specification lowers TCO adoption barriers, enabling diverse CXL deployments at both Hyperscaler and Enterprise levels. We present a CXL integrated solution, aligning with the aforementioned specification, introducing an energy-efficient, scalable, hardware-accelerated, Lossless Compressed Memory CXL Tier. This solution, slated for mid-2024 production and open for integration with Memory Expander controller manufacturers, offers 2-3X CXL memory compression in nanoseconds, delivering a 20-25% reduction in TCO for end customers without requiring additional physical slots. In our discussion, we pinpoint areas for collaborative innovation within the CXL Community to expedite software/hardware advancements for CXL Tiered Memory Expansion. Furthermore, we delve into unresolved challenges in Pooled deployment and explore potential solutions, collectively aiming to make CXL adoption a "No Brainer" at Hyperscale.


title: Representations of quantum lattice vertex algebras

abstract: Let $Q$ be a non-degenerated even lattice, let $V_Q$ be the lattice vertex algebra associated to $Q$, and let $V_Q^\eta$ be a quantum lattice vertex algebra. In this paper, we prove the equivalence between the category $V_Q$-modules and the category of $V_Q^\eta$-modules. As a consequence, we show that every $V_Q^\eta$-module is completely reducible, and the set of simple $V_Q^\eta$-modules are in one-to-one correspondence with the set of cosets of $Q$ in its dual lattice.


title: Bringing memory to Boolean networks: a unifying framework

abstract: Boolean networks are extensively applied as models of complex dynamical systems, aiming at capturing essential features related to causality and synchronicity of the state changes of components along time. Dynamics of Boolean networks result from the application of their Boolean map according to a so-called update mode, specifying the possible transitions between network configurations. In this paper, we explore update modes that possess a memory on past configurations, and provide a generic framework to define them. We show that recently introduced modes such as the most permissive and interval modes can be naturally expressed in this framework. We propose novel update modes, the history-based and trapping modes, and provide a comprehensive comparison between them. Furthermore, we show that trapping dynamics, which further generalize the most permissive mode, correspond to a rich class of networks related to transitive dynamics and encompassing commutative networks. Finally, we provide a thorough characterization of the structure of minimal and principal trapspaces, bringing a combinatorial and algebraic understanding of these objects.


title: No Panacea in Planning: Algorithm Selection for Suboptimal Multi-Agent Path Finding

abstract: Since more and more algorithms are proposed for multi-agent path finding (MAPF) and each of them has its strengths, choosing the correct one for a specific scenario that fulfills some specified requirements is an important task. Previous research in algorithm selection for MAPF built a standard workflow and showed that machine learning can help. In this paper, we study general solvers for MAPF, which further include suboptimal algorithms. We propose different groups of optimization objectives and learning tasks to handle the new tradeoff between runtime and solution quality. We conduct extensive experiments to show that the same loss can not be used for different groups of optimization objectives, and that standard computer vision models are no worse than customized architecture. We also provide insightful discussions on how feature-sensitive pre-processing is needed for learning for MAPF, and how different learning metrics are correlated to different learning tasks.


title: From News to Summaries: Building a Hungarian Corpus for Extractive and Abstractive Summarization

abstract: Training summarization models requires substantial amounts of training data. However for less resourceful languages like Hungarian, openly available models and datasets are notably scarce. To address this gap our paper introduces HunSum-2 an open-source Hungarian corpus suitable for training abstractive and extractive summarization models. The dataset is assembled from segments of the Common Crawl corpus undergoing thorough cleaning, preprocessing and deduplication. In addition to abstractive summarization we generate sentence-level labels for extractive summarization using sentence similarity. We train baseline models for both extractive and abstractive summarization using the collected dataset. To demonstrate the effectiveness of the trained models, we perform both quantitative and qualitative evaluation. Our dataset, models and code are publicly available, encouraging replication, further research, and real-world applications across various domains.


title: Robot Safety Monitoring using Programmable Light Curtains

abstract: As factories continue to evolve into collaborative spaces with multiple robots working together with human supervisors in the loop, ensuring safety for all actors involved becomes critical. Currently, laser-based light curtain sensors are widely used in factories for safety monitoring. While these conventional safety sensors meet high accuracy standards, they are difficult to reconfigure and can only monitor a fixed user-defined region of space. Furthermore, they are typically expensive. Instead, we leverage a controllable depth sensor, programmable light curtains (PLC), to develop an inexpensive and flexible real-time safety monitoring system for collaborative robot workspaces. Our system projects virtual dynamic safety envelopes that tightly envelop the moving robot at all times and detect any objects that intrude the envelope. Furthermore, we develop an instrumentation algorithm that optimally places (multiple) PLCs in a workspace to maximize the visibility coverage of robots. Our work enables fence-less human-robot collaboration, while scaling to monitor multiple robots with few sensors. We analyze our system in a real manufacturing testbed with four robot arms and demonstrate its capabilities as a fast, accurate, and inexpensive safety monitoring solution.


title: Signal-preserving CMB component separation with machine learning

abstract: Analysis of microwave sky signals, such as the cosmic microwave background, often requires component separation with multi-frequency methods, where different signals are isolated by their frequency behaviors. Many so-called "blind" methods, such as the internal linear combination (ILC), make minimal assumptions about the spatial distribution of the signal or contaminants, and only assume knowledge of the frequency dependence of the signal. The ILC is a minimum-variance linear combination of the measured frequency maps. In the case of Gaussian, statistically isotropic fields, this is the optimal linear combination, as the variance is the only statistic of interest. However, in many cases the signal we wish to isolate, or the foregrounds we wish to remove, are non-Gaussian and/or statistically anisotropic (in particular for Galactic foregrounds). In such cases, it is possible that machine learning (ML) techniques can be used to exploit the non-Gaussian features of the foregrounds and thereby improve component separation. However, many ML techniques require the use of complex, difficult-to-interpret operations on the data. We propose a hybrid method whereby we train an ML model using only combinations of the data that $\textit{do not contain the signal}$, and combine the resulting ML-predicted foreground estimate with the ILC solution to reduce the error from the ILC. We demonstrate our methods on simulations of extragalactic temperature and Galactic polarization foregrounds, and show that our ML model can exploit non-Gaussian features, such as point sources and spatially-varying spectral indices, to produce lower-variance maps than ILC - eg, reducing the variance of the B-mode residual by factors of up to 5 - while preserving the signal of interest in an unbiased manner. Moreover, we often find improved performance when applying our model to foreground models on which it was not trained.


title: How does Multi-Task Training Affect Transformer In-Context Capabilities? Investigations with Function Classes

abstract: Large language models (LLM) have recently shown the extraordinary ability to perform unseen tasks based on few-shot examples provided as text, also known as in-context learning (ICL). While recent works have attempted to understand the mechanisms driving ICL, few have explored training strategies that incentivize these models to generalize to multiple tasks. Multi-task learning (MTL) for generalist models is a promising direction that offers transfer learning potential, enabling large parameterized models to be trained from simpler, related tasks. In this work, we investigate the combination of MTL with ICL to build models that efficiently learn tasks while being robust to out-of-distribution examples. We propose several effective curriculum learning strategies that allow ICL models to achieve higher data efficiency and more stable convergence. Our experiments reveal that ICL models can effectively learn difficult tasks by training on progressively harder tasks while mixing in prior tasks, denoted as mixed curriculum in this work. Our code and models are available at https://github.com/harmonbhasin/curriculum_learning_icl .


title: A characterization of zero entropy loosely Bernoulli flows via FK-pseudometric

abstract: We introduce the Feldman-Katok pseudometric (FK-pseudometric for short) for flows. We then provide a characterization of zero entropy loosely Bernoulli measures for continuous flows via the FK-pseudometric extending the result known for discrete-time dynamical systems. We also provide a purely topological characterization of uniquely ergodic continuous flows whose unique invariant measure is zero entropy loosely Bernoulli.


title: A quantum Pascal pyramid and an extended de Moivre-Laplace theorem

abstract: Pascal's triangle is widely used as a pedagogical tool to explain the "first-order" multiplet patterns that arise in the spectra of $I_N S$ coupled spin-1/2 systems in magnetic resonance. Various other combinatorial structures, which may be well-known in the broader field of quantum dynamics, appear to have largely escaped the attention of the magnetic resonance community with a few exceptions, despite potential usefulness. In this brief set of lecture notes, we describe a "quantum Pascal pyramid" (OEIS https://oeis.org/A268533) as a generalization of Pascal's triangle, which is shown to directly map the relationship between multispin operators of arbitrary spin product rank $q$ ($\hat{Z}_N^q$) and population operators for states with magnetic quantum number $m$ ($\hat{S}_N^m$), and - as a consequence - obtain the general form of the intensity ratios of multiplets associated with antiphase single-quantum coherences, with an expression given in terms of the Jacobi polynomials. An extension of the de Moivre-Laplace theorem, beyond the trivial case $q=0$, is applied to the $q$-th columns of the quantum Pascal pyramid, and is given in terms of a product of the $q$-th order Hermite polynomials and a Gaussian distribution, reproducing the well-known functional forms of the solutions of the quantum harmonic oscillator and the classical limit of Hermite-Gaussian modes in laser physics (Allen et al., $\textit{Phys. Rev. A.}$, $\textbf{45}$, 1992). This is used to approximate the Fourier-transformed spectra of $\hat{Z}_N^q$-associated multiplets of arbitrary complexity. Finally, an exercise is shown in which the first two columns of the quantum Pascal pyramid are used to calculate the previously known symmetry-constrained upper bound on $I_z \rightarrow S_z$ polarization transfer in $I_N S$ spin systems.


title: Select and Summarize: Scene Saliency for Movie Script Summarization

abstract: Abstractive summarization for long-form narrative texts such as movie scripts is challenging due to the computational and memory constraints of current language models. A movie script typically comprises a large number of scenes; however, only a fraction of these scenes are salient, i.e., important for understanding the overall narrative. The salience of a scene can be operationalized by considering it as salient if it is mentioned in the summary. Automatically identifying salient scenes is difficult due to the lack of suitable datasets. In this work, we introduce a scene saliency dataset that consists of human-annotated salient scenes for 100 movies. We propose a two-stage abstractive summarization approach which first identifies the salient scenes in script and then generates a summary using only those scenes. Using QA-based evaluation, we show that our model outperforms previous state-of-the-art summarization methods and reflects the information content of a movie more accurately than a model that takes the whole movie script as input.


title: Multi-mode masers of thermally polarized nuclear spins in solution NMR

abstract: We present experimental single and multimode sustained 1H NMR masers in solution on thermally polarized spins at room temperature and 9.4 T achieved through the electronic control of radiation feedback (radiation damping). Our observations illustrate the breakdown of the usual three-dimensional Maxwell-Bloch equations for radiation feedback and a simple toy model of few coupled classical moments is used to interpret these experiments.


title: EASSE-DE: Easier Automatic Sentence Simplification Evaluation for German

abstract: In this work, we propose EASSE-multi, a framework for easier automatic sentence evaluation for languages other than English. Compared to the original EASSE framework, EASSE-multi does not focus only on English. It contains tokenizers and versions of text simplification evaluation metrics which are suitable for multiple languages. In this paper, we exemplify the usage of EASSE-multi for German TS, resulting in EASSE-DE. Further, we compare text simplification results when evaluating with different language or tokenization settings of the metrics. Based on this, we formulate recommendations on how to make the evaluation of (German) TS models more transparent and better comparable. The code of EASSE-multi and its German specialisation (EASSE-DE) can be found at https://github.com/rstodden/easse-de.


title: Polytope symmetries of Feynman integrals

abstract: Feynman integrals appropriately generalized are $\mathsf A$-hypergeometric functions. Among the properties of $\mathsf A$-hypergeometric functions are symmetries associated with the Newton polytope. In ordinary hypergeometric functions these symmetries lead to linear transformations. Combining tools of $\mathsf A$-hypergeometric systems and the computation of symmetries of polytopes, we consider the associated symmetries of Feynman integrals in the Lee-Pomeransky representation. We compute the symmetries of $\mathtt n$-gon integrals up to $\mathtt n=8$, massive banana integrals up to 5-loop, and on-shell ladders up to 3-loop. We apply these symmetries to study finite on-shell ladder integrals up to 3-loop.


title: Personalized LLM Response Generation with Parameterized Memory Injection

abstract: Large Language Models (LLMs) have exhibited remarkable proficiency in comprehending and generating natural language. On the other hand, personalized LLM response generation holds the potential to offer substantial benefits for individuals in critical areas such as medical. Existing research has explored memory-augmented methods to prompt the LLM with pre-stored user-specific knowledge for personalized response generation in terms of new queries. We contend that such paradigm is unable to perceive fine-granularity information. In this study, we propose a novel \textbf{M}emory-\textbf{i}njected approach using parameter-efficient fine-tuning (PEFT) and along with a Bayesian Optimisation searching strategy to achieve \textbf{L}LM \textbf{P}ersonalization(\textbf{MiLP}).


title: PointInfinity: Resolution-Invariant Point Diffusion Models

abstract: We present PointInfinity, an efficient family of point cloud diffusion models. Our core idea is to use a transformer-based architecture with a fixed-size, resolution-invariant latent representation. This enables efficient training with low-resolution point clouds, while allowing high-resolution point clouds to be generated during inference. More importantly, we show that scaling the test-time resolution beyond the training resolution improves the fidelity of generated point clouds and surfaces. We analyze this phenomenon and draw a link to classifier-free guidance commonly used in diffusion models, demonstrating that both allow trading off fidelity and variability during inference. Experiments on CO3D show that PointInfinity can efficiently generate high-resolution point clouds (up to 131k points, 31 times more than Point-E) with state-of-the-art quality.


title: Factored Task and Motion Planning with Combined Optimization, Sampling and Learning

abstract: In this thesis, we aim to improve the performance of TAMP algorithms from three complementary perspectives. First, we investigate the integration of discrete task planning with continuous trajectory optimization. Our main contribution is a conflict-based solver that automatically discovers why a task plan might fail when considering the constraints of the physical world. This information is then fed back into the task planner, resulting in an efficient, bidirectional, and intuitive interface between task and motion, capable of solving TAMP problems with multiple objects, robots, and tight physical constraints. In the second part, we first illustrate that, given the wide range of tasks and environments within TAMP, neither sampling nor optimization is superior in all settings. To combine the strengths of both approaches, we have designed meta-solvers for TAMP, adaptive solvers that automatically select which algorithms and computations to use and how to best decompose each problem to find a solution faster. In the third part, we combine deep learning architectures with model-based reasoning to accelerate computations within our TAMP solver. Specifically, we target infeasibility detection and nonlinear optimization, focusing on generalization, accuracy, compute time, and data efficiency. At the core of our contributions is a refined, factored representation of the trajectory optimization problems inside TAMP. This structure not only facilitates more efficient planning, encoding of geometric infeasibility, and meta-reasoning but also provides better generalization in neural architectures.


title: The Cauchy problem for the nonlinear Schr\"odinger equation with a convolution potential

abstract: This paper investigates the nonlinear Schr\"{o}dinger equation with a singular convolution potential. It demonstrates the local well-posedness of this equation in a modified Sobolev space linked to the energy. Additionally, we derive conditions under which the solutions are uniformly bounded in the energy space. This finding is closely linked to the existence of standing waves for this equation.


title: High redshift LBGs from deep broadband imaging for future spectroscopic surveys

abstract: Lyman break galaxies (LBGs) are promising probes for clustering measurements at high redshift, $z>2$, a region only covered so far by Lyman-$\alpha$ forest measurements. In this paper, we investigate the feasibility of selecting LBGs by exploiting the existence of a strong deficit of flux shortward of the Lyman limit, due to various absorption processes along the line of sight. The target selection relies on deep imaging data from the HSC and CLAUDS surveys in the $g,r,z$ and $u$ bands, respectively, with median depths reaching 27 AB in all bands. The selections were validated by several dedicated spectroscopic observation campaigns with DESI. Visual inspection of spectra has enabled us to develop an automated spectroscopic typing and redshift estimation algorithm specific to LBGs. Based on these data and tools, we assess the efficiency and purity of target selections optimised for different purposes. Selections providing a wide redshift coverage retain $57\%$ of the observed targets after spectroscopic confirmation with DESI, and provide an efficiency for LBGs of $83\pm3\%$, for a purity of the selected LBG sample of $90\pm2\%$. This would deliver a confirmed LBG density of $\sim 620$ deg$^{-2}$ in the range $2.3<z<3.5$ for a $r$-band limiting magnitude $r<24.2$. Selections optimised for high redshift efficiency retain $73\%$ of the observed targets after spectroscopic confirmation, with $89\pm4\%$ efficiency for $97\pm2\%$ purity. This would provide a confirmed LBG density of $\sim 470$ deg$^{-2}$ in the range $2.8<z<3.5$ for a $r$-band limiting magnitude $r<24.5$. A preliminary study of the LBG sample 3d-clustering properties is also presented and used to estimate the LBG linear bias. A value of $b_{LBG} = 3.3 \pm 0.2 (stat.)$ is obtained for a mean redshift of 2.9 and a limiting magnitude in $r$ of 24.2, in agreement with results reported in the literature.


title: Embodied AI with Two Arms: Zero-shot Learning, Safety and Modularity

abstract: We present an embodied AI system which receives open-ended natural language instructions from a human, and controls two arms to collaboratively accomplish potentially long-horizon tasks over a large workspace. Our system is modular: it deploys state of the art Large Language Models for task planning,Vision-Language models for semantic perception, and Point Cloud transformers for grasping. With semantic and physical safety in mind, these modules are interfaced with a real-time trajectory optimizer and a compliant tracking controller to enable human-robot proximity. We demonstrate performance for the following tasks: bi-arm sorting, bottle opening, and trash disposal tasks. These are done zero-shot where the models used have not been trained with any real world data from this bi-arm robot, scenes or workspace.Composing both learning- and non-learning-based components in a modular fashion with interpretable inputs and outputs allows the user to easily debug points of failures and fragilities. One may also in-place swap modules to improve the robustness of the overall platform, for instance with imitation-learned policies.


title: Extra Higgs boson searches at the LHC

abstract: Many searches for additional Higgs bosons, which are predicted by a lot of interesting models beyond the standard model, have been performed at the LHC. Some selected latest results of the searches for extra Higgs bosons at the LHC are presented. These additional Higgs bosons could be produced either directly from the parton interactions or from the decays of the observed standard model Higgs boson or a new heavier resonance. The searches used the data from proton-proton collisions delivered by the LHC at a centre-of-mass energy of $\sqrt{s}=13~\TeV$ and recorded with the ATLAS and CMS detectors. No direct evidence of new physics has been observed yet. Several mild excesses were observed in some final states. More data is needed to conclude on the nature of these excesses.


title: Terrain Point Cloud Inpainting via Signal Decomposition

abstract: The rapid development of 3D acquisition technology has made it possible to obtain point clouds of real-world terrains. However, due to limitations in sensor acquisition technology or specific requirements, point clouds often contain defects such as holes with missing data. Inpainting algorithms are widely used to patch these holes. However, existing traditional inpainting algorithms rely on precise hole boundaries, which limits their ability to handle cases where the boundaries are not well-defined. On the other hand, learning-based completion methods often prioritize reconstructing the entire point cloud instead of solely focusing on hole filling. Based on the fact that real-world terrain exhibits both global smoothness and rich local detail, we propose a novel representation for terrain point clouds. This representation can help to repair the holes without clear boundaries. Specifically, it decomposes terrains into low-frequency and high-frequency components, which are represented by B-spline surfaces and relative height maps respectively. In this way, the terrain point cloud inpainting problem is transformed into a B-spline surface fitting and 2D image inpainting problem. By solving the two problems, the highly complex and irregular holes on the terrain point clouds can be well-filled, which not only satisfies the global terrain undulation but also exhibits rich geometric details. The experimental results also demonstrate the effectiveness of our method.


title: Enhanced mobility of quantum droplets in periodic lattices

abstract: We predict that one- and two-dimensional self-bound quantum droplets, forming in Bose-Einstein condensates in the presence of Lee-Huang-Yang (LHY) quantum corrections to the mean-field energy, may demonstrate exceptional mobility in periodic optical lattices and that they may exhibit considerable displacements across the lattice, remaining dynamically stable, even under weak initial phase kicks imparted to them. Mobility properties of quantum droplets are determined by their internal structure and strongly depend on the number of particles in them. We find that due to the peculiar effect of the LHY quantum corrections, odd (i.e., on-site centered) and even (i.e., intersite-centered) one-dimensional quantum droplets feature alternating mobility and immobility bands closely corresponding to the regions, where translational perturbation mode is unstable and stable, respectively. This picture becomes even richer in two-dimensional case, where odd-odd, even-odd or even-even quantum droplets also feature alternating mobility and immobility domains, and where, surprisingly, the droplet may be mobile in one direction, but immobile in the orthogonal direction. We link changes in mobility properties with multiple intersections of energy $E(\mu)$ and norm $N(\mu)$ dependencies for droplets with different internal structure.


title: TinyVQA: Compact Multimodal Deep Neural Network for Visual Question Answering on Resource-Constrained Devices

abstract: Traditional machine learning models often require powerful hardware, making them unsuitable for deployment on resource-limited devices. Tiny Machine Learning (tinyML) has emerged as a promising approach for running machine learning models on these devices, but integrating multiple data modalities into tinyML models still remains a challenge due to increased complexity, latency, and power consumption. This paper proposes TinyVQA, a novel multimodal deep neural network for visual question answering tasks that can be deployed on resource-constrained tinyML hardware. TinyVQA leverages a supervised attention-based model to learn how to answer questions about images using both vision and language modalities. Distilled knowledge from the supervised attention-based VQA model trains the memory aware compact TinyVQA model and low bit-width quantization technique is employed to further compress the model for deployment on tinyML devices. The TinyVQA model was evaluated on the FloodNet dataset, which is used for post-disaster damage assessment. The compact model achieved an accuracy of 79.5%, demonstrating the effectiveness of TinyVQA for real-world applications. Additionally, the model was deployed on a Crazyflie 2.0 drone, equipped with an AI deck and GAP8 microprocessor. The TinyVQA model achieved low latencies of 56 ms and consumes 693 mW power while deployed on the tiny drone, showcasing its suitability for resource-constrained embedded systems.


title: DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling

abstract: Text-to-3D scene generation holds immense potential for the gaming, film, and architecture sectors. Despite significant progress, existing methods struggle with maintaining high quality, consistency, and editing flexibility. In this paper, we propose DreamScene, a 3D Gaussian-based novel text-to-3D scene generation framework, to tackle the aforementioned three challenges mainly via two strategies. First, DreamScene employs Formation Pattern Sampling (FPS), a multi-timestep sampling strategy guided by the formation patterns of 3D objects, to form fast, semantically rich, and high-quality representations. FPS uses 3D Gaussian filtering for optimization stability, and leverages reconstruction techniques to generate plausible textures. Second, DreamScene employs a progressive three-stage camera sampling strategy, specifically designed for both indoor and outdoor settings, to effectively ensure object-environment integration and scene-wide 3D consistency. Last, DreamScene enhances scene editing flexibility by integrating objects and environments, enabling targeted adjustments. Extensive experiments validate DreamScene's superiority over current state-of-the-art techniques, heralding its wide-ranging potential for diverse applications. Code and demos will be released at https://dreamscene-project.github.io .


title: The Rise of Faint, Red AGN at $z>4$: A Sample of Little Red Dots in the JWST Extragalactic Legacy Fields

abstract: We present a sample of 341 "little red dots" (LRDs) spanning the redshift range $z\sim2-11$ using data from the CEERS, PRIMER, JADES, UNCOVER and NGDEEP surveys. These sources are likely heavily-reddened AGN that trace a previously-hidden phase of dust-obscured black hole growth in the early Universe. Unlike past use of color indices to identify LRDs, we employ continuum slope fitting using shifting bandpasses to sample the same rest-frame emission blueward and redward of the Balmer break. This approach allows us to identify LRDs over a wider redshift range and is less susceptible to contamination from galaxies with strong breaks that otherwise lack a rising red continuum. The redshift distribution of our sample increases at $z<8$ and then undergoes a rapid decline at $z\sim4.5$, which may tie the emergence, and obscuration, of these sources to the inside-out growth that galaxies experience during this epoch. We find that LRDs are 2-3 dex more numerous than bright quasars at $z\sim5-7$, but their number density is only 0.6-1 dex higher than X-ray and UV selected AGN at these redshifts. Within our sample, we have identified the first X-ray detected LRDs at $z=3.1$ and $z=4.66$. An X-ray spectral analysis confirms that these AGN are moderately obscured with $\log\,(N_{\rm H}/{\rm cm}^{2}$) of $23.3^{+0.4}_{-1.3}$ and $22.72^{+0.13}_{-0.16}$. Our analysis reveals that reddened AGN emission dominates their rest-optical light, while the rest-UV originates from their host galaxies. We also present NIRSpec follow-up spectroscopy of 17 LRDs that show broad emission lines consistent with AGN activity. The confirmed AGN fraction of our sample is $71\%$ for sources with F444W$<26.5$. In addition, we find three LRDs with narrow blue-shifted Balmer absorption features in their spectra, suggesting an outflow of high-density, low ionization gas from near the central engine of these faint, red AGN.


title: Untangle the KNOT: Interweaving Conflicting Knowledge and Reasoning Skills in Large Language Models

abstract: Providing knowledge documents for large language models (LLMs) has emerged as a promising solution to update the static knowledge inherent in their parameters. However, knowledge in the document may conflict with the memory of LLMs due to outdated or incorrect knowledge in the LLMs' parameters. This leads to the necessity of examining the capability of LLMs to assimilate supplemental external knowledge that conflicts with their memory. While previous studies have explained to what extent LLMs extract conflicting knowledge from the provided text, they neglect the necessity to reason with conflicting knowledge. Furthermore, there lack a detailed analysis on strategies to enable LLMs to resolve conflicting knowledge via prompting, decoding strategy, and supervised fine-tuning. To address these limitations, we construct a new dataset, dubbed KNOT, for knowledge conflict resolution examination in the form of question answering. KNOT facilitates in-depth analysis by dividing reasoning with conflicting knowledge into three levels: (1) Direct Extraction, which directly extracts conflicting knowledge to answer questions. (2) Explicit Reasoning, which reasons with conflicting knowledge when the reasoning path is explicitly provided in the question. (3) Implicit Reasoning, where reasoning with conflicting knowledge requires LLMs to infer the reasoning path independently to answer questions. We also conduct extensive experiments on KNOT to establish empirical guidelines for LLMs to utilize conflicting knowledge in complex circumstances. Dataset and associated codes can be accessed at https://github.com/THU-KEG/KNOT .


title: Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithm

abstract: The sim-to-real gap, which represents the disparity between training and testing environments, poses a significant challenge in reinforcement learning (RL). A promising approach to addressing this challenge is distributionally robust RL, often framed as a robust Markov decision process (RMDP). In this framework, the objective is to find a robust policy that achieves good performance under the worst-case scenario among all environments within a pre-specified uncertainty set centered around the training environment. Unlike previous work, which relies on a generative model or a pre-collected offline dataset enjoying good coverage of the deployment environment, we tackle robust RL via interactive data collection, where the learner interacts with the training environment only and refines the policy through trial and error. In this robust RL paradigm, two main challenges emerge: managing distributional robustness while striking a balance between exploration and exploitation during data collection. Initially, we establish that sample-efficient learning without additional assumptions is unattainable owing to the curse of support shift; i.e., the potential disjointedness of the distributional supports between the training and testing environments. To circumvent such a hardness result, we introduce the vanishing minimal value assumption to RMDPs with a total-variation (TV) distance robust set, postulating that the minimal value of the optimal robust value function is zero. We prove that such an assumption effectively eliminates the support shift issue for RMDPs with a TV distance robust set, and present an algorithm with a provable sample complexity guarantee. Our work makes the initial step to uncovering the inherent difficulty of robust RL via interactive data collection and sufficient conditions for designing a sample-efficient algorithm accompanied by sharp sample complexity analysis.


title: The influence of substantial intragranular orientation gradients on the micromechanical response of heavily-worked material

abstract: In this study, we employ high-energy X-ray characterization to examine the role of relatively large amounts of intragranular lattice misorientation -- present after many thermomechanical processes -- on the micromechanical response of Al-7085 with a modified T7452 temper. We utilize near-field high energy X-ray diffraction microscopy (HEDM) to measure three-dimensional (3D) spatial orientation fields, facilitated by a novel method that utilizes grain orientation envelopes measured using far-field HEDM to enable reconstruction of grains with intragranular orientation spreads greater than 20{\deg}. We then assess the consequences of consideration of intragranular orientation fields on the predicted deformation response of the sample through 3D micromechanical simulations of the forged Al-7085. We construct two virtual polycrystalline specimens for use in simulations: the first a faithful representation of the HEDM reconstruction, the second a microstructure with no intragranular misorientation (i.e., grain-averaged orientations). We find significant differences in the predicted deformation mechanism activation, distribution of stress, and distribution of plastic strain between simulations containing intragranular misorientation and those with grain-averaged orientations, indicating the necessity for consideration of intragranular orientation fields for accurate predictions. Further, the influence of elastic anisotropy is discussed, along with the effects of intragranular misorientation on fatigue life through the calculation and analysis of fatigue indicator parameters.


title: The CCube reconstruction algorithm for the SoLid experiment

abstract: The SoLid experiment is a very-short-baseline experiment aimed at searching for nuclear reactor-produced active to sterile antineutrino oscillations. The detection principle is based on the pairing of two types of solid scintillators: polyvinyl toluene and $^6$LiF:ZnS(Ag), which is a new technology used in this field of Physics. In addition to good neutron-gamma discrimination, this setup allows the detector to be highly segmented (the basic detection unit is a 5 cm side cube). High segmentation provides numerous advantages, including the precise location of Inverse Beta Decay (IBD) products, the derivation of the considerate antineutrino energy estimator, and a powerful background reduction tool based on the topological signature of the signal. Finally, the system is read out by a network of wavelength-shifting fibres coupled to a photodetector (MPPC). This paper describes the design of the reconstruction algorithm that allows maximum use of the granularity of the detector. The goal of the algorithm is to convert the output of the optical-fibre readout to the list of the detection units from which it originated. This paper provides a performance comparison for three methods and concludes with a choice of the baseline approach for the experiment.


title: Consumer Behavior under Benevolent Price Discrimination

abstract: Extensive research shows that consumers are generally averse to price discrimination. However, instruments of differential pricing can benefit consumer surplus and alleviate inequity through targeted price discounts. This paper examines how these outcome considerations influence consumer reactions to price discrimination. Six studies with 3951 participants show that a large share of consumers is willing to costly switch away from a store that introduces a discount for low-income consumers. This happens irrespective of whether income differences are due to luck or merit. While the price-discriminating store does attract some new high-income consumers, it cannot compensate the loss of existing consumers. Allowing for altruistic preferences by simulating a market mechanism increases costly support for price discounts, but does not alleviate consumer aversions. Finally, we provide evidence that warm glow drives costly support for price discounts.


title: Recent Advancements in Mode Division Multiplexing for Communication and Computation in Silicon Photonics

abstract: Mode Division Multiplexing (MDM) is a technique used over the past decade in Silicon Photonics (SiPh) to incorporate more data into communication links by employing higher-order transverse electric or transverse magnetic modes. MDM was primarily used in optical communication; however, in recent years, there have been several applications of MDM in optical computing, including both classical and quantum computing. Although MDM has shown great promise for increasing the throughput of optical communication and the accuracy and fidelity of optical computation, there are a few challenges towards expanding its applications. One major challenge is the lack of process design kits (PDKs) and building block libraries compatible with standard SiPh foundries. Here, we present a comprehensive library of MDM components developed using classical and inverse design, compatible with standard 220 nm SiPh foundries. The library includes thermo-optic phase shifters, mode multiplexers and demultiplexers, mode converters, mode exchangers, and multi-mode interference couplers. We also discuss our recent achievements in MDM for datacom, classical and quantum optical computing, including a mode-selective switch for mode-reconfigurable optical add-drop multiplexer (ROADM), multimode multiply-accumulate operation, and multimode photonic quantum processors.


title: Nuclear Matter Equation of State in the Brueckner-Hartree-Fock Approach and Standard Skyrme Energy-Density Functionals

abstract: The equation of state of asymmetric nuclear matter as well as the neutron and proton effective masses and their partial-wave and spin-isospin decomposition are analyzed within the Brueckner--Hartree--Fock approach. Theoretical uncertainties for all these quantities are estimated by using several phase-shift-equivalent nucleon-nucleon forces together with two types of three-nucleon forces, phenomenological and microscopic. It is shown that the choice of the three-nucleon force plays an important role above saturation density, leading to different density dependencies of the energy per particle. These results are compared to the standard form of the Skyrme energy-density functional and we find that it is not possible to reproduce the BHF predictions in the $(S,T)$ channels in symmetric and neutron matter above saturation density, already at the level of the two-body interaction, and even more including the three-body interaction.


title: Towards more realistic human motion prediction with attention to motion coordination

abstract: Joint relation modeling is a curial component in human motion prediction. Most existing methods rely on skeletal-based graphs to build the joint relations, where local interactive relations between joint pairs are well learned. However, the motion coordination, a global joint relation reflecting the simultaneous cooperation of all joints, is usually weakened because it is learned from part to whole progressively and asynchronously. Thus, the final predicted motions usually appear unrealistic. To tackle this issue, we learn a medium, called coordination attractor (CA), from the spatiotemporal features of motion to characterize the global motion features, which is subsequently used to build new relative joint relations. Through the CA, all joints are related simultaneously, and thus the motion coordination of all joints can be better learned. Based on this, we further propose a novel joint relation modeling module, Comprehensive Joint Relation Extractor (CJRE), to combine this motion coordination with the local interactions between joint pairs in a unified manner. Additionally, we also present a Multi-timescale Dynamics Extractor (MTDE) to extract enriched dynamics from the raw position information for effective prediction. Extensive experiments show that the proposed framework outperforms state-of-the-art methods in both short- and long-term predictions on H3.6M, CMU-Mocap, and 3DPW.


title: PAC-learning of free-fermionic states is NP-hard

abstract: Free-fermionic states, also known as matchgates or Gaussian states, are a fundamental class of quantum states due to their efficient classical simulability and their crucial role across various domains of Physics. With the advent of quantum devices, experiments now yield data from quantum states, including estimates of expectation values. We establish that deciding whether a given dataset, formed by a few Majorana correlation functions estimates, can be consistent with a free-fermionic state is an NP-complete problem. Our result also extends to datasets formed by estimates of Pauli expectation values. This is in stark contrast to the case of stabilizer states, where the analogous problem can be efficiently solved. Moreover, our results directly imply that free-fermionic states are computationally hard to properly PAC-learn, where PAC-learning of quantum states is a learning framework introduced by Aaronson. Remarkably, this is the first class of classically simulable quantum states shown to have this property.


title: Leveraging Interpolation Models and Error Bounds for Verifiable Scientific Machine Learning

abstract: Effective verification and validation techniques for modern scientific machine learning workflows are challenging to devise. Statistical methods are abundant and easily deployed, but often rely on speculative assumptions about the data and methods involved. Error bounds for classical interpolation techniques can provide mathematically rigorous estimates of accuracy, but often are difficult or impractical to determine computationally. In this work, we present a best-of-both-worlds approach to verifiable scientific machine learning by demonstrating that (1) multiple standard interpolation techniques have informative error bounds that can be computed or estimated efficiently; (2) comparative performance among distinct interpolants can aid in validation goals; (3) deploying interpolation methods on latent spaces generated by deep learning techniques enables some interpretability for black-box models. We present a detailed case study of our approach for predicting lift-drag ratios from airfoil images. Code developed for this work is available in a public Github repository.


title: Anticipate & Collab: Data-driven Task Anticipation and Knowledge-driven Planning for Human-robot Collaboration

abstract: An agent assisting humans in daily living activities can collaborate more effectively by anticipating upcoming tasks. Data-driven methods represent the state of the art in task anticipation, planning, and related problems, but these methods are resource-hungry and opaque. Our prior work introduced a proof of concept framework that used an LLM to anticipate 3 high-level tasks that served as goals for a classical planning system that computed a sequence of low-level actions for the agent to achieve these goals. This paper describes DaTAPlan, our framework that significantly extends our prior work toward human-robot collaboration. Specifically, DaTAPlan planner computes actions for an agent and a human to collaboratively and jointly achieve the tasks anticipated by the LLM, and the agent automatically adapts to unexpected changes in human action outcomes and preferences. We evaluate DaTAPlan capabilities in a realistic simulation environment, demonstrating accurate task anticipation, effective human-robot collaboration, and the ability to adapt to unexpected changes. Project website: https://dataplan-hrc.github.io


title: $\bar b \bar b u d$ and $\bar b \bar b u s$ tetraquarks from lattice QCD using symmetric correlation matrices with both local and scattering interpolating operators

abstract: We study the $\bar b \bar b u d$ tetraquark with quantum numbers $I(J^P) = 0(1^+)$ as well as the $\bar b \bar b u s$ tetraquark with quantum numbers $J^P = 1^+$ using lattice QCD. We improve on existing work by including both local and scattering interpolating operators on both sides of the correlation functions and use symmetric correlation matrices. This allows not only a reliable determination of the energies of QCD-stable tetraquark ground states, but also of low-lying excited states, which are meson-meson scattering states. The latter is particularly important for future finite-volume scattering analyses. Here, we perform chiral and continuum extrapolations of just the ground-state energies, for which finite-volume effects are expected to be small. Our resulting tetraquark binding energies, $-100 \pm 10\:^{+36}_{-43}\:\:{\rm MeV}$ for $\bar b \bar b u d$ and $-30 \pm 3\:^{+11}_{-31}\:\:{\rm MeV}$ for $\bar b \bar b u s$, are consistent with other recent lattice-QCD predictions.


title: Homotopy types of diagrams of chain complexes

abstract: We study the homotopy theory of diagrams of chain complexes over a field indexed by a finite poset, and show that it can be completely described in terms of appropriate diagrams of graded vector spaces.


title: SemGrasp: Semantic Grasp Generation via Language Aligned Discretization

abstract: Generating natural human grasps necessitates consideration of not just object geometry but also semantic information. Solely depending on object shape for grasp generation confines the applications of prior methods in downstream tasks. This paper presents a novel semantic-based grasp generation method, termed SemGrasp, which generates a static human grasp pose by incorporating semantic information into the grasp representation. We introduce a discrete representation that aligns the grasp space with semantic space, enabling the generation of grasp postures in accordance with language instructions. A Multimodal Large Language Model (MLLM) is subsequently fine-tuned, integrating object, grasp, and language within a unified semantic space. To facilitate the training of SemGrasp, we have compiled a large-scale, grasp-text-aligned dataset named CapGrasp, featuring about 260k detailed captions and 50k diverse grasps. Experimental findings demonstrate that SemGrasp efficiently generates natural human grasps in alignment with linguistic intentions. Our code, models, and dataset are available publicly at: https://kailinli.github.io/SemGrasp.


title: Wilkins: HPC In Situ Workflows Made Easy

abstract: In situ approaches can accelerate the pace of scientific discoveries by allowing scientists to perform data analysis at simulation time. Current in situ workflow systems, however, face challenges in handling the growing complexity and diverse computational requirements of scientific tasks. In this work, we present Wilkins, an in situ workflow system that is designed for ease-of-use while providing scalable and efficient execution of workflow tasks. Wilkins provides a flexible workflow description interface, employs a high-performance data transport layer based on HDF5, and supports tasks with disparate data rates by providing a flow control mechanism. Wilkins seamlessly couples scientific tasks that already use HDF5, without requiring task code modifications. We demonstrate the above features using both synthetic benchmarks and two science use cases in materials science and cosmology.


title: ReFT: Representation Finetuning for Language Models

abstract: Parameter-efficient finetuning (PEFT) methods seek to adapt large neural models via updates to a small number of weights. However, much prior interpretability work has shown that representations encode rich semantic information, suggesting that editing representations might be a more powerful alternative. We pursue this hypothesis by developing a family of Representation Finetuning (ReFT) methods. ReFT methods operate on a frozen base model and learn task-specific interventions on hidden representations. We define a strong instance of the ReFT family, Low-rank Linear Subspace ReFT (LoReFT), and we identify an ablation of this method that trades some performance for increased efficiency. Both are drop-in replacements for existing PEFTs and learn interventions that are 15x--65x more parameter-efficient than LoRA. We showcase LoReFT on eight commonsense reasoning tasks, four arithmetic reasoning tasks, instruction-tuning, and GLUE. In all these evaluations, our ReFTs deliver the best balance of efficiency and performance, and almost always outperform state-of-the-art PEFTs. We release a generic ReFT training library publicly at https://github.com/stanfordnlp/pyreft.


title: Beyond the blur: using experimental point spread functions to help scanning Kelvin probe microscopy reach its full potential

abstract: Scanning Kelvin probe microscopy (SKPM) is a powerful technique for investigating the electrostatic properties of material surfaces, enabling the imaging of variations in work function, topology, surface charge density, or combinations thereof. Regardless of the underlying signal source, SKPM results in a voltage image which is spatially distorted due to the finite size of the probe, long-range electrostatic interactions, mechanical and electrical noise, and the finite response time of the electronics. In order to recover the underlying signal, it is necessary to deconvolve the measurement with an appropriate point spread function (PSF) that accounts the aforementioned distortions, but determining this PSF is difficult. Here we describe how such PSFs can be determined experimentally, and show how they can be used to recover the underlying information of interest. We first consider the physical principles that enable SKPM, and discuss how these affect the system PSF. We then show how one can experimentally measure PSFs by looking at well defined features, and that these compare well to simulated PSFs, provided scans are performed extremely slowly and carefully. Next, we work at realistic scan speeds, and show that the idealised PSFs fail to capture temporal distortions in the scan direction. While simulating PSFs for these situations would be quite challenging, we show that measuring PSFs with similar scan parameters works well. Our approach clarifies the basic principles of and inherent challenges to SKPM measurements, and gives practical methods to improve results.


title: Setpoint control of bilinear systems from noisy data

abstract: We consider the problem of designing a controller for an unknown bilinear system using only noisy input-states data points generated by it. The controller should achieve regulation to a given state setpoint and provide a guaranteed basin of attraction. Determining the equilibrium input to achieve that setpoint is not trivial in a data-based setting and we propose the design of a controller in two scenarios. The design takes the form of linear matrix inequalities and is validated numerically for a Cuk converter.


title: DiffDet4SAR: Diffusion-based Aircraft Target Detection Network for SAR Images

abstract: Aircraft target detection in SAR images is a challenging task due to the discrete scattering points and severe background clutter interference. Currently, methods with convolution-based or transformer-based paradigms cannot adequately address these issues. In this letter, we explore diffusion models for SAR image aircraft target detection for the first time and propose a novel \underline{Diff}usion-based aircraft target \underline{Det}ection network \underline{for} \underline{SAR} images (DiffDet4SAR). Specifically, the proposed DiffDet4SAR yields two main advantages for SAR aircraft target detection: 1) DiffDet4SAR maps the SAR aircraft target detection task to a denoising diffusion process of bounding boxes without heuristic anchor size selection, effectively enabling large variations in aircraft sizes to be accommodated; and 2) the dedicatedly designed Scattering Feature Enhancement (SFE) module further reduces the clutter intensity and enhances the target saliency during inference. Extensive experimental results on the SAR-AIRcraft-1.0 dataset show that the proposed DiffDet4SAR achieves 88.4\% mAP$_{50}$, outperforming the state-of-the-art methods by 6\%. Code is availabel at \href{https://github.com/JoyeZLearning/DiffDet4SAR}.


title: Laser Learning Environment: A new environment for coordination-critical multi-agent tasks

abstract: We introduce the Laser Learning Environment (LLE), a collaborative multi-agent reinforcement learning environment in which coordination is central. In LLE, agents depend on each other to make progress (interdependence), must jointly take specific sequences of actions to succeed (perfect coordination), and accomplishing those joint actions does not yield any intermediate reward (zero-incentive dynamics). The challenge of such problems lies in the difficulty of escaping state space bottlenecks caused by interdependence steps since escaping those bottlenecks is not rewarded. We test multiple state-of-the-art value-based MARL algorithms against LLE and show that they consistently fail at the collaborative task because of their inability to escape state space bottlenecks, even though they successfully achieve perfect coordination. We show that Q-learning extensions such as prioritized experience replay and n-steps return hinder exploration in environments with zero-incentive dynamics, and find that intrinsic curiosity with random network distillation is not sufficient to escape those bottlenecks. We demonstrate the need for novel methods to solve this problem and the relevance of LLE as cooperative MARL benchmark.


title: Chain union closures

abstract: We study spherical completeness of ball spaces and its stability under expansions. We give some criteria for ball spaces that guarantee that spherical completeness is preserved when the ball space is closed under unions of chains. This applies in particular to the spaces of closed ultrametric balls in ultrametric spaces with linearly ordered value sets, or more generally, with countable narrow value sets. We show that in general, chain union closures of ultrametric spaces with partially ordered value sets do not preserve spherical completeness. Further, we introduce and study the notions of chain union stability and of chain union rank, which measure how often the process of closing a ball space under all unions of chains has to be iterated until a ball space is obtained that is closed under unions of chains.


title: Intent Detection and Entity Extraction from BioMedical Literature

abstract: Biomedical queries have become increasingly prevalent in web searches, reflecting the growing interest in accessing biomedical literature. Despite recent research on large-language models (LLMs) motivated by endeavours to attain generalized intelligence, their efficacy in replacing task and domain-specific natural language understanding approaches remains questionable. In this paper, we address this question by conducting a comprehensive empirical evaluation of intent detection and named entity recognition (NER) tasks from biomedical text. We show that Supervised Fine Tuned approaches are still relevant and more effective than general-purpose LLMs. Biomedical transformer models such as PubMedBERT can surpass ChatGPT on NER task with only 5 supervised examples.


title: A mini-course on Generalized Symmetries and a relation to Cobordisms and K-theory

abstract: This mini-course, conducted at the XI School on Geometric, Algebraic, and Topological Methods in Quantum Field Theory held in Villa de Leyva, Colombia, provides an overview of the interconnection between generalized symmetries and cohomology. It is designed for advanced undergraduate students with a background in physics or mathematics. Additionally, we describe a method for connecting generalized symmetries with cobordisms and K-theory within the framework of string theory. We assume basic knowledge in quantum field theory and differential forms.


title: Deformation-induced CPT violation in entangled pairs of neutral kaons

abstract: In this paper we consider description of kaon -- anti-kaon interference in the context of a theory with deformed $\cal CPT$ symmetry. In the case of such theoretical models, deviations from the standard $\cal CPT$ invariance is related to the momentum carried by the particles; in particular the rest masses of particles and antiparticles are equal. We find that the decay intensity of kaon -- anti-kaon pair has three contributing terms: the correct-parity, the wrong-parity, and the interference between them, all of which are affected by deformation. Using the fact that the presence of such terms were not observed we estimate the magnitude of deformation parameter $\kappa \gtrsim 10^{18}$ GeV, very close to the expected Planck mass scale. This raises hopes that the effect, if exists, could be detected in a near future accelerator experiments. An uncertainty of the energy measurement is crucial for accuracy of these predictions.


title: Trimming Five Generated Gorenstein Ideals

abstract: Let $(R,\mathfrak{m},\Bbbk)$ be a regular local ring of dimension 3. Let $I$ be a Gorenstein ideal of $R$ of grade 3. It follows from a result of Buchsbaum and Eisenbud that there is a skew-symmetric matrix of odd size such that $I$ is generated by the sub-maximal pfaffians of this matrix. Let $J$ be the ideal obtained by multiplying some of the pfaffian generators of $I$ by $\mathfrak{m}$; we say that $J$ is a trimming of $I$. In a previous work, the first author and A. Hardesty constructed an explicit free resolution of $R/J$ and computed a DG algebra structure on this resolution. They utilized these products to analyze the Tor algebra of such trimmed ideals. Missing from their result was the case where $I$ is five generated. In this paper we address this case.


title: Evaluating LLMs at Detecting Errors in LLM Responses

abstract: With Large Language Models (LLMs) being widely used across various tasks, detecting errors in their responses is increasingly crucial. However, little research has been conducted on error detection of LLM responses. Collecting error annotations on LLM responses is challenging due to the subjective nature of many NLP tasks, and thus previous research focuses on tasks of little practical value (e.g., word sorting) or limited error types (e.g., faithfulness in summarization). This work introduces ReaLMistake, the first error detection benchmark consisting of objective, realistic, and diverse errors made by LLMs. ReaLMistake contains three challenging and meaningful tasks that introduce objectively assessable errors in four categories (reasoning correctness, instruction-following, context-faithfulness, and parameterized knowledge), eliciting naturally observed and diverse errors in responses of GPT-4 and Llama 2 70B annotated by experts. We use ReaLMistake to evaluate error detectors based on 12 LLMs. Our findings show: 1) Top LLMs like GPT-4 and Claude 3 detect errors made by LLMs at very low recall, and all LLM-based error detectors perform much worse than humans. 2) Explanations by LLM-based error detectors lack reliability. 3) LLMs-based error detection is sensitive to small changes in prompts but remains challenging to improve. 4) Popular approaches to improving LLMs, including self-consistency and majority vote, do not improve the error detection performance. Our benchmark and code are provided at https://github.com/psunlpgroup/ReaLMistake.


title: A semi-implicit second-order temporal scheme for solving the pressure head-based form of Richards' and advection-dispersion equations

abstract: In this study, a novel semi-implicit second-order temporal scheme combined with the finite element method for space discretization is proposed to solve the coupled system of infiltration and solute transport in unsaturated porous media. The Richards equation is used to describe unsaturated flow, while the advection-dispersion equation (ADE) is used for modeling solute transport. The proposed approach is used to linearize the system of equations in time, eliminating the need of iterative processes. A free parameter is introduced to ensure the stability of the scheme. Numerical tests are conducted to analyze the accuracy of the proposed method in comparison with a family of second-order iterative schemes. The proposed numerical technique based on the optimal free parameter is accurate and performs better in terms of efficiency since it offers a considerable gain in computational time compared to the other methods. For reliability and effectiveness evaluation of the developed semi-implicit scheme, four showcase scenarios are used. The first two numerical tests focus on modeling water flow in heterogeneous soil and transient flow in variably saturated zones. The last numerical tests are carried out to simulate the salt and nitrate transport through unsaturated soils. The simulation results are compared with reference solutions and laboratory data, and demonstrate the effectiveness of the proposed scheme in simulating infiltration and solute transport through unsaturated soils.


title: A Unified Algorithmic Framework for Dynamic Assortment Optimization under MNL Choice

abstract: We consider assortment and inventory planning problems with dynamic stockout-based substitution effects and no replenishment. We consider two settings: 1. Customers can see all available products when they arrive, which is commonly seen in physical stores. 2. The seller can choose to offer a subset of available products to each customer, which is typical on online platforms. Both settings are known to be computationally challenging, and the current approximation algorithms for the two settings are quite different. We develop a unified algorithm framework under the MNL choice model for both settings. Our algorithms improve on the state-of-the-art algorithms in terms of approximation guarantee, runtime, and the ability to manage uncertainty in the total number of customers and handle more complex constraints. In the process, we establish various novel properties of dynamic assortment planning (under the MNL choice) that may be useful more broadly.


title: Mitigating the Impact of Outlier Channels for Language Model Quantization with Activation Regularization

abstract: We consider the problem of accurate quantization for language models, where both the weights and activations are uniformly quantized to 4 bits per parameter, the lowest bitwidth format natively supported by GPU hardware. In this context, the key challenge is activation quantization: it is known that language models contain outlier channels whose values on average are orders of magnitude higher than than other channels, which prevents accurate low-bitwidth quantization with known techniques. We systematically study this phenomena and find that these outlier channels emerge early in training, and that they occur more frequently in layers with residual streams. We then propose a simple strategy which regularizes a layer's inputs via quantization-aware training (QAT) and its outputs via activation kurtosis regularization. We show that regularizing both the inputs and outputs is crucial for preventing a model's "migrating" the difficulty in input quantization to the weights, which makes post-training quantization (PTQ) of weights more difficult. When combined with weight PTQ, we show that our approach can obtain a W4A4 model that performs competitively to the standard-precision W16A16 baseline.


title: Analyzing Musical Characteristics of National Anthems in Relation to Global Indices

abstract: Music plays a huge part in shaping peoples' psychology and behavioral patterns. This paper investigates the connection between national anthems and different global indices with computational music analysis and statistical correlation analysis. We analyze national anthem musical data to determine whether certain musical characteristics are associated with peace, happiness, suicide rate, crime rate, etc. To achieve this, we collect national anthems from 169 countries and use computational music analysis techniques to extract pitch, tempo, beat, and other pertinent audio features. We then compare these musical characteristics with data on different global indices to ascertain whether a significant correlation exists. Our findings indicate that there may be a correlation between the musical characteristics of national anthems and the indices we investigated. The implications of our findings for music psychology and policymakers interested in promoting social well-being are discussed. This paper emphasizes the potential of musical data analysis in social research and offers a novel perspective on the relationship between music and social indices. The source code and data are made open-access for reproducibility and future research endeavors. It can be accessed at http://bit.ly/na_code.


title: Testing the Boundary-to-Bound Correspondence with Numerical Relativity

abstract: The Boundary-to-Bound (B2B) correspondence, which connects orbital and radiative observables between bound and unbound orbits, has recently been introduced and demonstrated in the perturbative regime. We produce a large number of numerical relativity simulations of bound and unbound encounters between two nonspinning equal mass black holes in order to test this correspondence in the non-perturbative regime. We focus on testing the radiated energy and angular momentum, as well as orbital parameters such as the period and periastron advance. We find that, across a wide range of eccentricities, the B2B relationships do not hold in the non-perturbative regime, thereby placing a clear limit on the applicability of these relationships. We also approximate the separatrix between bound and unbound relativistic encounters as a function of their initial energies and angular momenta.


title: Sailor: Open Language Models for South-East Asia

abstract: We present Sailor, a family of open language models ranging from 0.5B to 7B parameters, tailored for South-East Asian (SEA) languages. These models are continually pre-trained from Qwen1.5, a great language model for multilingual use cases. From Qwen1.5, Sailor models accept 200B to 400B tokens, primarily covering the languages of English, Chinese, Vietnamese, Thai, Indonesian, Malay, and Lao. The training leverages several techniques, including BPE dropout for improving the model robustness, aggressive data cleaning and deduplication, and small proxy models to optimize data mixture. Experimental results on four typical tasks indicate that Sailor models demonstrate strong performance across different benchmarks, including commonsense reasoning, question answering, reading comprehension and examination. Embracing the open-source spirit, we share our insights through this report to spark a wider interest in developing large language models for multilingual use cases.


title: Fundamental inequalities for the iterated Fourier-cosine convolution with Gaussian weight and its application

abstract: Derived from the results in (Math. Nachr., 283(12):1758-1770, 2010), in this paper, we devoted to studying the boundedness properties for Fourier-cosine convolution weighted by Gaussian functions via Young's type theorem and Saitoh's type inequality. New norm estimations in the weighted space are obtained and application of the corresponding class of convolutions in Fredholm's second kind of integral equation is discussed. The conditions for the solvability of this equation in $L_1$ space are also found, along with the analysis of an illustrative example, which exemplifies that the present object and method solve cases that are not under the conditions of previously known techniques.


title: Deriving Compact QUBO Models via Multilevel Constraint Transformation

abstract: With the advances in customized hardware for quantum annealing and digital/CMOS Annealing, Quadratic Unconstrained Binary Optimization (QUBO) models have received growing attention in the optimization literature. Motivated by an existing general-purpose approach that derives QUBO models from binary linear programs (BLP), we propose a novel Multilevel Constraint Transformation Scheme (MLCTS) that derives QUBO models with fewer ancillary binary variables. We formulate sufficient conditions for the existence of a compact QUBO formulation (i.e., in the original BLP decision space) in terms of constraint levelness and demonstrate the flexibility and applicability of MLCTS on synthetic examples and several well-known combinatorial optimization problems, i.e., the Maximum 2-Satisfiability Problem, the Linear Ordering Problem, the Community Detection Problem, and the Maximum Independence Set Problem. For a proof-of-concept, we compare the performance of two QUBO models for the latter problem on both a general-purpose software-based solver and a hardware-based QUBO solver. The MLCTS-derived models demonstrate significantly better performance for both solvers, in particular, solving up to seven times more instances with the hardware-based approach.


title: InsectMamba: Insect Pest Classification with State Space Model

abstract: The classification of insect pests is a critical task in agricultural technology, vital for ensuring food security and environmental sustainability. However, the complexity of pest identification, due to factors like high camouflage and species diversity, poses significant obstacles. Existing methods struggle with the fine-grained feature extraction needed to distinguish between closely related pest species. Although recent advancements have utilized modified network structures and combined deep learning approaches to improve accuracy, challenges persist due to the similarity between pests and their surroundings. To address this problem, we introduce InsectMamba, a novel approach that integrates State Space Models (SSMs), Convolutional Neural Networks (CNNs), Multi-Head Self-Attention mechanism (MSA), and Multilayer Perceptrons (MLPs) within Mix-SSM blocks. This integration facilitates the extraction of comprehensive visual features by leveraging the strengths of each encoding strategy. A selective module is also proposed to adaptively aggregate these features, enhancing the model's ability to discern pest characteristics. InsectMamba was evaluated against strong competitors across five insect pest classification datasets. The results demonstrate its superior performance and verify the significance of each model component by an ablation study.


title: Creator Hearts: Investigating the Impact Positive Signals from YouTube Creators in Shaping Comment Section Behavior

abstract: Much of the research in online moderation focuses on punitive actions. However, emerging research has shown that positive reinforcement is effective at encouraging desirable behavior on online platforms. We extend this research by studying the "creator heart" feature on YouTube, quantifying their primary effects on comments that receive hearts and on videos where hearts have been given. We find that creator hearts increased the visibility of comments, and increased the amount of positive engagement they received from other users. We also find that the presence of a creator hearted comment soon after a video is published can incentivize viewers to comment, increasing the total engagement with the video over time. We discuss the potential for creators to use hearts to shape behavior in their communities by highlighting, rewarding, and incentivizing desirable behaviors from users. We discuss avenues for extending our study to understanding positive signals from moderators on other platforms.


title: Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splatting

abstract: As 3D Gaussian Splatting (3DGS) provides fast and high-quality novel view synthesis, it is a natural extension to deform a canonical 3DGS to multiple frames. However, previous works fail to accurately reconstruct dynamic scenes, especially 1) static parts moving along nearby dynamic parts, and 2) some dynamic areas are blurry. We attribute the failure to the wrong design of the deformation field, which is built as a coordinate-based function. This approach is problematic because 3DGS is a mixture of multiple fields centered at the Gaussians, not just a single coordinate-based framework. To resolve this problem, we define the deformation as a function of per-Gaussian embeddings and temporal embeddings. Moreover, we decompose deformations as coarse and fine deformations to model slow and fast movements, respectively. Also, we introduce an efficient training strategy for faster convergence and higher quality. Project page: https://jeongminb.github.io/e-d3dgs/


title: Towards Trustworthy Automated Program Verifiers: Formally Validating Translations into an Intermediate Verification Language (extended version)

abstract: Automated program verifiers are typically implemented using an intermediate verification language (IVL), such as Boogie or Why3. A verifier front-end translates the input program and specification into an IVL program, while the back-end generates proof obligations for the IVL program and employs an SMT solver to discharge them. Soundness of such verifiers therefore requires that the front-end translation faithfully captures the semantics of the input program and specification in the IVL program, and that the back-end reports success only if the IVL program is actually correct. For a verification tool to be trustworthy, these soundness conditions must be satisfied by its actual implementation, not just the program logic it uses. In this paper, we present a novel validation methodology that, given a formal semantics for the input language and IVL, provides formal soundness guarantees for front-end implementations. For each run of the verifier, we automatically generate a proof in Isabelle showing that the correctness of the produced IVL program implies the correctness of the input program. This proof can be checked independently from the verifier, in Isabelle, and can be combined with existing work on validating back-ends to obtain an end-to-end soundness result. Our methodology based on forward simulation employs several modularisation strategies to handle the large semantic gap between the input language and the IVL, as well as the intricacies of practical, optimised translations. We present our methodology for the widely-used Viper and Boogie languages. Our evaluation shows that it is effective in validating the translations performed by the existing Viper implementation.


title: Collective coupling of driven multilevel atoms and its effect on four-wave mixing

abstract: Microscopic models based on multilevel atoms are central to controlling non-linear optical responses and coherent control of light. These models are traditionally based on single-atom responses that are then parametrically extrapolated to include collective effects, such as an enhanced response or propagation within the medium. In this work we present a systematic analysis of the cooperative effects arising in driven systems composed of multi-level atoms coupled by a common electromagnetic environment. The analysis is based on an interplay between dressed states induced by the driving field, photon exchanges, and the collective decay channels. This theory is applied to the case of four-wave mixing mediated by a pair of atoms in the diamond configuration, a nonlinear process commonly used to create correlated photon pairs. The effects of inter-atomic correlations and collective decay channels over outgoing photons are then explored. We find that the resulting correlation function changes from a Lorentzian distribution for independent atoms to a two-peaked distribution when dipole-dipole interactions are included. The two-peak structure is related to a joint action between the dressed states and the collective decay channels. Signatures of these processes are identified for existing experimental realizations. The intuition obtained from this connection helps to uncover relevant parameters that could be exploited for quantum control protocols based on dispersive and dissipative cooperative effects in multi-level systems.


title: On algebras of Dirichlet series invariant under permutations of coefficients

abstract: Let $\mathscr O_u$ be the algebra of holomorphic functions on ${\bf C}_+:=\{s\in{\bf C}:\text{Re }s>0\}$ that are limits of Dirichlet series $D=\sum_{n=1}^\infty a_n n^{-s}$, $s\in \bf{C}_+$, that converge uniformly on proper half-planes of $\bf{C}_+$. We study algebraic-topological properties of subalgebras of $\mathscr O_u$: the Banach algebras $\mathscr W, \mathscr A, \mathscr H^\infty$ and the Frechet algebra $\mathscr O_b$. Here $\mathscr W$ consists of functions in $\mathscr O_u$ of absolutely convergent Dirichlet series on the closure of $\bf{C}_+$, $\mathscr A$ is the uniform closure of $\mathscr W$, $\mathscr H^\infty$ is the algebra of all bounded functions in $\mathscr O_u$, and $\mathscr O_b$ is set of all $f(s)=\sum_{n=1}^\infty a_n n^{-s}$ in $\mathscr O_u$ so that $f_r\in \mathscr H^\infty$, $r\in (0,1)$, where $f_r(s):=\sum_{n=1}^\infty a_n r^{\Omega(n)} n^{-s}$ and $\Omega(n)$ is the number of prime factors of $n$. Let $S_\bf{N}$ be the group of permutations of $\bf{N}$. Each $\sigma\in S_\bf{N}$ determines a permutation $\hat\sigma\in S_\bf{N}$ (i.e., such that $\hat\sigma(mn)=\hat\sigma(n)\hat\sigma(m)$ for all $m,n\in \bf{N}$) via the fundamental theorem of arithmetic. For a Dirichlet series $D=\sum_{n=1}^\infty a_n n^{-s}$, and $\sigma \in S_\bf{N}$, $S_\sigma(D)=\sum_{n=1}^\infty a_{\hat{\sigma}^{-1}(n)} n^{-s}$ determines an action of $S_\bf{N}$ on the set of all Dirichlet series. It is shown that each of the algebras above is invariant with respect to this action. Given a subgroup $G$ of $S_\bf{N}$, the set of $G$-invariant subalgebras of these algebras are studied, and their maximal ideal spaces are described, and used to characterise groups of units and of invertible elements having logarithms, find the stable rank, show projective freeness, and describe when the special linear group is generated by elementary matrices, with bounds on the number of factors.


title: On the Efficiency of Convolutional Neural Networks

abstract: Since the breakthrough performance of AlexNet in 2012, convolutional neural networks (convnets) have grown into extremely powerful vision models. Deep learning researchers have used convnets to perform vision tasks with accuracy that was unachievable a decade ago. Confronted with the immense computation that convnets use, deep learning researchers also became interested in efficiency. However, the engineers who deployed efficient convnets soon realized that they were slower than the previous generation, despite using fewer operations. Many reverted to older models that ran faster. Hence researchers switched the objective of their search from arithmetic complexity to latency and produced a new wave of models that performed better. Paradoxically, these models also used more operations. Skepticism grew among researchers and engineers alike about the relevance of arithmetic complexity. Contrary to the prevailing view that latency and arithmetic complexity are irreconcilable, a simple formula relates both through computational efficiency. This insight enabled us to co-optimize the separate factors that determine latency. We observed that the degenerate conv2d layers that produce the best accuracy--complexity trade-off also use significant memory resources and have low computational efficiency. We devised block fusion algorithms to implement all the layers of a residual block in a single kernel, thereby creating temporal locality, avoiding communication, and reducing workspace size. Our ConvFirst model with block-fusion kernels has less arithmetic complexity and greater computational efficiency than baseline models and kernels, and ran approximately four times as fast as ConvNeXt. We also created novel tools, including efficiency gap plots and waterline analysis. Our unified approach to convnet efficiency envisions a new era of models and kernels that achieve greater accuracy at lower cost.


title: DeViDe: Faceted medical knowledge for improved medical vision-language pre-training

abstract: Vision-language pre-training for chest X-rays has made significant strides, primarily by utilizing paired radiographs and radiology reports. However, existing approaches often face challenges in encoding medical knowledge effectively. While radiology reports provide insights into the current disease manifestation, medical definitions (as used by contemporary methods) tend to be overly abstract, creating a gap in knowledge. To address this, we propose DeViDe, a novel transformer-based method that leverages radiographic descriptions from the open web. These descriptions outline general visual characteristics of diseases in radiographs, and when combined with abstract definitions and radiology reports, provide a holistic snapshot of knowledge. DeViDe incorporates three key features for knowledge-augmented vision language alignment: First, a large-language model-based augmentation is employed to homogenise medical knowledge from diverse sources. Second, this knowledge is aligned with image information at various levels of granularity. Third, a novel projection layer is proposed to handle the complexity of aligning each image with multiple descriptions arising in a multi-label setting. In zero-shot settings, DeViDe performs comparably to fully supervised models on external datasets and achieves state-of-the-art results on three large-scale datasets. Additionally, fine-tuning DeViDe on four downstream tasks and six segmentation tasks showcases its superior performance across data from diverse distributions.