title: Dissecting Cosmological Filaments at High Redshifts: Emergence of Spaghetti-type Flow Inside DM Haloes

abstract: We use high-resolution zoom-in simulations to study the fueling of the central galaxies by gas accretion from cosmological filaments at high redshifts, z>=2. Their parent haloes with similar DM masses of log(M_vir/M})~11.65, have been chosen at z=6, 4, and 2, in high/low overdensity environments, with the goal of comparing evolution within similar M at different z, under dual action of cosmological accretion and galactic outflows -- forming the circumgalactic medium (CGM). We focus on the filamentary and diffuse gas accretion within few virial radii, R_vir, down to the central galaxy. Using a hybrid d-web/entropy method we have mapped the gaseous filaments, and invoking particle kinematics allowed us to separate inflows from outflows, thus resolving thermodynamic and kinematic signatures of the CGM. We find that (1) The CGM is multiphase and not in thermodynamic or dynamic equilibrium; (2) accretion rates via individual filaments display a lower accretion rate and densities at lower redshifts. The inflow velocities along the filaments decrease with redshift, z~ 6-2, from 200-30 kms^-1 by a factor of 2; (3) Temperature within the filaments increases inside R_vir, faster at lower redshifts, in tandem with decrease in the accretion rate; (4) The filaments show a complex structure along their spines: a core radial flow surrounded by a lower density envelope. The core exhibits an elevated density and lower temperature, with no obvious metallicity gradient in the filament cross sections. It also tends to separate the filament into different infall velocity regions and density cores, thus producing a spaghetti-type flow; (6) Inside the inner ~ 30\,h^-1 kpc, the filaments develop the Kelvin-Helmholtz instability which ablates and dissolves them, and triggers turbulence along the filament spine; (7) Finally, the galactic outflows affect mostly the inner ~ 0.5R_vir~ 100 h^-1 kpc of the CGM.


title: Type-Based Verification of Delegated Control in Hybrid~Systems (Full Version)

abstract: We present a post-region-based verification system for distributed hybrid systems modeled with Hybrid Active Objects. The post-region of a class method is the region of the state space where a physical process must be proven safe to ensure some object invariant. Prior systems computed the post-region locally to a single object and could only verify systems where each object ensures its own safety, or relied on specific, non-modular communication patterns. The system presented here uses a type-and-effect system to structure the interactions between objects and computes post-regions globally, but verifies them locally. Furthermore, we are able to handle systems with delegated control: the object and method that shape the post-region change over time. We exemplify our approach with a model of a cloud-based hybrid system.


title: A comprehensive exploration of structural and electronic properties of Molybdenum clusters

abstract: Molybdenum clusters, characterised by their unique structure and intriguing catalytic properties, have gained significant attention in recent years. In several existing studies density functional theory (DFT) methods have been used to find the lowest energy Mo clusters and explore their electronic and magnetic structure. In all cases, with the exception of a single recent study, where a genetic algorithm was employed, initial geometries of the clusters, prior to geometry optimisation, were chosen using heuristic approaches based on symmetry considerations and known structures. DFT calculations were performed using different types of pseudopotentials, from hard to soft, and different types of basis sets. However, no comprehensive study has yet been done in which a DFT method with the best control on its precision would be complemented by a reliable global minimum search method to find the lowest energy Mo clusters. In this work, we employ a combination of a plane wave-based DFT method and \emph{ab initio} random structure searching (AIRSS) technique to find the lowest energy clusters of up to 10 Mo atoms. In each case, the search has been performed for clusters with different spin multiplicities, which enabled us to explore their magnetic structure. The results are compared for both hard and soft pseudopotentials stressing the importance of treating more electrons explicitly, in agreement with some of the previous studies. For most of the low-energy magnetic structures found, we investigate the distribution of their spin densities, and for all low energy clusters, we confirm their stability by calculating their phonon structure. Finally, free energies of the Mo clusters, within the quasi-harmonic approximation, are also calculated and discussed.


title: Electric dipole transitions in the relativistic quasiparticle random phase approximation at finite temperature

abstract: Finite temperature results in various effects on the properties of nuclear structure and excitations of relevance for nuclear processes in hot stellar environments. Here we introduce the self-consistent finite temperature relativistic quasiparticle random phase approximation (FT-RQRPA) based on relativistic energy density functional with point coupling interaction for describing the temperature effects in electric dipole (E1) transitions. We perform a study of E1 excitations in the temperature range $T=$ 0-2 MeV for the selected closed- and open-shell nuclei ranging from $^{40}$Ca to $^{60}$Ca and $^{100}$Sn to $^{140}$Sn by including both thermal and pairing effects. The isovector giant dipole resonance strength is slightly modified for the considered range of temperature, while new low-energy peaks emerge for $E<$12 MeV with non-negligible strength in neutron-rich nuclei at high temperatures. The analysis of relevant two-quasiparticle configurations discloses how new excitation channels open due to thermal unblocking of states at finite temperature. The study also examines the isospin and temperature dependence of electric dipole polarizability ($\alpha_D$), resulting in systematic increase in the values of $\alpha_D$ with increasing temperature, with a more pronounced effect observed in neutron-rich nuclei. The FT-RQRPA introduced in this work will open perspectives for microscopic calculation of $\gamma$-ray strength functions at finite temperatures relevant for nuclear reaction studies.


title: Weak Galerkin Finite Element Methods for Optimal Control Problems Governed by Second Order Elliptic Partial Differential Equations

abstract: This paper is concerned with the development of weak Galerkin (WG) finite element method for optimal control problems governed by second order elliptic partial differential equations (PDEs). It is advantageous to use discontinuous finite elements over the traditional $C^1$ finite elements here. Optimal order error estimates are established and confirmed by some numerical tests.


title: Corrected generalized cross-validation for finite ensembles of penalized estimators

abstract: Generalized cross-validation (GCV) is a widely-used method for estimating the squared out-of-sample prediction risk that employs a scalar degrees of freedom adjustment (in a multiplicative sense) to the squared training error. In this paper, we examine the consistency of GCV for estimating the prediction risk of arbitrary ensembles of penalized least-squares estimators. We show that GCV is inconsistent for any finite ensemble of size greater than one. Towards repairing this shortcoming, we identify a correction that involves an additional scalar correction (in an additive sense) based on degrees of freedom adjusted training errors from each ensemble component. The proposed estimator (termed CGCV) maintains the computational advantages of GCV and requires neither sample splitting, model refitting, or out-of-bag risk estimation. The estimator stems from a finer inspection of the ensemble risk decomposition and two intermediate risk estimators for the components in this decomposition. We provide a non-asymptotic analysis of the CGCV and the two intermediate risk estimators for ensembles of convex penalized estimators under Gaussian features and a linear response model. Furthermore, in the special case of ridge regression, we extend the analysis to general feature and response distributions using random matrix theory, which establishes model-free uniform consistency of CGCV.


title: Scaling laws and exact results in turbulence

abstract: In this note, we address the validity of certain exact results from turbulence theory in the deterministic setting. The main tools, inspired by the work of Duchon-Robert (Inertial energy dissipation for weak solutions of incompressible Euler and Navier-Stokes equations, Nonlinearity, 13(249), 2000) and Eyink (Local 4/5-law and energy dissipation anomaly in turbulence, Nonlinearity, 16(137), 2003), are a number of energy balance identities for weak solutions of the incompressible Euler and Navier-Stokes equations. As a consequence, we show that certain weak solutions of the Euler and Navier-Stokes equations satisfy deterministic versions of Kolmogorov's 4/5, 4/3, 4/15 laws. We apply these computations to improve a recent result of Hofmanova et al. (Kolmogorov 4/5 law for the forced 3D Navier-Stokes equations, arXiv:2304.14470), which shows that a construction of solutions of forced Navier-Stokes due to Bru\`e et al. (Onsager critical solutions of the forced Navier-Stokes equations, arXiv:2212.08413) and exhibiting a form of anomalous dissipation satisfies asymptotic versions of Kolmogorov's laws. In addition, we show that the globally dissipative 3D Euler flows recently constructed by Giri, Kwon, and the author (The $L^3$-based strong Onsager theorem, arXiv:2305.18509) satisfy the local versions of Kolmogorov's laws.


title: Towards Distribution-Agnostic Generalized Category Discovery

abstract: Data imbalance and open-ended distribution are two intrinsic characteristics of the real visual world. Though encouraging progress has been made in tackling each challenge separately, few works dedicated to combining them towards real-world scenarios. While several previous works have focused on classifying close-set samples and detecting open-set samples during testing, it's still essential to be able to classify unknown subjects as human beings. In this paper, we formally define a more realistic task as distribution-agnostic generalized category discovery (DA-GCD): generating fine-grained predictions for both close- and open-set classes in a long-tailed open-world setting. To tackle the challenging problem, we propose a Self-Balanced Co-Advice contrastive framework (BaCon), which consists of a contrastive-learning branch and a pseudo-labeling branch, working collaboratively to provide interactive supervision to resolve the DA-GCD task. In particular, the contrastive-learning branch provides reliable distribution estimation to regularize the predictions of the pseudo-labeling branch, which in turn guides contrastive learning through self-balanced knowledge transfer and a proposed novel contrastive loss. We compare BaCon with state-of-the-art methods from two closely related fields: imbalanced semi-supervised learning and generalized category discovery. The effectiveness of BaCon is demonstrated with superior performance over all baselines and comprehensive analysis across various datasets. Our code is publicly available.


title: UltraFeedback: Boosting Language Models with High-quality Feedback

abstract: Reinforcement learning from human feedback (RLHF) has become a pivot technique in aligning large language models (LLMs) with human preferences. In RLHF practice, preference data plays a crucial role in bridging human proclivity and LLMs. However, the scarcity of diverse, naturalistic datasets of human preferences on LLM outputs at scale poses a great challenge to RLHF as well as feedback learning research within the open-source community. Current preference datasets, either proprietary or limited in size and prompt variety, result in limited RLHF adoption in open-source models and hinder further exploration. In this study, we propose ULTRAFEEDBACK, a large-scale, high-quality, and diversified preference dataset designed to overcome these limitations and foster RLHF development. To create ULTRAFEEDBACK, we compile a diverse array of instructions and models from multiple sources to produce comparative data. We meticulously devise annotation instructions and employ GPT-4 to offer detailed feedback in both numerical and textual forms. ULTRAFEEDBACK establishes a reproducible and expandable preference data construction pipeline, serving as a solid foundation for future RLHF and feedback learning research. Utilizing ULTRAFEEDBACK, we train various models to demonstrate its effectiveness, including the reward model UltraRM, chat language model UltraLM-13B-PPO, and critique model UltraCM. Experimental results indicate that our models outperform existing open-source models, achieving top performance across multiple benchmarks. Our data and models are available at https://github.com/thunlp/UltraFeedback.


title: On Grid Graph Reachability and Puzzle Games

abstract: Many puzzle video games, like Sokoban, involve moving some agent in a maze. The reachable locations are usually apparent for a human player, and the difficulty of the game is mainly related to performing actions on objects, such as pushing (reachable) boxes. For this reason, the difficulty of a particular level is often measured as the number of actions on objects, other than agent walking, needed to find a solution. In this paper we study CP and SAT approaches for solving these kind of problems. We review some reachability encodings and propose a new one. We empirically show that the new encoding is well-suited for solving puzzle problems in the planning as SAT paradigm, especially when considering the execution of several actions in parallel.


title: EXTRACTER: Efficient Texture Matching with Attention and Gradient Enhancing for Large Scale Image Super Resolution

abstract: Recent Reference-Based image super-resolution (RefSR) has improved SOTA deep methods introducing attention mechanisms to enhance low-resolution images by transferring high-resolution textures from a reference high-resolution image. The main idea is to search for matches between patches using LR and Reference image pair in a feature space and merge them using deep architectures. However, existing methods lack the accurate search of textures. They divide images into as many patches as possible, resulting in inefficient memory usage, and cannot manage large images. Herein, we propose a deep search with a more efficient memory usage that reduces significantly the number of image patches and finds the $k$ most relevant texture match for each low-resolution patch over the high-resolution reference patches, resulting in an accurate texture match. We enhance the Super Resolution result adding gradient density information using a simple residual architecture showing competitive metrics results: PSNR and SSMI.


title: Pessimistic Nonlinear Least-Squares Value Iteration for Offline Reinforcement Learning

abstract: Offline reinforcement learning (RL), where the agent aims to learn the optimal policy based on the data collected by a behavior policy, has attracted increasing attention in recent years. While offline RL with linear function approximation has been extensively studied with optimal results achieved under certain assumptions, many works shift their interest to offline RL with non-linear function approximation. However, limited works on offline RL with non-linear function approximation have instance-dependent regret guarantees. In this paper, we propose an oracle-efficient algorithm, dubbed Pessimistic Nonlinear Least-Square Value Iteration (PNLSVI), for offline RL with non-linear function approximation. Our algorithmic design comprises three innovative components: (1) a variance-based weighted regression scheme that can be applied to a wide range of function classes, (2) a subroutine for variance estimation, and (3) a planning phase that utilizes a pessimistic value iteration approach. Our algorithm enjoys a regret bound that has a tight dependency on the function class complexity and achieves minimax optimal instance-dependent regret when specialized to linear function approximation. Our work extends the previous instance-dependent results within simpler function classes, such as linear and differentiable function to a more general framework.


title: DiffAR: Denoising Diffusion Autoregressive Model for Raw Speech Waveform Generation

abstract: Diffusion models have recently been shown to be relevant for high-quality speech generation. Most work has been focused on generating spectrograms, and as such, they further require a subsequent model to convert the spectrogram to a waveform (i.e., a vocoder). This work proposes a diffusion probabilistic end-to-end model for generating a raw speech waveform. The proposed model is autoregressive, generating overlapping frames sequentially, where each frame is conditioned on a portion of the previously generated one. Hence, our model can effectively synthesize an unlimited speech duration while preserving high-fidelity synthesis and temporal coherence. We implemented the proposed model for unconditional and conditional speech generation, where the latter can be driven by an input sequence of phonemes, amplitudes, and pitch values. Working on the waveform directly has some empirical advantages. Specifically, it allows the creation of local acoustic behaviors, like vocal fry, which makes the overall waveform sounds more natural. Furthermore, the proposed diffusion model is stochastic and not deterministic; therefore, each inference generates a slightly different waveform variation, enabling abundance of valid realizations. Experiments show that the proposed model generates speech with superior quality compared with other state-of-the-art neural speech generation systems.


title: Compressing LLMs: The Truth is Rarely Pure and Never Simple

abstract: Despite their remarkable achievements, modern Large Language Models (LLMs) face exorbitant computational and memory footprints. Recently, several works have shown significant success in training-free and data-free compression (pruning and quantization) of LLMs that achieve 50 - 60% sparsity and reduce the bit width to 3 or 4 bits per weight, with negligible degradation of perplexity over the uncompressed baseline. As recent research efforts are focused on developing increasingly sophisticated compression methods, our work takes a step back and re-evaluates the effectiveness of existing SoTA compression methods, which rely on a fairly simple and widely questioned metric, perplexity (even for dense LLMs). We introduce Knowledge-Intensive Compressed LLM BenchmarK (LLM-KICK), a collection of carefully curated tasks to redefine the evaluation protocol for compressed LLMs, which have significant alignment with their dense counterparts and perplexity fail to capture subtle change in their true capabilities. LLM-KICK unveils many favorable merits and unfortunate plights of current SoTA compression methods: all pruning methods suffer significant performance degradation, sometimes at trivial sparsity ratios (e.g., 25-30%), and fail for N:M sparsity in knowledge-intensive tasks; current quantization methods are more successful than pruning; yet, pruned LLMs even at $\geq 50$% sparsity are robust in-context retrieval and summarization systems; among others. LLM-KICK is designed to holistically access compressed LLMs' ability for language understanding, reasoning, generation, in-context retrieval, in-context summarization, etc. We hope our study can foster the development of better LLM compression methods. The reproduced codes are available at https://github.com/VITA-Group/llm-kick.


title: SpinPSO: An agent-based optimization workflow for identifying global noncollinear magnetic ground-states from first-principles

abstract: We propose and implement a novel hybrid meta-heuristic optimization algorithm for the identification of non-collinear global ground-states in magnetic systems. The inputs to this optimization scheme are directly from non-collinear density functional theory (DFT), and the workflow is implemented in the atomate code framework, making it suitable to run on high-performance computing architectures. The hybrid algorithm provides a seamless theoretical extension of particle swarm optimization (PSO) algorithms to continuous $\mathcal S^2$ spins, giving it the name SpinPSO. The hybrid nature of the algorithm stems from setting the dynamics of individual spins to be governed by physically motivated atomistic spin dynamics. Using this algorithm, we are able to achieve convergence to experimentally resolved magnetic ground-states for a set of diverse test case materials that exhibit exotic spin textures.

categories: cond-mat.mtrl-sci math-ph math.MP physics.atom-ph


title: Exact Ground States and Phase Diagram of the Quantum Compass Model under an in-plane Field

abstract: We consider the square lattice $S$=1/2 quantum compass model (QCM) parameterized by $J_x, J_z$, under a field, $\mathbf{h}$, in the $x$-$z$ plane. At the special field value, $(h_x^\star,h_z^\star)$=$2S(J_x,J_z)$, we show that the QCM Hamiltonian may be written in a form such that two simple product states can be identified as exact ground-states, below a gap. Exact excited states can also be found. The exact product states are characterized by a staggered vector chirality, attaining a non-zero value in the surrounding phase. The resulting gapped phase, which we denote by $SVC$ occupies most of the in-plane field phase diagram. For some values of $h_x>h_z$ and $h_z>h_x$ at the edges of the phase diagram, we have found transitions between the $SVC$ phase and phases of weakly-coupled Ising-chain states, $Z$ and $X$. In zero field, the QCM is known to have an emergent sub-extensive ground-state degeneracy. As the field is increased from zero, we find that this degeneracy is partially lifted, resulting in bond-oriented spin-stripe states, $L$ and $R$, which are each separated from one another and the $SVC$ phase by first-order transitions. Our findings are important for understanding the field dependent phase diagram of materials with predominantly directionally-dependent Ising interactions.


title: Feature-Driven Strategies for Trading Wind Power and Hydrogen

abstract: This paper develops a feature-driven model for hybrid power plants, enabling them to exploit available contextual information such as historical forecasts of wind power, and make optimal wind power and hydrogen trading decisions in the day-ahead stage. For that, we develop different variations of feature-driven linear policies, including a variation where policies depend on price domains, resulting in a price-quantity bidding curve. In addition, we propose a real-time adjustment strategy for hydrogen production. Our numerical results show that the final profit obtained from our proposed feature-driven trading mechanism in the day-ahead stage together with the real-time adjustment strategy is very close to that in an ideal benchmark with perfect information.


title: Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench

abstract: Large Language Models (LLMs) have recently showcased their remarkable capacities, not only in natural language processing tasks but also across diverse domains such as clinical medicine, legal consultation, and education. LLMs become more than mere applications, evolving into assistants capable of addressing diverse user requests. This narrows the distinction between human beings and artificial intelligence agents, raising intriguing questions regarding the potential manifestation of personalities, temperaments, and emotions within LLMs. In this paper, we propose a framework, PsychoBench, for evaluating diverse psychological aspects of LLMs. Comprising thirteen scales commonly used in clinical psychology, PsychoBench further classifies these scales into four distinct categories: personality traits, interpersonal relationships, motivational tests, and emotional abilities. Our study examines five popular models, namely text-davinci-003, gpt-3.5-turbo, gpt-4, LLaMA-2-7b, and LLaMA-2-13b. Additionally, we employ a jailbreak approach to bypass the safety alignment protocols and test the intrinsic natures of LLMs. We have made PsychoBench openly accessible via https://github.com/CUHK-ARISE/PsychoBench.


title: It's MBR All the Way Down: Modern Generation Techniques Through the Lens of Minimum Bayes Risk

abstract: Minimum Bayes Risk (MBR) decoding is a method for choosing the outputs of a machine learning system based not on the output with the highest probability, but the output with the lowest risk (expected error) among multiple candidates. It is a simple but powerful method: for an additional cost at inference time, MBR provides reliable several-point improvements across metrics for a wide variety of tasks without any additional data or training. Despite this, MBR is not frequently applied in NLP works, and knowledge of the method itself is limited. We first provide an introduction to the method and the recent literature. We show that several recent methods that do not reference MBR can be written as special cases of MBR; this reformulation provides additional theoretical justification for the performance of these methods, explaining some results that were previously only empirical. We provide theoretical and empirical results about the effectiveness of various MBR variants and make concrete recommendations for the application of MBR in NLP models, including future directions in this area.


title: Cartan media: geometric continuum mechanics in homogeneous spaces

abstract: We present a geometric formulation of the mechanics of a field that takes values in a homogeneous space \mathbb{X} on which a Lie group G acts transitively. This generalises the mechanics of Cosserat media where \mathbb{X} is the frame bundle of Euclidean space and G is the special Euclidean group. Kinematics is described by a map from a space-time manifold to the homogeneous space. This map is characterised locally by generalised strains (representing spatial deformations) and generalised velocities (representing temporal motions). These are, respectively, the spatial and temporal components of the Maurer-Cartan one-form in the Lie algebra of G. Cartan's equation of structure provides the fundamental kinematic relationship between generalised strains and velocities. Dynamics is derived from a Lagrange-d'Alembert principle in which generalised stresses and momenta, taking values in the dual Lie algebra of G, are paired, respectively, with generalised strains and velocities. For conservative systems, the dynamics can be expressed completely through a generalised Euler-Poincare action principle. The geometric formulation leads to accurate and efficient structure-preserving integrators for numerical simulations. We provide an unified description of the mechanics of Cosserat solids, surfaces and rods using our formulation. We further show that, with suitable choices of \mathbb{X} and G, a variety of systems in soft condensed matter physics and beyond can be understood as instances of a class of materials we provisionally call Cartan media.


title: Gluon PDF of the proton using twisted mass fermions

abstract: In this paper, we present lattice QCD results for the $x$-dependence of the unpolarized gluon PDF for the proton. We use one ensemble of $N_f=2+1+1$ maximally twisted mass fermions with a clover improvement, and the Iwasaki improved gluon action. The quark masses are tuned to produce a pion with a mass of 260 MeV. The ensemble has a lattice spacing of $a=0.093$ fm and a spatial extent of 3 fm. We employ the pseudo-distribution approach, which relies on matrix elements of non-local operators that couple to momentum-boosted hadrons. In this work, we use five values of the momentum boost between 0 and 1.67 GeV. The gluon field strength tensors of the non-local operator are connected with straight Wilson lines of varying length $z$. The light-cone Ioffe time distribution (ITD) is extracted utilizing data with $z$ up to 0.56 fm and a quadratic parametrization in terms of the Ioffe time at fixed values of $z$. We explore systematic effects, such as the effect of the stout smearing for the gluon operator, excited states effects, and the dependence on the maximum value of $z$ entering the fits to obtain the gluon PDF. Also, for the first time, the mixing with the quark singlet PDFs is eliminated using matrix elements with non-local quark operators that were previously analyzed within the quasi-PDF framework on the same ensemble. Here, we expand the data set for the quark singlet and reanalyze within the pseudo-PDFs method eliminating the corresponding mixing in the gluon PDF.


title: The Impact of COVID-19 on Chronic Pain: Multidimensional Clustering Reveals Deep Insights into Spinal Cord Stimulation Patients

abstract: The emergence of COVID-19 offered a unique opportunity to study chronic pain patients as they responded to sudden changes in social environments, increased community stress, and reduced access to care. We report findings from n=70 Spinal Cord Stimulation (SCS) patients before and during initial pandemic stages resulting from advances in home monitoring and artificial intelligence that produced novel insights despite pandemic-related disruptions. From a multi-dimensional array of frequently monitored signals-including mobility, sleep, voice, and psychological assessments-we found that while the overall patient cohort appeared unaffected by the pandemic onset, patients had significantly different individual experiences. Three distinct patient responses (sub-cohorts) were revealed, those with: worsened pain, reduced activities, or improved quality of life. Remarkably, none of the specific measures by themselves were significantly affected; instead, it was their synergy that exposed the effects elicited by the pandemic onset. Partial correlations illustrating linked dimensions by sub-cohort during the pandemic and those associations were different for each sub-cohort before COVID-19, suggesting that daily at-home tele-monitoring of chronic conditions may reveal novel patient types. This work highlights the opportunities afforded by applying modern analytic techniques to more holistic and longitudinal patient outcomes, which might aid clinicians in making more informed treatment decisions in the future.


title: A Restoration Network as an Implicit Prior

abstract: Image denoisers have been shown to be powerful priors for solving inverse problems in imaging. In this work, we introduce a generalization of these methods that allows any image restoration network to be used as an implicit prior. The proposed method uses priors specified by deep neural networks pre-trained as general restoration operators. The method provides a principled approach for adapting state-of-the-art restoration models for other inverse problems. Our theoretical result analyzes its convergence to a stationary point of a global functional associated with the restoration operator. Numerical results show that the method using a super-resolution prior achieves state-of-the-art performance both quantitatively and qualitatively. Overall, this work offers a step forward for solving inverse problems by enabling the use of powerful pre-trained restoration models as priors.


title: The analysis of the impact of fear in the presence of additional food and prey refuge with nonlocal predator-prey models

abstract: In a predator-prey interaction, many factors are present that affect the growth of the species, either positively or negatively. Fear of predation is such a factor that causes psychological stress in a prey species, so their overall growth starts to decline. In this work, a predator-prey model is proposed where the prey species faces a reduction in their growth out of fear, and the predator is also provided with an alternative food source that helps the prey to hide in a safer place. The dynamics produce a wide range of interesting results, including the significance of the presence of a certain amount of fear or even prey refuge for population coexistence. The analysis is extended later to the nonlocal model to analyze how the non-equilibrium phenomena influence the dynamical behaviour. It is observed through numerical simulations that the scope of pattern formation reduces with the increase of fear level in the spatio-temporal model, whereas the incorporation of nonlocal interaction further increases the chance of species colonization.


title: DST-Det: Simple Dynamic Self-Training for Open-Vocabulary Object Detection

abstract: Open-vocabulary object detection (OVOD) aims to detect the objects beyond the set of classes observed during training. This work introduces a straightforward and efficient strategy that utilizes pre-trained vision-language models (VLM), like CLIP, to identify potential novel classes through zero-shot classification. Previous methods use a class-agnostic region proposal network to detect object proposals and consider the proposals that do not match the ground truth as background. Unlike these methods, our method will select a subset of proposals that will be considered as background during the training. Then, we treat them as novel classes during training. We refer to this approach as the self-training strategy, which enhances recall and accuracy for novel classes without requiring extra annotations, datasets, and re-training. Compared to previous pseudo methods, our approach does not require re-training and offline labeling processing, which is more efficient and effective in one-shot training. Empirical evaluations on three datasets, including LVIS, V3Det, and COCO, demonstrate significant improvements over the baseline performance without incurring additional parameters or computational costs during inference. In addition, we also apply our method to various baselines. In particular, compared with the previous method, F-VLM, our method achieves a 1.7% improvement on the LVIS dataset. Combined with the recent method CLIPSelf, our method also achieves 46.7 novel class AP on COCO without introducing extra data for pertaining. We also achieve over 6.5% improvement over the F-VLM baseline in the recent challenging V3Det dataset. We release our code and models at https://github.com/xushilin1/dst-det.


title: Twins in ordered hyper-matchings

abstract: An ordered $r$-matching of size $n$ is an $r$-uniform hypergraph on a linearly ordered set of vertices, consisting of $n$ pairwise disjoint edges. Two ordered $r$-matchings are isomorphic if there is an order-preserving isomorphism between them. A pair of twins in an ordered $r$-matching is formed by two vertex disjoint isomorphic sub-matchings. Let $t^{(r)}(n)$ denote the maximum size of twins one may find in every ordered $r$-matching of size $n$. By relating the problem to that of largest twins in permutations and applying some recent Erd\H{o}s-Szekeres-type results for ordered matchings, we show that $t^{(r)}(n)=\Omega\left(n^{\frac{3}{5\cdot(2^{r-1}-1)}}\right)$ for every fixed $r\geqslant 2$. On the other hand, $t^{(r)}(n)=O\left(n^{\frac{2}{r+1}}\right)$, by a simple probabilistic argument. As our main result, we prove that, for almost all ordered $r$-matchings of size $n$, the size of the largest twins achieves this bound.


title: Requirements' Characteristics: How do they Impact on Project Budget in a Systems Engineering Context?

abstract: Background: Requirements engineering is of a principal importance when starting a new project. However, the number of the requirements involved in a single project can reach up to thousands. Controlling and assuring the quality of natural language requirements (NLRs), in these quantities, is challenging. Aims: In a field study, we investigated with the Swedish Transportation Agency (STA) to what extent the characteristics of requirements had an influence on change requests and budget changes in the project. Method: We choose the following models to characterize system requirements formulated in natural language: Concern-based Model of Requirements (CMR), Requirements Abstractions Model (RAM) and Software-Hardware model (SHM). The classification of the NLRs was conducted by the three authors. The robust statistical measure Fleiss' Kappa was used to verify the reliability of the results. We used descriptive statistics, contingency tables, results from the Chi-Square test of association along with post hoc tests. Finally, a multivariate statistical technique, Correspondence analysis was used in order to provide a means of displaying a set of requirements in two-dimensional graphical form. Results: The results showed that software requirements are associated with less budget cost than hardware requirements. Moreover, software requirements tend to stay open for a longer period indicating that they are "harder" to handle. Finally, the more discussion or interaction on a change request can lower the actual estimated change request cost. Conclusions: The results lead us to a need to further investigate the reasons why the software requirements are treated differently from the hardware requirements, interview the project managers, understand better the way those requirements are formulated and propose effective ways of Software management.


title: A Learning Based Scheme for Fair Timeliness in Sparse Gossip Networks

abstract: We consider a gossip network, consisting of $n$ nodes, which tracks the information at a source. The source updates its information with a Poisson arrival process and also sends updates to the nodes in the network. The nodes themselves can exchange information among themselves to become as timely as possible. However, the network structure is sparse and irregular, i.e., not every node is connected to every other node in the network, rather, the order of connectivity is low, and varies across different nodes. This asymmetry of the network implies that the nodes in the network do not perform equally in terms of timelines. Due to the gossiping nature of the network, some nodes are able to track the source very timely, whereas, some nodes fall behind versions quite often. In this work, we investigate how the rate-constrained source should distribute its update rate across the network to maintain fairness regarding timeliness, i.e., the overall worst case performance of the network can be minimized. Due to the continuous search space for optimum rate allocation, we formulate this problem as a continuum-armed bandit problem and employ Gaussian process based Bayesian optimization to meet a trade-off between exploration and exploitation sequentially.


title: Posterior Uncertainty Estimation via a Monte Carlo Procedure Specialized for Data Assimilation

abstract: Through the Bayesian lens of data assimilation, uncertainty on model parameters is traditionally quantified through the posterior covariance matrix. However, in modern settings involving high-dimensional and computationally expensive forward models, posterior covariance knowledge must be relaxed to deterministic or stochastic approximations. In the carbon flux inversion literature, Chevallier et al. proposed a stochastic method capable of approximating posterior variances of linear functionals of the model parameters that is particularly well-suited for large-scale Earth-system data assimilation tasks. This note formalizes this algorithm and clarifies its properties. We provide a formal statement of the algorithm, demonstrate why it converges to the desired posterior variance quantity of interest, and provide additional uncertainty quantification allowing incorporation of the Monte Carlo sampling uncertainty into the method's Bayesian credible intervals. The methodology is demonstrated using toy simulations and a realistic carbon flux inversion observing system simulation experiment.


title: Local markers for crystalline topology

abstract: Over the last few years, crystalline topology has been used in photonic crystals to realize edge- and corner-localized states that enhance light-matter interactions for potential device applications. However, the band-theoretic approaches currently used to classify bulk topological crystalline phases cannot predict the existence, localization, or spectral isolation of any resulting boundary-localized modes. While interfaces between materials in different crystalline phases must have topological states at some energy, these states need not appear within the band gap, and thus may not be useful for applications. Here, we derive a class of local markers for identifying material topology due to crystalline symmetries, as well as a corresponding measure of topological protection. As our real-space-based approach is inherently local, it immediately reveals the existence and robustness of topological boundary-localized states, yielding a predictive framework for designing topological crystalline heterostructures. Beyond enabling the optimization of device geometries, we anticipate that our framework will also provide a route forward to deriving local markers for other classes of topology that are reliant upon spatial symmetries.

categories: physics.optics cond-mat.mtrl-sci math-ph math.MP


title: Estimators of Bolometric Luminosity and Black Hole Mass with Mid-infrared Continuum Luminosities for Dust-obscured Quasars: Prevalence of Dust-obscured SDSS Quasars

abstract: We present bolometric luminosity ($L_{\rm bol}$) and black hole (BH) mass ($M_{\rm BH}$) estimators based on mid-infrared (MIR) continuum luminosity (hereafter, $L_{\rm MIR}$) that are measured from infrared (IR) photometric data. The $L_{\rm MIR}$-based estimators are relatively immune from dust extinction effects, hence they can be used for dust-obscured quasars. To derive the $L_{\rm bol}$ and $M_{\rm BH}$ estimators, we use unobscured quasars selected from the Sloan Digital Sky Survey (SDSS) quasar catalog, which have wide ranges of $L_{\rm bol}$ ($10^{44.62}$--$10^{46.16}$\,$\rm erg\,s^{-1}$) and $M_{\rm BH}$ ($10^{7.14}$--$10^{9.69}$\,$M_{\odot}$). We find empirical relations between (i) continuum luminosity at 5100\,$\rm{\AA{}}$ (hereafter, L5100) and $L_{\rm MIR}$; (ii) $L_{\rm bol}$ and $L_{\rm MIR}$. Using these relations, we derive the $L_{\rm MIR}$-based $L_{\rm bol}$ and $M_{\rm BH}$ estimators. We find that our estimators allow the determination of $L_{\rm bol}$ and $M_{\rm BH}$ at an accuracy of $\sim$0.2\,dex against the fiducial estimates based on the optical properties of the unobscured quasars. We apply the $L_{\rm MIR}$-based estimators to SDSS quasars at $z \lesssim 0.5$ including obscured ones. The ratios of $L_{\rm bol}$ from the $L_{\rm MIR}$-based estimators to those from the optical luminosity-based estimators become larger with the amount of the dust extinction, and a non-negligible fraction ($\sim$15\,\%) of the SDSS quasars exhibits ratios greater than 1.5. This result suggests that dust extinction can significantly affect physical parameter derivations even for SDSS quasars, and that dust extinction needs to be carefully taken into account when deriving quasar properties.


title: Sequential Data Generation with Groupwise Diffusion Process

abstract: We present the Groupwise Diffusion Model (GDM), which divides data into multiple groups and diffuses one group at one time interval in the forward diffusion process. GDM generates data sequentially from one group at one time interval, leading to several interesting properties. First, as an extension of diffusion models, GDM generalizes certain forms of autoregressive models and cascaded diffusion models. As a unified framework, GDM allows us to investigate design choices that have been overlooked in previous works, such as data-grouping strategy and order of generation. Furthermore, since one group of the initial noise affects only a certain group of the generated data, latent space now possesses group-wise interpretable meaning. We can further extend GDM to the frequency domain where the forward process sequentially diffuses each group of frequency components. Dividing the frequency bands of the data as groups allows the latent variables to become a hierarchical representation where individual groups encode data at different levels of abstraction. We demonstrate several applications of such representation including disentanglement of semantic attributes, image editing, and generating variations.


title: Pixel-Aligned Recurrent Queries for Multi-View 3D Object Detection

abstract: We present PARQ - a multi-view 3D object detector with transformer and pixel-aligned recurrent queries. Unlike previous works that use learnable features or only encode 3D point positions as queries in the decoder, PARQ leverages appearance-enhanced queries initialized from reference points in 3D space and updates their 3D location with recurrent cross-attention operations. Incorporating pixel-aligned features and cross attention enables the model to encode the necessary 3D-to-2D correspondences and capture global contextual information of the input images. PARQ outperforms prior best methods on the ScanNet and ARKitScenes datasets, learns and detects faster, is more robust to distribution shifts in reference points, can leverage additional input views without retraining, and can adapt inference compute by changing the number of recurrent iterations.


title: Evaluating the Decency and Consistency of Data Validation Tests Generated by LLMs

abstract: We investigated whether large language models (LLMs) can develop data validation tests. We considered 96 conditions each for both GPT-3.5 and GPT-4, examining different prompt scenarios, learning modes, temperature settings, and roles. The prompt scenarios were: 1) Asking for expectations, 2) Asking for expectations with a given context, 3) Asking for expectations after requesting a data simulation, and 4) Asking for expectations with a provided data sample. The learning modes were: 1) zero-shot, 2) one-shot, and 3) few-shot learning. We also tested four temperature settings: 0, 0.4, 0.6, and 1. And the two distinct roles were: 1) helpful assistant, 2) expert data scientist. To gauge consistency, every setup was tested five times. The LLM-generated responses were benchmarked against a gold standard data validation suite, created by an experienced data scientist knowledgeable about the data in question. We find there are considerable returns to the use of few-shot learning, and that the more explicit the data setting can be the better, to a point. The best LLM configurations complement, rather than substitute, the gold standard results. This study underscores the value LLMs can bring to the data cleaning and preparation stages of the data science workflow, but highlights that they need considerable evaluation by experienced analysts.


title: CLIPSelf: Vision Transformer Distills Itself for Open-Vocabulary Dense Prediction

abstract: Open-vocabulary dense prediction tasks including object detection and image segmentation have been advanced by the success of Contrastive Language-Image Pre-training (CLIP). CLIP models, particularly those incorporating vision transformers (ViTs), have exhibited remarkable generalization ability in zero-shot image classification. However, when transferring the vision-language alignment of CLIP from global image representation to local region representation for the open-vocabulary dense prediction tasks, CLIP ViTs suffer from the domain shift from full images to local image regions. In this paper, we embark on an in-depth analysis of the region-language alignment in CLIP models, which is essential for downstream open-vocabulary dense prediction tasks. Subsequently, we propose an approach named CLIPSelf, which adapts the image-level recognition ability of CLIP ViT to local image regions without needing any region-text pairs. CLIPSelf empowers ViTs to distill itself by aligning a region representation extracted from its dense feature map with the image-level representation of the corresponding image crop. With the enhanced CLIP ViTs, we achieve new state-of-the-art performance on open-vocabulary object detection, semantic segmentation, and panoptic segmentation across various benchmarks. Models and code are released at https://github.com/wusize/CLIPSelf.


title: H-InDex: Visual Reinforcement Learning with Hand-Informed Representations for Dexterous Manipulation

abstract: Human hands possess remarkable dexterity and have long served as a source of inspiration for robotic manipulation. In this work, we propose a human $\textbf{H}$and$\textbf{-In}$formed visual representation learning framework to solve difficult $\textbf{Dex}$terous manipulation tasks ($\textbf{H-InDex}$) with reinforcement learning. Our framework consists of three stages: (i) pre-training representations with 3D human hand pose estimation, (ii) offline adapting representations with self-supervised keypoint detection, and (iii) reinforcement learning with exponential moving average BatchNorm. The last two stages only modify $0.36\%$ parameters of the pre-trained representation in total, ensuring the knowledge from pre-training is maintained to the full extent. We empirically study 12 challenging dexterous manipulation tasks and find that H-InDex largely surpasses strong baseline methods and the recent visual foundation models for motor control. Code is available at https://yanjieze.com/H-InDex .


title: Representation Engineering: A Top-Down Approach to AI Transparency

abstract: In this paper, we identify and characterize the emerging area of representation engineering (RepE), an approach to enhancing the transparency of AI systems that draws on insights from cognitive neuroscience. RepE places population-level representations, rather than neurons or circuits, at the center of analysis, equipping us with novel methods for monitoring and manipulating high-level cognitive phenomena in deep neural networks (DNNs). We provide baselines and an initial analysis of RepE techniques, showing that they offer simple yet effective solutions for improving our understanding and control of large language models. We showcase how these methods can provide traction on a wide range of safety-relevant problems, including honesty, harmlessness, power-seeking, and more, demonstrating the promise of top-down transparency research. We hope that this work catalyzes further exploration of RepE and fosters advancements in the transparency and safety of AI systems.


title: HumanNorm: Learning Normal Diffusion Model for High-quality and Realistic 3D Human Generation

abstract: Recent text-to-3D methods employing diffusion models have made significant advancements in 3D human generation. However, these approaches face challenges due to the limitations of text-to-image diffusion models, which lack an understanding of 3D structures. Consequently, these methods struggle to achieve high-quality human generation, resulting in smooth geometry and cartoon-like appearances. In this paper, we propose HumanNorm, a novel approach for high-quality and realistic 3D human generation. The main idea is to enhance the model's 2D perception of 3D geometry by learning a normal-adapted diffusion model and a normal-aligned diffusion model. The normal-adapted diffusion model can generate high-fidelity normal maps corresponding to user prompts with view-dependent and body-aware text. The normal-aligned diffusion model learns to generate color images aligned with the normal maps, thereby transforming physical geometry details into realistic appearance. Leveraging the proposed normal diffusion model, we devise a progressive geometry generation strategy and a multi-step Score Distillation Sampling (SDS) loss to enhance the performance of 3D human generation. Comprehensive experiments substantiate HumanNorm's ability to generate 3D humans with intricate geometry and realistic appearances. HumanNorm outperforms existing text-to-3D methods in both geometry and texture quality. The project page of HumanNorm is https://humannorm.github.io/.


title: CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation

abstract: Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption is hindered by the high computational cost, which limits their real-time application. To address this challenge, we introduce a novel method dubbed CoDi, that adapts a pre-trained latent diffusion model to accept additional image conditioning inputs while significantly reducing the sampling steps required to achieve high-quality results. Our method can leverage architectures such as ControlNet to incorporate conditioning inputs without compromising the model's prior knowledge gained during large scale pre-training. Additionally, a conditional consistency loss enforces consistent predictions across diffusion steps, effectively compelling the model to generate high-quality images with conditions in a few steps. Our conditional-task learning and distillation approach outperforms previous distillation methods, achieving a new state-of-the-art in producing high-quality images with very few steps (e.g., 1-4) across multiple tasks, including super-resolution, text-guided image editing, and depth-to-image generation.


title: Generalized Animal Imitator: Agile Locomotion with Versatile Motion Prior

abstract: The agility of animals, particularly in complex activities such as running, turning, jumping, and backflipping, stands as an exemplar for robotic system design. Transferring this suite of behaviors to legged robotic systems introduces essential inquiries: How can a robot be trained to learn multiple locomotion behaviors simultaneously? How can the robot execute these tasks with a smooth transition? How to integrate these skills for wide-range applications? This paper introduces the Versatile Instructable Motion prior (VIM) - a Reinforcement Learning framework designed to incorporate a range of agile locomotion tasks suitable for advanced robotic applications. Our framework enables legged robots to learn diverse agile low-level skills by imitating animal motions and manually designed motions. Our Functionality reward guides the robot's ability to adopt varied skills, and our Stylization reward ensures that robot motions align with reference motions. Our evaluations of the VIM framework span both simulation environments and real-world deployment. To the best of our knowledge, this is the first work that allows a robot to concurrently learn diverse agile locomotion skills using a single learning-based controller in the real world. Further details and supportive media can be found at our project site: https://rchalyang.github.io/VIM


title: Direct Comparison of Isobaric and Isochoric Vitrification of Two Aqueous Solutions with Photon Counting X-Ray Computed Tomography

abstract: Vitrification is a promising approach for ice-free cryopreservation of biological material, but progress is hindered by the limited set of experimental tools for studying processes in the interior of the vitrified matter. Isochoric cryopreservation chambers are often metallic, and their opacity prevents direct visual observation. In this study, we introduce photon counting X-ray computed tomography (CT) to compare the effects of rigid isochoric and unconfined isobaric conditions on vitrification and ice formation during cooling of two aqueous solutions: 50 wt% DMSO and a coral vitrification solution, CVS1. Previous studies have only compared vitrification in isochoric systems with isobaric systems that have an exposed air-liquid interface. We use a movable piston to replicate the surface and thermal boundary conditions of the isochoric system yet maintain isobaric conditions. When controlling for the boundary conditions we find that similar ice and vapor volume fractions form during cooling in isochoric and isobaric conditions. Interestingly, we observe distinct ice and vapor cavity morphology in the isochoric systems, possibly due to vapor outgassing or cavitation as rapid cooling causes the pressure to drop in the confined systems. These observations highlight the array of thermo-fluidic processes that occur during vitrification in confined aqueous systems and motivate the further application of imaging techniques such as photon counting X-ray CT in fundamental studies of vitrification.


title: LEAP: Liberate Sparse-view 3D Modeling from Camera Poses

abstract: Are camera poses necessary for multi-view 3D modeling? Existing approaches predominantly assume access to accurate camera poses. While this assumption might hold for dense views, accurately estimating camera poses for sparse views is often elusive. Our analysis reveals that noisy estimated poses lead to degraded performance for existing sparse-view 3D modeling methods. To address this issue, we present LEAP, a novel pose-free approach, therefore challenging the prevailing notion that camera poses are indispensable. LEAP discards pose-based operations and learns geometric knowledge from data. LEAP is equipped with a neural volume, which is shared across scenes and is parameterized to encode geometry and texture priors. For each incoming scene, we update the neural volume by aggregating 2D image features in a feature-similarity-driven manner. The updated neural volume is decoded into the radiance field, enabling novel view synthesis from any viewpoint. On both object-centric and scene-level datasets, we show that LEAP significantly outperforms prior methods when they employ predicted poses from state-of-the-art pose estimators. Notably, LEAP performs on par with prior approaches that use ground-truth poses while running $400\times$ faster than PixelNeRF. We show LEAP generalizes to novel object categories and scenes, and learns knowledge closely resembles epipolar geometry. Project page: https://hwjiang1510.github.io/LEAP/


title: Evolution of Stellar Bars in Spinning Dark Matter Halos and Stellar Bulges

abstract: We use high-resolution numerical simulations to follow the barred disk evolution in a suite of models with progressively more massive stellar bulges, with bulge-to-total (disk$+$bulge) mass ratios of $B/T\sim 0-0.25$, embedded in dark matter (DM) halos with the spin $\lambda \sim 0 - 0.09$. We focus on models with a sequence of initial rotational support for bulges, and analyze their spinup and spindown. We find that (1) the presence of a bulge affects the evolution of stellar bars, i.e., the timescale of bar instability, bar pattern speed and its decay, and the vertical buckling instability. The bar strength is nearly independent of $B/T$ in halos with spin $\lambda = 0$, and is suppressed by a factor $\sim 2$ for halos with $\lambda = 0.09$; (2) The main effect of the bulge is the destruction of the harmonic core which affects the buckling; (3) The bulge plays a minor role in the exchange of angular momentum between the barred disk and the DM halo, during its spinup and spindown; (4) Most interestingly, the buckling process triggers different response above/below the disk midplane, which anti-correlates with the bulge mass; (5) In spinning halos, the buckling process has a prolonged amplitude tail, extending by few Gyr, as verified by measuring distortions in the Laplace plane; (6) Furthermore, as verified by orbital spectral analysis, the bulge gains its spin from the bar mainly via the inner Lindblad resonance, while losing it via a number of resonances lying between the outer and inner Lindblad resonance.


title: DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Model

abstract: Multimodal large language models (MLLMs) have emerged as a prominent area of interest within the research community, given their proficiency in handling and reasoning with non-textual data, including images and videos. This study seeks to extend the application of MLLMs to the realm of autonomous driving by introducing DriveGPT4, a novel interpretable end-to-end autonomous driving system based on LLMs. Capable of processing multi-frame video inputs and textual queries, DriveGPT4 facilitates the interpretation of vehicle actions, offers pertinent reasoning, and effectively addresses a diverse range of questions posed by users. Furthermore, DriveGPT4 predicts low-level vehicle control signals in an end-to-end fashion. These advanced capabilities are achieved through the utilization of a bespoke visual instruction tuning dataset, specifically tailored for autonomous driving applications, in conjunction with a mix-finetuning training strategy. DriveGPT4 represents the pioneering effort to leverage LLMs for the development of an interpretable end-to-end autonomous driving solution. Evaluations conducted on the BDD-X dataset showcase the superior qualitative and quantitative performance of DriveGPT4. Additionally, the fine-tuning of domain-specific data enables DriveGPT4 to yield close or even improved results in terms of autonomous driving grounding when contrasted with GPT4-V. The code and dataset will be publicly available.


title: A multi-institutional pediatric dataset of clinical radiology MRIs by the Children's Brain Tumor Network

abstract: Pediatric brain and spinal cancers remain the leading cause of cancer-related death in children. Advancements in clinical decision-support in pediatric neuro-oncology utilizing the wealth of radiology imaging data collected through standard care, however, has significantly lagged other domains. Such data is ripe for use with predictive analytics such as artificial intelligence (AI) methods, which require large datasets. To address this unmet need, we provide a multi-institutional, large-scale pediatric dataset of 23,101 multi-parametric MRI exams acquired through routine care for 1,526 brain tumor patients, as part of the Children's Brain Tumor Network. This includes longitudinal MRIs across various cancer diagnoses, with associated patient-level clinical information, digital pathology slides, as well as tissue genotype and omics data. To facilitate downstream analysis, treatment-na\"ive images for 370 subjects were processed and released through the NCI Childhood Cancer Data Initiative via the Cancer Data Service. Through ongoing efforts to continuously build these imaging repositories, our aim is to accelerate discovery and translational AI models with real-world data, to ultimately empower precision medicine for children.


title: Broadening of particle distributions in electron- and (anti)neutrino-nucleus scattering from QED interactions

abstract: Proper interpretation of past, current, and future data on lepton-nucleus reactions requires a clear separation between quantum electrodynamics (QED) and strong interaction effects inside the nucleus. First studies of QED in-medium lepton dynamics have set a theoretical framework to derive electron-nucleus and (anti)neutrino-nucleus cross-section corrections. We employ this approach to quantitatively compute the effects of Glauber photon-mediated multiple re-scattering within the nuclear medium. We find that the relativistic charged lepton acquires momentum of order $10~\mathrm{MeV}$ transverse to its direction of propagation inside the nucleus. This broadening sizably deflects expected electron tracks and suppresses scattering cross sections. Precise extraction of the nucleon and nuclear structure by electron and muon probes should, thus, take the QED nuclear medium angular redistribution of particles into account. Our results further show that the associated effects in (anti)neutrino-nucleus scattering with measured final-lepton energy are significant only at the kinematical endpoints.


title: GPT-Driver: Learning to Drive with GPT

abstract: We present a simple yet effective approach that can transform the OpenAI GPT-3.5 model into a reliable motion planner for autonomous vehicles. Motion planning is a core challenge in autonomous driving, aiming to plan a driving trajectory that is safe and comfortable. Existing motion planners predominantly leverage heuristic methods to forecast driving trajectories, yet these approaches demonstrate insufficient generalization capabilities in the face of novel and unseen driving scenarios. In this paper, we propose a novel approach to motion planning that capitalizes on the strong reasoning capabilities and generalization potential inherent to Large Language Models (LLMs). The fundamental insight of our approach is the reformulation of motion planning as a language modeling problem, a perspective not previously explored. Specifically, we represent the planner inputs and outputs as language tokens, and leverage the LLM to generate driving trajectories through a language description of coordinate positions. Furthermore, we propose a novel prompting-reasoning-finetuning strategy to stimulate the numerical reasoning potential of the LLM. With this strategy, the LLM can describe highly precise trajectory coordinates and also its internal decision-making process in natural language. We evaluate our approach on the large-scale nuScenes dataset, and extensive experiments substantiate the effectiveness, generalization ability, and interpretability of our GPT-based motion planner. Code is now available at https://github.com/PointsCoder/GPT-Driver.


title: Gramian Angular Fields for leveraging pretrained computer vision models with anomalous diffusion trajectories

abstract: Anomalous diffusion is present at all scales, from atomic to large scales. Some exemplary systems are; ultra-cold atoms, telomeres in the nucleus of cells, moisture transport in cement-based materials, the free movement of arthropods, and the migration patterns of birds. The characterization of the diffusion gives critical information about the dynamics of these systems and provides an interdisciplinary framework with which to study diffusive transport. Thus, the problem of identifying underlying diffusive regimes and inferring the anomalous diffusion exponent {$\alpha$} with high confidence is critical to physics, chemistry, biology, and ecology. Classification and analysis of raw trajectories combining machine learning techniques with statistics extracted from them have widely been studied in the Anomalous Diffusion Challenge ge (Munoz-Gil et al., 2021). Here we present a new data-driven method for working with diffusive trajectories. This method utilizes Gramian Angular Fields (GAF) to encode one-dimensional trajectories as images (Gramian Matrices), while preserving their spatiotemporal structure for input to computer-vision models. This allows us to leverage two well-established pre-trained computer-vision models, ResNet and MobileNet, to characterize the underlying diffusive regime, and infer the anomalous diffusion exponent {$\alpha$}. Short raw trajectories, of lengths between 10 and 50, are commonly encountered in single-particle tracking experiments and are the most difficult to characterize. We show that by using GAF images, we can outperform the current state-of-the-art while increasing accessibility to machine learning methods in an applied setting.

categories: eess.IV cs.AI cs.LG physics.bio-ph q-bio.QM


title: The Feasibility of Electric Air Taxis: Balancing Time Savings and CO$_2$ Emissions -- A joint case study of respective plans in Paris

abstract: This paper evaluates the sustainability of Advanced Air Mobility (AAM) in urban and regional mobility, using Paris as a case study. Paris is committed to eco-friendly transportation and has introduced AAM, including electric Vertical Take-Off and Landing (eVTOL) air taxis for the 2024 Olympic Games. We assess eVTOL energy consumption and CO$_2$ emissions on urban and regional routes, comparing them with cars, public transport, and helicopters. Urban eVTOLs save around 23 minutes over cars and 22 minutes over public transport on 50 km routes. For regional routes (300 km), eVTOLs save 76 minutes over cars and 69 minutes over trains. However, eVTOLs' eco-friendliness depends on context. In urban areas, they consume more energy than electric cars, but beat traditional helicopters by 47%. For regional travel, eVTOLs outperform helicopters and some cars but lag behind electric vehicles and trains. To maximize AAM's sustainability in Paris, stakeholders must consider real-world operations and integrate eVTOLs into the broader transportation system. This approach can lead to greener urban and regional transportation.


title: Cordyceps@LT-EDI: Depression Detection with Reddit and Self-training

abstract: Depression is debilitating, and not uncommon. Indeed, studies of excessive social media users show correlations with depression, ADHD, and other mental health concerns. Given that there is a large number of people with excessive social media usage, then there is a significant population of potentially undiagnosed users and posts that they create. In this paper, we propose a depression severity detection system using a semi-supervised learning technique to predict if a post is from a user who is experiencing severe, moderate, or low (non-diagnostic) levels of depression. Namely, we use a trained model to classify a large number of unlabelled social media posts from Reddit, then use these generated labels to train a more powerful classifier. We demonstrate our framework on Detecting Signs of Depression from Social Media Text - LT-EDI@RANLP 2023 shared task, where our framework ranks 3rd overall.


title: Design Principles of Robust Multi-Armed Bandit Framework in Video Recommendations

abstract: Current multi-armed bandit approaches in recommender systems (RS) have focused more on devising effective exploration techniques, while not adequately addressing common exploitation challenges related to distributional changes and item cannibalization. Little work exists to guide the design of robust bandit frameworks that can address these frequent challenges in RS. In this paper, we propose a new design principles to (i) make bandit models robust to time-variant metadata signals, (ii) less prone to item cannibalization, and (iii) prevent their weights fluctuating due to data sparsity. Through a series of experiments, we systematically examine the influence of several important bandit design choices. We demonstrate the advantage of our proposed design principles at making bandit models robust to dynamic behavioral changes through in-depth analyses. Noticeably, we show improved relative gain compared to a baseline bandit model not incorporating our design choices of up to $11.88\%$ and $44.85\%$, respectively in ROC-AUC and PR-AUC. Case studies about fairness in recommending specific popular and unpopular titles are presented, to demonstrate the robustness of our proposed design at addressing popularity biases.


title: Ruffle&Riley: Towards the Automated Induction of Conversational Tutoring Systems

abstract: Conversational tutoring systems (CTSs) offer learning experiences driven by natural language interaction. They are known to promote high levels of cognitive engagement and benefit learning outcomes, particularly in reasoning tasks. Nonetheless, the time and cost required to author CTS content is a major obstacle to widespread adoption. In this paper, we introduce a novel type of CTS that leverages the recent advances in large language models (LLMs) in two ways: First, the system induces a tutoring script automatically from a lesson text. Second, the system automates the script orchestration via two LLM-based agents (Ruffle&Riley) with the roles of a student and a professor in a learning-by-teaching format. The system allows a free-form conversation that follows the ITS-typical inner and outer loop structure. In an initial between-subject online user study (N = 100) comparing Ruffle&Riley to simpler QA chatbots and reading activity, we found no significant differences in post-test scores. Nonetheless, in the learning experience survey, Ruffle&Riley users expressed higher ratings of understanding and remembering and further perceived the offered support as more helpful and the conversation as coherent. Our study provides insights for a new generation of scalable CTS technologies.


title: Using Focus Group Interviews to Examine Biased Experiences in Human-Robot-Interaction

abstract: When deploying interactive agents like (social) robots in public spaces they need to be able to interact with a diverse audience, with members each having individual diversity characteristics and prior experiences with interactive systems. To cater for these various predispositions, it is important to examine what experiences citizens have made with interactive systems and how these experiences might create a bias towards such systems. To analyze these bias-inducing experiences, focus group interviews have been conducted to learn of citizens individual discrimination experiences, their attitudes towards and arguments for and against the deployment of social robots in public spaces. This extended abstract focuses especially on the method and measurement of diversity.


title: Service Pet Robot Design: Queer, Feminine and Sexuality Aspects

abstract: The integration of robots and AI in society raises concerns about discrimination and biases mostly affecting underrepresented groups, including queer and feminine figures. Socially assistive robots (SAR) are being used in a variety of service and companion roles, following social norms during their interaction with humans and seem to be beneficial in many roles, such as the pet therapy robots. To promote inclusion and representation, robot design should incorporate queer and feminine characteristics. As a response to these concerns, a pet robot called BB was designed using a multidisciplinary and inclusive approach. BB was presented in a queer architecture and aesthetics environment, emphasizing aspects of techno-touch, vulnerability, and sexuality in human-robot interactions. The audience's perception of both the robot and the female researcher was evaluated through questionnaires and focus groups. This study aims to explore how technology and design can better accommodate diverse perspectives and needs in the field of SAR.


title: An Empirical Study of AI Generated Text Detection Tools

abstract: Since ChatGPT has emerged as a major AIGC model, providing high-quality responses across a wide range of applications (including software development and maintenance), it has attracted much interest from many individuals. ChatGPT has great promise, but there are serious problems that might arise from its misuse, especially in the realms of education and public safety. Several AIGC detectors are available, and they have all been tested on genuine text. However, more study is needed to see how effective they are for multi-domain ChatGPT material. This study aims to fill this need by creating a multi-domain dataset for testing the state-of-the-art APIs and tools for detecting artificially generated information used by universities and other research institutions. A large dataset consisting of articles, abstracts, stories, news, and product reviews was created for this study. The second step is to use the newly created dataset to put six tools through their paces. Six different artificial intelligence (AI) text identification systems, including "GPTkit," "GPTZero," "Originality," "Sapling," "Writer," and "Zylalab," have accuracy rates between 55.29 and 97.0%. Although all the tools fared well in the evaluations, originality was particularly effective across the board.


title: Identifying and Mitigating Privacy Risks Stemming from Language Models: A Survey

abstract: Large Language Models (LLMs) have shown greatly enhanced performance in recent years, attributed to increased size and extensive training data. This advancement has led to widespread interest and adoption across industries and the public. However, training data memorization in Machine Learning models scales with model size, particularly concerning for LLMs. Memorized text sequences have the potential to be directly leaked from LLMs, posing a serious threat to data privacy. Various techniques have been developed to attack LLMs and extract their training data. As these models continue to grow, this issue becomes increasingly critical. To help researchers and policymakers understand the state of knowledge around privacy attacks and mitigations, including where more work is needed, we present the first SoK on data privacy for LLMs. We (i) identify a taxonomy of salient dimensions where attacks differ on LLMs, (ii) systematize existing attacks, using our taxonomy of dimensions to highlight key trends, (iii) survey existing mitigation strategies, highlighting their strengths and limitations, and (iv) identify key gaps, demonstrating open problems and areas for concern.


title: Borges and AI

abstract: Many believe that Large Language Models (LLMs) open the era of Artificial Intelligence (AI). Some see opportunities while others see dangers. Yet both proponents and opponents grasp AI through the imagery popularised by science fiction. Will the machine become sentient and rebel against its creators? Will we experience a paperclip apocalypse? Before answering such questions, we should first ask whether this mental imagery provides a good description of the phenomenon at hand. Understanding weather patterns through the moods of the gods only goes so far. The present paper instead advocates understanding LLMs and their connection to AI through the imagery of Jorge Luis Borges, a master of 20th century literature, forerunner of magical realism, and precursor to postmodern literature. This exercise leads to a new perspective that illuminates the relation between language modelling and artificial intelligence.


title: REMEDI: REinforcement learning-driven adaptive MEtabolism modeling of primary sclerosing cholangitis DIsease progression

abstract: Primary sclerosing cholangitis (PSC) is a rare disease wherein altered bile acid metabolism contributes to sustained liver injury. This paper introduces REMEDI, a framework that captures bile acid dynamics and the body's adaptive response during PSC progression that can assist in exploring treatments. REMEDI merges a differential equation (DE)-based mechanistic model that describes bile acid metabolism with reinforcement learning (RL) to emulate the body's adaptations to PSC continuously. An objective of adaptation is to maintain homeostasis by regulating enzymes involved in bile acid metabolism. These enzymes correspond to the parameters of the DEs. REMEDI leverages RL to approximate adaptations in PSC, treating homeostasis as a reward signal and the adjustment of the DE parameters as the corresponding actions. On real-world data, REMEDI generated bile acid dynamics and parameter adjustments consistent with published findings. Also, our results support discussions in the literature that early administration of drugs that suppress bile acid synthesis may be effective in PSC treatment.


title: Attention Sorting Combats Recency Bias In Long Context Language Models

abstract: Current language models often fail to incorporate long contexts efficiently during generation. We show that a major contributor to this issue are attention priors that are likely learned during pre-training: relevant information located earlier in context is attended to less on average. Yet even when models fail to use the information from a relevant document in their response, they still pay preferential attention to that document compared to an irrelevant document at the same position. We leverage this fact to introduce ``attention sorting'': perform one step of decoding, sort documents by the attention they receive (highest attention going last), repeat the process, generate the answer with the newly sorted context. We find that attention sorting improves performance of long context models. Our findings highlight some challenges in using off-the-shelf language models for retrieval augmented generation.


title: Unraveling Post-COVID-19 Immune Dysregulation Using Machine Learning-based Immunophenotyping

abstract: The COVID-19 pandemic has left a significant mark on global healthcare, with many individuals experiencing lingering symptoms long after recovering from the acute phase of the disease, a condition often referred to as "long COVID." This study delves into the intricate realm of immune dysregulation that ensues in 509 post-COVID-19 patients across multiple Iraqi regions during the years 2022 and 2023. Utilizing advanced machine learning techniques for immunophenotyping, this research aims to shed light on the diverse immune dysregulation patterns present in long COVID patients. By analyzing a comprehensive dataset encompassing clinical, immunological, and demographic information, the study provides valuable insights into the complex interplay of immune responses following COVID-19 infection. The findings reveal that long COVID is associated with a spectrum of immune dysregulation phenomena, including persistent inflammation, altered cytokine profiles, and abnormal immune cell subsets. These insights highlight the need for personalized interventions and tailored treatment strategies for individuals suffering from long COVID-19. This research represents a significant step forward in our understanding of the post-COVID-19 immune landscape and opens new avenues for targeted therapies and clinical management of long COVID patients. As the world grapples with the long-term implications of the pandemic, these findings offer hope for improving the quality of life for those affected by this enigmatic condition.


title: Chatmap : Large Language Model Interaction with Cartographic Data

abstract: The swift advancement and widespread availability of foundational Large Language Models (LLMs), complemented by robust fine-tuning methodologies, have catalyzed their adaptation for innovative and industrious applications. Enabling LLMs to recognize and interpret geospatial data, while offering a linguistic access to vast cartographic datasets, is of significant importance. OpenStreetMap (OSM) is the most ambitious open-source global initiative offering detailed urban and rural geographic data, curated by a community of over 10 million contributors, which constitutes a great potential for LLM applications. In this study, we demonstrate the proof of concept and details of the process of fine-tuning a relatively small scale (1B parameters) LLM with a relatively small artificial dataset curated by a more capable teacher model, in order to provide a linguistic interface to the OSM data of an arbitrary urban region. Through this interface, users can inquire about a location's attributes, covering a wide spectrum of concepts, such as its touristic appeal or the potential profitability of various businesses in that vicinity. The study aims to provide an initial guideline for such generative artificial intelligence (AI) adaptations and demonstrate early signs of useful emerging abilities in this context even in minimal computational settings. The embeddings of artificially curated prompts including OSM data are also investigated in detail, which might be instrumental for potential geospatially aware urban Retrieval Augmented Generation (RAG) applications.


title: Sarcasm in Sight and Sound: Benchmarking and Expansion to Improve Multimodal Sarcasm Detection

abstract: The introduction of the MUStARD dataset, and its emotion recognition extension MUStARD++, have identified sarcasm to be a multi-modal phenomenon -- expressed not only in natural language text, but also through manners of speech (like tonality and intonation) and visual cues (facial expression). With this work, we aim to perform a rigorous benchmarking of the MUStARD++ dataset by considering state-of-the-art language, speech, and visual encoders, for fully utilizing the totality of the multi-modal richness that it has to offer, achieving a 2\% improvement in macro-F1 over the existing benchmark. Additionally, to cure the imbalance in the `sarcasm type' category in MUStARD++, we propose an extension, which we call \emph{MUStARD++ Balanced}, benchmarking the same with instances from the extension split across both train and test sets, achieving a further 2.4\% macro-F1 boost. The new clips were taken from a novel source -- the TV show, House MD, which adds to the diversity of the dataset, and were manually annotated by multiple annotators with substantial inter-annotator agreement in terms of Cohen's kappa and Krippendorf's alpha. Our code, extended data, and SOTA benchmark models are made public.


title: NISQ Computers: A Path to Quantum Supremacy

abstract: The quest for quantum advantage, wherein quantum computers surpass the computational capabilities of classical computers executing state-of-the-art algorithms on well-defined tasks, represents a pivotal race in the domain of quantum computing. NISQ (Noisy Intermediate-Scale Quantum) computing has witnessed remarkable advancements, culminating in significant milestones on the journey towards the realization of universal fault-tolerant quantum computers. This transformative turning point, known as quantum supremacy, has been achieved amid a series of breakthroughs, signifying the dawn of the quantum era. Quantum hardware has undergone substantial integration and architectural evolution, contrasting with its nascent stages. In this review, we critically examine the quantum supremacy experiments conducted thus far, shedding light on their implications and contributions to the evolving landscape of quantum computing. Additionally, we endeavor to illuminate a range of cutting-edge proof-of-principle investigations in the realm of applied quantum computing, providing an insightful overview of the current state of applied quantum research and its prospective influence across diverse scientific, industrial, and technological frontiers.


title: Split and Merge: Aligning Position Biases in Large Language Model based Evaluators

abstract: Large language models (LLMs) have shown promise as automated evaluators for assessing the quality of answers generated by AI systems. However, these LLM-based evaluators exhibit position bias, or inconsistency, when used to evaluate candidate answers in pairwise comparisons, favoring either the first or second answer regardless of content. To address this limitation, we propose PORTIA, an alignment-based system designed to mimic human comparison strategies to calibrate position bias in a lightweight yet effective manner. Specifically, PORTIA splits the answers into multiple segments, aligns similar content across candidate answers, and then merges them back into a single prompt for evaluation by LLMs. We conducted extensive experiments with six diverse LLMs to evaluate 11,520 answer pairs. Our results show that PORTIA markedly enhances the consistency rates for all the models and comparison forms tested, achieving an average relative improvement of 47.46%. Remarkably, PORTIA enables less advanced GPT models to achieve 88% agreement with the state-of-the-art GPT-4 model at just 10% of the cost. Furthermore, it rectifies around 80% of the position bias instances within the GPT-4 model, elevating its consistency rate up to 98%. Subsequent human evaluations indicate that the PORTIA-enhanced GPT-3.5 model can even surpass the standalone GPT-4 in terms of alignment with human evaluators. These findings highlight PORTIA's ability to correct position bias, improve LLM consistency, and boost performance while keeping cost-efficiency. This represents a valuable step toward a more reliable and scalable use of LLMs for automated evaluations across diverse applications.


title: AI-Aristotle: A Physics-Informed framework for Systems Biology Gray-Box Identification

abstract: Discovering mathematical equations that govern physical and biological systems from observed data is a fundamental challenge in scientific research. We present a new physics-informed framework for parameter estimation and missing physics identification (gray-box) in the field of Systems Biology. The proposed framework -- named AI-Aristotle -- combines eXtreme Theory of Functional Connections (X-TFC) domain-decomposition and Physics-Informed Neural Networks (PINNs) with symbolic regression (SR) techniques for parameter discovery and gray-box identification. We test the accuracy, speed, flexibility and robustness of AI-Aristotle based on two benchmark problems in Systems Biology: a pharmacokinetics drug absorption model, and an ultradian endocrine model for glucose-insulin interactions. We compare the two machine learning methods (X-TFC and PINNs), and moreover, we employ two different symbolic regression techniques to cross-verify our results. While the current work focuses on the performance of AI-Aristotle based on synthetic data, it can equally handle noisy experimental data and can even be used for black-box identification in just a few minutes on a laptop. More broadly, our work provides insights into the accuracy, cost, scalability, and robustness of integrating neural networks with symbolic regressors, offering a comprehensive guide for researchers tackling gray-box identification challenges in complex dynamical systems in biomedicine and beyond.


title: Revolutionizing Mobile Interaction: Enabling a 3 Billion Parameter GPT LLM on Mobile

abstract: The field of Artificial Intelligence has witnessed remarkable progress in recent years, especially with the emergence of powerful large language models (LLMs) based on the transformer architecture. Cloud-based LLMs, such as OpenAI's ChatGPT, offer impressive capabilities but come with concerns regarding latency and privacy due to network dependencies. This article presents an innovative approach to LLM inference, envisioning a future where LLMs with billions of parameters can be executed directly on mobile devices without network connectivity. The article showcases a fine-tuned GPT LLM with 3 billion parameters that can operate smoothly on devices with as low as 4GB of memory. Through the integration of native code and model quantization techniques, the application not only serves as a general-purpose assistant but also facilitates seamless mobile interactions with text-to-actions features. The article provides insights into the training pipeline, implementation details, test results, and future directions of on-device LLM inference. This breakthrough technology opens up possibilities for empowering users with sophisticated AI capabilities while preserving their privacy and eliminating latency concerns.


title: Stable 3-dimensional Vortex Families Consistent with Jovian Observations Including the Great Red Spot

abstract: Detailed observations of the velocities of Jovian vortices exist at only one height in the atmosphere, so their vertical structures are poorly understood. This motivates this study that computes stable 3-dimensional, long-lived planetary vortices that satisfy the equations of motion. We solve the anelastic equations with a high-resolution pseudo-spectral method using the observed Jovian atmospheric temperatures and zonal flow. We examine several families of vortices and find that {\it constant-vorticity} vortices, which have nearly-uniform vorticity as a function of height and horizontal areas that go to zero at their tops and bottoms, converge to stable vortices that look like the Great Red Spot (GRS) and other Jovian anticyclones. In contrast, the {\it constant-area} vortices proposed in previous studies, which have nearly-uniform areas as a function of height and vertical vorticities that go to zero at their tops and bottoms, are far from equilibrium, break apart, and converge to {\it constant-vorticity} vortices. Our late-time vortices show unexpected properties. Vortices that are initially non-hollow become hollow (i.e., have local minima of vertical vorticity at their centers), which is a feature of the GRS that cannot be explained with 2-dimensional simulations. The central axes of the final vortices align with the planetary-spin axis even if they initially align with the local direction of gravity. We present scaling laws for how vortex properties change with the Rossby number and other non-dimensional parameters. We analytically prove that the horizontal mid-plane of a stable vortex must lie at a height above the top of the convective zone.


title: Graph Neural Architecture Search with GPT-4

abstract: Graph Neural Architecture Search (GNAS) has shown promising results in automatically designing graph neural networks. However, GNAS still requires intensive human labor with rich domain knowledge to design the search space and search strategy. In this paper, we integrate GPT-4 into GNAS and propose a new GPT-4 based Graph Neural Architecture Search method (GPT4GNAS for short). The basic idea of our method is to design a new class of prompts for GPT-4 to guide GPT-4 toward the generative task of graph neural architectures. The prompts consist of descriptions of the search space, search strategy, and search feedback of GNAS. By iteratively running GPT-4 with the prompts, GPT4GNAS generates more accurate graph neural networks with fast convergence. Experimental results show that embedding GPT-4 into GNAS outperforms the state-of-the-art GNAS methods.


title: Enhancing Secrecy in UAV RSMA Networks: Deep Unfolding Meets Deep Reinforcement Learning

abstract: In this paper, we consider the maximization of the secrecy rate in multiple unmanned aerial vehicles (UAV) rate-splitting multiple access (RSMA) network. A joint beamforming, rate allocation, and UAV trajectory optimization problem is formulated which is nonconvex. Hence, the problem is transformed into a Markov decision problem and a novel multiagent deep reinforcement learning (DRL) framework is designed. The proposed framework (named DUN-DRL) combines deep unfolding to design beamforming and rate allocation, data-driven to design the UAV trajectory, and deep deterministic policy gradient (DDPG) for the learning procedure. The proposed DUN-DRL have shown great performance and outperformed other DRL-based methods in the literature.


title: Building Flexible, Scalable, and Machine Learning-ready Multimodal Oncology Datasets

abstract: The advancements in data acquisition, storage, and processing techniques have resulted in the rapid growth of heterogeneous medical data. Integrating radiological scans, histopathology images, and molecular information with clinical data is essential for developing a holistic understanding of the disease and optimizing treatment. The need for integrating data from multiple sources is further pronounced in complex diseases such as cancer for enabling precision medicine and personalized treatments. This work proposes Multimodal Integration of Oncology Data System (MINDS) - a flexible, scalable, and cost-effective metadata framework for efficiently fusing disparate data from public sources such as the Cancer Research Data Commons (CRDC) into an interconnected, patient-centric framework. MINDS offers an interface for exploring relationships across data types and building cohorts for developing large-scale multimodal machine learning models. By harmonizing multimodal data, MINDS aims to potentially empower researchers with greater analytical ability to uncover diagnostic and prognostic insights and enable evidence-based personalized care. MINDS tracks granular end-to-end data provenance, ensuring reproducibility and transparency. The cloud-native architecture of MINDS can handle exponential data growth in a secure, cost-optimized manner while ensuring substantial storage optimization, replication avoidance, and dynamic access capabilities. Auto-scaling, access controls, and other mechanisms guarantee pipelines' scalability and security. MINDS overcomes the limitations of existing biomedical data silos via an interoperable metadata-driven approach that represents a pivotal step toward the future of oncology data integration.


title: Making Friends in the Dark: Ad Hoc Teamwork Under Partial Observability

abstract: This paper introduces a formal definition of the setting of ad hoc teamwork under partial observability and proposes a first-principled model-based approach which relies only on prior knowledge and partial observations of the environment in order to perform ad hoc teamwork. We make three distinct assumptions that set it apart previous works, namely: i) the state of the environment is always partially observable, ii) the actions of the teammates are always unavailable to the ad hoc agent and iii) the ad hoc agent has no access to a reward signal which could be used to learn the task from scratch. Our results in 70 POMDPs from 11 domains show that our approach is not only effective in assisting unknown teammates in solving unknown tasks but is also robust in scaling to more challenging problems.


title: The Many Voices of Duying: Revisiting the Disputed Essays Between Lu Xun and Zhou Zuoren

abstract: Lu Xun and Zhou Zuoren stand as two of the most influential writers in modern Chinese literature. Beyond their familial ties as brothers, they were also intimate collaborators during the nascent stages of their writing careers. This research employs quantitative methods to revisit three disputed essays pseudonymously published by the brothers in 1912. Our stylometric analysis uses an interpretable authorship attribution model to investigate the essays' authorship and examine the brothers' respective writing styles. Our findings suggest that 'Looking at the Country of China' was authored by Lu Xun. Moreover, 'People of Yue, Forget Not Your Ancestors' Instructions' seems to be either predominantly authored or extensively revised by Lu Xun given its notable stylistic similarities to 'Looking at the Land of Yue,' a piece Zhou Zuoren recognized as his own, but edited by Lu Xun. The third essay, 'Where Has the Character of the Republic Gone?,' exhibits a 'diluted', mixed writing style, suggesting thorough collaboration. We offer visual representations of essay features to facilitate a nuanced and intuitive understanding. We have uncovered evidence suggesting Lu Xun's covert engagement with social issues during his purported 'silent era' and provided insights into the brothers' formative intellectual trajectories.