title: AutoDAN: Interpretable Gradient-Based Adversarial Attacks on Large Language Models

abstract: Safety alignment of Large Language Models (LLMs) can be compromised with manual jailbreak attacks and (automatic) adversarial attacks. Recent studies suggest that defending against these attacks is possible: adversarial attacks generate unlimited but unreadable gibberish prompts, detectable by perplexity-based filters; manual jailbreak attacks craft readable prompts, but their limited number due to the necessity of human creativity allows for easy blocking. In this paper, we show that these solutions may be too optimistic. We introduce AutoDAN, an interpretable, gradient-based adversarial attack that merges the strengths of both attack types. Guided by the dual goals of jailbreak and readability, AutoDAN optimizes and generates tokens one by one from left to right, resulting in readable prompts that bypass perplexity filters while maintaining high attack success rates. Notably, these prompts, generated from scratch using gradients, are interpretable and diverse, with emerging strategies commonly seen in manual jailbreak attacks. They also generalize to unforeseen harmful behaviors and transfer to black-box LLMs better than their unreadable counterparts when using limited training data or a single proxy model. Furthermore, we show the versatility of AutoDAN by automatically leaking system prompts using a customized objective. Our work offers a new way to red-team LLMs and understand jailbreak mechanisms via interpretability.


title: SpecTr: Fast Speculative Decoding via Optimal Transport

abstract: Autoregressive sampling from large language models has led to state-of-the-art results in several natural language tasks. However, autoregressive sampling generates tokens one at a time making it slow, and even prohibitive in certain tasks. One way to speed up sampling is $\textit{speculative decoding}$: use a small model to sample a $\textit{draft}$ (block or sequence of tokens), and then score all tokens in the draft by the large language model in parallel. A subset of the tokens in the draft are accepted (and the rest rejected) based on a statistical method to guarantee that the final output follows the distribution of the large model. In this work, we provide a principled understanding of speculative decoding through the lens of optimal transport (OT) with $\textit{membership cost}$. This framework can be viewed as an extension of the well-known $\textit{maximal-coupling}$ problem. This new formulation enables us to generalize the speculative decoding method to allow for a set of $k$ candidates at the token-level, which leads to an improved optimal membership cost. We show that the optimal draft selection algorithm (transport plan) can be computed via linear programming, whose best-known runtime is exponential in $k$. We then propose a valid draft selection algorithm whose acceptance probability is $(1-1/e)$-optimal multiplicatively. Moreover, it can be computed in time almost linear with size of domain of a single token. Using this $new draft selection$ algorithm, we develop a new autoregressive sampling algorithm called $\textit{SpecTr}$, which provides speedup in decoding while ensuring that there is no quality degradation in the decoded output. We experimentally demonstrate that for state-of-the-art large language models, the proposed approach achieves a wall clock speedup of 2.13X, a further 1.37X speedup over speculative decoding on standard benchmarks.


title: Global Navier-Stokes flows in intermediate spaces

abstract: We construct global weak solutions of the three dimensional incompressible Navier-Stokes equations in intermediate spaces between the space of uniformly locally square integrable functions and Herz-type spaces which involve weighted integrals centered at the origin. Our results bridge the existence theorems of Lemari\'e-Rieusset and of Bradshaw, Kukavica and Tsai. An application to eventual regularity is included which generalizes the prior work of Bradshaw, Kukavica and Tsai as well as Bradshaw, Kukavica and Ozanski.


title: Hyperparameter optimization of hp-greedy reduced basis for gravitational wave surrogates

abstract: In a previous work we introduced, in the context of gravitational wave science, an initial study on an automated domain-decomposition approach for reduced basis through hp-greedy refinement. The approach constructs local reduced bases of lower dimensionality than global ones, with the same or higher accuracy. These ``light'' local bases should imply both faster evaluations when predicting new waveforms and faster data analysis, in particular faster statistical inference (the forward and inverse problems, respectively). In this approach, however, we have previously found important dependence on several hyperparameters, which do not appear in global reduced basis. This naturally leads to the problem of hyperparameter optimization (HPO), which is the subject of this paper. We tackle the problem through a Bayesian optimization, and show its superiority when compared to grid or random searches. We find that for gravitational waves from the collision of two spinning but non-precessing black holes, for the same accuracy, local hp-greedy reduced bases with HPO have a lower dimensionality of up to $4 \times$ for the cases here studied, depending on the desired accuracy. This factor should directly translate in a parameter estimation speedup, for instance. Such acceleration might help in the near real-time requirements for electromagnetic counterparts of gravitational waves from compact binary coalescences. In addition, we find that the Bayesian approach used in this paper for HPO is two orders of magnitude faster than, for example, a grid search, with about a $100 \times$ acceleration. The code developed for this project is available as open source from public repositories.


title: DEsignBench: Exploring and Benchmarking DALL-E 3 for Imagining Visual Design

abstract: We introduce DEsignBench, a text-to-image (T2I) generation benchmark tailored for visual design scenarios. Recent T2I models like DALL-E 3 and others, have demonstrated remarkable capabilities in generating photorealistic images that align closely with textual inputs. While the allure of creating visually captivating images is undeniable, our emphasis extends beyond mere aesthetic pleasure. We aim to investigate the potential of using these powerful models in authentic design contexts. In pursuit of this goal, we develop DEsignBench, which incorporates test samples designed to assess T2I models on both "design technical capability" and "design application scenario." Each of these two dimensions is supported by a diverse set of specific design categories. We explore DALL-E 3 together with other leading T2I models on DEsignBench, resulting in a comprehensive visual gallery for side-by-side comparisons. For DEsignBench benchmarking, we perform human evaluations on generated images in DEsignBench gallery, against the criteria of image-text alignment, visual aesthetic, and design creativity. Our evaluation also considers other specialized design capabilities, including text rendering, layout composition, color harmony, 3D design, and medium style. In addition to human evaluations, we introduce the first automatic image generation evaluator powered by GPT-4V. This evaluator provides ratings that align well with human judgments, while being easily replicable and cost-efficient. A high-resolution version is available at https://github.com/design-bench/design-bench.github.io/raw/main/designbench.pdf?download=


title: Robot Fine-Tuning Made Easy: Pre-Training Rewards and Policies for Autonomous Real-World Reinforcement Learning

abstract: The pre-train and fine-tune paradigm in machine learning has had dramatic success in a wide range of domains because the use of existing data or pre-trained models on the internet enables quick and easy learning of new tasks. We aim to enable this paradigm in robotic reinforcement learning, allowing a robot to learn a new task with little human effort by leveraging data and models from the Internet. However, reinforcement learning often requires significant human effort in the form of manual reward specification or environment resets, even if the policy is pre-trained. We introduce RoboFuME, a reset-free fine-tuning system that pre-trains a multi-task manipulation policy from diverse datasets of prior experiences and self-improves online to learn a target task with minimal human intervention. Our insights are to utilize calibrated offline reinforcement learning techniques to ensure efficient online fine-tuning of a pre-trained policy in the presence of distribution shifts and leverage pre-trained vision language models (VLMs) to build a robust reward classifier for autonomously providing reward signals during the online fine-tuning process. In a diverse set of five real robot manipulation tasks, we show that our method can incorporate data from an existing robot dataset collected at a different institution and improve on a target task within as little as 3 hours of autonomous real-world experience. We also demonstrate in simulation experiments that our method outperforms prior works that use different RL algorithms or different approaches for predicting rewards. Project website: https://robofume.github.io


title: When Should the FDA Inspect Pharmaceutical Manufacturing Facilities to Better Mitigate Drug Shortages?

abstract: Drug shortages have been a persistent problem in American healthcare for decades, and the resulting lack of access to necessary drugs has been disastrous to patient health. A majority of these shortages were caused by quality issues related to problems in the manufacturing process. More frequent inspections can reduce quality concerns, but deciding when to inspect is a complex problem; strict regulation enforcement can force low-profit facilities to close due to excessive maintenance costs, while lax enforcement allows for regulation violations to persist, both of which can cause drug shortages. We propose a novel model to assist the FDA in determining when to inspect manufacturing facilities. We formulate this problem as a finite-horizon partially observable Markov decision process (POMDP) based on the classifications the FDA assigns to each facility after inspection, as well two disruptive events: a manufacturing failure occurring or the facility closing for non-mandatory maintenance. We theoretically show that this problem can be reduced to only needing to consider whether or not to inspect immediately, which is independent of the time horizon. We additionally determine the sensitivity of the optimal inspection time on the penalty incurred for an unexpected disruptive event occurring. Our computational study demonstrates a quadratic relationship between the relative difference in average value accumulated between inspecting based on the optimal inspection time produced by our model and inspecting based on the expected time to an unexpected disruptive event, highlighting the importance of allocating more inspection resources to high-risk facilities that produce drugs that highly impact public health. We additionally find that optimal inspection time is more sensitive to changes in the penalty incurred from a disruptive event occurring the longer it has been since the last inspection.


title: S3Eval: A Synthetic, Scalable, Systematic Evaluation Suite for Large Language Models

abstract: The rapid development of Large Language Models (LLMs) has led to great strides in model capabilities like long-context understanding and reasoning. However, as LLMs are able to process longer contexts, it becomes more challenging to evaluate whether they have acquired certain capabilities, since the length of text (e.g., 200K tokens) they can process far exceeds what humans can reliably assess in a reasonable duration. In this paper, we propose using complex synthetic tasks as a proxy evaluation method, and present S3Eval, a Synthetic, Scalable, Systematic evaluation suite for LLMs evaluation. The synthetic nature of S3Eval provides users full control over the dataset, allowing them to systematically probe LLM capabilities by scaling text length and varying task difficulty across diverse scenarios. The strong correlation between S3Eval and real-world benchmarks demonstrates the soundness of using S3Eval for evaluation of LLMs. S3Eval provides a flexible and infinite long-context data generation method. We have generated a comprehensive dataset called S3Eval-Standard, and experimental results have shown that it poses significant challenges for all existing LLMs.


title: Physics informed neural networks learning a two-qubit Hamiltonian

abstract: Machine learning techniques are employed to perform the full characterization of a quantum system. The particular artificial intelligence technique used to learn the Hamiltonian is called physics informed neural network (PINN). The idea behind PINN is the universal approximation theorem, which claims that any function can be approximate by a neural network if it contains enough complexity. Consequently, a neural network can be a solution of a physical model. Moreover, by means of extra data provided by the user, intrinsic physical parameters can be extracted from the approach called inverse-PINN. Here, we apply inverse-PINN with the goal of extracting all the physical parameters that constitutes a two qubit Hamiltonian. We find that this approach is very efficient. To probe the robustness of the inverse-PINN to learn the Hamiltonian of a two-qubit system, we use the IBM quantum computers as experimental platforms to obtain the data that is plugged in the PINN. We found that our method is able to predict the two-qubit parameters with 5% of accuracy on average.


title: Unlocking the Transferability of Tokens in Deep Models for Tabular Data

abstract: Fine-tuning a pre-trained deep neural network has become a successful paradigm in various machine learning tasks. However, such a paradigm becomes particularly challenging with tabular data when there are discrepancies between the feature sets of pre-trained models and the target tasks. In this paper, we propose TabToken, a method aims at enhancing the quality of feature tokens (i.e., embeddings of tabular features). TabToken allows for the utilization of pre-trained models when the upstream and downstream tasks share overlapping features, facilitating model fine-tuning even with limited training examples. Specifically, we introduce a contrastive objective that regularizes the tokens, capturing the semantics within and across features. During the pre-training stage, the tokens are learned jointly with top-layer deep models such as transformer. In the downstream task, tokens of the shared features are kept fixed while TabToken efficiently fine-tunes the remaining parts of the model. TabToken not only enables knowledge transfer from a pre-trained model to tasks with heterogeneous features, but also enhances the discriminative ability of deep tabular models in standard classification and regression tasks.


title: Online Detection of AI-Generated Images

abstract: With advancements in AI-generated images coming on a continuous basis, it is increasingly difficult to distinguish traditionally-sourced images (e.g., photos, artwork) from AI-generated ones. Previous detection methods study the generalization from a single generator to another in isolation. However, in reality, new generators are released on a streaming basis. We study generalization in this setting, training on N models and testing on the next (N+k), following the historical release dates of well-known generation methods. Furthermore, images increasingly consist of both real and generated components, for example through image inpainting. Thus, we extend this approach to pixel prediction, demonstrating strong performance using automatically-generated inpainted data. In addition, for settings where commercial models are not publicly available for automatic data generation, we evaluate if pixel detectors can be trained solely on whole synthetic images.


title: Verb Conjugation in Transformers Is Determined by Linear Encodings of Subject Number

abstract: Deep architectures such as Transformers are sometimes criticized for having uninterpretable "black-box" representations. We use causal intervention analysis to show that, in fact, some linguistic features are represented in a linear, interpretable format. Specifically, we show that BERT's ability to conjugate verbs relies on a linear encoding of subject number that can be manipulated with predictable effects on conjugation accuracy. This encoding is found in the subject position at the first layer and the verb position at the last layer, but distributed across positions at middle layers, particularly when there are multiple cues to subject number.


title: Sampling Balanced Forests of Grids in Polynomial Time

abstract: We prove that a polynomial fraction of the set of $k$-component forests in the $m \times n$ grid graph have equal numbers of vertices in each component, for any constant $k$. This resolves a conjecture of Charikar, Liu, Liu, and Vuong, and establishes the first provably polynomial-time algorithm for (exactly or approximately) sampling balanced grid graph partitions according to the spanning tree distribution, which weights each $k$-partition according to the product, across its $k$ pieces, of the number of spanning trees of each piece. Our result follows from a careful analysis of the probability a uniformly random spanning tree of the grid can be cut into balanced pieces. Beyond grids, we show that for a broad family of lattice-like graphs, we achieve balance up to any multiplicative $(1 \pm \varepsilon)$ constant with constant probability, and up to an additive constant with polynomial probability. More generally, we show that, with constant probability, components derived from uniform spanning trees can approximate any given partition of a planar region specified by Jordan curves. These results imply polynomial time algorithms for sampling approximately balanced tree-weighted partitions for lattice-like graphs. Our results have applications to understanding political districtings, where there is an underlying graph of indivisible geographic units that must be partitioned into $k$ population-balanced connected subgraphs. In this setting, tree-weighted partitions have interesting geometric properties, and this has stimulated significant effort to develop methods to sample them.


title: Accelerate Microstructure Evolution Simulation Using Graph Neural Networks with Adaptive Spatiotemporal Resolution

abstract: Surrogate models driven by sizeable datasets and scientific machine-learning methods have emerged as an attractive microstructure simulation tool with the potential to deliver predictive microstructure evolution dynamics with huge savings in computational costs. Taking 2D and 3D grain growth simulations as an example, we present a completely overhauled computational framework based on graph neural networks with not only excellent agreement to both the ground truth phase-field methods and theoretical predictions, but enhanced accuracy and efficiency compared to previous works based on convolutional neural networks. These improvements can be attributed to the graph representation, both improved predictive power and a more flexible data structure amenable to adaptive mesh refinement. As the simulated microstructures coarsen, our method can adaptively adopt remeshed grids and larger timesteps to achieve further speedup. The data-to-model pipeline with training procedures together with the source codes are provided.


title: Linear Representations of Sentiment in Large Language Models

abstract: Sentiment is a pervasive feature in natural language text, yet it is an open question how sentiment is represented within Large Language Models (LLMs). In this study, we reveal that across a range of models, sentiment is represented linearly: a single direction in activation space mostly captures the feature across a range of tasks with one extreme for positive and the other for negative. Through causal interventions, we isolate this direction and show it is causally relevant in both toy tasks and real world datasets such as Stanford Sentiment Treebank. Through this case study we model a thorough investigation of what a single direction means on a broad data distribution. We further uncover the mechanisms that involve this direction, highlighting the roles of a small subset of attention heads and neurons. Finally, we discover a phenomenon which we term the summarization motif: sentiment is not solely represented on emotionally charged words, but is additionally summarized at intermediate positions without inherent sentiment, such as punctuation and names. We show that in Stanford Sentiment Treebank zero-shot classification, 76% of above-chance classification accuracy is lost when ablating the sentiment direction, nearly half of which (36%) is due to ablating the summarized sentiment direction exclusively at comma positions.


title: On $\ell$-open $C^*$ algebras and $\ell$-closed $C^*$-algebras

abstract: In this paper, we characterize $\ell$-open and $\ell$-closed $C^*$-algebras and deduce that $\ell$-open $C^*$-algebras are $\ell$-closed, as conjectured by Blackadar. Moreover, we show that a commutative unital $C^*$-algebra is $\ell$-open if and only if it is semiprojective.


title: Optimal uni-local virtual quantum broadcasting

abstract: Quantum broadcasting is a cornerstone in the realm of quantum information processing and characterizes the correlations within quantum states. Nonetheless, traditional quantum broadcasting encounters inherent limitations dictated by the principles of quantum mechanics. In this work, we introduce a novel protocol known as \textit{virtual quantum broadcasting} which focuses on broadcasting measurement statistics of a target state rather than the state itself. First, we propose a universal unilocal protocol enabling multiple parties to share the expectation value for any observable in any target bipartite state. Second, we formalize the simulation cost of a virtual quantum broadcasting protocol into a semidefinite programming problem. Notably, we propose a specific protocol with optimal simulation cost for the 2-broadcasting scenario, revealing an explicit relationship between simulation cost and the quantum system's dimension. Moreover, we establish upper and lower bounds on the simulation cost of the virtual $n$-broadcasting protocol and demonstrate the convergence of the lower bound to the upper bound as the quantum system's dimension increases. Our work paves the way for new approaches to distributing quantum information, potentially advancing quantum communication and computing technologies.


title: A Realist Interpretation of Unitarity in Quantum Gravity

abstract: Unitarity is a difficult concept to implement in canonical quantum gravity because of state non-normalizability and the problem of time. We take a realist approach based on pilot-wave theory to address this issue in the Ashtekar formulation of the Wheeler-DeWitt equation. We use the postulate of a definite configuration in the theory to define a global time for the gravitational-fermionic system recently discussed in (Phys. Rev. D 106.10 (2022): 106012), by parameterizing a variation of a Weyl-spinor that depends on the Kodama state. The total Hamiltonian constraint yields a time-dependent Schrodinger equation, without semi-classical approximations, which we use to derive a local continuity equation over the configuration space. We implement the reality conditions at the level of the guidance equation, and obtain a real spin-connection, extrinsic curvature and triad along the system trajectory. We obtain quantum corrections to deSitter spacetime from the guidance equation. The non-normalizable Kodama state is naturally factored out of the full quantum state in the conserved current density, opening the possibility for quantum-mechanical unitarity. We also give a pilot-wave generalisation of the notion of unitarity applicable to non-normalizable states, and show the existence of equilibrium density for our system. Lastly, we find unitary states in mini-superspace by finding an approximate solution to the Hamiltonian constraint.


title: Ages and metallicities of stellar clusters using S-PLUS narrow-band integrated photometry: the Small Magellanic Cloud

abstract: The Magellanic Clouds are the most massive and closest satellite galaxies of the Milky Way, with stars covering ages from a few Myr up to 13 Gyr. This makes them important for validating integrated light methods to study stellar populations and star-formation processes, which can be applied to more distant galaxies. We characterized a set of stellar clusters in the Small Magellanic Cloud (SMC), using the $\textit{Southern Photometric Local Universe Survey}$. This is the first age (metallicity) determination for 11 (65) clusters of this sample. Through its 7 narrow bands, centered on important spectral features, and 5 broad bands, we can retrieve detailed information about stellar populations. We obtained ages and metallicities for all stellar clusters using the Bayesian spectral energy distribution fitting code $\texttt{BAGPIPES}$. With a sample of clusters in the color range $-0.20 < r-z < +0.35$, for which our determined parameters are most reliable, we modeled the age-metallicity relation of SMC. At any given age, the metallicities of SMC clusters are lower than those of both the Gaia Sausage-Enceladus disrupted dwarf galaxy and the Milky Way. In comparison with literature values, differences are $\Delta$log(age)$\approx0.31$ and $\Delta$[Fe/H]$\approx0.41$, which is comparable to low-resolution spectroscopy of individual stars. Finally, we confirm a previously known gradient, with younger clusters in the center and older ones preferentially located in the outermost regions. On the other hand, we found no evidence of a significant metallicity gradient.


title: Probing Transverse Momentum Dependent Structures with Azimuthal Dependence of Energy Correlators

abstract: We study the azimuthal angle dependence of the energy-energy correlators $\langle \mathcal{E}(\hat{n}_1)\mathcal{E}(\hat{n}_2)\rangle$ in the back-to-back region for $e^+e^-$ annihilation and deep inelastic scattering (DIS) processes with general polarization of the proton beam. We demonstrate that the polarization information of the beam and the underlying partons from the hard scattering is propagated into the azimuthal angle dependence of the energy-energy correlators. In the process, we define the Collins-type EEC jet functions and introduce a new EEC observable using the lab-frame angles in the DIS process. Furthermore, we extend our formalism to explore the two-point energy correlation between hadrons with different quantum numbers $\mathbb{S}_i$ in the back-to-back limit $\langle \mathcal{E}_{\mathbb{S}_1}(\hat{n}_1)\mathcal{E}_{\mathbb{S}_2}(\hat{n}_2)\rangle$. We find that in the Operator Product Expansion (OPE) region the nonperturbative information is entirely encapsulated by a single number. Using our formalism, we present several phenomenological studies that showcase how energy correlators can be used to probe transverse momentum dependent structures.


title: FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Models

abstract: Semantic segmentation has witnessed tremendous progress due to the proposal of various advanced network architectures. However, they are extremely hungry for delicate annotations to train, and the acquisition is laborious and unaffordable. Therefore, we present FreeMask in this work, which resorts to synthetic images from generative models to ease the burden of both data collection and annotation procedures. Concretely, we first synthesize abundant training images conditioned on the semantic masks provided by realistic datasets. This yields extra well-aligned image-mask training pairs for semantic segmentation models. We surprisingly observe that, solely trained with synthetic images, we already achieve comparable performance with real ones (e.g., 48.3 vs. 48.5 mIoU on ADE20K, and 49.3 vs. 50.5 on COCO-Stuff). Then, we investigate the role of synthetic images by joint training with real images, or pre-training for real images. Meantime, we design a robust filtering principle to suppress incorrectly synthesized regions. In addition, we propose to inequally treat different semantic masks to prioritize those harder ones and sample more corresponding synthetic images for them. As a result, either jointly trained or pre-trained with our filtered and re-sampled synthesized images, segmentation models can be greatly enhanced, e.g., from 48.7 to 52.0 on ADE20K. Code is available at https://github.com/LiheYoung/FreeMask.


title: SAM-Med3D

abstract: Although the Segment Anything Model (SAM) has demonstrated impressive performance in 2D natural image segmentation, its application to 3D volumetric medical images reveals significant shortcomings, namely suboptimal performance and unstable prediction, necessitating an excessive number of prompt points to attain the desired outcomes. These issues can hardly be addressed by fine-tuning SAM on medical data because the original 2D structure of SAM neglects 3D spatial information. In this paper, we introduce SAM-Med3D, the most comprehensive study to modify SAM for 3D medical images. Our approach is characterized by its comprehensiveness in two primary aspects: firstly, by comprehensively reformulating SAM to a thorough 3D architecture trained on a comprehensively processed large-scale volumetric medical dataset; and secondly, by providing a comprehensive evaluation of its performance. Specifically, we train SAM-Med3D with over 131K 3D masks and 247 categories. Our SAM-Med3D excels at capturing 3D spatial information, exhibiting competitive performance with significantly fewer prompt points than the top-performing fine-tuned SAM in the medical domain. We then evaluate its capabilities across 15 datasets and analyze it from multiple perspectives, including anatomical structures, modalities, targets, and generalization abilities. Our approach, compared with SAM, showcases pronouncedly enhanced efficiency and broad segmentation capabilities for 3D volumetric medical images. Our code is released at https://github.com/uni-medical/SAM-Med3D.


title: Ionized Gas Extended Over 40 kpc in an Odd Radio Circle Host Galaxy

abstract: A new class of extragalactic astronomical sources discovered in 2021, named Odd Radio Circles (ORCs, Norris et al. 2021), are large rings of faint, diffuse radio continuum emission spanning ~1 arcminute on the sky. Galaxies at the centers of several ORCs have photometric redshifts of z~0.3-0.6, implying physical scales of several 100 kiloparsecs in diameter for the radio emission, the origin of which is unknown. Here we report spectroscopic data on an ORC including strong [OII] emission tracing ionized gas in the central galaxy of ORC4 at z=0.4512. The physical extent of the [OII] emission is ~40 kpc in diameter, larger than expected for a typical early-type galaxy (Pandya et al, 2017) but an order of magnitude smaller than the large-scale radio continuum emission. We detect a ~200 km/s velocity gradient across the [OII] nebula, as well as a high velocity dispersion of ~180 km/s. The [OII] equivalent width (EW, ~50 Ang) is extremely high for a quiescent galaxy. The morphology, kinematics, and strength of the [OII] emission are consistent with the infall of shock ionized gas near the galaxy, following a larger-scale, outward moving shock driven by a galactic wind. Both the extended optical and radio emission, while observed on very different scales, may therefore result from the same dramatic event.


title: Bitrate Ladder Prediction Methods for Adaptive Video Streaming: A Review and Benchmark

abstract: HTTP adaptive streaming (HAS) has emerged as a widely adopted approach for over-the-top (OTT) video streaming services, due to its ability to deliver a seamless streaming experience. A key component of HAS is the bitrate ladder, which provides the encoding parameters (e.g., bitrate-resolution pairs) to encode the source video. The representations in the bitrate ladder allow the client's player to dynamically adjust the quality of the video stream based on network conditions by selecting the most appropriate representation from the bitrate ladder. The most straightforward and lowest complexity approach involves using a fixed bitrate ladder for all videos, consisting of pre-determined bitrate-resolution pairs known as one-size-fits-all. Conversely, the most reliable technique relies on intensively encoding all resolutions over a wide range of bitrates to build the convex hull, thereby optimizing the bitrate ladder for each specific video. Several techniques have been proposed to predict content-based ladders without performing a costly exhaustive search encoding. This paper provides a comprehensive review of various methods, including both conventional and learning-based approaches. Furthermore, we conduct a benchmark study focusing exclusively on various learning-based approaches for predicting content-optimized bitrate ladders across multiple codec settings. The considered methods are evaluated on our proposed large-scale dataset, which includes 300 UHD video shots encoded with software and hardware encoders using three state-of-the-art encoders, including AVC/H.264, HEVC/H.265, and VVC/H.266, at various bitrate points. Our analysis provides baseline methods and insights, which will be valuable for future research in the field of bitrate ladder prediction. The source code of the proposed benchmark and the dataset will be made publicly available upon acceptance of the paper.


title: LINC: A Neurosymbolic Approach for Logical Reasoning by Combining Language Models with First-Order Logic Provers

abstract: Logical reasoning, i.e., deductively inferring the truth value of a conclusion from a set of premises, is an important task for artificial intelligence with wide potential impacts on science, mathematics, and society. While many prompting-based strategies have been proposed to enable Large Language Models (LLMs) to do such reasoning more effectively, they still appear unsatisfactory, often failing in subtle and unpredictable ways. In this work, we investigate the validity of instead reformulating such tasks as modular neurosymbolic programming, which we call LINC: Logical Inference via Neurosymbolic Computation. In LINC, the LLM acts as a semantic parser, translating premises and conclusions from natural language to expressions in first-order logic. These expressions are then offloaded to an external theorem prover, which symbolically performs deductive inference. Leveraging this approach, we observe significant performance gains on FOLIO and a balanced subset of ProofWriter for three different models in nearly all experimental conditions we evaluate. On ProofWriter, augmenting the comparatively small open-source StarCoder+ (15.5B parameters) with LINC even outperforms GPT-3.5 and GPT-4 with Chain-of-Thought (CoT) prompting by an absolute 38% and 10%, respectively. When used with GPT-4, LINC scores 26% higher than CoT on ProofWriter while performing comparatively on FOLIO. Further analysis reveals that although both methods on average succeed roughly equally often on this dataset, they exhibit distinct and complementary failure modes. We thus provide promising evidence for how logical reasoning over natural language can be tackled through jointly leveraging LLMs alongside symbolic provers. All corresponding code is publicly available at https://github.com/benlipkin/linc


title: Handling Data Heterogeneity via Architectural Design for Federated Visual Recognition

abstract: Federated Learning (FL) is a promising research paradigm that enables the collaborative training of machine learning models among various parties without the need for sensitive information exchange. Nonetheless, retaining data in individual clients introduces fundamental challenges to achieving performance on par with centrally trained models. Our study provides an extensive review of federated learning applied to visual recognition. It underscores the critical role of thoughtful architectural design choices in achieving optimal performance, a factor often neglected in the FL literature. Many existing FL solutions are tested on shallow or simple networks, which may not accurately reflect real-world applications. This practice restricts the transferability of research findings to large-scale visual recognition models. Through an in-depth analysis of diverse cutting-edge architectures such as convolutional neural networks, transformers, and MLP-mixers, we experimentally demonstrate that architectural choices can substantially enhance FL systems' performance, particularly when handling heterogeneous data. We study 19 visual recognition models from five different architectural families on four challenging FL datasets. We also re-investigate the inferior performance of convolution-based architectures in the FL setting and analyze the influence of normalization layers on the FL performance. Our findings emphasize the importance of architectural design for computer vision tasks in practical scenarios, effectively narrowing the performance gap between federated and centralized learning. Our source code is available at https://github.com/sarapieri/fed_het.git.


title: Large Language Models are Visual Reasoning Coordinators

abstract: Visual reasoning requires multimodal perception and commonsense cognition of the world. Recently, multiple vision-language models (VLMs) have been proposed with excellent commonsense reasoning ability in various domains. However, how to harness the collective power of these complementary VLMs is rarely explored. Existing methods like ensemble still struggle to aggregate these models with the desired higher-order communications. In this work, we propose Cola, a novel paradigm that coordinates multiple VLMs for visual reasoning. Our key insight is that a large language model (LLM) can efficiently coordinate multiple VLMs by facilitating natural language communication that leverages their distinct and complementary capabilities. Extensive experiments demonstrate that our instruction tuning variant, Cola-FT, achieves state-of-the-art performance on visual question answering (VQA), outside knowledge VQA, visual entailment, and visual spatial reasoning tasks. Moreover, we show that our in-context learning variant, Cola-Zero, exhibits competitive performance in zero and few-shot settings, without finetuning. Through systematic ablation studies and visualizations, we validate that a coordinator LLM indeed comprehends the instruction prompts as well as the separate functionalities of VLMs; it then coordinates them to enable impressive visual reasoning capabilities.


title: Quantum phase transitions and cat states in cavity-coupled quantum dots

abstract: We study double quantum dots coupled to a quasistatic cavity mode with high mode-volume compression allowing for strong light-matter coupling. Besides the cavity-mediated interaction, electrons in different double quantum dots interact with each other via dipole-dipole (Coulomb) interaction. For attractive dipolar interaction, a cavity-induced ferroelectric quantum phase transition emerges leading to ordered dipole moments. Surprisingly, we find that the phase transition can be either continuous or discontinuous, depending on the ratio between the strengths of cavity-mediated and Coulomb interactions. We show that, in the strong coupling regime, both the ground and the first excited states of an array of double quantum dots are squeezed Schr\"{o}dinger cat states. Such states are actively discussed as high-fidelity qubits for quantum computing, and thus our proposal provides a platform for semiconductor implementation of such qubits. We also calculate gauge-invariant observables such as the net dipole moment, the optical conductivity, and the absorption spectrum beyond the semiclassical approximation.


title: Ghost on the Shell: An Expressive Representation of General 3D Shapes

abstract: The creation of photorealistic virtual worlds requires the accurate modeling of 3D surface geometry for a wide range of objects. For this, meshes are appealing since they 1) enable fast physics-based rendering with realistic material and lighting, 2) support physical simulation, and 3) are memory-efficient for modern graphics pipelines. Recent work on reconstructing and statistically modeling 3D shape, however, has critiqued meshes as being topologically inflexible. To capture a wide range of object shapes, any 3D representation must be able to model solid, watertight, shapes as well as thin, open, surfaces. Recent work has focused on the former, and methods for reconstructing open surfaces do not support fast reconstruction with material and lighting or unconditional generative modelling. Inspired by the observation that open surfaces can be seen as islands floating on watertight surfaces, we parameterize open surfaces by defining a manifold signed distance field on watertight templates. With this parameterization, we further develop a grid-based and differentiable representation that parameterizes both watertight and non-watertight meshes of arbitrary topology. Our new representation, called Ghost-on-the-Shell (G-Shell), enables two important applications: differentiable rasterization-based reconstruction from multiview images and generative modelling of non-watertight meshes. We empirically demonstrate that G-Shell achieves state-of-the-art performance on non-watertight mesh reconstruction and generation tasks, while also performing effectively for watertight meshes.


title: FreeNoise: Tuning-Free Longer Video Diffusion via Noise Rescheduling

abstract: With the availability of large-scale video datasets and the advances of diffusion models, text-driven video generation has achieved substantial progress. However, existing video generation models are typically trained on a limited number of frames, resulting in the inability to generate high-fidelity long videos during inference. Furthermore, these models only support single-text conditions, whereas real-life scenarios often require multi-text conditions as the video content changes over time. To tackle these challenges, this study explores the potential of extending the text-driven capability to generate longer videos conditioned on multiple texts. 1) We first analyze the impact of initial noise in video diffusion models. Then building upon the observation of noise, we propose FreeNoise, a tuning-free and time-efficient paradigm to enhance the generative capabilities of pretrained video diffusion models while preserving content consistency. Specifically, instead of initializing noises for all frames, we reschedule a sequence of noises for long-range correlation and perform temporal attention over them by window-based function. 2) Additionally, we design a novel motion injection method to support the generation of videos conditioned on multiple text prompts. Extensive experiments validate the superiority of our paradigm in extending the generative capabilities of video diffusion models. It is noteworthy that compared with the previous best-performing method which brought about 255% extra time cost, our method incurs only negligible time cost of approximately 17%. Generated video samples are available at our website: http://haonanqiu.com/projects/FreeNoise.html.


title: Oxygen abundance of gamma Vel from [O III] 88um Herschel/PACS spectroscopy

abstract: We present Herschel PACS spectroscopy of the [O III] 88.4um fine-structure line in the nearby WC8+O binary system gamma Vel to determine its oxygen abundance. The critical density of this line corresponds to several 10^5 R* such that it is spatially extended in PACS observations at the 336 pc distance to gamma Vel. Two approaches are used, the first involving a detailed stellar atmosphere analysis of gamma Vel using CMFGEN, extending to Ne ~ 10^0 cm^-3 in order to fully sample the line formation region of [O III] 88.4um. The second approach involves the analytical model introduced by Barlow et al. and revised by Dessart et al, additionally exploiting ISO LWS spectroscopy of [O III] 51.8um. We obtain higher luminosities for the WR and O components of gamma Vel with respect to De Marco et al, log L/L_sun = 5.31 and 5.56, respectively, due to the revised (higher) interferometric distance. We obtain an oxygen mass fraction of X_O = 1.0+/- 0.3% for an outer wind volume filling factor of f = 0.5+/-0.25, favouring either standard or slightly reduced Kunz et al. rates for the ^12C(alpha, gamma)^16O reaction from comparison with BPASS binary population synthesis models. We also revisit neon and sulphur abundances in the outer wind of gamma Vel from ISO SWS spectroscopy of [S IV] 10.5um [Ne II] 12.8um and [Ne III] 15.5um. The inferred neon abundance X_Ne = 2.0-0.6+0.4%, is in excellent agreement with BPASS predictions, while the.sulphur abundance of X_S = 0.04 +/- 0.01% agrees with the solar abundance, as expected for unprocessed elements.


title: RoboDepth: Robust Out-of-Distribution Depth Estimation under Corruptions

abstract: Depth estimation from monocular images is pivotal for real-world visual perception systems. While current learning-based depth estimation models train and test on meticulously curated data, they often overlook out-of-distribution (OoD) situations. Yet, in practical settings -- especially safety-critical ones like autonomous driving -- common corruptions can arise. Addressing this oversight, we introduce a comprehensive robustness test suite, RoboDepth, encompassing 18 corruptions spanning three categories: i) weather and lighting conditions; ii) sensor failures and movement; and iii) data processing anomalies. We subsequently benchmark 42 depth estimation models across indoor and outdoor scenes to assess their resilience to these corruptions. Our findings underscore that, in the absence of a dedicated robustness evaluation framework, many leading depth estimation models may be susceptible to typical corruptions. We delve into design considerations for crafting more robust depth estimation models, touching upon pre-training, augmentation, modality, model capacity, and learning paradigms. We anticipate our benchmark will establish a foundational platform for advancing robust OoD depth estimation.


title: Elaboration and characterization of bioplastic films based on bitter cassava starch (Manihot esculenta) reinforced by chitosan extracted from crab (Shylla seratta) shells

abstract: Bioplastics are polymer plastics which are derived from renewable biomass resources. In this study, bioplastic films based on two different polysaccharides such as bitter cassava starch and chitosan extracted from crab shells were produced by casting technique, using glycerol as plasticizer. The purposes of this research are to characterize and to figure out the effect of additional chitosan concentrations (0; 10; 20; 30; 50% by weight of starch) on the physicochemical, mechanical and water barrier properties of bioplastic films. The film's solubility in water (S), water absorption capacity (WAP), water vapor permeability (WVP), tensile strength (TS), elongation at break (E), Young's modulus (YM) and biodegradability were investigated. The possible interactions between starch and chitosan molecules were evaluated by Fourier transform infrared spectroscopy (FTIR). From the analysis, the incorporation of the chitosan shows improved results on the water barrier properties of the bioplastic films. Optimum solubility in water, water absorption capacity, and water vapor permeability are obtained on the composition of starch/chitosan was 50/50. Actually, the addition of chitosan increased tensile strength, and elongation at break. The characterization of optimum mechanical proprieties also occurred on the 50/50 composition of cassava-starch and chitosan. At this ratio, tensile strength obtained were 6,3000 MPa; and the elongation at break were 62,8571%. It was found that cassava-starch/chitosan-based films have a stable structure compared to native cassava-starch films.


title: Hierarchical Event Descriptor library schema for EEG data annotation

abstract: Standardizing terminology to describe electrophysiological events can improve both clinical care and computational research. Sharing data enriched by such standardized terminology can support advances in neuroscientific data exploration, from single-subject to mega-analysis. Machine readability of electrophysiological event annotations is essential for performing such analyses efficiently across software tools and packages. Hierarchical Event Descriptors (HED) provide a framework for describing events in neuroscience experiments. HED library schemas extend the standard HED schema vocabulary to include specialized vocabularies, such as standardized clinical terms for electrophysiological events. The Standardized Computer-based Organized Reporting of EEG (SCORE) defines terms for annotating EEG events, including artifacts. This study makes SCORE machine-readable by incorporating it into a HED library schema. We demonstrate the use of the HED-SCORE library schema to annotate events in example EEG data stored in Brain Imaging Data Structure (BIDS) format. Clinicians and researchers worldwide can now use the HED-SCORE library schema to annotate and then compute on electrophysiological data obtained from the human brain.


title: New formulas and trees of Pythagorean triples

abstract: New formulas for the construction of Pythagorean triples and generalizations to equations of higher powers. Application of formulas to some problems, in particular Fermat's equation with n=4.


title: Trace and diffeomorphism anomalies of the classical Liouville theory, Virasoro algebras, Weyl-gauging and all that

abstract: To fully clarify the invariance of the classical Liouville field theory under the Virasoro algebra, we first elucidate in detail the concept of classical anomaly, discuss the occurrence of two symmetry algebras associated to this problem, and provide some new formulae to compute the classical center in a general fashion. We apply this to the study of the symmetries of the free boson in two dimensions. Moving to Liouville, we see how this gives rise to an energy-momentum tensor with non-tensorial conformal transformations, in flat space, and a non-vanishing trace, in curved space. We provide a variety of improvements of the (local) theory, that restore Weyl invariance. With explicit computations, we show that the covariant conservation of the Weyl-invariance-improved energy-momentum tensor is lost, in general, and relate the chosen improvement with the corresponding subset of preserved diffeomorphisms. The non-tensorial transformation rule of the Weyl-invariance-improved energy-momentum tensor in curved space is explicitly back-traced to the Virasoro center.


title: The Cornell black hole

abstract: The Cornell potential can be derived from a recently proposed non-local extension of Abelian electrodynamics. Non-locality can be alternatively described by an extended charge distributions in Maxwell electrodynamics. We state that in these models the energy momentum tensor necessarily requires the presence of the interaction term between the field and the charge itself. We show that this extended form of energy momentum tensor leads to an exact solution of the Einstein equations describing a charged AdS black hole. We refer to it as the "Cornell black hole"(CBH). Identifying the effective cosmological constant with the pressure of Van der Waals fluid, we study the gas-liquid phase transition and determine the critical parameters.


title: A Neuro-mimetic Realization of the Common Model of Cognition via Hebbian Learning and Free Energy Minimization

abstract: Over the last few years, large neural generative models, capable of synthesizing semantically rich passages of text or producing complex images, have recently emerged as a popular representation of what has come to be known as ``generative artificial intelligence'' (generative AI). Beyond opening the door to new opportunities as well as challenges for the domain of statistical machine learning, the rising popularity of generative AI brings with it interesting questions for Cognitive Science, which seeks to discover the nature of the processes that underpin minds and brains as well as to understand how such functionality might be acquired and instantianted in biological (or artificial) substrate. With this goal in mind, we argue that a promising research program lies in the crafting of cognitive architectures, a long-standing tradition of the field, cast fundamentally in terms of neuro-mimetic generative building blocks. Concretely, we discuss the COGnitive Neural GENerative system, such an architecture that casts the Common Model of Cognition in terms of Hebbian adaptation operating in service of optimizing a variational free energy functional.


title: Finite-size behavior in phase transitions and scaling in the progress of an epidemic

abstract: Analytical descriptions of patterns concerning spread and fatality during an epidemic, covering natural as well as restriction periods, are important for reducing damage. We employ a scaling model to investigate this aspect in the real data of COVID-19. It transpires from our study that the statistics of fatality in many geographical regions follow unique behavior, implying the existence of universality. Via Monte Carlo simulations in finite boxes, we also present results on coarsening dynamics in a generic model that is used frequently for the studies of phase transitions in various condensed matter systems. It is shown that the overall growth, in a large set of regions, concerning disease dynamics and that during phase transitions in a broad class of finite systems are closely related to each other and can be described via a single and compact mathematical function, thereby providing a new angle to the studies of the former. In the case of disease we have demonstrated that the employed scaling model has predictive capability, even for periods with complex social restrictions. These results are of much general epidemiological relevance.


title: Reducing Uncertainty in Sea-level Rise Prediction: A Spatial-variability-aware Approach

abstract: Given multi-model ensemble climate projections, the goal is to accurately and reliably predict future sea-level rise while lowering the uncertainty. This problem is important because sea-level rise affects millions of people in coastal communities and beyond due to climate change's impacts on polar ice sheets and the ocean. This problem is challenging due to spatial variability and unknowns such as possible tipping points (e.g., collapse of Greenland or West Antarctic ice-shelf), climate feedback loops (e.g., clouds, permafrost thawing), future policy decisions, and human actions. Most existing climate modeling approaches use the same set of weights globally, during either regression or deep learning to combine different climate projections. Such approaches are inadequate when different regions require different weighting schemes for accurate and reliable sea-level rise predictions. This paper proposes a zonal regression model which addresses spatial variability and model inter-dependency. Experimental results show more reliable predictions using the weights learned via this approach on a regional scale.

categories: physics.ao-ph cs.AI cs.LG math.DS stat.OT


title: Lorentzian path integral in Kantowski-Sachs anisotropic cosmology

abstract: Motivated by the recent development in quantum cosmology, we revisit the anisotropic Kantowski-Sachs model in the light of a Lorentzian path integral formalism. Studies so far have considered the Euclidean method where the choice of the lapse integration contour is constrained by certain physical considerations rather than mathematical justification. In this paper, we have studied the Hartle-Hawking no-boundary proposal along with the use of Picard-Lefschetz theory in performing the lapse integration. In an isotropic limit, we show our results agree with the studies made in FLRW cosmology. We also observe that in the large scale structure the no-boundary proposal tends towards a conical singularity at the beginning of time. We have also performed a massless scalar perturbation analysis with no back reaction. This reveals that if there were any perturbation present at the beginning of the universe then that would flare up at the final boundary.


title: Poisson structure and Integrability of a Hamiltonian flow for the inhomogeneous six-vertex model

abstract: We compute the action-angle variables for a Hamiltonian flow of the inhomogeneous six-vertex model, from a formulation introduced in a 2022 work due to Keating, Reshetikhin, and Sridhar, hence confirming a conjecture of the authors as to whether the Hamiltonian flow is integrable. To demonstrate that such an integrability property of the Hamiltonian holds from the action-angle variables, we make use of previous methods for studying Hamiltonian systems, implemented by Faddeev and Takhtajan, in which it was shown that integrability of a Hamiltonian system holds for the nonlinear Schrodinger's equation by computing action-angle variables from the Poisson bracket, which is connected to the analysis of entries of the monodromy and transfer matrices. For the inhomogeneous six-vertex model, an approach for computing the action-angle variables is possible through formulating several relations between entries of the quantum monodromy, and transfer, matrices, which can be not only be further examined from the structure of $L$ operators, but also from computing several Poisson brackets parameterized from entries of the monodromy matrix.

categories: math-ph cond-mat.stat-mech math.MP math.PR nlin.SI


title: Topological classes of thermodynamics of black holes in perfect fluid dark matter background

abstract: In this paper we explore the topological classes of thermodynamics of a family of black holes. In particular we investigate the influence of distinct fields, including the electric field, non-linear magnetic field, along with the perfect fluid matter background that can mimic dark matter in large distances. In light of these considerations, we shall henceforth denote this fluid as perfect fluid dark matter (PFDM). Our analysis reveals that the winding and topological numbers for the Schwarzschild and Kerr black holes in PFDM background are the same as the Schwarzschild and Kerr black holes, however for the Kerr-AdS background in PFDM we obtain a different topological number compared to the Kerr black hole in PFDM. Furthermore, we explore in details the interplay of electric charge and nonlinear magnetic charge, impacting the topological classes of thermodynamics both in the absence and presence of PFDM. Interestingly, it is demonstrated that the topological numbers associated with the static Hayward black holes, both in the absence and presence of PFDM, deviate from those of the Schwarzschild black hole. This observation shows that the presence of a magnetic charge introduces an additional role and can alter the topological numbers. Finally, our study culminates with the comprehensive analysis of the topological numbers pertaining to the Hayward black hole, considering the combined effects of PFDM and rotation.


title: Graphical Processing of Geodesic Propagation in Python

abstract: Black holes and other compact objects are powerful tools to observationally test Einsteins theory of General Relativity. We develop raytracing code to create visual images of compact objects that are solutions of Einsteins field equations. These include Kerr black holes and Manko-Novikov spacetimes with extra independent multipole moments. Using parallel processing on a graphical processing unit we can trace the millions of geodesics required to create such images of compact objects. The loss of symmetry in Manko-Novikov spacetime leads to strange features such as chaotic regions in the dynamics. We also analyse other properties of geodesics, such as their exit times from the strong field nearby the object, their redshift, or behaviour near capture regions. We also add objects such as accretion disks to our spacetime, and determine how they are lensed by the object. The main draw of this code is it's efficiency and simplicity, as it allows for creating these images even on older hardware, while still allowing any time independent metric to be studied. The code is publicly available on github.


title: Thermal Purcell effect and cavity-induced renormalization of dissipations

abstract: In recent years there has been great interest towards optical cavities as a tool to manipulate the properties and phases of embedded quantum materials. Due to the Purcell effect, a cavity changes the photon phase space and thus the rate of electromagnetic transitions within the material, modifying the exchange rate of heat radiation with the photon environment. Here, I derive a simple expression for the radiative heat power absorbed by the material, investigate how it changes in the presence of a cavity and show that it is enhanced dramatically for appropriate cavity geometries. I compare this effect with typical energy dissipation processes, provide a criterion to establish its impact on the temperature of a material coupled to the cavity and apply it to 1T-TaS$_2$.


title: Real particle geodesics and thermodynamics of a black hole in Regular Schwarzschild-Anti de Sitter space-time

abstract: In this work, we illustrate the geodesics of real particles obtained numerically in a Regular Schwarzschild Anti-de Sitter (RSch-AdS) space-time. The behavior of these geodesics are considered depending on variation of effective parameters such as mass distribution, angular momentum and cosmological constant. Also, using the laws of thermodynamics of black holes, we will study and discuss some aspect of black hole (BH) described by this spacetime such as temperature, entropy, heat capacity and Gibbs free energy.


abstract: The existence of Schwarzchild black holes in the structure of Swiss-cheese brane-world led to the argument that this specific brane-world scenario is more realistic than the FLRW branes. In this paper, we show that a Logamediate inflation on the Swiss-cheese brane leads to a positive kinetic term and a negative potential with AdS minimum. While cosmic pressure is always positive, the energy density starts to get negative after a finite time and there is a time interval where both $\rho$ and $p$ are positive. Although this can be considered as a drawback of Swiss-cheese brane as positive energy dominates the present universe, it has been suggested that the presence of some source of negative energy could have played a significant role in early cosmic expansion. The model also suffers from the eternal inflation problem. Due to the existence of $\rho^2$ term, we have tested the new nonlinear energy conditions. The cosmographic and slow-roll parameters have been investigated.


title: Multi-Spacecraft Magnetic Field Reconstructions: A Cross-Scale Comparison of Methods

abstract: Space plasma studies frequently use in situ magnetic field measurements taken from many spacecraft simultaneously. A useful data product of these measurements is the reconstructed magnetic field in a volume near the spacecraft observatory. We compare a standard method of computing the magnetic field at arbitrary spatial points, the Curlometer, to two novel approaches: a Radial Basis Function interpolation and a time-dependent 2D inverse distance weighted interpolation scheme called Timesync. These three methods, which only require in situ measurements of the magnetic fields and bulk plasma velocities at a sparse set of spatial points, are implemented on synthetic data drawn from a time-evolving numerical simulation of plasma turbulence. We compare both the topology of the reconstructed field to the ground truth of the simulation and the statistics of the fluctuations found in the reconstructed field to those from the simulated turbulence. We conclude that the Radial Basis Function and Timesync methods outperform the Curlometer in both the topological and statistical comparisons.


title: Deep Learning Approaches for Dynamic Mechanical Analysis of Viscoelastic Fiber Composites

abstract: The increased adoption of reinforced polymer (RP) composite materials, driven by eco-design standards, calls for a fine balance between lightness, stiffness, and effective vibration control. These materials are integral to enhancing comfort, safety, and energy efficiency. Dynamic Mechanical Analysis (DMA) characterizes viscoelastic behavior, yet there's a growing interest in using Machine Learning (ML) to expedite the design and understanding of microstructures. In this paper we aim to map microstructures to their mechanical properties using deep neural networks, speeding up the process and allowing for the generation of microstructures from desired properties.


title: Towards Subject Agnostic Affective Emotion Recognition

abstract: This paper focuses on affective emotion recognition, aiming to perform in the subject-agnostic paradigm based on EEG signals. However, EEG signals manifest subject instability in subject-agnostic affective Brain-computer interfaces (aBCIs), which led to the problem of distributional shift. Furthermore, this problem is alleviated by approaches such as domain generalisation and domain adaptation. Typically, methods based on domain adaptation confer comparatively better results than the domain generalisation methods but demand more computational resources given new subjects. We propose a novel framework, meta-learning based augmented domain adaptation for subject-agnostic aBCIs. Our domain adaptation approach is augmented through meta-learning, which consists of a recurrent neural network, a classifier, and a distributional shift controller based on a sum-decomposable function. Also, we present that a neural network explicating a sum-decomposable function can effectively estimate the divergence between varied domains. The network setting for augmented domain adaptation follows meta-learning and adversarial learning, where the controller promptly adapts to new domains employing the target data via a few self-adaptation steps in the test phase. Our proposed approach is shown to be effective in experiments on a public aBICs dataset and achieves similar performance to state-of-the-art domain adaptation methods while avoiding the use of additional computational resources.


title: Fast Path Planning for Autonomous Vehicle Parking with Safety-Guarantee using Hamilton-Jacobi Reachability

abstract: We present a fast planning architecture called Hamilton-Jacobi-based bidirectional A* (HJBA*) to solve general tight parking scenarios. The algorithm is a two-layer composed of a high-level HJ-based reachability analysis and a lower-level bidirectional A* search algorithm. In high-level reachability analysis, a backward reachable tube (BRT) concerning vehicle dynamics is computed by the HJ analysis and it intersects with a safe set to get a safe reachable set. The safe set is defined by constraints of positive signed distances for obstacles in the environment and computed by solving QP optimization problems offline. For states inside the intersection set, i.e., the safe reachable set, the computed backward reachable tube ensures they are reachable subjected to system dynamics and input bounds, and the safe set guarantees they satisfy parking safety with respect to obstacles in different shapes. For online computation, randomized states are sampled from the safe reachable set, and used as heuristic guide points to be considered in the bidirectional A* search. The bidirectional A* search is paralleled for each randomized state from the safe reachable set. We show that the proposed two-level planning algorithm is able to solve different parking scenarios effectively and computationally fast for typical parking requests. We validate our algorithm through simulations in large-scale randomized parking scenarios and demonstrate it to be able to outperform other state-of-the-art parking planning algorithms.


title: Application of deep and reinforcement learning to boundary control problems

abstract: The boundary control problem is a non-convex optimization and control problem in many scientific domains, including fluid mechanics, structural engineering, and heat transfer optimization. The aim is to find the optimal values for the domain boundaries such that the enclosed domain adhering to the governing equations attains the desired state values. Traditionally, non-linear optimization methods, such as the Interior-Point method (IPM), are used to solve such problems. This project explores the possibilities of using deep learning and reinforcement learning to solve boundary control problems. We adhere to the framework of iterative optimization strategies, employing a spatial neural network to construct well-informed initial guesses, and a spatio-temporal neural network learns the iterative optimization algorithm using policy gradients. Synthetic data, generated from the problems formulated in the literature, is used for training, testing and validation. The numerical experiments indicate that the proposed method can rival the speed and accuracy of existing solvers. In our preliminary results, the network attains costs lower than IPOPT, a state-of-the-art non-linear IPM, in 51\% cases. The overall number of floating point operations in the proposed method is similar to that of IPOPT. Additionally, the informed initial guess method and the learned momentum-like behaviour in the optimizer method are incorporated to avoid convergence to local minima.


title: Hamilton-Jacobi formalism to warm anisotropic inflation

abstract: Warm inflation in the framework of locally rotationally symmetric Bianchi type I universe model in the Hamilton-Jacobi formalism is being considered. Matter-Radiation fluid in warm inflation, endowed with and without a viscous pressure. For the tow different cases dynamical equations are obtained under slow-roll approximation and in the strong dissipative regime. Special case of dissipation and bulk viscous pressure coefficients are considered. Warm anisotropic inflationary model is compatible with observational data. But for warm anisotropic inflation with viscous pressure in the first case where dissipation and bulk viscous pressure coefficients are considered to be constant, perturbation parameters are not compatible with observational data. In the case where dissipation and bulk viscous pressure coefficients are considered to be variable, the perturbation parameters are compatible with Plank data.


title: Analysis of four sets of global average temperature anomalies

abstract: Four sets of global average temperature anomalies, altered so that they refer to pre-industrial temperature levels (baseline), as recommended by the Intergovernmental Panel on Climate Change, are analysed in this study. Expectation values of the time, at which the crossing of the $1.5^\circ$C threshold above the baseline will occur, are extracted from the two datasets which are accompanied by meaningful uncertainties; the two estimates are in the 2030s and differ by about four years: mid-2032 and mid-2036.


title: How do the resting EEG preprocessing states affect the outcomes of postprocessing?

abstract: Plenty of artifact removal tools and pipelines have been developed to correct the EEG recordings and discover the values below the waveforms. Without visual inspection from the experts, it is susceptible to derive improper preprocessing states, like the insufficient preprocessed EEG (IPE), and the excessive preprocessed EEG (EPE). However, little is known about the impacts of IPE or EPE on the postprocessing in the frequency, spatial and temporal domains, particularly as to the spectra and the functional connectivity (FC) analysis. Here, the clean EEG (CE) was synthesized as the ground truth based on the New-York head model and the multivariate autoregressive model. Later, the IPE and the EPE were simulated by injecting the Gaussian noise and losing the brain activities, respectively. Then, the impacts on postprocessing were quantified by the deviation caused by the IPE or EPE from the CE as to the 4 temporal statistics, the multichannel power, the cross spectra, the dispersion of source imaging, and the properties of scalp EEG network. Lastly, the association analysis was performed between the PaLOSi metric and the varying trends of postprocessing with the evolution of preprocessing states. This study shed light on how the postprocessing outcomes are affected by the preprocessing states and PaLOSi may be a potential effective quality metric.


title: Neural Multi-Objective Combinatorial Optimization with Diversity Enhancement

abstract: Most of existing neural methods for multi-objective combinatorial optimization (MOCO) problems solely rely on decomposition, which often leads to repetitive solutions for the respective subproblems, thus a limited Pareto set. Beyond decomposition, we propose a novel neural heuristic with diversity enhancement (NHDE) to produce more Pareto solutions from two perspectives. On the one hand, to hinder duplicated solutions for different subproblems, we propose an indicator-enhanced deep reinforcement learning method to guide the model, and design a heterogeneous graph attention mechanism to capture the relations between the instance graph and the Pareto front graph. On the other hand, to excavate more solutions in the neighborhood of each subproblem, we present a multiple Pareto optima strategy to sample and preserve desirable solutions. Experimental results on classic MOCO problems show that our NHDE is able to generate a Pareto front with higher diversity, thereby achieving superior overall performance. Moreover, our NHDE is generic and can be applied to different neural methods for MOCO.


title: Efficient Meta Neural Heuristic for Multi-Objective Combinatorial Optimization

abstract: Recently, neural heuristics based on deep reinforcement learning have exhibited promise in solving multi-objective combinatorial optimization problems (MOCOPs). However, they are still struggling to achieve high learning efficiency and solution quality. To tackle this issue, we propose an efficient meta neural heuristic (EMNH), in which a meta-model is first trained and then fine-tuned with a few steps to solve corresponding single-objective subproblems. Specifically, for the training process, a (partial) architecture-shared multi-task model is leveraged to achieve parallel learning for the meta-model, so as to speed up the training; meanwhile, a scaled symmetric sampling method with respect to the weight vectors is designed to stabilize the training. For the fine-tuning process, an efficient hierarchical method is proposed to systematically tackle all the subproblems. Experimental results on the multi-objective traveling salesman problem (MOTSP), multi-objective capacitated vehicle routing problem (MOCVRP), and multi-objective knapsack problem (MOKP) show that, EMNH is able to outperform the state-of-the-art neural heuristics in terms of solution quality and learning efficiency, and yield competitive solutions to the strong traditional heuristics while consuming much shorter time.


title: Can strong structural encoding reduce the importance of Message Passing?

abstract: The most prevalent class of neural networks operating on graphs are message passing neural networks (MPNNs), in which the representation of a node is updated iteratively by aggregating information in the 1-hop neighborhood. Since this paradigm for computing node embeddings may prevent the model from learning coarse topological structures, the initial features are often augmented with structural information of the graph, typically in the form of Laplacian eigenvectors or Random Walk transition probabilities. In this work, we explore the contribution of message passing when strong structural encodings are provided. We introduce a novel way of modeling the interaction between feature and structural information based on their tensor product rather than the standard concatenation. The choice of interaction is compared in common scenarios and in settings where the capacity of the message-passing layer is severely reduced and ultimately the message-passing phase is removed altogether. Our results indicate that using tensor-based encodings is always at least on par with the concatenation-based encoding and that it makes the model much more robust when the message passing layers are removed, on some tasks incurring almost no drop in performance. This suggests that the importance of message passing is limited when the model can construct strong structural encodings.


title: Quantitative errors in the Cochrane review on "Physical interventions to interrupt or reduce the spread of respiratory viruses"

abstract: The COVID-19 pandemic has heightened the urgency to understand and prevent pathogen transmission, specifically regarding infectious airborne particles. Extensive studies validate the understanding of larger (droplets) and smaller (aerosols) particles in disease transmission. Similarly, N95 respirators, and other forms of respiratory protection, have proven efficacy in reducing the risk of infection across various environments. Even though multiple studies confirm their protective effect when adopted in healthcare and public settings for infection prevention, studies on their adoption over the last several decades in both clinical trials and observational studies have not provided as clear an understanding. Here we show that the standard analytical equations used in the analysis of these studies do not accurately represent the random variables impacting study results. By correcting these equations, it is demonstrated that conclusions drawn from these studies are heavily biased and uncertain, providing little useful information. Despite these limitations, we show that when outcome measures are properly analyzed, existing results consistently point to the benefit of N95 respirators over medical masks, and masking over its absence. Correcting errors in widely reported meta-analyses also yields statistically significant estimates. These findings have important implications for study design and using existing evidence for infection control policy guidelines.


title: Characteristic p approaches to the Jacobian Conjecture

abstract: We present several versions of the Jacobian Conjecture in positive characteristic each of which if true would imply the Jacobian conjecture in characteristic 0. We test these characteristic p versions of the conjecture against several families of Jacobian pairs in characteristic p. Based on the results we propose a characteristic p approach to solving the Jacobian Conjecture in characteristic 0.


title: Open-Set Image Tagging with Multi-Grained Text Supervision

abstract: In this paper, we introduce the Recognize Anything Plus Model (RAM++), an open-set image tagging model effectively leveraging multi-grained text supervision. Previous approaches (e.g., CLIP) primarily utilize global text supervision paired with images, leading to sub-optimal performance in recognizing multiple individual semantic tags. In contrast, RAM++ seamlessly integrates individual tag supervision with global text supervision, all within a unified alignment framework. This integration not only ensures efficient recognition of predefined tag categories, but also enhances generalization capabilities for diverse open-set categories. Furthermore, RAM++ employs large language models (LLMs) to convert semantically constrained tag supervision into more expansive tag description supervision, thereby enriching the scope of open-set visual description concepts. Comprehensive evaluations on various image recognition benchmarks demonstrate RAM++ exceeds existing state-of-the-art (SOTA) open-set image tagging models on most aspects. Specifically, for predefined commonly used tag categories, RAM++ showcases 10.2 mAP and 15.4 mAP enhancements over CLIP on OpenImages and ImageNet. For open-set categories beyond predefined, RAM++ records improvements of 5.0 mAP and 6.4 mAP over CLIP and RAM respectively on OpenImages. For diverse human-object interaction phrases, RAM++ achieves 7.8 mAP and 4.7 mAP improvements on the HICO benchmark. Code, datasets and pre-trained models are available at \url{https://github.com/xinyu1205/recognize-anything}.


title: A Skin Microbiome Model with AMP interactions and Analysis of Quasi-Stability vs Stability in Population Dynamics

abstract: The skin microbiome plays an important role in the maintenance of a healthy skin. It is an ecosystem, composed of several species, competing for resources and interacting with the skin cells. Imbalance in the cutaneous microbiome, also called dysbiosis, has been correlated with several skin conditions, including acne and atopic dermatitis. Generally, dysbiosis is linked to colonization of the skin by a population of opportunistic pathogenic bacteria. Treatments consisting in non-specific elimination of cutaneous microflora have shown conflicting results. In this article, we introduce a mathematical model based on ordinary differential equations, with 2 types of bacteria populations (skin commensals and opportunistic pathogens) and including the production of antimicrobial peptides to study the mechanisms driving the dominance of one population over the other. By using published experimental data, assumed to correspond to the observation of stable states in our model, we reduce the number of parameters of the model from 13 to 5. We then use a formal specification in quantitative temporal logic to calibrate our model by global parameter optimization and perform sensitivity analyses. On the time scale of 2 days of the experiments, the model predicts that certain changes of the environment, like the elevation of skin surface pH, create favorable conditions for the emergence and colonization of the skin by the opportunistic pathogen population, while the production of human AMPs has non-linear effect on the balance between pathogens and commensals. Surprisingly, simulations on longer time scales reveal that the equilibrium reached around 2 days can in fact be a quasi-stable state followed by the reaching of a reversed stable state after 12 days or more. We analyse the conditions of quasi-stability observed in this model using tropical algebraic methods, and show their non-generic character in contrast to slow-fast systems. These conditions are then generalized to a large class of population dynamics models over any number of species.


title: Predicting Transcription Factor Binding Sites using Transformer based Capsule Network

abstract: Prediction of binding sites for transcription factors is important to understand how they regulate gene expression and how this regulation can be modulated for therapeutic purposes. Although in the past few years there are significant works addressing this issue, there is still space for improvement. In this regard, a transformer based capsule network viz. DNABERT-Cap is proposed in this work to predict transcription factor binding sites mining ChIP-seq datasets. DNABERT-Cap is a bidirectional encoder pre-trained with large number of genomic DNA sequences, empowered with a capsule layer responsible for the final prediction. The proposed model builds a predictor for transcription factor binding sites using the joint optimisation of features encompassing both bidirectional encoder and capsule layer, along with convolutional and bidirectional long-short term memory layers. To evaluate the efficiency of the proposed approach, we use a benchmark ChIP-seq datasets of five cell lines viz. A549, GM12878, Hep-G2, H1-hESC and Hela, available in the ENCODE repository. The results show that the average area under the receiver operating characteristic curve score exceeds 0.91 for all such five cell lines. DNABERT-Cap is also compared with existing state-of-the-art deep learning based predictors viz. DeepARC, DeepTF, CNN-Zeng and DeepBind, and is seen to outperform them.


title: Mean reflected BSDE driven by a marked point process and application in insurance risk management

abstract: This paper aims to solve a super-hedging problem along with insurance re-payment under running risk management constraints. The initial endowment for the super-heding problem is characterized by a class of mean reflected backward stochastic differential equation driven by a marked point process (MPP) and a Brownian motion. By Lipschitz assumptions on the generators and proper integrability on the terminal value, we give the well-posedness of this kind of BSDEs by combining a representation theorem with the fixed point argument.


title: Mid-Long Term Daily Electricity Consumption Forecasting Based on Piecewise Linear Regression and Dilated Causal CNN

abstract: Daily electricity consumption forecasting is a classical problem. Existing forecasting algorithms tend to have decreased accuracy on special dates like holidays. This study decomposes the daily electricity consumption series into three components: trend, seasonal, and residual, and constructs a two-stage prediction method using piecewise linear regression as a filter and Dilated Causal CNN as a predictor. The specific steps involve setting breakpoints on the time axis and fitting the piecewise linear regression model with one-hot encoded information such as month, weekday, and holidays. For the challenging prediction of the Spring Festival, distance is introduced as a variable using a third-degree polynomial form in the model. The residual sequence obtained in the previous step is modeled using Dilated Causal CNN, and the final prediction of daily electricity consumption is the sum of the two-stage predictions. Experimental results demonstrate that this method achieves higher accuracy compared to existing approaches.


title: DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuning

abstract: We propose Multiple Experts Fine-tuning Framework to build a financial large language model (LLM), DISC-FinLLM. Our methodology improves general LLMs by endowing them with multi-turn question answering abilities, domain text processing capabilities, mathematical computation skills, and retrieval-enhanced generation capabilities. We build a financial instruction-tuning dataset named DISC-FIN-SFT, including instruction samples of four categories (consulting, NLP tasks, computing and retrieval-augmented generation). Evaluations conducted on multiple benchmarks demonstrate that our model performs better than baseline models in various financial scenarios. Further resources can be found at https://github.com/FudanDISC/DISC-FinLLM.


title: GOLEM: distribution of Gene regulatOry eLEMents within the plant promoters

abstract: Motivation: The regulation of gene expression during tissue development is extremely complex. One of the key regulatory mechanisms of gene expression involves the recognition of regulatory motifs by various proteins in the promoter regions of many genes. Localisation of these motifs in proximity to the transcription start site (TSS) or translation start site (ATG) is critical for regulating the initiation and rate of transcription. The levels of transcription of individual genes, regulated by these motifs, can vary signifi cantly in diff erent tissues and developmental stages, especially during tightly regulated processes such as sexual reproduction. However, the precise localisation and visualisation of the regulatory motifs within gene promoters with respect to gene transcription in specifi c tissues, can be challenging. Results: Here, we introduce a program called GOLEM (Gene regulatOry eLEMents) which enables users to precisely locate any motif of interest with respect to TSS or ATG within the relevant plant genomes across the plant Tree of Life (Marchantia, Physcomitrium, Amborella, Oryza, Zea, Solanum and Arabidopsis). The visualisation of the motifs is performed with respect to the transcript levels of particular genes in leaves and male reproductive tissues, and can be compared with genome-wide distribution regardless of the transcription level. Availability and implementation: GOLEM is freely available at https://golem.ncbr.muni.cz and its source codes are provided under the MIT licence at GitHub at https://github.com/sb-ncbr/golem.


title: Dwork-type $q$-congruences through the $q$-Lucas theorem

abstract: Employing the $q$-Lucas theorem and some known $q$-supercongruences, we give some Dwork-type $q$-congruences, confirming three conjectures in [J. Combin. Theory, Ser. A 178 (2021), Art.~105362]. As conclusions, we obtain the following supercongruences: for any prime $p\equiv 1\pmod{4}$ and positive integer $r$, \begin{align*} \sum_{k=0}^{(p^r-1)/2} \frac{(\frac{1}{2})_k^3}{k!^3} &\equiv -\Gamma_p(\tfrac{1}{4})^4 \sum_{k=0}^{(p^{r-1}-1)/2} \frac{(\frac{1}{2})_k^3}{k!^3} \pmod{p^{r+1}}, \\ \sum_{k=0}^{p^r-1} \frac{(\frac{1}{2})_k^3}{k!^3} &\equiv -\Gamma_p(\tfrac{1}{4})^4 \sum_{k=0}^{p^{r-1}-1} \frac{(\frac{1}{2})_k^3}{k!^3} \pmod{p^{r+1}}, \end{align*} where $\Gamma_p(x)$ stands for the $p$-adic Gamma function. The first one confirms a weaker form of Swisher's (H.3) conjecture for $p\equiv 1\pmod{4}$, which originally predicts that the supercongruence is true modulo $p^{3r}$.


title: Simulation of adaptive feedforward control for magnetic alloy cavity

abstract: The upgrade plan of the China Spallation Neutron Source aims to enhance the beam power from 100 kW to 500 kW. To achieve this, the plan involves incorporating three new magnetic alloy cavities while maintaining the existing system to enable double harmonic acceleration. As a consequence of the increased current intensity, the beam loading effect will be significantly amplified, presenting a considerable challenge for the low-level RF control system of the magnetic alloy cavity. To address this challenge, an adaptive feedforward algorithm has been developed to enable optimal control. In addition, comprehensive simulations of the algorithm have been successfully conducted to validate its.


title: DeepOrientation: convolutional neural network for fringe pattern orientation map estimation

abstract: Fringe pattern based measurement techniques are the state-of-the-art in full-field optical metrology. They are crucial both in macroscale, e.g., fringe projection profilometry, and microscale, e.g., label-free quantitative phase microscopy. Accurate estimation of the local fringe orientation map can significantly facilitate the measurement process on various ways, e.g., fringe filtering (denoising), fringe pattern boundary padding, fringe skeletoning (contouring/following/tracking), local fringe spatial frequency (fringe period) estimation and fringe pattern phase demodulation. Considering all of that the accurate, robust and preferably automatic estimation of local fringe orientation map is of high importance. In this paper we propose novel numerical solution for local fringe orientation map estimation based on convolutional neural network and deep learning called DeepOrientation. Numerical simulations and experimental results corroborate the effectiveness of the proposed DeepOrientation comparing it with the representative of the classical approach to orientation estimation called combined plane fitting/gradient method. The example proving the effectiveness of DeepOrientation in fringe pattern analysis, which we present in this paper is the application of DeepOrientation for guiding the phase demodulation process in Hilbert spiral transform. In particular, living HeLa cells quantitative phase imaging outcomes verify the method as an important asset in label-free microscopy.


title: Monotonicity of the imaginary part of the Riemann $\xi$ function in the region $S$

abstract: This paper proves that the imaginary part of the Riemann $\xi$ function is strictly monotonic with $b$ in the region $S = \{t|t=a+bi,\ 0\leq a \leq 9.508,\ -1/2<b<1/2\}$. That leads to Im($\xi$)=0 being true only when $b=0$ in $S$.


title: Modeling Path Importance for Effective Alzheimer's Disease Drug Repurposing

abstract: Recently, drug repurposing has emerged as an effective and resource-efficient paradigm for AD drug discovery. Among various methods for drug repurposing, network-based methods have shown promising results as they are capable of leveraging complex networks that integrate multiple interaction types, such as protein-protein interactions, to more effectively identify candidate drugs. However, existing approaches typically assume paths of the same length in the network have equal importance in identifying the therapeutic effect of drugs. Other domains have found that same length paths do not necessarily have the same importance. Thus, relying on this assumption may be deleterious to drug repurposing attempts. In this work, we propose MPI (Modeling Path Importance), a novel network-based method for AD drug repurposing. MPI is unique in that it prioritizes important paths via learned node embeddings, which can effectively capture a network's rich structural information. Thus, leveraging learned embeddings allows MPI to effectively differentiate the importance among paths. We evaluate MPI against a commonly used baseline method that identifies anti-AD drug candidates primarily based on the shortest paths between drugs and AD in the network. We observe that among the top-50 ranked drugs, MPI prioritizes 20.0% more drugs with anti-AD evidence compared to the baseline. Finally, Cox proportional-hazard models produced from insurance claims data aid us in identifying the use of etodolac, nicotine, and BBB-crossing ACE-INHs as having a reduced risk of AD, suggesting such drugs may be viable candidates for repurposing and should be explored further in future studies.


title: Photoemission study and band alignment of GaN passivation layers on GaInP heterointerface

abstract: III-V semiconductor-based photoelectrochemical (PEC) devices show the highest solar-to-electricity or solar-to-fuel conversion efficiencies. GaInP is a relevant top photoabsorber layer or a charge-selective contact in PEC for integrated and direct solar fuel production, due to its tunable lattice constant, electronic band structure, and favorable optical properties. To enhance the stability of its surface against chemical corrosion which leads to decomposition, we deposit a GaN protection and passivation layer. The n-doped GaInP(100) epitaxial layers were grown by metalorganic chemical vapor deposition on top of GaAs(100) substrate. Subsequently, thin 1-20 nm GaN films were grown on top of the oxidized GaInP surfaces by atomic layer deposition. We studied the band alignment of these multi-junction heterostructures by X-ray and ultraviolet photoelectron spectroscopy. Due to the limited emission depth of photoelectrons, we determined the band alignment by a series of separate measurements in which we either modified the GaInP(100) surface termination or the film thickness of the grown GaN on GaInP(100) buffer layers. On n-GaInP(100) surfaces prepared with the well-known phosphorus-rich (2x2)/c(4x2) reconstruction we found up-ward surface band bending (BB) of 0.34 eV, and Fermi level pinning due to the present surface states. Upon oxidation, the surface states are partially passivated resulting in a reduction of BB to 0.12 eV and a valence band offset (VBO) between GaInP and oxide bands of 2.0 eV. Between the GaInP(100) buffer layer and the GaN passivation layer, we identified a VBO of 1.8 eV. The corresponding conduction band offset of -0.2 eV is found to be rather small. Therefore, we evaluate the application of the GaN passivation layer as a promising technological step not only to reduce surface states but also to increase the stability of the surfaces of photoelectrochemical devices.


title: Function Vectors in Large Language Models

abstract: We report the presence of a simple neural mechanism that represents an input-output function as a vector within autoregressive transformer language models (LMs). Using causal mediation analysis on a diverse range of in-context-learning (ICL) tasks, we find that a small number attention heads transport a compact representation of the demonstrated task, which we call a function vector (FV). FVs are robust to changes in context, i.e., they trigger execution of the task on inputs such as zero-shot and natural text settings that do not resemble the ICL contexts from which they are collected. We test FVs across a range of tasks, models, and layers and find strong causal effects across settings in middle layers. We investigate the internal structure of FVs and find while that they often contain information that encodes the output space of the function, this information alone is not sufficient to reconstruct an FV. Finally, we test semantic vector composition in FVs, and find that to some extent they can be summed to create vectors that trigger new complex tasks. Our findings show that compact, causal internal vector representations of function abstractions can be explicitly extracted from LLMs. Our code and data are available at https://functions.baulab.info.


title: Can prompt cusps of WIMP dark matter be detected as individual gamma-ray sources?

abstract: Prompt $\rho\propto r^{-1.5}$ density cusps are the densest and most abundant dark matter systems. If the dark matter is a weakly interacting massive particle (WIMP), recent studies have shown that prompt cusps dominate the aggregate dark matter annihilation rate. This article explores whether individual prompt cusps could be detected as gamma-ray sources. At the Fermi telescope's point-source sensitivity, WIMPs with the canonical annihilation cross section could form detectable prompt cusps if the particle mass is of order 10 GeV. These objects could be 10-100 pc away and weigh under a solar mass; they would subtend around 0.1 degrees on the sky. For GeV-scale dark matter particles with below-canonical cross sections, searches for individual prompt cusps can be more sensitive than searches for the annihilation signals from galactic dark matter halos.


title: X-ray Astronomy from the Lunar Surface

abstract: Motivated by efforts to return humanity to the Moon, three cases are reviewed for X-ray astronomy from the lunar surface: (1) Facilitation of ambitious engineering designs including high throughput telescopes, long focal length optics and X-ray interferometery; (2) Occultation studies and the gain they enable in astrometric precision; (3) Multimessenger time-domain coordinated observations. The potential benefits of, and challenges presented by, operating from the Moon are discussed. Some of these cases have relatively low mass budgets and could be conducted as early pathfinders, while others are more ambitious and will likely need to await improvements in technology or well-developed lunar bases.