title: LatticeGen: A Cooperative Framework which Hides Generated Text in a Lattice for Privacy-Aware Generation on Cloud

abstract: In the current user-server interaction paradigm of prompted generation with large language models (LLM) on cloud, the server fully controls the generation process, which leaves zero options for users who want to keep the generated text to themselves. We propose LatticeGen, a cooperative framework in which the server still handles most of the computation while the user controls the sampling operation. The key idea is that the true generated sequence is mixed with noise tokens by the user and hidden in a noised lattice. Considering potential attacks from a hypothetically malicious server and how the user can defend against it, we propose the repeated beam-search attack and the mixing noise scheme. In our experiments we apply LatticeGen to protect both prompt and generation. It is shown that while the noised lattice degrades generation quality, LatticeGen successfully protects the true generation to a remarkable degree under strong attacks (more than 50% of the semantic remains hidden as measured by BERTScore).


title: Compromise in Multilateral Negotiations and the Global Regulation of Artificial Intelligence

abstract: As artificial intelligence (AI) technologies spread worldwide, international discussions have increasingly focused on their consequences for democracy, human rights, fundamental freedoms, security, and economic and social development. In this context, UNESCO's Recommendation on the Ethics of Artificial Intelligence, adopted in November 2021, has emerged as the first global normative framework for AI development and deployment. The intense negotiations of every detail of the document brought forth numerous controversies among UNESCO member states. Drawing on a unique set of primary sources, including written positions and recorded deliberations, this paper explains the achievement of global compromise on AI regulation despite the multiplicity of UNESCO member-state positions representing a variety of liberal and sovereignist preferences. Building upon Boltanski's pragmatic sociology, it conceptualises the practice of multilateral negotiations and attributes the multilateral compromise to two embedded therein mechanisms: Structural normative hybridity and situated normative ambiguity allowed to accomplish a compromise by linking macro-normative structures with situated debates of multilateral negotiations.


title: Numerically computed Double, Triple, and Quadruple Planar Bubbles for Density $r^p$

abstract: Using Brakke's Evolver, we numerically verify conjectured optimal planar double bubbles for density $r^p$ and provide conjectures for triple and quadruple bubbles.


title: Redistributing the Precision and Content in 3D-LUT-based Inverse Tone-mapping for HDR/WCG Display

abstract: ITM(inverse tone-mapping) converts SDR (standard dynamic range) footage to HDR/WCG (high dynamic range /wide color gamut) for media production. It happens not only when remastering legacy SDR footage in front-end content provider, but also adapting on-theair SDR service on user-end HDR display. The latter requires more efficiency, thus the pre-calculated LUT (look-up table) has become a popular solution. Yet, conventional fixed LUT lacks adaptability, so we learn from research community and combine it with AI. Meanwhile, higher-bit-depth HDR/WCG requires larger LUT than SDR, so we consult traditional ITM for an efficiency-performance trade-off: We use 3 smaller LUTs, each has a non-uniform packing (precision) respectively denser in dark, middle and bright luma range. In this case, their results will have less error only in their own range, so we use a contribution map to combine their best parts to final result. With the guidance of this map, the elements (content) of 3 LUTs will also be redistributed during training. We conduct ablation studies to verify method's effectiveness, and subjective and objective experiments to show its practicability. Code is available at: https://github.com/AndreGuo/ITMLUT.


title: Current Methods for Drug Property Prediction in the Real World

abstract: Predicting drug properties is key in drug discovery to enable de-risking of assets before expensive clinical trials, and to find highly active compounds faster. Interest from the Machine Learning community has led to the release of a variety of benchmark datasets and proposed methods. However, it remains unclear for practitioners which method or approach is most suitable, as different papers benchmark on different datasets and methods, leading to varying conclusions that are not easily compared. Our large-scale empirical study links together numerous earlier works on different datasets and methods; thus offering a comprehensive overview of the existing property classes, datasets, and their interactions with different methods. We emphasise the importance of uncertainty quantification and the time and therefore cost of applying these methods in the drug development decision-making cycle. We discover that the best method depends on the dataset, and that engineered features with classical ML methods often outperform deep learning. Specifically, QSAR datasets are typically best analysed with classical methods such as Gaussian Processes while ADMET datasets are sometimes better described by Trees or Deep Learning methods such as Graph Neural Networks or language models. Our work highlights that practitioners do not yet have a straightforward, black-box procedure to rely on, and sets the precedent for creating practitioner-relevant benchmarks. Deep learning approaches must be proven on these benchmarks to become the practical method of choice in drug property prediction.


title: APNet: Urban-level Scene Segmentation of Aerial Images and Point Clouds

abstract: In this paper, we focus on semantic segmentation method for point clouds of urban scenes. Our fundamental concept revolves around the collaborative utilization of diverse scene representations to benefit from different context information and network architectures. To this end, the proposed network architecture, called APNet, is split into two branches: a point cloud branch and an aerial image branch which input is generated from a point cloud. To leverage the different properties of each branch, we employ a geometry-aware fusion module that is learned to combine the results of each branch. Additional separate losses for each branch avoid that one branch dominates the results, ensure the best performance for each branch individually and explicitly define the input domain of the fusion network assuring it only performs data fusion. Our experiments demonstrate that the fusion output consistently outperforms the individual network branches and that APNet achieves state-of-the-art performance of 65.2 mIoU on the SensatUrban dataset. Upon acceptance, the source code will be made accessible.


title: Calibrating the effective magnitudes of type Ia supernovae with a model-independent method

abstract: This research explores the correlation between the absolute magnitude and the redshift of Type Ia supernovae (SNe Ia) with a model-independent approach. The Pantheon sample of SNe Ia and strong gravitational lensing systems (SGLS) are used. With the cosmic distance-duality relation (CDDR), the evolution parameter of the magnitude, the light curve parameters of SNe Ia, and the parameters of the SGLS geometric model are constrained simultaneously. Considering the consistency of the redshifts, we selected a subsample of SNe Ia in which the redshift of each SNe Ia is close to the corresponding redshift of the SGLS sample. Two parametric models are used to describe this evolution, which can be written as $\delta_M=\varepsilon z$ and $\delta_M=\varepsilon\log(1+z)$, respectively. Our analysis reveals that $\varepsilon=-0.036^{+0.357}_{-0.339}$ in the first parametric model and $\varepsilon=-0.014^{+0.588}_{-0.630}$ in the second model, indicating that no significant evolution ($\varepsilon=0$) is supported at the 1$\sigma$ confidence level in this study. These results represent a significant advancement in our understanding of the intrinsic properties of SNe Ia and provide important constraints for future SNe Ia study.


title: Retail-786k: a Large-Scale Dataset for Visual Entity Matching

abstract: Entity Matching (EM) defines the task of learning to group objects by transferring semantic concepts from example groups (=entities) to unseen data. Despite the general availability of image data in the context of many EM-problems, most currently available EM-algorithms solely rely on (textual) meta data. In this paper, we introduce the first publicly available large-scale dataset for "visual entity matching", based on a production level use case in the retail domain. Using scanned advertisement leaflets, collected over several years from different European retailers, we provide a total of ~786k manually annotated, high resolution product images containing ~18k different individual retail products which are grouped into ~3k entities. The annotation of these product entities is based on a price comparison task, where each entity forms an equivalence class of comparable products. Following on a first baseline evaluation, we show that the proposed "visual entity matching" constitutes a novel learning problem which can not sufficiently be solved using standard image based classification and retrieval algorithms. Instead, novel approaches which allow to transfer example based visual equivalent classes to new data are needed to address the proposed problem. The aim of this paper is to provide a benchmark for such algorithms. Information about the dataset, evaluation code and download instructions are provided under https://www.retail-786k.org/.


title: Algebraic intersection, lengths and Veech surfaces

abstract: In this paper, we continue the study of intersections of closed curves on translation surfaces, initiated in by S. Cheboui, A. Kessi and D. Massart for a family of arithmetic Veech surfaces and the author, E. Lanneau and D. Massart for a family of non-arithmetic Veech surfaces. Namely, we investigate the question of maximizing the algebraic intersection between two curves of given lengths by studying the quantity KVol defined for any closed orientable surface by: $$ \mathrm{KVol}(X): = \mathrm{Vol}(X,g)\cdot \sup_{\alpha,\beta} \frac{\mathrm{Int} (\alpha,\beta)}{l_g (\alpha) l_g (\beta)},$$ where the supremum is taken over all pairs of closed curves on $X$. In this paper we focus on regular $n$-gons for even $n \geq 8$ as well as their Teichm\"uller disks.


title: Advances in Kidney Biopsy Lesion Assessment through Dense Instance Segmentation

abstract: Renal biopsies are the gold standard for diagnosis of kidney diseases. Lesion scores made by renal pathologists are semi-quantitative and exhibit high inter-observer variability. Automating lesion classification within segmented anatomical structures can provide decision support in quantification analysis and reduce the inter-observer variability. Nevertheless, classifying lesions in regions-of-interest (ROIs) is clinically challenging due to (a) a large amount of densely packed anatomical objects (up to 1000), (b) class imbalance across different compartments (at least 3), (c) significant variation in object scales (i.e. sizes and shapes), and (d) the presence of multi-label lesions per anatomical structure. Existing models lack the capacity to address these complexities efficiently and generically. This paper presents \textbf{a generalized technical solution} for large-scale, multi-source datasets with diverse lesions. Our approach utilizes two sub-networks: dense instance segmentation and lesion classification. We introduce \textbf{DiffRegFormer}, an end-to-end dense instance segmentation model designed for multi-class, multi-scale objects within ROIs. Combining diffusion models, transformers, and RCNNs, DiffRegFormer efficiently recognizes over 500 objects across three anatomical classes (glomeruli, tubuli, arteries) within ROIs on a single NVIDIA GeForce RTX 3090 GPU. On a dataset of 303 ROIs (from 148 Jones' silver-stained renal WSIs), it outperforms state of art models, achieving AP of 52.1\% (detection) and 46.8\% (segmentation). Our lesion classification sub-network achieves 89.2\% precision and 64.6\% recall on 21889 object patches (from the 303 ROIs). Importantly, the model demonstrates direct domain transfer to PAS-stained WSIs without fine-tuning.


title: DyVal: Dynamic Evaluation of Large Language Models for Reasoning Tasks

abstract: Large language models (LLMs) have achieved remarkable performance in various evaluation benchmarks. However, concerns are raised about potential data contamination in their considerable volume of training corpus. Moreover, the static nature and fixed complexity of current benchmarks may inadequately gauge the advancing capabilities of LLMs. In this paper, we introduce DyVal, a general and flexible protocol for dynamic evaluation of LLMs. Based on our framework, we build graph-informed DyVal by leveraging the structural advantage of directed acyclic graphs to dynamically generate evaluation samples with controllable complexities. DyVal generates challenging evaluation sets on reasoning tasks including mathematics, logical reasoning, and algorithm problems. We evaluate various LLMs ranging from Flan-T5-large to GPT-3.5-Turbo and GPT-4. Experiments show that LLMs perform worse in DyVal-generated evaluation samples with different complexities, highlighting the significance of dynamic evaluation. We also analyze the failure cases and results of different prompting methods. Moreover, DyVal-generated samples are not only evaluation sets, but also helpful data for fine-tuning to improve the performance of LLMs on existing benchmarks. We hope that DyVal can shed light on future evaluation research of LLMs. Code is available at: https://github.com/microsoft/promptbench.


title: Charge-parity switching effects and optimisation of transmon-qubit design parameters

abstract: Enhancing the performance of noisy quantum processors requires improving our understanding of error mechanisms and the ways to overcome them. In this study, we identify optimal ranges for qubit design parameters, grounded in comprehensive noise modeling. To this end, we also analyze a previously unexplored error mechanism that can perturb two-qubit gates due to charge-parity switches caused by quasiparticles. Due to the utilization of the higher levels of a transmon, where the charge dispersion is significantly larger, a charge-parity switch will affect the conditional phase of the two-qubit gate. We derive an analytical expression for the infidelity of a diabatic controlled-Z gate and see effects of similar magnitude in adiabatic controlled phase gates in the tunable coupler architecture. Moreover, we show that the effect of a charge-parity switch can be the dominant quasiparticle-related error source of a two-qubit gate. We also demonstrate that charge-parity switches induce a residual longitudinal interaction between qubits in a tunable-coupler circuit. We present a performance metric for quantum circuit execution, encompassing the fidelity and number of single and two-qubit gates in an algorithm, as well as the state preparation fidelity. This comprehensive metric, coupled with a detailed noise model, empowers us to determine an optimal range for the qubit design parameters Substantiating our findings through exact numerical simulations, we establish that fabricating quantum chips within this optimal parameter range not only augments the performance metric but also ensures its continued improvement with the enhancement of individual qubit coherence properties. Our systematic analysis offers insights and serves as a guiding framework for the development of the next generation of transmon-based quantum processors.


title: An evaluation of GPT models for phenotype concept recognition

abstract: Objective: Clinical deep phenotyping and phenotype annotation play a critical role in both the diagnosis of patients with rare disorders as well as in building computationally-tractable knowledge in the rare disorders field. These processes rely on using ontology concepts, often from the Human Phenotype Ontology, in conjunction with a phenotype concept recognition task (supported usually by machine learning methods) to curate patient profiles or existing scientific literature. With the significant shift in the use of large language models (LLMs) for most NLP tasks, we examine the performance of the latest Generative Pre-trained Transformer (GPT) models underpinning ChatGPT as a foundation for the tasks of clinical phenotyping and phenotype annotation. Materials and Methods: The experimental setup of the study included seven prompts of various levels of specificity, two GPT models (gpt-3.5-turbo and gpt-4.0) and two established gold standard corpora for phenotype recognition, one consisting of publication abstracts and the other clinical observations. Results: Our results show that, with an appropriate setup, these models can achieve state of the art performance. The best run, using few-shot learning, achieved 0.58 macro F1 score on publication abstracts and 0.75 macro F1 score on clinical observations, the former being comparable with the state of the art, while the latter surpassing the current best in class tool. Conclusion: While the results are promising, the non-deterministic nature of the outcomes, the high cost and the lack of concordance between different runs using the same prompt and input make the use of these LLMs challenging for this particular task.


title: A Vision-Guided Robotic System for Grasping Harvested Tomato Trusses in Cluttered Environments

abstract: Currently, truss tomato weighing and packaging require significant manual work. The main obstacle to automation lies in the difficulty of developing a reliable robotic grasping system for already harvested trusses. We propose a method to grasp trusses that are stacked in a crate with considerable clutter, which is how they are commonly stored and transported after harvest. The method consists of a deep learning-based vision system to first identify the individual trusses in the crate and then determine a suitable grasping location on the stem. To this end, we have introduced a grasp pose ranking algorithm with online learning capabilities. After selecting the most promising grasp pose, the robot executes a pinch grasp without needing touch sensors or geometric models. Lab experiments with a robotic manipulator equipped with an eye-in-hand RGB-D camera showed a 100% clearance rate when tasked to pick all trusses from a pile. 93% of the trusses were successfully grasped on the first try, while the remaining 7% required more attempts.


title: Comparative Analysis of Named Entity Recognition in the Dungeons and Dragons Domain

abstract: Many NLP tasks, although well-resolved for general English, face challenges in specific domains like fantasy literature. This is evident in Named Entity Recognition (NER), which detects and categorizes entities in text. We analyzed 10 NER models on 7 Dungeons and Dragons (D&D) adventure books to assess domain-specific performance. Using open-source Large Language Models, we annotated named entities in these books and evaluated each model's precision. Our findings indicate that, without modifications, Flair, Trankit, and Spacy outperform others in identifying named entities in the D&D context.


title: Domain-Adaptive Learning: Unsupervised Adaptation for Histology Images with Improved Loss Function Combination

abstract: This paper presents a novel approach for unsupervised domain adaptation (UDA) targeting H&E stained histology images. Existing adversarial domain adaptation methods may not effectively align different domains of multimodal distributions associated with classification problems. The objective is to enhance domain alignment and reduce domain shifts between these domains by leveraging their unique characteristics. Our approach proposes a novel loss function along with carefully selected existing loss functions tailored to address the challenges specific to histology images. This loss combination not only makes the model accurate and robust but also faster in terms of training convergence. We specifically focus on leveraging histology-specific features, such as tissue structure and cell morphology, to enhance adaptation performance in the histology domain. The proposed method is extensively evaluated in accuracy, robustness, and generalization, surpassing state-of-the-art techniques for histology images. We conducted extensive experiments on the FHIST dataset and the results show that our proposed method - Domain Adaptive Learning (DAL) significantly surpasses the ViT-based and CNN-based SoTA methods by 1.41% and 6.56% respectively.


title: Properties of charge-exchange giant spin-dipole resonances in medium-heavy closed-shell parent nuclei: a semimicroscopic description

abstract: The semimicroscopic particle-hole dispersive optical model is adapted for a description of main properties of charge-exchange giant spin-multipole resonances in medium-heavy closed-shell parent nuclei. The adapted model is implemented to evaluating the strength functions, transition densities, and branching ratios of direct one-nucleon decay for charge-exchange giant spin-dipole resonances in the ^{48}Ca, ^{90}Zr, ^{132}Sn, and ^{208}Pb parent nuclei. Some of calculation results are compared with available experimental data.


title: FedZeN: Towards superlinear zeroth-order federated learning via incremental Hessian estimation

abstract: Federated learning is a distributed learning framework that allows a set of clients to collaboratively train a model under the orchestration of a central server, without sharing raw data samples. Although in many practical scenarios the derivatives of the objective function are not available, only few works have considered the federated zeroth-order setting, in which functions can only be accessed through a budgeted number of point evaluations. In this work we focus on convex optimization and design the first federated zeroth-order algorithm to estimate the curvature of the global objective, with the purpose of achieving superlinear convergence. We take an incremental Hessian estimator whose error norm converges linearly, and we adapt it to the federated zeroth-order setting, sampling the random search directions from the Stiefel manifold for improved performance. In particular, both the gradient and Hessian estimators are built at the central server in a communication-efficient and privacy-preserving way by leveraging synchronized pseudo-random number generators. We provide a theoretical analysis of our algorithm, named FedZeN, proving local quadratic convergence with high probability and global linear convergence up to zeroth-order precision. Numerical simulations confirm the superlinear convergence rate and show that our algorithm outperforms the federated zeroth-order methods available in the literature.


title: TextField3D: Towards Enhancing Open-Vocabulary 3D Generation with Noisy Text Fields

abstract: Recent works learn 3D representation explicitly under text-3D guidance. However, limited text-3D data restricts the vocabulary scale and text control of generations. Generators may easily fall into a stereotype concept for certain text prompts, thus losing open-vocabulary generation ability. To tackle this issue, we introduce a conditional 3D generative model, namely TextField3D. Specifically, rather than using the text prompts as input directly, we suggest to inject dynamic noise into the latent space of given text prompts, i.e., Noisy Text Fields (NTFs). In this way, limited 3D data can be mapped to the appropriate range of textual latent space that is expanded by NTFs. To this end, an NTFGen module is proposed to model general text latent code in noisy fields. Meanwhile, an NTFBind module is proposed to align view-invariant image latent code to noisy fields, further supporting image-conditional 3D generation. To guide the conditional generation in both geometry and texture, multi-modal discrimination is constructed with a text-3D discriminator and a text-2.5D discriminator. Compared to previous methods, TextField3D includes three merits: 1) large vocabulary, 2) text consistency, and 3) low latency. Extensive experiments demonstrate that our method achieves a potential open-vocabulary 3D generation capability.


title: AdaRefiner: Refining Decisions of Language Models with Adaptive Feedback

abstract: Large Language Models (LLMs) have demonstrated significant success across various domains. However, their application in complex decision-making tasks frequently necessitates intricate prompt engineering or fine-tuning, leading to challenges in unseen downstream tasks and heavy demands on computational resources. Meanwhile, Reinforcement Learning (RL) has been recognized as effective in decision-making problems but struggles in environments with sparse rewards, such as open-world games. To overcome these challenges, we introduce AdaRefiner, a novel framework designed to enhance the synergy between LLMs and RL feedback. The key component of AdaRefiner is a lightweight Adapter Language Model (LM), which automatically refines task comprehension based on feedback from RL agents. This method mitigates the need for intricate prompt engineering and intensive LLM fine-tuning while maintaining the LLMs' generalization abilities and enhancing their decision-making capabilities in downstream tasks. Empirical evaluations of AdaRefiner on 22 diverse tasks within the open-world game Crafter have demonstrated its superior effectiveness, especially in guiding agents towards higher-level and common-sense skills. Our work makes contributions to the automatic self-refinement of LLMs with RL feedback, offering a more adaptable and efficient solution for complex decision-making problems.


title: Measurement of the production cross-section of $J/\psi$ and $\psi(2$S$)$ mesons in $pp$ collisions at $\sqrt{s} = 13$ TeV with the ATLAS detector

abstract: Measurements of the differential production cross-sections of prompt and non-prompt $J/\psi$ and $\psi(2$S$)$ mesons with transverse momenta between 8 and 360 GeV and rapidity in the range $|y|<2$ are reported. Furthermore, measurements of the non-prompt fractions of $J/\psi$ and $\psi(2$S$)$, and the prompt and non-prompt $\psi(2$S$)$-to-$J/\psi$ production ratios, are presented. The analysis is performed using 140 fb$^{-1}$ of $\sqrt{s}=13$ TeV $pp$ collision data recorded by the ATLAS detector at the LHC during the years 2015-2018.


title: Nuclear dimension of subhomogeneous twisted groupoid C*-algebras and dynamic asymptotic dimension

abstract: We characterise subhomogeneity for twisted \'etale groupoid C*-algebras and obtain an upper bound on their nuclear dimension. As an application, we remove the principality assumption in recent results on upper bounds on the nuclear dimension of a twisted \'etale groupoid C*-algebra in terms of the dynamic asymptotic dimension of the groupoid and the covering dimension of its unit space. As a non-principal example, we show that the dynamic asymptotic dimension of any minimal (not necessarily free) action of the infinite dihedral group $D_\infty$ on an infinite compact Hausdorff space $X$ is always one. So if we further assume that $X$ is second-countable and has finite covering dimension, then $C(X)\rtimes_r D_\infty$ has finite nuclear dimension and is classifiable by its Elliott invariant.


title: Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training

abstract: Recent works like Tree-of-Thought (ToT) and Reasoning via Planning (RAP) aim to augment the reasoning capabilities of LLMs by using tree-search algorithms to guide multi-step reasoning. These methods rely on prompting a pre-trained model to serve as a value function and focus on problems with low search depth. As a result, these methods will not work in domains where the pre-trained LLM does not have enough knowledge to serve as an effective value function or in domains that require long-horizon planning. To address these limitations, we present an AlphaZero-like tree-search learning framework for LLMs (termed TS-LLM), systematically illustrating how tree-search with a learned value function can guide LLM decoding. TS-LLM distinguishes itself in two key ways. (1) Leveraging a learned value function and AlphaZero-like algorithms, our approach can be generally adaptable to a wide range of tasks, language models of any size, and tasks of varying search depths. (2) Our approach can guide LLMs during both inference and training, iteratively improving the LLM. Empirical results across reasoning, planning, alignment, and decision-making tasks show that TS-LLM outperforms existing approaches and can handle trees with a depth of 64.


title: A new tidal scenario for double bar formation

abstract: Double bars make up a significant fraction of barred galaxies. We propose a new formation scenario for double bars that involves tidal interactions. We demonstrate the viability of this scenario using two examples of simulated galaxies from run TNG50-1 of the IllustrisTNG project. In the proposed scenario the inner bar forms first, either in isolation, via instabilities, or through previous tides. The outer bar forms later from the material that is tidally distorted by a strong interaction. The inner and outer bars formed this way rotate with different pattern speeds and can be mistaken for a single bar when their phases align. The double-barred structure is stable and can last for at least 3 Gyr. The inner bars of the tidally induced double bars can also have big sizes, which can possibly explain the origin of sizable inner bars recently found in some galaxies.


title: Gauss decomposition and $q$-difference equations for Jackson integrals of symmetric Selberg type

abstract: We provide explicit expressions for two types of first order $q$-difference systems for the Jackson integral of symmetric Selberg type. One is the $q$-difference system known to be the $q$-KZ equation and the other is the $q$-difference system for parameters different from the $q$-KZ equation. We use a basis of the systems introduced by Matsuo in his study of the $q$-KZ equation. As a result, the similarity of these two systems is discussed by concrete calculations. Intermediate calculations are made use of the Riemann-Hilbelt method for $q$-difference equation from connection matrix established by Aomoto.


title: RECOMBINER: Robust and Enhanced Compression with Bayesian Implicit Neural Representations

abstract: COMpression with Bayesian Implicit NEural Representations (COMBINER) is a recent data compression method that addresses a key inefficiency of previous Implicit Neural Representation (INR)-based approaches: it avoids quantization and enables direct optimization of the rate-distortion performance. However, COMBINER still has significant limitations: 1) it uses factorized priors and posterior approximations that lack flexibility; 2) it cannot effectively adapt to local deviations from global patterns in the data; and 3) its performance can be susceptible to modeling choices and the variational parameters' initializations. Our proposed method, Robust and Enhanced COMBINER (RECOMBINER), addresses these issues by 1) enriching the variational approximation while retaining a low computational cost via a linear reparameterization of the INR weights, 2) augmenting our INRs with learnable positional encodings that enable them to adapt to local details and 3) splitting high-resolution data into patches to increase robustness and utilizing expressive hierarchical priors to capture dependency across patches. We conduct extensive experiments across several data modalities, showcasing that RECOMBINER achieves competitive results with the best INR-based methods and even outperforms autoencoder-based codecs on low-resolution images at low bitrates. Our PyTorch implementation is available at https://github.com/cambridge-mlg/RECOMBINER/.


title: Grand Perspective: Load Shedding in Distributed CEP Applications

abstract: In distributed Complex Event Processing (CEP) applications with high load but limited resources, bottleneck operators in the operator graph can significantly slow down processing of event streams, thus compelling the need to shed load. A high-quality load shedding strategy that resolves the bottleneck with high output quality evaluates each event's importance with regards to the application's final output and drops less important events from the event stream for the benefit of important ones. So far, no solution has been proposed that is able to permit good load shedding in distributed, multi-operator CEP applications. On one hand, shedding strategies have been proposed for single-operator CEP applications that can measure an event's importance immediately at the bottleneck operator, only, and thereby ignore the effect of other streams in the application on an event's importance. On the other hand, shedding strategies have been proposed for applications with multiple operators from the area of stream processing that provide a fixed selectivity which is not given in the conditional CEP operators. We, therefore, propose a load-shedding solution for distributed CEP applications that maximizes the application's final output and ensures timely processing of important events by using a set of CEP-tailored selectivity functions and a linear program, which is an abstraction of the CEP application. Moreover, our solution ensures a quality optimal shedder configuration even in the presence of dynamically changing conditions. With the help of extensive evaluations on both synthetic and real data, we show that our solution successfully resolves overload at bottleneck operators and at the same time maximizes the quality of the application's output.


title: Hamiltonian formalism for cosmological perturbations: fixing the gauge

abstract: Cosmological perturbation theory is an example of a gauge theory, where gauge transformations correspond to changes in the space-time coordinate system. To determine physical quantities, one is free to introduce gauge conditions (i.e. to work with specific space-time coordinates), and such conditions are often used to simplify technical aspects of the calculation or to facilitate the interpretation of the physical degrees of freedom. Some of the prescriptions introduced in the literature are known to fix the gauge only partially, but it is commonly assumed that the remaining gauge degrees of freedom can be fixed somehow. In this work, we show that this is not necessarily the case, and that some of these gauges are indeed pathological. We derive a systematic procedure to determine whether a gauge is pathological or not, and to complete partially-fixed gauges into healthy gauges when this is possible. In this approach, the Lagrange multipliers (i.e. the perturbed lapse and shift in the ADM formalism) cannot appear in the off-shell definition of the gauges, they necessarily arise as on-shell consequences of the gauge conditions. As illustrative applications, we propose an alternative, non-pathological formulation of the synchronous gauge, and we show that the uniform-expansion gauge (as well as any gauge ensuring vanishing lapse perturbations) can hardly be made healthy. Our methodology also allows us to construct all gauge-invariant variables. We further show that at the quantum level, imposing that the constraints are satisfied necessarily leads to gauge-invariant quantum states, hence any quantum treatment of cosmological perturbations precludes the gauge from being fixed. We finally discuss possible generalisations of our formalism.


title: Meta Reinforcement Learning for Fast Spectrum Sharing in Vehicular Networks

abstract: In this paper, we investigate the problem of fast spectrum sharing in vehicle-to-everything communication. In order to improve the spectrum efficiency of the whole system, the spectrum of vehicle-to-infrastructure links is reused by vehicle-to-vehicle links. To this end, we model it as a problem of deep reinforcement learning and tackle it with proximal policy optimization. A considerable number of interactions are often required for training an agent with good performance, so simulation-based training is commonly used in communication networks. Nevertheless, severe performance degradation may occur when the agent is directly deployed in the real world, even though it can perform well on the simulator, due to the reality gap between the simulation and the real environments. To address this issue, we make preliminary efforts by proposing an algorithm based on meta reinforcement learning. This algorithm enables the agent to rapidly adapt to a new task with the knowledge extracted from similar tasks, leading to fewer interactions and less training time. Numerical results show that our method achieves near-optimal performance and exhibits rapid convergence.


title: Unaware, Unfunded and Uneducated: A Systematic Review of SME Cybersecurity

abstract: Small and Medium Enterprises (SMEs) are pivotal in the global economy, accounting for over 90% of businesses and 60% of employment worldwide. Despite their significance, SMEs have been disregarded from cybersecurity initiatives, rendering them ill-equipped to deal with the growing frequency, sophistication, and destructiveness of cyber-attacks. We systematically reviewed the cybersecurity literature on SMEs published between 2017 and 2023. We focus on research discussing cyber threats, adopted controls, challenges, and constraints SMEs face in pursuing cybersecurity resilience. Our search yielded 916 studies that we narrowed to 77 relevant papers. We identified 44 unique themes and categorised them as novel findings or established knowledge. This distinction revealed that research on SMEs is shallow and has made little progress in understanding SMEs' roles, threats, and needs. Studies often repeated early discoveries without replicating or offering new insights. The existing research indicates that the main challenges to attaining cybersecurity resilience of SMEs are a lack of awareness of the cybersecurity risks, limited cybersecurity literacy and constrained financial resources. However, resource availability varied between developed and developing countries. Our analysis indicated a relationship among these themes, suggesting that limited literacy is the root cause of awareness and resource constraint issues.


title: TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Data

abstract: Social navigation and pedestrian behavior research has shifted towards machine learning-based methods and converged on the topic of modeling inter-pedestrian interactions and pedestrian-robot interactions. For this, large-scale datasets that contain rich information are needed. We describe a portable data collection system, coupled with a semi-autonomous labeling pipeline. As part of the pipeline, we designed a label correction web app that facilitates human verification of automated pedestrian tracking outcomes. Our system enables large-scale data collection in diverse environments and fast trajectory label production. Compared with existing pedestrian data collection methods, our system contains three components: a combination of top-down and ego-centric views, natural human behavior in the presence of a socially appropriate "robot", and human-verified labels grounded in the metric space. To the best of our knowledge, no prior data collection system has a combination of all three components. We further introduce our ever-expanding dataset from the ongoing data collection effort -- the TBD Pedestrian Dataset and show that our collected data is larger in scale, contains richer information when compared to prior datasets with human-verified labels, and supports new research opportunities.


title: Analytic regularity of global solutions for the b-equation

abstract: In this paper, we delve into the $b$-family of equations and explore regularity properties of its global solutions. Our findings reveal that, irrespective of the real choice of the constitutive parameter, when the initial datum is confined to an analytic Gevrey function the resulting global solution is analytic in both temporal and spatial variables.


title: RTFS-Net: Recurrent Time-Frequency Modelling for Efficient Audio-Visual Speech Separation

abstract: Audio-visual speech separation methods aim to integrate different modalities to generate high-quality separated speech, thereby enhancing the performance of downstream tasks such as speech recognition. Most existing state-of-the-art (SOTA) models operate in the time domain. However, their overly simplistic approach to modeling acoustic features often necessitates larger and more computationally intensive models in order to achieve SOTA performance. In this paper, we present a novel time-frequency domain audio-visual speech separation method: Recurrent Time-Frequency Separation Network (RTFS-Net), which applies its algorithms on the complex time-frequency bins yielded by the Short-Time Fourier Transform. We model and capture the time and frequency dimensions of the audio independently using a multi-layered RNN along each dimension. Furthermore, we introduce a unique attention-based fusion technique for the efficient integration of audio and visual information, and a new mask separation approach that takes advantage of the intrinsic spectral nature of the acoustic features for a clearer separation. RTFS-Net outperforms the prior SOTA method in both inference speed and separation quality while reducing the number of parameters by 90% and MACs by 83%. This is the first time-frequency domain audio-visual speech separation method to outperform all contemporary time-domain counterparts.


title: PARF: Primitive-Aware Radiance Fusion for Indoor Scene Novel View Synthesis

abstract: This paper proposes a method for fast scene radiance field reconstruction with strong novel view synthesis performance and convenient scene editing functionality. The key idea is to fully utilize semantic parsing and primitive extraction for constraining and accelerating the radiance field reconstruction process. To fulfill this goal, a primitive-aware hybrid rendering strategy was proposed to enjoy the best of both volumetric and primitive rendering. We further contribute a reconstruction pipeline conducts primitive parsing and radiance field learning iteratively for each input frame which successfully fuses semantic, primitive, and radiance information into a single framework. Extensive evaluations demonstrate the fast reconstruction ability, high rendering quality, and convenient editing functionality of our method.


title: $B\to K^* M_X$ vs $B\to K M_X$ as a probe of a scalar-mediator dark matter scenario

abstract: Recently, Belle II reported the observation of the decay $B\to K M_X$, $M_X$ the missing mass, with the branching ratio much exceeding ${\cal B}(B\to K \nu\bar\nu)$ which is the only Standard Model (SM) process contributing to this reaction. If confirmed, this might be an indication of new nonSM particles produced in this decay. One of the possible explanations of the observed effect could be light dark-matter (DM) particles produced via a scalar mediator field. We give simple arguments, that a combined analysis of the $B\to K M_X$ and $B\to K^* M_X$ reactions would be a clean probe of the scalar mediator scenario: (i) making use of an observed value ${\cal B}(B\to K M_X)\simeq 5.4\, {\cal B}(B\to K \nu\bar\nu)_{\rm SM}$ and (ii) assuming that the effect is due to the light dark matter coupling to the top quark via a {\it scalar} mediator field, one finds an upper limit ${\cal B}(B\to K^* M_X) < 2.8 \, {\cal B}(B\to K^* \nu\bar\nu)_{\rm SM}$. Within the discussed scenario, this upper limit does not depend on the mass of the scalar mediator nor on the specific details of the unobserved dark-matter particles in the final state.


title: A Survey of Incremental Transfer Learning: Combining Peer-to-Peer Federated Learning and Domain Incremental Learning for Multicenter Collaboration

abstract: Due to data privacy constraints, data sharing among multiple clinical centers is restricted, which impedes the development of high performance deep learning models from multicenter collaboration. Naive weight transfer methods share intermediate model weights without raw data and hence can bypass data privacy restrictions. However, performance drops are typically observed when the model is transferred from one center to the next because of the forgetting problem. Incremental transfer learning, which combines peer-to-peer federated learning and domain incremental learning, can overcome the data privacy issue and meanwhile preserve model performance by using continual learning techniques. In this work, a conventional domain/task incremental learning framework is adapted for incremental transfer learning. A comprehensive survey on the efficacy of different regularization-based continual learning methods for multicenter collaboration is performed. The influences of data heterogeneity, classifier head setting, network optimizer, model initialization, center order, and weight transfer type have been investigated thoroughly. Our framework is publicly accessible to the research community for further development.


title: M-DAB: An Input-Distribution Optimization Algorithm for Composite DNA Storage by the Multinomial Channel

abstract: Recent experiments have shown that the capacity of DNA storage systems may be significantly increased by synthesizing composite DNA letters. In this work, we model a DNA storage channel with composite inputs as a \textit{multinomial channel}, and propose an optimization algorithm for its capacity achieving input distribution, for an arbitrary number of output reads. The algorithm is termed multidimensional dynamic assignment Blahut-Arimoto (M-DAB), and is a generalized version of the DAB algorithm, proposed by Wesel et al. developed for the binomial channel. We also empirically observe a scaling law behavior of the capacity as a function of the support size of the capacity-achieving input distribution.


title: Generalized Activation via Multivariate Projection

abstract: Activation functions are essential to introduce nonlinearity into neural networks, with the Rectified Linear Unit (ReLU) often favored for its simplicity and effectiveness. Motivated by the structural similarity between a shallow Feedforward Neural Network (FNN) and a single iteration of the Projected Gradient Descent (PGD) algorithm, a standard approach for solving constrained optimization problems, we consider ReLU as a projection from R onto the nonnegative half-line R+. Building on this interpretation, we extend ReLU by substituting it with a generalized projection operator onto a convex cone, such as the Second-Order Cone (SOC) projection, thereby naturally extending it to a Multivariate Projection Unit (MPU), an activation function with multiple inputs and multiple outputs. We further provide mathematical proof establishing that FNNs activated by SOC projections outperform those utilizing ReLU in terms of expressive power. Experimental evaluations on widely-adopted architectures further corroborate MPU's effectiveness against a broader range of existing activation functions.


title: Fossil and present-day stromatolite ooids contain a meteoritic polymer of glycine and iron

abstract: Hemoglycin, a space polymer of glycine and iron, has been identified in the carbonaceous chondritic meteorites Allende, Acfer 086, Kaba, Sutters Mill and Orgueil. Its core form has a mass of 1494Da and is basically an antiparallel pair of polyglycine strands linked at each end by an iron atom. The polymer forms two- and three- dimensional lattices with an inter-vertex distance of 4.9nm. Here the extraction technique for meteorites is applied to a 2.1Gya fossil stromatolite to reveal the presence of hemoglycin by mass spectrometry. Intact ooids from a recent (3,000Ya) stromatolite exhibited the same visible hemoglycin fluorescence in response to x-rays as an intact crystal from the Orgueil meteorite. X-ray analysis confirmed the existence in ooids of an internal 3-dimensional lattice of 4.9nm inter-vertex spacing, matching the spacing of lattices in meteoritic crystals. FTIR measurements of acid-treated ooid and a Sutters Mill meteoritic crystal both show the presence, via the splitting of the Amide I band, of an extended anti-parallel beta sheet structure. It seems probable that the copious in-fall of carbonaceous meteoritic material, from Archaean times onward, has left traces of hemoglycin in sedimentary carbonates and potentially has influenced ooid formation.


title: ResBit: Residual Bit Vector for Categorical Values

abstract: One-hot vectors, a method for representing discrete/categorical data, are commonly used in machine learning due to their simplicity and intuitiveness. However, the one-hot vectors suffer from a linear increase in dimensionality, posing computational and memory challenges, especially when dealing with datasets containing numerous categories. To address this issue, we propose Residual Bit Vectors (ResBit), a technique for densely representing categorical data. While Analog Bits presents a similar approach, it faces challenges in categorical data generation tasks. ResBit overcomes these limitations, offering a more versatile solution. In our experiments, we focus on tabular data generation, examining the performance across scenarios with varying amounts of categorical data. We verify the acceleration and ensure the maintenance or improvement of performance.


title: An Investigation Into Race Bias in Random Forest Models Based on Breast DCE-MRI Derived Radiomics Features

abstract: Recent research has shown that artificial intelligence (AI) models can exhibit bias in performance when trained using data that are imbalanced by protected attribute(s). Most work to date has focused on deep learning models, but classical AI techniques that make use of hand-crafted features may also be susceptible to such bias. In this paper we investigate the potential for race bias in random forest (RF) models trained using radiomics features. Our application is prediction of tumour molecular subtype from dynamic contrast enhanced magnetic resonance imaging (DCE-MRI) of breast cancer patients. Our results show that radiomics features derived from DCE-MRI data do contain race-identifiable information, and that RF models can be trained to predict White and Black race from these data with 60-70% accuracy, depending on the subset of features used. Furthermore, RF models trained to predict tumour molecular subtype using race-imbalanced data seem to produce biased behaviour, exhibiting better performance on test data from the race on which they were trained.


title: Efficient cycles of hyperbolic manifolds

abstract: Let $N$ be a complete finite-volume hyperbolic $n$-manifold. An efficient cycle for $N$ is the limit (in an appropriate measure space) of a sequence of fundamental cycles whose $\ell^1$-norm converges to the simplicial volume of $N$. Gromov and Thurston's smearing construction exhibits an explicit efficient cycle, and Jungreis and Kuessner proved that, in dimension $n\geq 3$, such cycle actually is the unique efficient cycle for a huge class of finite volume hyperbolic manifolds, including all the closed ones. In this paper we prove that, for $n\geq 3$, the class of finite-volume hyperbolic manifolds for which the uniqueness of the efficient cycle does not hold is exactly the commensurability class of the figure-8 knot complement (or, equivalently, of the Gieseking manifold).


title: Entanglement entropy along a massless renormalisation flow: the tricritical to critical Ising crossover

abstract: We study the R\'enyi entanglement entropies along the massless renormalisation group flow that connects the tricritical and critical Ising field theories. Similarly to the massive integrable field theories, we derive a set of bootstrap equations, from which we can analytically calculate the twist field form factors in a recursive way. Additionally, we also obtain them as a non-trivial roaming limit of the sinh-Gordon theory. Then the R\'enyi entanglement entropies are obtained as expansions in terms of the form factors of these branch point twist fields. We find that the form factor expansion of the entanglement entropy along the flow organises in two different kind of terms. Those that couple particles with the same chirality, and reproduce the entropy of the infrared Ising theory, and those that couple particles with different chirality, which provide the ultraviolet contributions. The massless flow under study possesses a global $\mathbb{Z}_2$ spin-flip symmetry. We further consider the composite twist fields associated to this group, which enter in the study of the symmetry resolution of the entanglement. We derive analytical expressions for their form factors both from the bootstrap equations and from the roaming limit of the sinh-Gordon theory.


title: Secure-by-design smart contract based on dataflow implementations

abstract: This article conducts an extensive examination of the persisting challenges related to smart contract attacks within blockchain networks, with a particular focus on the reentrancy attack. It emphasizes the inherent vulnerabilities embedded in the programming languages commonly employed for smart contract development, particularly within Ethereum Virtual Machine (EVM)-based blockchains. While the concrete example used primarily employs the Solidity programming language, the insights garnered from this study are readily generalizable to a wide array of blockchain architectures. Significantly, this article extends beyond the mere identification of vulnerabilities and ventures into the realm of proactive security measures. It explores the adaptation and adoption of dataflow programming paradigms, employing Domain-Specific Languages (DSLs) to enforce security by design in the context of smart contract development. This forward-looking approach aims to bolster the foundational principles of blockchain security, offering a promising research direction for mitigating the risks associated with smart contract vulnerabilities. The objective of this article is to cater to a diverse audience, ranging from individuals with limited computer science and programming expertise to seasoned experts in the field. It provides a comprehensive and accessible resource for fostering a deeper understanding of the intricate dynamics between blockchain technology and the imperative need for secure smart contract development practices.


title: Beyond fixed points: transient quasi-stable dynamics emerging from ghost channels and ghost cycles

abstract: Dynamical description of natural systems has generally focused on fixed points, with saddles and saddle-based phase space objects such as heteroclinic channels and heteroclinic cycles being central concepts behind the emergence of quasi-stable dynamics or long transients. Reliable and robust quasi-stable dynamics observed for real, inherently noisy systems is, however, not met by saddle-based dynamics, as demonstrated here. Generalizing the notion of ghost states, we provide a complementary framework for emergence of sequential quasi-stable dynamics that does not rely on (un)stable fixed points, but rather on slow directed flows on ghost manifolds from which ghost channels and ghost cycles are generated. Moreover, we show that these novel phase space objects are an emergent property of a broad class of models, typically used for description of natural systems.


title: Dynamic Behavior of a Multi-Layer Quasi-Geostrophic Model: Weak and Time-Periodic Solutions

abstract: The quasi-geostrophic two-layer (QS2L) system models the dynamic evolution of two interconnected potential vorticities, each is governed by an active scalar equation. These vorticities are linked through a distinctive combination of their respective stream functions, which can be loosely characterized as a parameterized blend of both Euler and shallow-water stream functions. In this article, we study (QS2L) in two directions: First, we prove the existence and uniqueness of global weak solutions in the class of Yudovich, that is when the initial vorticities are only bounded and Lebesgue-integrable. The uniqueness is obtained as a consequence of a stability analysis of the flow-maps associated with the two vorticities. This approach replaces the relative energy method and allows us to surmount the absence of a velocity formulation for (QS2L). Second, we show how to construct $m$-fold time-periodic solutions bifurcating from two arbitrary distinct initial discs rotating with the same angular velocity. This is achieved provided that the number of symmetry $m$ is large enough, or for any symmetry $m\in \mathbb{N}^*$ as long as one of the initial radii of the discs does not belong to some set that contains, at most, a finite number of elements. Due to its multi-layer structure, it is essential to emphasize that the bifurcation diagram exhibits a two-dimensional pattern. Upon analysis, it reveals some similarities with the scheme accomplished for the doubly connected V-states of the Euler and shallow-water equations. However, the coupling between the equations gives rise to several difficulties in various stages of the proof when applying Crandall-Rabinowitz's Theorem. To address this challenge, we conduct a careful analysis of the coupling between the kernels associated with the Euler and shallow-water equations.


title: Balancing Both Behavioral Quality and Diversity in Unsupervised Skill Discovery

abstract: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Unsupervised skill discovery seeks to dig out diverse and exploratory skills without extrinsic reward, with the discovered skills efficiently adapting to multiple downstream tasks in various ways. However, recent advanced methods struggle to well balance behavioral exploration and diversity, particularly when the agent dynamics are complex and potential skills are hard to discern (e.g., robot behavior discovery). In this paper, we propose \textbf{Co}ntrastive \textbf{m}ulti-objective \textbf{S}kill \textbf{D}iscovery \textbf{(ComSD)} which discovers exploratory and diverse behaviors through a novel intrinsic incentive, named contrastive multi-objective reward. It contains a novel diversity reward based on contrastive learning to effectively drive agents to discern existing skills, and a particle-based exploration reward to access and learn new behaviors. Moreover, a novel dynamic weighting mechanism between the above two rewards is proposed for diversity-exploration balance, which further improves behavioral quality. Extensive experiments and analysis demonstrate that ComSD can generate diverse behaviors at different exploratory levels for complex multi-joint robots, enabling state-of-the-art performance across 32 challenging downstream adaptation tasks, which recent advanced methods cannot. Codes will be opened after publication.


title: Bandwidth Parameterized by Cluster Vertex Deletion Number

abstract: Given a graph $G$ and an integer $b$, Bandwidth asks whether there exists a bijection $\pi$ from $V(G)$ to $\{1, \ldots, |V(G)|\}$ such that $\max_{\{u, v \} \in E(G)} | \pi(u) - \pi(v) | \leq b$. This is a classical NP-complete problem, known to remain NP-complete even on very restricted classes of graphs, such as trees of maximum degree 3 and caterpillars of hair length 3. In the realm of parameterized complexity, these results imply that the problem remains NP-hard on graphs of bounded pathwidth, while it is additionally known to be W[1]-hard when parameterized by the treedepth of the input graph. In contrast, the problem does become FPT when parameterized by the vertex cover number of the input graph. In this paper, we make progress towards the parameterized (in)tractability of Bandwidth. We first show that it is FPT when parameterized by the cluster vertex deletion number cvd plus the clique number $\omega$ of the input graph, thus generalizing the previously mentioned result for vertex cover. On the other hand, we show that Bandwidth is W[1]-hard when parameterized only by cvd. Our results generalize some of the previous results and narrow some of the complexity gaps.


title: Towards Complex-query Referring Image Segmentation: A Novel Benchmark

abstract: Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms. However, there has been a lack of research investigating how existing algorithms should be benchmarked with complex language queries, which include more informative descriptions of surrounding objects and backgrounds (\eg \textit{"the black car."} vs. \textit{"the black car is parking on the road and beside the bus."}). Given the significant improvement in the semantic understanding capability of large pre-trained models, it is crucial to take a step further in RIS by incorporating complex language that resembles real-world applications. To close this gap, building upon the existing RefCOCO and Visual Genome datasets, we propose a new RIS benchmark with complex queries, namely \textbf{RIS-CQ}. The RIS-CQ dataset is of high quality and large scale, which challenges the existing RIS with enriched, specific and informative queries, and enables a more realistic scenario of RIS research. Besides, we present a nichetargeting method to better task the RIS-CQ, called dual-modality graph alignment model (\textbf{\textsc{DuMoGa}}), which outperforms a series of RIS methods.


title: The future of X-ray polarimetry towards the 3-Dimensional photoelectron track reconstruction

abstract: The development of the first X-ray polarimeter, based on the photoelectric effect 20 years ago and implemented thanks to advances in gas amplification structures and readout techniques, had a significant impact in opening a new window for X-ray polarimetry. This system measures the X-ray polarization by reconstructing the initial direction of the photoelectron, emitted by the interaction of an incident photon with an atomic electron, in a gas mixture from an ionization track collected on a two-dimensional plane. However, actual X-ray polarimeters, are still requiring relatively long exposure time and cannot coupled with high effective area mirrors or concentrators. In this context, the high yield polarimetry experiment in X-rays (Hype-X) project is currently underway, aiming to improve the sensitivity of the next generation X-ray polarimetry detectors taking advantage of the recent advancements in imaging techniques for high-resolution time projection chambers. In particular, we are evaluating the use of TIMEPIX3 to be applied for the read-out of a gas detector, which will allow us to obtain a three-dimensional image of the photoelectron track. To evaluate the improvement achievable by using a 3D track reconstruction, in this paper, we have reproduced a three-dimensional photoelectron track from a 'Geant4' Monte Carlo simulation and examined the sensitivity of X-ray polarimetry using a new three-dimensional track reconstruction algorithm. We report the improvement of the modulation factor with three-dimensional track reconstruction as $\sim5\%$ (relative) in the 2-8 keV range and $\sim17\%$ (relative) in the 2-4 keV range compared to the current two-dimensional polarimetry system. This is equivalent to add a further telescope to the three-telescope systems now employed in space on board the IXPE mission.


title: Memory Gym: Towards Endless Tasks to Benchmark Memory Capabilities of Agents

abstract: Memory Gym presents a suite of 2D partially observable environments, namely Mortar Mayhem, Mystery Path, and Searing Spotlights, designed to benchmark memory capabilities in decision-making agents. These environments, originally with finite tasks, are expanded into innovative, endless formats, mirroring the escalating challenges of cumulative memory games such as ``I packed my bag''. This progression in task design shifts the focus from merely assessing sample efficiency to also probing the levels of memory effectiveness in dynamic, prolonged scenarios. To address the gap in available memory-based Deep Reinforcement Learning baselines, we introduce an implementation that integrates Transformer-XL (TrXL) with Proximal Policy Optimization. This approach utilizes TrXL as a form of episodic memory, employing a sliding window technique. Our comparative study between the Gated Recurrent Unit (GRU) and TrXL reveals varied performances across different settings. TrXL, on the finite environments, demonstrates superior sample efficiency in Mystery Path and outperforms in Mortar Mayhem. However, GRU is more efficient on Searing Spotlights. Most notably, in all endless tasks, GRU makes a remarkable resurgence, consistently outperforming TrXL by significant margins. Website and Source Code: https://github.com/MarcoMeter/endless-memory-gym/


title: On the regularity of Dirac eigenfunctions

abstract: The article provides proofs for the regularity of Dirac eigenfunctions, subject to MIT boundary conditions employed on various types of open sets ranging from smooth ones to convex polygons in two dimensions, as well as on half-space and smooth bounded domains in three-dimensional space.


title: Robots That Can See: Leveraging Human Pose for Trajectory Prediction

abstract: Anticipating the motion of all humans in dynamic environments such as homes and offices is critical to enable safe and effective robot navigation. Such spaces remain challenging as humans do not follow strict rules of motion and there are often multiple occluded entry points such as corners and doors that create opportunities for sudden encounters. In this work, we present a Transformer based architecture to predict human future trajectories in human-centric environments from input features including human positions, head orientations, and 3D skeletal keypoints from onboard in-the-wild sensory information. The resulting model captures the inherent uncertainty for future human trajectory prediction and achieves state-of-the-art performance on common prediction benchmarks and a human tracking dataset captured from a mobile robot adapted for the prediction task. Furthermore, we identify new agents with limited historical data as a major contributor to error and demonstrate the complementary nature of 3D skeletal poses in reducing prediction error in such challenging scenarios.


title: Anomalous criticality coexists with giant cluster in the uniform forest model

abstract: We show by extensive simulations that the whole supercritical phase of the three-dimensional uniform forest model simultaneously exhibits an infinite tree and a rich variety of critical phenomena. Besides typical scalings like algebraically decaying correlation, power-law distribution of cluster sizes, and divergent correlation length, a number of anomalous behaviors emerge. The fractal dimensions for off-giant trees take different values when being measured by linear system size or gyration radius. The giant-tree size displays two-length scaling fluctuations, instead of following the central-limit theorem.


title: Instant Complexity Reduction in CNNs using Locality-Sensitive Hashing

abstract: To reduce the computational cost of convolutional neural networks (CNNs) for usage on resource-constrained devices, structured pruning approaches have shown promising results, drastically reducing floating-point operations (FLOPs) without substantial drops in accuracy. However, most recent methods require fine-tuning or specific training procedures to achieve a reasonable trade-off between retained accuracy and reduction in FLOPs. This introduces additional cost in the form of computational overhead and requires training data to be available. To this end, we propose HASTE (Hashing for Tractable Efficiency), a parameter-free and data-free module that acts as a plug-and-play replacement for any regular convolution module. It instantly reduces the network's test-time inference cost without requiring any training or fine-tuning. We are able to drastically compress latent feature maps without sacrificing much accuracy by using locality-sensitive hashing (LSH) to detect redundancies in the channel dimension. Similar channels are aggregated to reduce the input and filter depth simultaneously, allowing for cheaper convolutions. We demonstrate our approach on the popular vision benchmarks CIFAR-10 and ImageNet. In particular, we are able to instantly drop 46.72% of FLOPs while only losing 1.25% accuracy by just swapping the convolution modules in a ResNet34 on CIFAR-10 for our HASTE module.


title: Is the Mg-related GaN blue luminescence deep-level an MgO surface state?

abstract: Mg is currently the only p-type dopant in technological use in GaN. Its incorporation into the GaN lattice is difficult. It requires a thermal treatment that only partially activates the Mg. To achieve moderate p-type doping requires high doses of Mg that mostly remain inactive. High p-type doping is thus typically achieved at the cost of certain lattice distortion and the creation of defects. Using low-temperature surface photovoltage spectroscopy, we obtain a wide spectrum of optical transitions within the bandgap of Mg-doped GaN. The results reveal an optical transition from the valence band into a deep trap around 0.49 eV above the valence band, along with what appears to be a complimentary transition from the same trap into the conduction band observed at 2.84 eV (coinciding with the energy of the famous Mg-related GaN blue luminescence). The similar shape of the spectra, their complimentary energies within the GaN gap and their opposite nature (hole vs. electron trap) appear to be more than a coincidence suggesting that this is an Mg-related surface state. The density of charge we calculate for this surface state is about 2x1012 cm-2. We suggest that these small amounts of surface-segregated Mg partially oxidize during the growth and further oxidize during the consecutive Mg-activation heat treatment. This minute quantity of oxidized surface Mg should be about enough to form an Mg-related surface state. Etching the GaN with H3PO4 is shown to affect the photovoltage at the blue-luminescence-related energy. Finally, we show that pure MgO powder produces the same blue luminescence even at the absolute absence of GaN.


title: The local character expansion as branching rules: nilpotent cones and the case of $\mathrm{SL}(2)$

abstract: We show there exist representations of each maximal compact subgroup $K$ of the $p$-adic group $G=\mathrm{SL}(2,F)$, attached to each nilpotent coadjoint orbit, such that every irreducible representation of $G$, upon restriction to a suitable subgroup of $K$, is a sum of these five representations in the Grothendieck group. This is a representation-theoretic analogue of the analytic local character expansion due to Harish-Chandra and Howe. Moreover, we show for general connected reductive groups that the wave front set of many irreducible positive-depth representations of $G$ are completely determined by the nilpotent support of their unrefined minimal $K$-types.


title: Understanding the optical properties of doped and undoped 9-armchair graphene nanoribbons in dispersion

abstract: Graphene nanoribbons are one-dimensional stripes of graphene with width- and edge-structure-dependent electronic properties. They can be synthesized bottom-up in solution to obtain precise ribbon geometries. Here we investigate the optical properties of solution-synthesized 9-armchair graphene nanoribbons (9-aGNRs) that are stabilized as dispersions in organic solvents and further fractioned by liquid cascade centrifugation (LCC). Absorption and photoluminescence spectroscopy reveal two near-infrared absorption and emission peaks whose ratios depend on the LCC fraction. Low-temperature single-nanoribbon photoluminescence spectra suggest the presence of two different nanoribbon species. Based on density functional theory (DFT) and time-dependent DFT calculations, the lowest energy transition can be assigned to pristine 9-aGNRs, while 9-aGNRs with edge-defects, caused by incomplete graphitization, result in more blue-shifted transitions and higher Raman D/G-mode ratios. Hole doping of 9-aGNR dispersions with the electron acceptor F4TCNQ leads to concentration dependent bleaching and quenching of the main absorption and emission bands and the appearance of redshifted, charge-induced absorption features but no additional emission peaks, thus indicating the formation of polarons instead of the predicted trions (charged excitons) in doped 9-aGNRs.


title: RSAM: Learning on manifolds with Riemannian Sharpness-aware Minimization

abstract: Nowadays, understanding the geometry of the loss landscape shows promise in enhancing a model's generalization ability. In this work, we draw upon prior works that apply geometric principles to optimization and present a novel approach to improve robustness and generalization ability for constrained optimization problems. Indeed, this paper aims to generalize the Sharpness-Aware Minimization (SAM) optimizer to Riemannian manifolds. In doing so, we first extend the concept of sharpness and introduce a novel notion of sharpness on manifolds. To support this notion of sharpness, we present a theoretical analysis characterizing generalization capabilities with respect to manifold sharpness, which demonstrates a tighter bound on the generalization gap, a result not known before. Motivated by this analysis, we introduce our algorithm, Riemannian Sharpness-Aware Minimization (RSAM). To demonstrate RSAM's ability to enhance generalization ability, we evaluate and contrast our algorithm on a broad set of problems, such as image classification and contrastive learning across different datasets, including CIFAR100, CIFAR10, and FGVCAircraft. Our code is publicly available at \url{https://t.ly/RiemannianSAM}.


title: The long-term impact of (un)conditional cash transfers on labour market outcomes in Ecuador

abstract: Despite the popularity of conditional cash transfers in low- and middle-income countries, evidence on their long-term effects remains scarce. This paper assesses the impact of the Ecuador's Human Development Grant on the formal sector labour market outcomes of children in eligible households. This grant -- one of the first of its kind -- is characterised by weak enforcement of its eligibility criteria. By means of a regression discontinuity design, we find that this programme increased formal employment rates and labour income around a decade after exposure, thereby curbing the intergenerational transmission of poverty. We discuss possible mediating mechanisms based on findings from previous literature and, in particular, provide evidence on how the programme contributed to persistence in school in the medium run.


title: $P_{tail}^{\alpha}$: a high resolution gamma/hadron and composition discriminant variable for Water-Cherenkov Detector cosmic-ray observatories

abstract: The precise and efficient identification of the nature of the primary cosmic rays on an event-by-event basis stands as a fundamental aspiration for any cosmic ray observatory. In particular, the detection and characterization of gamma ray events are challenged by their occurrence within an overwhelmingly greater flux of charged cosmic rays spanning several orders of magnitude. The intricacies of distinguishing between cosmic ray compositions and the inherent uncertainties associated with hadronic interactions present formidable challenges, which, if not properly addressed, can introduce significant sources of systematic errors. This work introduces a novel composition discriminant variable, $P_{tail}^{\alpha}$, which quantifies the number of Water Cherenkov Detectors with a signal well above the mean signal observed in WCDs located at an equivalent distance from the shower core, in events with approximately the same energy at the ground. This new event variable is then shown to be, in the reconstructed energy range $10\,{\rm TeV}$ to $1.6\,{\rm PeV}$, well correlated with the total number of muons that hit, in the same event, all the observatory stations located at a distance greater than $200\,{\rm m}$ from the shower core. The two variables should thus have similar efficiencies in the selection of high-purity gamma event samples and in the determination of the nature of charged cosmic ray events.

categories: astro-ph.HE astro-ph.IM hep-ex hep-ph physics.ins-det


title: When Epipolar Constraint Meets Non-local Operators in Multi-View Stereo

abstract: Learning-based multi-view stereo (MVS) method heavily relies on feature matching, which requires distinctive and descriptive representations. An effective solution is to apply non-local feature aggregation, e.g., Transformer. Albeit useful, these techniques introduce heavy computation overheads for MVS. Each pixel densely attends to the whole image. In contrast, we propose to constrain non-local feature augmentation within a pair of lines: each point only attends the corresponding pair of epipolar lines. Our idea takes inspiration from the classic epipolar geometry, which shows that one point with different depth hypotheses will be projected to the epipolar line on the other view. This constraint reduces the 2D search space into the epipolar line in stereo matching. Similarly, this suggests that the matching of MVS is to distinguish a series of points lying on the same line. Inspired by this point-to-line search, we devise a line-to-point non-local augmentation strategy. We first devise an optimized searching algorithm to split the 2D feature maps into epipolar line pairs. Then, an Epipolar Transformer (ET) performs non-local feature augmentation among epipolar line pairs. We incorporate the ET into a learning-based MVS baseline, named ET-MVSNet. ET-MVSNet achieves state-of-the-art reconstruction performance on both the DTU and Tanks-and-Temples benchmark with high efficiency. Code is available at https://github.com/TQTQliu/ET-MVSNet.


title: Covariance matrix filtering and portfolio optimisation: the Average Oracle vs Non-Linear Shrinkage and all the variants of DCC-NLS

abstract: The Average Oracle, a simple and very fast covariance filtering method, is shown to yield superior Sharpe ratios than the current state-of-the-art (and complex) methods, Dynamic Conditional Covariance coupled to Non-Linear Shrinkage (DCC+NLS). We pit all the known variants of DCC+NLS (quadratic shrinkage, gross-leverage or turnover limitations, and factor-augmented NLS) against the Average Oracle in large-scale randomized experiments. We find generically that while some variants of DCC+NLS sometimes yield the lowest average realized volatility, albeit with a small improvement, their excessive gross leverage and investment concentration, and their 10-time larger turnover contribute to smaller average portfolio returns, which mechanically result in smaller realized Sharpe ratios than the Average Oracle. We also provide simple analytical arguments about the origin of the advantage of the Average Oracle over NLS in a changing world.


title: The strongest aftershock in seismic models of epidemic type

abstract: We consider an epidemic-type aftershock model (ETAS($F$)) for a large class of distributions $F$ determining the number of direct aftershocks. This class includes Poisson, Geometric, Negative Binomial distributions and many other. Assuming an exponential form of the productivity and magnitude laws, we find a limiting distribution of the strongest aftershock magnitude $m_a$ when the initial cluster event $m_0$ is large. The regime can be either subcritical or critical; the initial event can be dominant in size or not. In the subcritical regime, the mode of the limiting distribution is determined by the parameters of productivity and the magnitude laws; the shape of this distribution is not universal and is effectively determined by $F$. For example, the Geometric $F$-distribution generates the logistic law, and the Poisson distribution (studied earlier) generates the Gumbel type 1 law. The accuracy of these laws for moderate initial magnitudes is tested numerically. The limit distribution of the Bath's difference $m_0$-$m_a$ is independent of the initial event size only if the regime is critical, and the ratio of exponents in the laws of magnitude and productivity is contained in the interval $(1,2)$. Previous studies of the $m_a$-distribution have dealt with the traditional Poisson $F$ model and with arbitrary (not necessarily dominant) initial magnitude $m_0$.


title: Spin- and valley-dependent transports through ferromagnetic 8-pmmn borophene monolayer

abstract: We study spin and valley-dependent transport properties in an n-p-n junction of 8-pmmn borophene monolayer. An external gate voltage and exchange magnetic field, induced by the proximity effect of a ferromagnetic insulator, are applied to this junction as electric and magnetic potential barriers. We show that the exchange magnetic field generates spin polarization in the system and applying a gate voltage, as a simple method, causes valley polarization. This property (valley polarization) is due to the anisotropic and tilted Dirac cones of the borophene structure. It is an advantage of borophene monolayer over graphene monolayer because in graphene it is necessary to apply strain to have valley polarization. We also show that the proposed device (borophene-based n-p-n junction) can work as perfect spin and perfect valley filters. The spin and valley filters can be controlled by changing two factors, i.e. gate voltage and Fermi energy. Moreover, it is shown that for full spin and valley polarizations and thus perfect spin and valley filters, the length of the barriers must be larger than a specific value (60nm). These results show that the borophene monolayer has a suitable potential to be used in spintronic and valleytronic devices.


title: Fine-Resolution Silicon Photonic Wavelength-Selective Switch Using Hybrid Multimode Racetrack Resonators

abstract: In this work, we describe a procedure for synthesizing racetrack resonators with large quality factors and apply it to realize a multi-channel wavelength-selective switch (WSS) on a silicon photonic chip. We first determine the contribution of each component primitive to propagation loss in a racetrack resonator and use this data to develop a model for the frequency response of arbitrary order, coupled-racetrack channel dropping filters. We design second-order racetrack filters based on this model and cascade multiple such filters to form a 1x7 WSS. We find good agreement between our model and device performance with second-order racetrack that have ~1 dB of drop-port loss, ~2 GHz FWHM linewidth, and low optical crosstalk due to the quick filter roll-off of ~ 5.3 dB/GHz. Using a control algorithm, we show three-channel operation of our WSS with a channel spacing of only 10 GHz. Owing to the high quality factor and quick roll-off of our filter design, adjacent channel crosstalk is measured to be <-25 dB for channels spaced on a 10 GHz grid. As a further demonstration, we use five of seven WSS channels to perform a demultiplexing operation on both an 8 GHz and a 10 GHz grid. These results suggest that a low-loss WSS with fine channel resolution can be realized in a scalable manner using the silicon photonics platform.


title: Glioma subtype classification from histopathological images using in-domain and out-of-domain transfer learning: An experimental study

abstract: We provide in this paper a comprehensive comparison of various transfer learning strategies and deep learning architectures for computer-aided classification of adult-type diffuse gliomas. We evaluate the generalizability of out-of-domain ImageNet representations for a target domain of histopathological images, and study the impact of in-domain adaptation using self-supervised and multi-task learning approaches for pretraining the models using the medium-to-large scale datasets of histopathological images. A semi-supervised learning approach is furthermore proposed, where the fine-tuned models are utilized to predict the labels of unannotated regions of the whole slide images (WSI). The models are subsequently retrained using the ground-truth labels and weak labels determined in the previous step, providing superior performance in comparison to standard in-domain transfer learning with balanced accuracy of 96.91% and F1-score 97.07%, and minimizing the pathologist's efforts for annotation. Finally, we provide a visualization tool working at WSI level which generates heatmaps that highlight tumor areas; thus, providing insights to pathologists concerning the most informative parts of the WSI.


title: Training and inference of large language models using 8-bit floating point

abstract: FP8 formats are gaining popularity to boost the computational efficiency for training and inference of large deep learning models. Their main challenge is that a careful choice of scaling is needed to prevent degradation due to the reduced dynamic range compared to higher-precision formats. Although there exists ample literature about selecting such scalings for INT formats, this critical aspect has yet to be addressed for FP8. This paper presents a methodology to select the scalings for FP8 linear layers, based on dynamically updating per-tensor scales for the weights, gradients and activations. We apply this methodology to train and validate large language models of the type of GPT and Llama 2 using FP8, for model sizes ranging from 111M to 70B. To facilitate the understanding of the FP8 dynamics, our results are accompanied by plots of the per-tensor scale distribution for weights, activations and gradients during both training and inference.


title: Turbulent dynamo action and its effects on the mixing at the convective boundary of an idealized oxygen-burning shell

abstract: Convection is one of the most important mixing processes in stellar interiors. Hydrodynamic mass entrainment can bring fresh fuel from neighboring stable layers into a convection zone, modifying the structure and evolution of the star. Under some conditions, strong magnetic fields can be sustained by the action of a turbulent dynamo, adding another layer of complexity and possibly altering the dynamics in the convection zone and at its boundaries. In this study, we used our fully compressible Seven-League Hydro code to run detailed and highly resolved three-dimensional magnetohydrodynamic simulations of turbulent convection, dynamo amplification, and convective boundary mixing in a simplified setup whose stratification is similar to that of an oxygen-burning shell in a star with an initial mass of $25\ M_\odot$. We find that the random stretching of magnetic field lines by fluid motions in the inertial range of the turbulent spectrum (i.e., a small-scale dynamo) naturally amplifies the seed field by several orders of magnitude in a few convective turnover timescales. During the subsequent saturated regime, the magnetic-to-kinetic energy ratio inside the convective shell reaches values as high as $0.33$, and the average magnetic field strength is ${\sim}10^{10}\,\mathrm{G}$. Such strong fields efficiently suppress shear instabilities, which feed the turbulent cascade of kinetic energy, on a wide range of spatial scales. The resulting convective flows are characterized by thread-like structures that extend over a large fraction of the convective shell. The reduced flow speeds and the presence of magnetic fields with strengths up to $60\%$ of the equipartition value at the upper convective boundary diminish the rate of mass entrainment from the stable layer by ${\approx}\,20\%$ as compared to the purely hydrodynamic case.


title: Differentiable Optimization Based Time-Varying Control Barrier Functions for Dynamic Obstacle Avoidance

abstract: Control barrier functions (CBFs) provide a simple yet effective way for safe control synthesis. Recently, work has been done using differentiable optimization (diffOpt) based methods to systematically construct CBFs for static obstacle avoidance tasks between geometric shapes. In this work, we extend the application of diffOpt CBFs to perform dynamic obstacle avoidance tasks. We show that by using the time-varying CBF (TVCBF) formulation, we can perform obstacle avoidance for dynamic geometric obstacles. Additionally, we show how to extend the TVCBF constraint to consider measurement noise and actuation limits. To demonstrate the efficacy of our proposed approach, we first compare its performance with a model predictive control based method and a circular CBF based method on a simulated dynamic obstacle avoidance task. Then, we demonstrate the performance of our proposed approach in experimental studies using a 7-degree-of-freedom Franka Research 3 robotic manipulator.


title: MORPH: Design Co-optimization with Reinforcement Learning via a Differentiable Hardware Model Proxy

abstract: We introduce MORPH, a method for co-optimization of hardware design parameters and control policies in simulation using reinforcement learning. Like most co-optimization methods, MORPH relies on a model of the hardware being optimized, usually simulated based on the laws of physics. However, such a model is often difficult to integrate into an effective optimization routine. To address this, we introduce a proxy hardware model, which is always differentiable and enables efficient co-optimization alongside a long-horizon control policy using RL. MORPH is designed to ensure that the optimized hardware proxy remains as close as possible to its realistic counterpart, while still enabling task completion. We demonstrate our approach on simulated 2D reaching and 3D multi-fingered manipulation tasks.


title: Roundoff error analysis of the double exponential formula-based method for the matrix sign function

abstract: In this paper, we perform a roundoff error analysis of an integration-based method for computing the matrix sign function recently proposed by Nakaya and Tanaka. The method expresses the matrix sign function using an integral representation and computes the integral numerically by the double-exponential formula. While the method has large-grain parallelism and works well for well-conditioned matrices, its accuracy deteriorates when the input matrix is ill-conditioned or highly nonnormal. We investigate the reason for this phenomenon by a detailed roundoff error analysis.


title: Asymmetric cloning in quantum information theory

abstract: This thesis investigates quantum cloning and related quantum entanglement problems using core concepts of representation theory, in particular those associated with the symmetric group. The research explores Schur-Weyl duality and its extensions, which allow efficient representation and manipulation of quantum systems, serving as a valuable tool for quantum information theory. A primary application of Schur-Weyl duality is the quantum cloning problem, which is studied for both the $1 \to 2$ and the more general $1 \to N$ cases, providing new insights into the constraints imposed by the no-cloning theorem. The investigation extends to a more general quantum entanglement problem on a complete graph.


title: Spurious Feature Diversification Improves Out-of-distribution Generalization

abstract: Generalization to out-of-distribution (OOD) data is a critical challenge in machine learning. Ensemble-based methods, like weight space ensembles that interpolate model parameters, have been shown to achieve superior OOD performance. However, the underlying mechanism for their effectiveness remains unclear. In this study, we closely examine WiSE-FT, a popular weight space ensemble method that interpolates between a pre-trained and a fine-tuned model. We observe an unexpected phenomenon, in which WiSE-FT successfully corrects many cases where each individual model makes incorrect predictions, which contributes significantly to its OOD effectiveness. To gain further insights, we conduct theoretical analysis in a multi-class setting with a large number of spurious features. Our analysis predicts the above phenomenon and it further shows that ensemble-based models reduce prediction errors in the OOD settings by utilizing a more diverse set of spurious features. Contrary to the conventional wisdom that focuses on learning invariant features for better OOD performance, our findings suggest that incorporating a large number of diverse spurious features weakens their individual contributions, leading to improved overall OOD generalization performance. Empirically we demonstrate the effectiveness of utilizing diverse spurious features on a MultiColorMNIST dataset, and our experimental results are consistent with the theoretical analysis. Building upon the new theoretical insights into the efficacy of ensemble methods, we further identify an issue of WiSE-FT caused by the overconfidence of fine-tuned models in OOD situations. This overconfidence magnifies the fine-tuned model's incorrect prediction, leading to deteriorated OOD ensemble performance. To remedy this problem, we propose a novel method called BAlaNced averaGing (BANG), which significantly enhances the OOD performance of WiSE-FT.


title: Planar thermal Hall effect from phonons in a Kitaev candidate material

abstract: Kitaev materials are a promising platform for the realization of quantum spin liquid states. The thermal Hall effect has emerged as a potential probe of exotic excitations within such states. In the Kitaev candidate material $\alpha$-RuCl$_{3}$, however, the thermal Hall conductivity $\kappa_{xy}$ has been attributed not only to exotic Majorana fermions or chiral magnons, but also to phonons. It has been shown theoretically that the former two types of heat carriers can generate a "planar" thermal Hall effect, whereby the magnetic field is parallel to the heat current, as observed experimentally, but it is unknown whether phonons also could. Here we show that a planar thermal Hall effect is present in another Kitaev candidate material, Na$_{2}$Co$_{2}$TeO$_{6}$. On the basis of a striking similarity between the temperature and field dependence of $\kappa_{xy}$ and that of the phonon-dominated thermal conductivity $\kappa_{xx}$, we argue that the planar thermal Hall effect in Na$_{2}$Co$_{2}$TeO$_{6}$ is generated by phonons. The phonon contributed planar $\kappa_{xy}$ also shows a strong sample dependence, which indicates an extrinsic origin of the mechanism. By conducting a complete study with different in-plane configurations of heat current $J$ and magnetic field $H$, $i.e.$ $H$ $\|$ $J$ and $H$ $\bot$ $J$, we observe a large difference in $\kappa_{xy}$ between these two configurations, which reveals that the direction of the heat current $J$ may play an important role in determining the planar thermal Hall effect. Our observation calls for a re-evaluation of the planar thermal Hall effect observed in $\alpha$-RuCl$_{3}$.


title: Zemach and Friar radii of the proton and neutron from lattice QCD

abstract: We present the first lattice-QCD result for the Zemach and Friar radii of the proton and neutron. Our calculation includes both quark-connected and -disconnected diagrams and assesses all sources of systematic uncertainties arising from excited-state contributions, finite-volume effects and the continuum extrapolation. At the physical point, we obtain for the proton $r_Z^p = ( 1.013 \pm 0.010\ (\mathrm{stat}) \pm 0.012\ (\mathrm{syst}) )~\mathrm{fm}$ and $r_F^p = ( 1.301 \pm 0.012\ (\mathrm{stat}) \pm 0.014\ (\mathrm{syst}) )~\mathrm{fm}$. These numbers suggest small values of the Zemach and Friar radii of the proton, but are compatible with most of the experimental studies.


title: Open Hardware Solutions in Quantum Technology

abstract: Quantum technologies such as communications, computing, and sensing offer vast opportunities for advanced research and development. While an open-source ethos currently exists within some quantum technologies, especially in quantum computer programming, we argue that there are additional advantages in developing open quantum hardware (OQH). Open quantum hardware encompasses open-source software for the control of quantum devices in labs, blueprints and open-source toolkits for chip design and other hardware components, as well as openly-accessible testbeds and facilities that allow cloud-access to a wider scientific community. We provide an overview of current projects in the OQH ecosystem, identify gaps, and make recommendations on how to close them today. More open quantum hardware would accelerate technology transfer to and growth of the quantum industry and increase accessibility in science.


title: Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation

abstract: There is an growing interest in using Large Language Models (LLMs) in multi-agent systems to tackle interactive real-world tasks that require effective collaboration and assessing complex situations. Yet, we still have a limited understanding of LLMs' communication and decision-making abilities in multi-agent setups. The fundamental task of negotiation spans many key features of communication, such as cooperation, competition, and manipulation potentials. Thus, we propose using scorable negotiation to evaluate LLMs. We create a testbed of complex multi-agent, multi-issue, and semantically rich negotiation games. To reach an agreement, agents must have strong arithmetic, inference, exploration, and planning capabilities while integrating them in a dynamic and multi-turn setup. We propose multiple metrics to rigorously quantify agents' performance and alignment with the assigned role. We provide procedures to create new games and increase games' difficulty to have an evolving benchmark. Importantly, we evaluate critical safety aspects such as the interaction dynamics between agents influenced by greedy and adversarial players. Our benchmark is highly challenging; GPT-3.5 and small models mostly fail, and GPT-4 and SoTA large models (e.g., Llama-3 70b) still underperform.