title: Pressure of Coulomb systems with volume-dependent long-range potentials

abstract: In this work, we consider the pressure of Coulomb systems, in which particles interact via a volume-dependent potential (in particular, the Ewald potential). We confirm that the expression for virial pressure should be corrected in this case. We show that the corrected virial pressure coincides with the formula obtained by differentiation of free energy if the potential energy is a homogeneous function of particle coordinates and a cell length. As a consequence, we find out that the expression for pressure in the recent paper by J. Liang \textit{et al.} [\href{https://doi.org/10.1063/5.0107140}{J. Chem. Phys. \textbf{157}, 144102 (2022)}] is incorrect.


title: Dynamics of photospheric magnetic flux distribution and variations in solar RVs -- a study using HARPS-N solar and SDO observations

abstract: The distribution and evolution of photospheric magnetic field in sunspots, plages and network, and variations in their relative flux content, play key roles in radial velocity (RV) fluctuations observed in Sun-as-a-star spectra. Differentiating and disentangling such magnetic contributions to RVs help in building models to account for stellar activity signals in high precision RV exoplanet searches. In this work, as earlier authors, we employ high-resolution images of the solar magnetic field and continuum intensities from SDO/HMI to understand the activity contributions to RVs from HARPS-N solar observations. Using well observed physical relationships between strengths and fluxes of photospheric magnetic fields, we show that the strong fields (spots, plages and network) and the weak internetwork fields leave distinguishing features in their contributions to the RV variability. We also find that the fill-factors and average unsigned magnetic fluxes of different features correlate differently with the RVs and hence warrant care in employing either of them as a proxy for RV variations. In addition, we examine disk averaged UV intensities at 1600 \r{A} and 1700 \r{A} wavelength bands imaged by SDO/AIA and their performances as proxies for variations in different magnetic features. We find that the UV intensities provide a better measure of contributions of plage fields to RVs than the Ca II H-K emission indices, especially during high activity levels when the latter tend to saturate.


title: Improving Information Extraction on Business Documents with Specific Pre-Training Tasks

abstract: Transformer-based Language Models are widely used in Natural Language Processing related tasks. Thanks to their pre-training, they have been successfully adapted to Information Extraction in business documents. However, most pre-training tasks proposed in the literature for business documents are too generic and not sufficient to learn more complex structures. In this paper, we use LayoutLM, a language model pre-trained on a collection of business documents, and introduce two new pre-training tasks that further improve its capacity to extract relevant information. The first is aimed at better understanding the complex layout of documents, and the second focuses on numeric values and their order of magnitude. These tasks force the model to learn better-contextualized representations of the scanned documents. We further introduce a new post-processing algorithm to decode BIESO tags in Information Extraction that performs better with complex entities. Our method significantly improves extraction performance on both public (from 93.88 to 95.50 F1 score) and private (from 84.35 to 84.84 F1 score) datasets composed of expense receipts, invoices, and purchase orders.


title: Neuromorphic Auditory Perception by Neural Spiketrum

abstract: Neuromorphic computing holds the promise to achieve the energy efficiency and robust learning performance of biological neural systems. To realize the promised brain-like intelligence, it needs to solve the challenges of the neuromorphic hardware architecture design of biological neural substrate and the hardware amicable algorithms with spike-based encoding and learning. Here we introduce a neural spike coding model termed spiketrum, to characterize and transform the time-varying analog signals, typically auditory signals, into computationally efficient spatiotemporal spike patterns. It minimizes the information loss occurring at the analog-to-spike transformation and possesses informational robustness to neural fluctuations and spike losses. The model provides a sparse and efficient coding scheme with precisely controllable spike rate that facilitates training of spiking neural networks in various auditory perception tasks. We further investigate the algorithm-hardware co-designs through a neuromorphic cochlear prototype which demonstrates that our approach can provide a systematic solution for spike-based artificial intelligence by fully exploiting its advantages with spike-based computation.


title: General theory for plane extensible elastica with arbitrary undeformed shape

abstract: A general expression for the strain energy of a homogeneous, isotropic, plane extensible elastica with an arbitrary undeformed configuration is derived. This energy constitutes the correct expression for one-dimensional models of polymers or vesicles, whose natural configuration is characterized by locally changing curvature. We derive the macroscopic stress-strain relations, providing an universal criterion for the neutral curve location. In this respect, we demonstrate that the natural curve existence constitutes the fundamental requirement for the conformational dynamics of any inextensbile biological filament.


title: Improved method to determine the $\Xi_c-\Xi_c'$ mixing

abstract: We develop an improved method to explore the $\Xi_c- \Xi_c'$ mixing which arises from the flavor SU(3) and heavy quark symmetry breaking. In this method, the flavor eigenstates under the SU(3) symmetry are at first constructed and the corresponding masses can be nonperturbatively determined. Matrix elements of the mass operators which break the flavor SU(3) symmetry sandwiched by the flavor eigenstates are then calculated. Diagonalizing the corresponding matrix of Hamiltonian gives the mass eigenstates of the full Hamiltonian and determines the mixing. Following the previous lattice QCD calculation of $\Xi_c$ and $\Xi_c'$, and estimating an off-diagonal matrix element, we extract the mixing angle between the $\Xi_c$ and $\Xi_c'$. Preliminary numerical results for the mixing angle confirm the previous observation that such mixing is incapable to explain the large SU(3) symmetry breaking in semileptonic decays of charmed baryons.


title: Design and Validation of a Wireless Drone Docking Station

abstract: Drones are increasingly operating autonomously, and the need for extending drone power autonomy is rapidly increasing. One of the most promising solutions to extend drone power autonomy is the use of docking stations to support both landing and recharging of the drone. To this end, we introduce a novel wireless drone docking station with three commercial wireless charging modules. We have developed two independent units, both in mechanical and electrical aspects: the energy transmitting unit and the energy receiving unit. We have also studied the efficiency of wireless power transfer and demonstrated the advantages of connecting three receiver modules connected in series and parallel. We have achieved maximum output power of 96.5 W with a power transfer efficiency of 56.6% for the series connection of coils. Finally, we implemented the system in practice on a drone and tested both energy transfer and landing.


title: A parameterised model for link prediction using node centrality and similarity measure based on graph embedding

abstract: Link prediction is a key aspect of graph machine learning, with applications as diverse as disease prediction, social network recommendations, and drug discovery. It involves predicting new links that may form between network nodes. Despite the clear importance of link prediction, existing models have significant shortcomings. Graph Convolutional Networks, for instance, have been proven to be highly efficient for link prediction on a variety of datasets. However, they encounter severe limitations when applied to short-path networks and ego networks, resulting in poor performance. This presents a critical problem space that this work aims to address. In this paper, we present the Node Centrality and Similarity Based Parameterised Model (NCSM), a novel method for link prediction tasks. NCSM uniquely integrates node centrality and similarity measures as edge features in a customised Graph Neural Network (GNN) layer, effectively leveraging the topological information of large networks. This model represents the first parameterised GNN-based link prediction model that considers topological information. The proposed model was evaluated on five benchmark graph datasets, each comprising thousands of nodes and edges. Experimental results highlight NCSM's superiority over existing state-of-the-art models like Graph Convolutional Networks and Variational Graph Autoencoder, as it outperforms them across various metrics and datasets. This exceptional performance can be attributed to NCSM's innovative integration of node centrality, similarity measures, and its efficient use of topological information.


title: Parallel Selected Inversion for Space-Time Gaussian Markov Random Fields

abstract: Performing a Bayesian inference on large spatio-temporal models requires extracting inverse elements of large sparse precision matrices for marginal variances. Although direct matrix factorizations can be used for the inversion, such methods fail to scale well for distributed problems when run on large computing clusters. On the contrary, Krylov subspace methods for the selected inversion have been gaining traction. We propose a parallel hybrid approach based on domain decomposition, which extends the Rao-Blackwellized Monte Carlo estimator for distributed precision matrices. Our approach exploits the strength of Krylov subspace methods as global solvers and efficiency of direct factorizations as base case solvers to compute the marginal variances using a divide-and-conquer strategy. By introducing subdomain overlaps, one can achieve a greater accuracy at an increased computational effort with little to no additional communication. We demonstrate the speed improvements on both simulated models and a massive US daily temperature data.


title: Quantized Fourier and Polynomial Features for more Expressive Tensor Network Models

abstract: In the context of kernel machines, polynomial and Fourier features are commonly used to provide a nonlinear extension to linear models by mapping the data to a higher-dimensional space. Unless one considers the dual formulation of the learning problem, which renders exact large-scale learning unfeasible, the exponential increase of model parameters in the dimensionality of the data caused by their tensor-product structure prohibits to tackle high-dimensional problems. One of the possible approaches to circumvent this exponential scaling is to exploit the tensor structure present in the features by constraining the model weights to be an underparametrized tensor network. In this paper we quantize, i.e. further tensorize, polynomial and Fourier features. Based on this feature quantization we propose to quantize the associated model weights, yielding quantized models. We show that, for the same number of model parameters, the resulting quantized models have a higher bound on the VC-dimension as opposed to their non-quantized counterparts, at no additional computational cost while learning from identical features. We verify experimentally how this additional tensorization regularizes the learning problem by prioritizing the most salient features in the data and how it provides models with increased generalization capabilities. We finally benchmark our approach on large regression task, achieving state-of-the-art results on a laptop computer.


title: Generation of three-dimensional cluster entangled state

abstract: Measurement-based quantum computing is a promising paradigm of quantum computation, where universal computing is achieved through a sequence of local measurements. The backbone of this approach is the preparation of multipartite entanglement, known as cluster states. While a cluster state with two-dimensional (2D) connectivity is required for universality, a three-dimensional (3D) cluster state is necessary for additionally achieving fault tolerance. However, the challenge of making 3D connectivity has limited cluster state generation up to 2D. Here we demonstrate deterministic generation of a 3D cluster state based on the photonic continuous-variable platform. To realize 3D connectivity, we harness a crucial advantage of time-frequency modes of ultrafast quantum light: an arbitrary complex mode basis can be accessed directly, enabling connectivity as desired. We demonstrate the versatility of our method by generating cluster states with 1D, 2D, and 3D connectivities. For their complete characterization, we develop a quantum state tomography method for multimode Gaussian states. Moreover, we verify the cluster state generation by nullifier measurements as well as full inseparability tests. Our work paves the way toward fault-tolerant and universal measurement-based quantum computing.


title: Towards Content-based Pixel Retrieval in Revisited Oxford and Paris

abstract: This paper introduces the first two pixel retrieval benchmarks. Pixel retrieval is segmented instance retrieval. Like semantic segmentation extends classification to the pixel level, pixel retrieval is an extension of image retrieval and offers information about which pixels are related to the query object. In addition to retrieving images for the given query, it helps users quickly identify the query object in true positive images and exclude false positive images by denoting the correlated pixels. Our user study results show pixel-level annotation can significantly improve the user experience. Compared with semantic and instance segmentation, pixel retrieval requires a fine-grained recognition capability for variable-granularity targets. To this end, we propose pixel retrieval benchmarks named PROxford and PRParis, which are based on the widely used image retrieval datasets, ROxford and RParis. Three professional annotators label 5,942 images with two rounds of double-checking and refinement. Furthermore, we conduct extensive experiments and analysis on the SOTA methods in image search, image matching, detection, segmentation, and dense matching using our pixel retrieval benchmarks. Results show that the pixel retrieval task is challenging to these approaches and distinctive from existing problems, suggesting that further research can advance the content-based pixel-retrieval and thus user search experience. The datasets can be downloaded from \href{https://github.com/anguoyuan/Pixel_retrieval-Segmented_instance_retrieval}{this link}.


title: An axially symmetric spacetime with causality violation in Ricci-inverse gravity

abstract: In this paper, Ricci-inverse gravity is investigated. It is an alternative theory of gravity that introduces into the Einstein-Hilbert action an anti-curvature scalar that is obtained from the anti-curvature tensor which is the inverse of the Ricci tensor. An axially symmetric spacetime with causality violation is studied. Two classes of the model are discussed. Different sources of matter are considered. Then a direct relation between the content of matter and causality violation is shown. Our results confirm that Ricci-inverse gravity allows the existence of Closed Time-like Curves (CTCs) that lead to the violation of causality. Furthermore, a comparison is made between the results of general relativity and Ricci-inverse gravity. Other spacetimes, such as G\"{o}del and G\"{o}del-type universes, which are exact solutions of general relativity and allow for causality violations, are also explored in Ricci-inverse gravity framework.


title: Emissions and energy efficiency on large-scale high performance computing facilities: ARCHER2 UK national supercomputing service case study

abstract: Large supercomputing facilities are critical to research in many areas that impact on decisions such as how to address the current climate emergency. For example, climate modelling, renewable energy facility design and new battery technologies. However, these systems themselves are a source of large amounts of emissions due to the embodied emissions associated with their construction, transport, and decommissioning; and the power consumption associated with running the facility. Recently, the UK National Supercomputing Service, ARCHER2, has been analysing the impact of the facility in terms of energy and emissions. Based on this work, we have made changes to the operation of the service that give a cumulative saving of more than 20% in power draw of the computational resources with all application benchmarks showing reduced power to solution. In this paper, we describe our analysis and the changes made to the operation of the service to improve its energy efficiency, and thereby reduce its climate impacts.


title: Revised Fowler-Dubridge model for photoelectron emission from two-dimensional materials

abstract: We revise the Fowler-Dubridge (FB) model for photoelectron emission from two-dimensional (2D) materials to include the effects of reduced dimensionality, non-parabolic and anisotropic energy dispersion of 2D materials. Two different directions of electron emission are studied, namely vertical emission from the surface and lateral emission from the edge. Our analytical model reveals a universal temperature scaling of T\b{eta} with \b{eta} = 1 and \b{eta} = 3/2, respectively, for the surface and edge emission over a wide class of 2D materials, which are distinct from the traditional scaling of \b{eta} = 2 originally derived for the traditional bulk materials. Our comparison shows good agreement to two experiments of photo-electron emitted from graphene for both surface and edge emission. Our calculations also show the photoelectron emission is more pronounced than the coexisting thermionic emission for materials with low temperature and Fermi energy. This model provides helpful guidance in choosing proper combinations of light intensity, temperature range and type of 2D materials for the design of photoemitters, photodetectors and other optoelectronics


title: Testing Spreading Behavior in Networks with Arbitrary Topologies

abstract: Inspired by the works of Goldreich and Ron (J. ACM, 2017) and Nakar and Ron (ICALP, 2021), we initiate the study of property testing in dynamic environments with arbitrary topologies. Our focus is on the simplest non-trivial rule that can be tested, which corresponds to the 1-BP rule of bootstrap percolation and models a simple spreading behavior: Every "infected" node stays infected forever, and each "healthy" node becomes infected if and only if it has at least one infected neighbor. We show various results for both the case where we test a single time step of evolution and where the evolution spans several time steps. In the first, we show that the worst-case query complexity is $O(\Delta/\varepsilon)$ or $\tilde{O}(\sqrt{n}/\varepsilon)$ (whichever is smaller), where $\Delta$ and $n$ are the maximum degree of a node and number of vertices, respectively, in the underlying graph, and we also show lower bounds for both one- and two-sided error testers that match our upper bounds up to $\Delta = o(\sqrt{n})$ and $\Delta = O(n^{1/3})$, respectively. In the second setting of testing the environment over $T$ time steps, we show upper bounds of $O(\Delta^{T-1}/\varepsilon T)$ and $\tilde{O}(|E|/\varepsilon T)$, where $E$ is the set of edges of the underlying graph. All of our algorithms are one-sided error, and all of them are also time-conforming and non-adaptive, with the single exception of the more complex $\tilde{O}(\sqrt{n}/\varepsilon)$-query tester for the case $T = 2$.


title: Know What Not To Know: Users' Perception of Abstaining Classifiers

abstract: Machine learning systems can help humans to make decisions by providing decision suggestions (i.e., a label for a datapoint). However, individual datapoints do not always provide enough clear evidence to make confident suggestions. Although methods exist that enable systems to identify those datapoints and subsequently abstain from suggesting a label, it remains unclear how users would react to such system behavior. This paper presents first findings from a user study on systems that do or do not abstain from labeling ambiguous datapoints. Our results show that label suggestions on ambiguous datapoints bear a high risk of unconsciously influencing the users' decisions, even toward incorrect ones. Furthermore, participants perceived a system that abstains from labeling uncertain datapoints as equally competent and trustworthy as a system that delivers label suggestions for all datapoints. Consequently, if abstaining does not impair a system's credibility, it can be a useful mechanism to increase decision quality.


title: Pushing Mixture of Experts to the Limit: Extremely Parameter Efficient MoE for Instruction Tuning

abstract: The Mixture of Experts (MoE) is a widely known neural architecture where an ensemble of specialized sub-models optimizes overall performance with a constant computational cost. However, conventional MoEs pose challenges at scale due to the need to store all experts in memory. In this paper, we push MoE to the limit. We propose extremely parameter-efficient MoE by uniquely combining MoE architecture with lightweight experts.Our MoE architecture outperforms standard parameter-efficient fine-tuning (PEFT) methods and is on par with full fine-tuning by only updating the lightweight experts -- less than 1% of an 11B parameters model. Furthermore, our method generalizes to unseen tasks as it does not depend on any prior task knowledge. Our research underscores the versatility of the mixture of experts architecture, showcasing its ability to deliver robust performance even when subjected to rigorous parameter constraints. Our code used in all the experiments is publicly available here: https://github.com/for-ai/parameter-efficient-moe.


title: Many Cores, Many Models: GPU Programming Model vs. Vendor Compatibility Overview

abstract: In recent history, GPUs became a key driver of compute performance in HPC. With the installation of the Frontier supercomputer, they became the enablers of the Exascale era; further largest-scale installations are in progress (Aurora, El Capitan, JUPITER). But the early-day dominance by NVIDIA and their CUDA programming model has changed: The current HPC GPU landscape features three vendors (AMD, Intel, NVIDIA), each with native and derived programming models. The choices are ample, but not all models are supported on all platforms, especially if support for Fortran is needed; in addition, some restrictions might apply. It is hard for scientific programmers to navigate this abundance of choices and limits. This paper gives a guide by matching the GPU platforms with supported programming models, presented in a concise table and further elaborated in detailed comments. An assessment is made regarding the level of support of a model on a platform.


title: A Localization-to-Segmentation Framework for Automatic Tumor Segmentation in Whole-Body PET/CT Images

abstract: Fluorodeoxyglucose (FDG) positron emission tomography (PET) combined with computed tomography (CT) is considered the primary solution for detecting some cancers, such as lung cancer and melanoma. Automatic segmentation of tumors in PET/CT images can help reduce doctors' workload, thereby improving diagnostic quality. However, precise tumor segmentation is challenging due to the small size of many tumors and the similarity of high-uptake normal areas to the tumor regions. To address these issues, this paper proposes a localization-to-segmentation framework (L2SNet) for precise tumor segmentation. L2SNet first localizes the possible lesions in the lesion localization phase and then uses the location cues to shape the segmentation results in the lesion segmentation phase. To further improve the segmentation performance of L2SNet, we design an adaptive threshold scheme that takes the segmentation results of the two phases into consideration. The experiments with the MICCAI 2023 Automated Lesion Segmentation in Whole-Body FDG-PET/CT challenge dataset show that our method achieved a competitive result and was ranked in the top 7 methods on the preliminary test set. Our work is available at: https://github.com/MedCAI/L2SNet.


title: DoG-Instruct: Towards Premium Instruction-Tuning Data via Text-Grounded Instruction Wrapping

abstract: The improvement of LLMs' instruction-following capabilities relies heavily on the availability of high-quality instruction-response pairs. Unfortunately, the current methods used to collect the pairs suffer from either unaffordable labor costs or severe hallucinations in the self-generation of LLM. To tackle these challenges, this paper proposes a scalable solution. It involves training LLMs to generate instruction-response pairs based on human-written documents, rather than relying solely on self-generation without context. Our proposed method not only exploits the advantages of human-written documents in reducing hallucinations but also utilizes an LLM to wrap the expression of documents, which enables us to bridge the gap between various document styles and the standard AI response. Experiments demonstrate that our method outperforms existing typical methods on multiple benchmarks. In particular, compared to the best-performing baseline, the LLM trained using our generated dataset exhibits a 10\% relative improvement in performance on AlpacaEval, despite utilizing only 1/5 of its training data. Furthermore, a comprehensive manual evaluation validates the quality of the data we generated. Our trained wrapper is publicly available at https://github.com/Bahuia/Dog-Instruct.


title: Panoptic Vision-Language Feature Fields

abstract: Recently, methods have been proposed for 3D open-vocabulary semantic segmentation. Such methods are able to segment scenes into arbitrary classes based on text descriptions provided during runtime. In this paper, we propose to the best of our knowledge the first algorithm for open-vocabulary panoptic segmentation in 3D scenes. Our algorithm, Panoptic Vision-Language Feature Fields (PVLFF), learns a semantic feature field of the scene by distilling vision-language features from a pretrained 2D model, and jointly fits an instance feature field through contrastive learning using 2D instance segments on input frames. Despite not being trained on the target classes, our method achieves panoptic segmentation performance similar to the state-of-the-art closed-set 3D systems on the HyperSim, ScanNet and Replica dataset and additionally outperforms current 3D open-vocabulary systems in terms of semantic segmentation. We ablate the components of our method to demonstrate the effectiveness of our model architecture. Our code will be available at https://github.com/ethz-asl/pvlff.


title: First exploration of the runaway greenhouse transition with a GCM

abstract: Even if their detection is for now challenging, observation of small terrestrial planets will be easier in a near future thanks to continuous improvements of detection and characterisation instruments. In this quest, climate modeling is a key step to understand their characteristics, atmospheric composition and possible history. If a surface water reservoir is present on such a terrestrial planet, an increase in insolation may lead to a dramatic positive feedback induced by water evaporation: the runaway greenhouse. The resulting rise of global surface temperature leads to the evaporation of the entire water reservoir, separating two very different population of planets: 1) temperate planets with a surface water ocean and 2) hot planets with a puffed atmosphere dominated by water vapor. In this work we use a 3D General Circulation Model (GCM), the Generic-PCM, to study the runaway greenhouse transition, linking temperate and post-runaway states. Our simulations are made of two steps. First, assuming initially a liquid surface ocean, an evaporation phase which enriches the atmosphere in water vapor. Second, when the ocean is considered entirely evaporated, a dry transition phase for which the surface temperature increases dramatically. Finally, it converges on a hot and stable post-runaway state. By describing in detail the evolution of the climate during these two steps, we show a rapid transition of the cloud coverage and of the wind circulation from the troposphere to the stratosphere. By comparing our result to previous studies using 1D models, we discuss the effect of intrinsically 3D processes such as the global dynamics and the clouds, keys to understand the runaway greenhouse. We also explore the potential reversibility of the runaway greenhouse, limited by its radiative unbalance.


title: A Comparison between Frame-based and Event-based Cameras for Flapping-Wing Robot Perception

abstract: Perception systems for ornithopters face severe challenges. The harsh vibrations and abrupt movements caused during flapping are prone to produce motion blur and strong lighting condition changes. Their strict restrictions in weight, size, and energy consumption also limit the type and number of sensors to mount onboard. Lightweight traditional cameras have become a standard off-the-shelf solution in many flapping-wing designs. However, bioinspired event cameras are a promising solution for ornithopter perception due to their microsecond temporal resolution, high dynamic range, and low power consumption. This paper presents an experimental comparison between frame-based and an event-based camera. Both technologies are analyzed considering the particular flapping-wing robot specifications and also experimentally analyzing the performance of well-known vision algorithms with data recorded onboard a flapping-wing robot. Our results suggest event cameras as the most suitable sensors for ornithopters. Nevertheless, they also evidence the open challenges for event-based vision on board flapping-wing robots.


title: Dual-view Curricular Optimal Transport for Cross-lingual Cross-modal Retrieval

abstract: Current research on cross-modal retrieval is mostly English-oriented, as the availability of a large number of English-oriented human-labeled vision-language corpora. In order to break the limit of non-English labeled data, cross-lingual cross-modal retrieval (CCR) has attracted increasing attention. Most CCR methods construct pseudo-parallel vision-language corpora via Machine Translation (MT) to achieve cross-lingual transfer. However, the translated sentences from MT are generally imperfect in describing the corresponding visual contents. Improperly assuming the pseudo-parallel data are correctly correlated will make the networks overfit to the noisy correspondence. Therefore, we propose Dual-view Curricular Optimal Transport (DCOT) to learn with noisy correspondence in CCR. In particular, we quantify the confidence of the sample pair correlation with optimal transport theory from both the cross-lingual and cross-modal views, and design dual-view curriculum learning to dynamically model the transportation costs according to the learning stage of the two views. Extensive experiments are conducted on two multilingual image-text datasets and one video-text dataset, and the results demonstrate the effectiveness and robustness of the proposed method. Besides, our proposed method also shows a good expansibility to cross-lingual image-text baselines and a decent generalization on out-of-domain data.


title: Evaluating the Deductive Competence of Large Language Models

abstract: The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning problem from the cognitive science literature. The tested LLMs have limited abilities to solve these problems in their conventional form. We performed follow up experiments to investigate if changes to the presentation format and content improve model performance. We do find performance differences between conditions; however, they do not improve overall performance. Moreover, we find that performance interacts with presentation format and content in unexpected ways that differ from human performance. Overall, our results suggest that LLMs have unique reasoning biases that are only partially predicted from human reasoning performance and the human-generated language corpora that informs them.


title: A Minimum-propellant Pontryagin-based Nonlinear MPC for Spacecraft Rendezvous in Lunar Orbit: the Extended Version

abstract: We propose a Nonlinear Model Predictive Control approach to spacecraft rendezvous in non-Keplerian Lunar orbits. The approach is based on the Pontryagin Minimum Principle and allows the accomplishment of minimum-propellant maneuvers. The relative motion between the chaser and the target is described by the nonlinear and unstable dynamics of the circular restricted three body-problem. In the proposed formulation, we design a minimum-propellant controller, which leads to a bang-bang behavior of the control signal. Under suitable assumptions, simplified dynamics is employed as prediction model, in order to reduce the complexity of the controller algorithm but, at the same time, without penalizing the controller tracking performance. The proposed approach's effectiveness is validated by a simulation example.


title: Flesch or Fumble? Evaluating Readability Standard Alignment of Instruction-Tuned Language Models

abstract: Readability metrics and standards such as Flesch Kincaid Grade Level (FKGL) and the Common European Framework of Reference for Languages (CEFR) exist to guide teachers and educators to properly assess the complexity of educational materials before administering them for classroom use. In this study, we select a diverse set of open and closed-source instruction-tuned language models and investigate their performances in writing story completions and simplifying narratives--tasks that teachers perform--using standard-guided prompts controlling text readability. Our extensive findings provide empirical proof of how globally recognized models like ChatGPT may be considered less effective and may require more refined prompts for these generative tasks compared to other open-sourced models such as BLOOMZ and FlanT5--which have shown promising results.


title: Diffusion-Based Co-Speech Gesture Generation Using Joint Text and Audio Representation

abstract: This paper describes a system developed for the GENEA (Generation and Evaluation of Non-verbal Behaviour for Embodied Agents) Challenge 2023. Our solution builds on an existing diffusion-based motion synthesis model. We propose a contrastive speech and motion pretraining (CSMP) module, which learns a joint embedding for speech and gesture with the aim to learn a semantic coupling between these modalities. The output of the CSMP module is used as a conditioning signal in the diffusion-based gesture synthesis model in order to achieve semantically-aware co-speech gesture generation. Our entry achieved highest human-likeness and highest speech appropriateness rating among the submitted entries. This indicates that our system is a promising approach to achieve human-like co-speech gestures in agents that carry semantic meaning.


title: Top-degree rational cohomology in the symplectic group of a number ring

abstract: Let $K$ be a number field with ring of integers $R = \mathcal{O}_K$. We show that if $R$ is not a principal ideal domain, then the symplectic group $\operatorname{Sp}_{2n}(R)$ has non-trivial rational cohomology in its virtual cohomological dimension. This demonstrates a sharp contrast to the situation where $R$ is Euclidean. To prove our result, we study the symplectic Steinberg module, i.e. the top-dimensional homology group of the spherical building associated to $\operatorname{Sp}_{2n}(K)$. We show that this module is not generated by integral apartment classes.


title: Unveiling the Sentinels: Assessing AI Performance in Cybersecurity Peer Review

abstract: Peer review is the method employed by the scientific community for evaluating research advancements. In the field of cybersecurity, the practice of double-blind peer review is the de-facto standard. This paper touches on the holy grail of peer reviewing and aims to shed light on the performance of AI in reviewing for academic security conferences. Specifically, we investigate the predictability of reviewing outcomes by comparing the results obtained from human reviewers and machine-learning models. To facilitate our study, we construct a comprehensive dataset by collecting thousands of papers from renowned computer science conferences and the arXiv preprint website. Based on the collected data, we evaluate the prediction capabilities of ChatGPT and a two-stage classification approach based on the Doc2Vec model with various classifiers. Our experimental evaluation of review outcome prediction using the Doc2Vec-based approach performs significantly better than the ChatGPT and achieves an accuracy of over 90%. While analyzing the experimental results, we identify the potential advantages and limitations of the tested ML models. We explore areas within the paper-reviewing process that can benefit from automated support approaches, while also recognizing the irreplaceable role of human intellect in certain aspects that cannot be matched by state-of-the-art AI techniques.


title: ECG-based estimation of respiratory modulation of AV nodal conduction during atrial fibrillation

abstract: Information about autonomic nervous system (ANS) activity may be valuable for personalized atrial fibrillation (AF) treatment but is not easily accessible from the ECG. In this study, we propose a new approach for ECG-based assessment of respiratory modulation in AV nodal refractory period and conduction delay. A 1-dimensional convolutional neural network (1D-CNN) was trained to estimate respiratory modulation of AV nodal conduction properties from 1-minute segments of RR series, respiration signals, and atrial fibrillatory rates (AFR) using synthetic data that replicates clinical ECG-derived data. The synthetic data were generated using a network model of the AV node and 4 million unique model parameter sets. The 1D-CNN was then used to analyze respiratory modulation in clinical deep breathing test data of 28 patients in AF, where a ECG-derived respiration signal was extracted using a novel approach based on periodic component analysis. We demonstrated using synthetic data that the 1D-CNN can predict the respiratory modulation from RR series alone ($\rho$ = 0.805) and that the addition of either respiration signal ($\rho$ = 0.830), AFR ($\rho$ = 0.837), or both ($\rho$ = 0.855) improves the prediction. Results from analysis of clinical ECG data of 20 patients with sufficient signal quality suggest that respiratory modulation decreased in response to deep breathing for five patients, increased for five patients, and remained similar for ten patients, indicating a large inter-patient variability.


title: The rationality of ineffective spin genus-4 thetanull loci

abstract: In this paper, we show that the divisor given by couples [C,{\theta}] where C is a curve of genus 4 with a vanishing thetanull and {\theta} is an ineffective thetacharacteristic is a rational variety. By our construction, it follows also that the analogous divisor in the Prym moduli space is rational.


title: Towards Intuitive HMI for UAV Control

abstract: In the last decade, UAVs have become a widely used technology. As they are used by both professionals and amateurs, there is a need to explore different control modalities to make control intuitive and easier, especially for new users. In this work, we compared the most widely used joystick control with a custom human pose control. We used human pose estimation and arm movements to send UAV commands in the same way that operators use their fingers to send joystick commands. Experiments were conducted in a simulation environment with first-person visual feedback. Participants had to traverse the same maze with joystick and human pose control. Participants' subjective experience was assessed using the raw NASA Task Load Index.


title: Topological nonsymmorphic insulator versus Dirac semimetal in KZnBi

abstract: KZnBi was discovered recently as a new three-dimensional Dirac semimetal with a pair of bulk Dirac fermions in contrast to the $\mathbb{Z}_2$ trivial insulator reported earlier. In order to address this discrepancy, we have performed electronic structure and topological state analysis of KZnBi using the local, semilocal, and hybrid exchange-correlation (XC) functionals within the density functional theory framework. We find that various XC functionals, including the SCAN meta-GGA and hybrid functional with 25\% Hartree-Fock (HF) exchange (HSE06), resolve a topological nonsymmorphic insulator state with the glide-mirror protected hourglass surface Dirac fermions. By carefully tuning the XC strength in modified Becke-Johnson (mBJ) potential, we recover the correct orbital ordering and Dirac semimetal state of KZnBi. We further show that increasing the default HF exchange in hybrid functional ($> 40\%$) can also capture the desired Dirac semimetal state with the correct orbital ordering of KZnBi. The calculated energy dispersion and carrier velocities of Dirac states are found to be in excellent agreement with the available experimental results. Our results demonstrate that KZnBi is a unique topological material where large XC effects are crucial to producing the Dirac semimetal state.


title: Equivariant line bundles with connection on the p-adic upper half plane

abstract: Let $F$ be a finite extension of $\mathbb{Q}_p$, let $\Omega_F$ be Drinfeld's upper half-plane over $F$ and let $G^0$ the subgroup of $GL_2(F)$ consisting of elements whose determinant has norm $1$. By working locally on $\Omega_F$, we construct and classify the torsion $G^0$-equivariant line bundles with integrable connection on $\Omega$ in terms of the smooth linear characters of the units of the maximal order of the quaternion algebra over $F$.


title: Textbooks Are All You Need II: phi-1.5 technical report

abstract: We continue the investigation into the power of smaller Transformer-based language models as initiated by \textbf{TinyStories} -- a 10 million parameter model that can produce coherent English -- and the follow-up work on \textbf{phi-1}, a 1.3 billion parameter model with Python coding performance close to the state-of-the-art. The latter work proposed to use existing Large Language Models (LLMs) to generate ``textbook quality" data as a way to enhance the learning process compared to traditional web data. We follow the ``Textbooks Are All You Need" approach, focusing this time on common sense reasoning in natural language, and create a new 1.3 billion parameter model named \textbf{phi-1.5}, with performance on natural language tasks comparable to models 5x larger, and surpassing most non-frontier LLMs on more complex reasoning tasks such as grade-school mathematics and basic coding. More generally, \textbf{phi-1.5} exhibits many of the traits of much larger LLMs, both good -- such as the ability to ``think step by step" or perform some rudimentary in-context learning -- and bad, including hallucinations and the potential for toxic and biased generations -- encouragingly though, we are seeing improvement on that front thanks to the absence of web data. We open-source \textbf{phi-1.5} to promote further research on these urgent topics.


title: On the absence of the electrostriction force in dilute clouds of cold atoms

abstract: The momentum of light in a medium and the mechanisms of momentum transfer between light and dielectrics have long been the topic of controversies and confusion. We discuss here the problem of momentum transfers that follow the refraction of light by dilute, inhomogeneous ensembles of ultra-cold atoms. We show experimentally and theoretically that the refraction of light rays by a dilute gas does not entail momentum transfers to first order in the light-atom coupling coefficient, in contradiction with the work reported in Matzliah et al. Phys. Rev. Lett. 119, 189902 (2017).


title: "Toward" Metal-Organic Framework Design by Quantum Computing

abstract: The article summarizes the study performed in the context of the Deloitte Quantum Climate Challenge in 2023. We present a hybrid quantum-classical method for calculating Potential Energy Surface scans, which are essential for designing Metal-Organic Frameworks for Direct Air Capture applications. The primary objective of this challenge was to highlight the potential advantages of employing quantum computing. To evaluate the performance of the model, we conducted total energy calculations using various computing frameworks and methods. The results demonstrate, at a small scale, the potential advantage of quantum computing-based models. We aimed to define relevant classical computing model references for method benchmarking. The most important benefits of using the PISQ approach for hybrid quantum-classical computational model development and assessment are demonstrated.


title: Development of the CMS detector for the CERN LHC Run 3

abstract: Since the initial data taking of the CERN LHC, the CMS experiment has undergone substantial upgrades and improvements. This paper discusses the CMS detector as it is configured for the third data-taking period of the CERN LHC, Run 3, which started in 2022. The entire silicon pixel tracking detector was replaced. A new powering system for the superconducting solenoid was installed. The electronics of the hadron calorimeter was upgraded. All the muon electronic systems were upgraded, and new muon detector stations were added, including a gas electron multiplier detector. The precision proton spectrometer was upgraded. The dedicated luminosity detectors and the beam loss monitor were refurbished. Substantial improvements to the trigger, data acquisition, software, and computing systems were also implemented, including a new hybrid CPU/GPU farm for the high-level trigger.


title: Assessing Wind Impact on Semi-Autonomous Drone Landings for In-Contact Power Line Inspection

abstract: In recent years, the use of inspection drones has become increasingly popular for high-voltage electric cable inspections due to their efficiency, cost-effectiveness, and ability to access hard-to-reach areas. However, safely landing drones on power lines, especially under windy conditions, remains a significant challenge. This study introduces a semi-autonomous control scheme for landing on an electrical line with the NADILE drone (an experimental drone based on original LineDrone key features for inspection of power lines) and assesses the operating envelope under various wind conditions. A Monte Carlo method is employed to analyze the success probability of landing given initial drone states. The performance of the system is evaluated for two landing strategies, variously controllers parameters and four level of wind intensities. The results show that a two-stage landing strategies offers higher probabilities of landing success and give insight regarding the best controller parameters and the maximum wind level for which the system is robust. Lastly, an experimental demonstration of the system landing autonomously on a power line is presented.


title: Universality for graphs of bounded degeneracy

abstract: Given a family $\mathcal{H}$ of graphs, a graph $G$ is called $\mathcal{H}$-universal if $G$ contains every graph of $\mathcal{H}$ as a subgraph. Following the extensive research on universal graphs of small size for bounded-degree graphs, Alon asked what is the minimum number of edges that a graph must have to be universal for the class of all $n$-vertex graphs that are $D$-degenerate. In this paper, we answer this question up to a factor that is polylogarithmic in $n.$


title: Invariant-based control of quantum many-body systems across critical points

abstract: Quantum many-body systems are emerging as key elements in the quest for quantum-based technologies and in the study of fundamental physics. In this context, finding control protocols that allow for fast and high fidelity evolutions across quantum phase transitions is of particular interest. Ideally, such controls should be scalable with the system size and not require controllable and unwanted extra interactions. In addition, its performance should be robust against potential imperfections. Here we design an invariant-based control technique that ensures perfect adiabatic-like evolution in the lowest energy subspace of the many-body system, and is able to meet all these requirements -- tuning the controllable parameter according to the analytical control results in high-fidelity evolutions operating close to the speed limit, valid for any number particles. As such, Kibble-Zurek scaling laws break down, leading to tunable and much better time scaling behavior. We illustrate our findings by means of detailed numerical simulations in the transverse-field Ising and long-range Kitaev models and demonstrate the robustness against noisy controls and disorder.


title: An approach to normal polynomials through symmetrization and symmetric reduction

abstract: An irreducible polynomial $f\in\Bbb F_q[X]$ of degree $n$ is {\em normal} over $\Bbb F_q$ if and only if its roots $r, r^q,\dots,r^{q^{n-1}}$ satisfy the condition $\Delta_n(r, r^q,\dots,r^{q^{n-1}})\ne 0$, where $\Delta_n(X_0,\dots,X_{n-1})$ is the $n\times n$ circulant determinant. By finding a suitable {\em symmetrization} of $\Delta_n$ (A multiple of $\Delta_n$ which is symmetric in $X_0,\dots,X_{n-1}$), we obtain a condition on the coefficients of $f$ that is sufficient for $f$ to be normal. This approach works well for $n\le 5$ but encounters computational difficulties when $n\ge 6$. In the present paper, we consider irreducible polynomials of the form $f=X^n+X^{n-1}+a\in\Bbb F_q[X]$. For $n=6$ and $7$, by an indirect method, we are able to find simple conditions on $a$ that are sufficient for $f$ to be normal. In a more general context, we also explore the normal polynomials of a finite Galois extension through the irreducible characters of the Galois group.


title: Electron and photon energy calibration with the ATLAS detector using LHC Run 2 data

abstract: This paper presents the electron and photon energy calibration obtained with the ATLAS detector using 140 fb$^{-1}$ of LHC proton-proton collision data recorded at $\sqrt{s}=13$ TeV between 2015 and 2018. Methods for the measurement of electron and photon energies are outlined, along with the current knowledge of the passive material in front of the ATLAS electromagnetic calorimeter. The energy calibration steps are discussed in detail, with emphasis on the improvements introduced in this paper. The absolute energy scale is set using a large sample of $Z$-boson decays into electron-positron pairs, and its residual dependence on the electron energy is used for the first time to further constrain systematic uncertainties. The achieved calibration uncertainties are typically 0.05% for electrons from resonant $Z$-boson decays, 0.4% at $E_\text{T}\sim 10$ GeV, and 0.3% at $E_\text{T}\sim 1$ TeV; for photons at $E_\text{T}\sim 60$ GeV, they are 0.2% on average. This is more than twice as precise as the previous calibration. The new energy calibration is validated using $J/\psi \to ee$ and radiative $Z$-boson decays.


title: LeBenchmark 2.0: a Standardized, Replicable and Enhanced Framework for Self-supervised Representations of French Speech

abstract: Self-supervised learning (SSL) is at the origin of unprecedented improvements in many different domains including computer vision and natural language processing. Speech processing drastically benefitted from SSL as most of the current domain-related tasks are now being approached with pre-trained models. This work introduces LeBenchmark 2.0 an open-source framework for assessing and building SSL-equipped French speech technologies. It includes documented, large-scale and heterogeneous corpora with up to 14,000 hours of heterogeneous speech, ten pre-trained SSL wav2vec 2.0 models containing from 26 million to one billion learnable parameters shared with the community, and an evaluation protocol made of six downstream tasks to complement existing benchmarks. LeBenchmark 2.0 also presents unique perspectives on pre-trained SSL models for speech with the investigation of frozen versus fine-tuned downstream models, task-agnostic versus task-specific pre-trained models as well as a discussion on the carbon footprint of large-scale model training. Overall, the newly introduced models trained on 14,000 hours of French speech outperform multilingual and previous LeBenchmark SSL models across the benchmark but also required up to four times more energy for pre-training.


title: Machine learning the dimension of a Fano variety

abstract: Fano varieties are basic building blocks in geometry - they are `atomic pieces' of mathematical shapes. Recent progress in the classification of Fano varieties involves analysing an invariant called the quantum period. This is a sequence of integers which gives a numerical fingerprint for a Fano variety. It is conjectured that a Fano variety is uniquely determined by its quantum period. If this is true, one should be able to recover geometric properties of a Fano variety directly from its quantum period. We apply machine learning to the question: does the quantum period of X know the dimension of X? Note that there is as yet no theoretical understanding of this. We show that a simple feed-forward neural network can determine the dimension of X with 98% accuracy. Building on this, we establish rigorous asymptotics for the quantum periods of a class of Fano varieties. These asymptotics determine the dimension of X from its quantum period. Our results demonstrate that machine learning can pick out structure from complex mathematical data in situations where we lack theoretical understanding. They also give positive evidence for the conjecture that the quantum period of a Fano variety determines that variety.


title: How robust are gravitational wave predictions from cosmological phase transitions?

abstract: Gravitational wave (GW) predictions of cosmological phase transitions are almost invariably evaluated at either the nucleation or percolation temperature. We investigate the effect of the transition temperature choice on GW predictions, for phase transitions with weak, intermediate and strong supercooling. We find that the peak amplitude of the GW signal varies by a factor of a few for weakly supercooled phase transitions, and by an order of magnitude for strongly supercooled phase transitions. The variation in amplitude for even weakly supercooled phase transitions can be several orders of magnitude if one uses the mean bubble separation, while the variation is milder if one uses the mean bubble radius instead. We also investigate the impact of various approximations used in GW predictions. Many of these approximations introduce at least a 10% error in the GW signal, with others introducing an error of over an order of magnitude.


title: Zero-shot Learning with Minimum Instruction to Extract Social Determinants and Family History from Clinical Notes using GPT Model

abstract: Demographics, Social determinants of health, and family history documented in the unstructured text within the electronic health records are increasingly being studied to understand how this information can be utilized with the structured data to improve healthcare outcomes. After the GPT models were released, many studies have applied GPT models to extract this information from the narrative clinical notes. Different from the existing work, our research focuses on investigating the zero-shot learning on extracting this information together by providing minimum information to the GPT model. We utilize de-identified real-world clinical notes annotated for demographics, various social determinants, and family history information. Given that the GPT model might provide text different from the text in the original data, we explore two sets of evaluation metrics, including the traditional NER evaluation metrics and semantic similarity evaluation metrics, to completely understand the performance. Our results show that the GPT-3.5 method achieved an average of 0.975 F1 on demographics extraction, 0.615 F1 on social determinants extraction, and 0.722 F1 on family history extraction. We believe these results can be further improved through model fine-tuning or few-shots learning. Through the case studies, we also identified the limitations of the GPT models, which need to be addressed in future research.


title: The Influence of Macroscopic Pedestrian Structures on Train Boarding Efficiency

abstract: A deeper understanding of pedestrian dynamics is essential to improve crowd flows in public spaces such as train stations. It is essential to understand both the physical and the psychological processes present in this context. However, current research on train boarding behavior is limited in scope and mainly focuses on how group level variables such as number of boarders/deboarders influence train boarding efficiency. Viewing pedestrian dynamics through a psychological lens is important for a detailed understanding of the train boarding context and to recognize target areas for improving crowd flows. At Dutch train stations, boarders follow a social norm of waiting at the train door until deboarding is complete. Although people generally adhere to this norm, the way it is executed may not be optimal for deboarding efficiency. We investigate how waiting boarders form a deboarding channel (a corridor where deboarders exit the train) which is a macroscopic structure formed by pedestrians, and how this channel in turn influences the efficiency of deboarding. Analyzing a dataset with 3278 boarding events at Utrecht Centraal Station in the Netherlands from 2017 - 2020 (a subset of a trajectory dataset that captures 100,000 trajectories per day), we found that higher numbers of boarders and a higher ratio of boarders to deboarders, reduced the width of the deboarding channel, and a lower width was associated with lower deboarding efficiency. These results shift the focus from group level variables to identifying macroscopic structures that are formed when pedestrians interact within a social system and provide specific target areas where nudges/behavioral interventions could be implemented.


title: Learning Objective-Specific Active Learning Strategies with Attentive Neural Processes

abstract: Pool-based active learning (AL) is a promising technology for increasing data-efficiency of machine learning models. However, surveys show that performance of recent AL methods is very sensitive to the choice of dataset and training setting, making them unsuitable for general application. In order to tackle this problem, the field Learning Active Learning (LAL) suggests to learn the active learning strategy itself, allowing it to adapt to the given setting. In this work, we propose a novel LAL method for classification that exploits symmetry and independence properties of the active learning problem with an Attentive Conditional Neural Process model. Our approach is based on learning from a myopic oracle, which gives our model the ability to adapt to non-standard objectives, such as those that do not equally weight the error on all data points. We experimentally verify that our Neural Process model outperforms a variety of baselines in these settings. Finally, our experiments show that our model exhibits a tendency towards improved stability to changing datasets. However, performance is sensitive to choice of classifier and more work is necessary to reduce the performance the gap with the myopic oracle and to improve scalability. We present our work as a proof-of-concept for LAL on nonstandard objectives and hope our analysis and modelling considerations inspire future LAL work.


title: Classification of Quantum Computer Fault Injection Attacks

abstract: The rapid growth of interest in quantum computing has brought about the need to secure these powerful machines against a range of physical attacks. As qubit counts increase and quantum computers achieve higher levels of fidelity, their potential to execute novel algorithms and generate sensitive intellectual property becomes more promising. However, there is a significant gap in our understanding of the vulnerabilities these computers face in terms of security and privacy attacks. Among the potential threats are physical attacks, including those orchestrated by malicious insiders within data centers where the quantum computers are located, which could compromise the integrity of computations and resulting data. This paper presents an exploration of fault-injection attacks as one class of physical attacks on quantum computers. This work first introduces a classification of fault-injection attacks and strategies, including the domain of fault-injection attacks, the fault targets, and fault manifestations in quantum computers. The resulting classification highlights the potential threats that exist. By shedding light on the vulnerabilities of quantum computers to fault-injection attacks, this work contributes to the development of robust security measures for this emerging technology.


title: Topological transitions in dissipatively coupled Su-Schrieffer-Heeger models

abstract: Non-Hermitian topological phenomena have gained much interest among physicists in recent years. In this paper, we expound on the physics of dissipatively coupled Su-Schrieffer-Heeger (SSH) lattices, specifically in systems with bosonic and electrical constituents. In the context of electrical circuits, we demonstrate that a series of resistively coupled LCR circuits mimics the topology of a dissipatively coupled SSH model. In addition, we foreground a scheme to construct dissipatively coupled SSH lattices involving a set of non-interacting bosonic oscillators weakly coupled to engineered reservoirs of modes possessing substantially small lifetimes when compared to other system timescales. Further, by activating the coherent coupling between bosonic oscillators, we elucidate the emergence of non-reciprocal dissipative coupling which can be controlled by the phase of the coherent interaction strength precipitating in phase-dependent topological transitions and skin effect. Our analyses are generic, apropos of a large class of systems involving, for instance, optical and microwave settings, while the circuit implementation represents the most straightforward of them.


title: New Observations Needed to Advance Our Understanding of Coronal Mass Ejections

abstract: Coronal mass ejections (CMEs) are large eruptions from the Sun that propagate through the heliosphere after launch. Observational studies of these transient phenomena are usually based on 2D images of the Sun, corona, and heliosphere (remote-sensing data), as well as magnetic field, plasma, and particle samples along a 1D spacecraft trajectory (in-situ data). Given the large scales involved and the 3D nature of CMEs, such measurements are generally insufficient to build a comprehensive picture, especially in terms of local variations and overall geometry of the whole structure. This White Paper aims to address this issue by identifying the data sets and observational priorities that are needed to effectively advance our current understanding of the structure and evolution of CMEs, in both the remote-sensing and in-situ regimes. It also provides an outlook of possible missions and instruments that may yield significant improvements into the subject.


title: Photovoltaic potential of tin perovskites revealed through layer-by-layer investigation of optoelectronic and charge transport properties

abstract: Tin perovskites are the most promising environmentally friendly alternative to lead perovskites. Among tin perovskites, FASnI3 (CH4N2SnI3) shows optimum band gap, and easy processability. However, the performance of FASnI3 based solar cells is incomparable to lead perovskites for several reasons, including energy band mismatch between the perovskite absorber film and the charge transporting layers (CTLs) for both types of carriers, i.e., for electrons (ETLs) and holes (HTLs). However, the band diagrams in the literature are inconsistent, and the charge extraction dynamics are poorly understood. In this paper, we study the energy band positions of FASnI3 based perovskites using Kelvin probe (KP) and photoelectron yield spectroscopy (PYS) to provide a precise band diagram of the most used device stack. In addition, we analyze the defects within the current energetic landscape of tin perovskites. We uncover the role of bathocuproine (BCP) in enhancing the electron extraction at the fullerene C60/BCP interface. Furthermore, we used transient surface photovoltage (tr-SPV) for the first time for tin perovskites to understand the charge extraction dynamics of the most reported HTLs such as NiOx and PEDOT, and ETLs such as C60, ICBA, and PCBM. Finally, we used Hall effect, KP, and time-resolved photoluminescence (TRPL) to estimate an accurate value of the p-doping concentration in FASnI3 and showed a consistent result of 1.5 * 1017 cm-3. Our findings prove that the energetic system of tin halide perovskites is deformed and should be redesigned independently from lead perovskites to unlock the full potential of tin perovskites.


title: A conformal test of linear models via permutation-augmented regressions

abstract: Permutation tests are widely recognized as robust alternatives to tests based on normal theory. Random permutation tests have been frequently employed to assess the significance of variables in linear models. Despite their widespread use, existing random permutation tests lack finite-sample and assumption-free guarantees for controlling type I error in partial correlation tests. To address this ongoing challenge, we have developed a conformal test through permutation-augmented regressions, which we refer to as PALMRT. PALMRT not only achieves power competitive with conventional methods but also provides reliable control of type I errors at no more than $2\alpha$, given any targeted level $\alpha$, for arbitrary fixed designs and error distributions. We have confirmed this through extensive simulations. Compared to the cyclic permutation test (CPT) and residual permutation test (RPT), which also offer theoretical guarantees, PALMRT does not compromise as much on power or set stringent requirements on the sample size, making it suitable for diverse biomedical applications. We further illustrate the differences in a long-Covid study where PALMRT validated key findings previously identified using the t-test after multiple corrections, while both CPT and RPT suffered from a drastic loss of power and failed to identify any discoveries. We endorse PALMRT as a robust and practical hypothesis test in scientific research for its superior error control, power preservation, and simplicity. An R package for PALMRT is available at \url{https://github.com/LeyingGuan/PairedRegression}.


title: Sound Atomicity Inference for Data-Centric Synchronization

abstract: Data-Centric Concurrency Control (DCCC) shifts the reasoning about concurrency restrictions from control structures to data declaration. It is a high-level declarative approach that abstracts away from the actual concurrency control mechanism(s) in use. Despite its advantages, the practical use of DCCC is hindered by the fact that it may require many annotations and/or multiple implementations of the same method to cope with differently qualified parameters. Moreover, the existing DCCC solutions do not address the use of interfaces, precluding their use in most object-oriented programs. To overcome these limitations, in this paper we present AtomiS, a new DCCC model based on a rigorously defined type-sound programming language. Programming with AtomiS requires only (atomic)-qualifying types of parameters and return values in interface definitions, and of fields in class definitions. From this atomicity specification, a static analysis infers the atomicity constraints that are local to each method, considering valid only the method variants that are consistent with the specification, and performs code generation for all valid variants of each method. The generated code is then the target for automatic injection of concurrency control primitives, by means of the desired automatic technique and associated atomicity and deadlock-freedom guarantees, which can be plugged-into the model's pipeline. We present the foundations for the AtomiS analysis and synthesis, with formal guarantees that the generated program is well-typed and that it corresponds behaviourally to the original one. The proofs are mechanised in Coq. We also provide a Java implementation that showcases the applicability of AtomiS in real-life programs.


title: Observation of the Singly Cabibbo-Suppressed Decay $\Lambda_{c}^{+}\to \Sigma^{-}K^{+}\pi^{+}$

abstract: The singly Cabibbo-suppressed decay $\Lambda_{c}^{+}\to \Sigma^{-}K^{+}\pi^{+}$ is observed for the first time with a statistical significance of $6.4\sigma$ by using 4.5 fb$^{-1}$ of $e^+e^-$ collision data collected at center-of-mass energies between 4.600 and 4.699 GeV with the BESIII detector at BEPCII. The absolute branching fraction of $\Lambda_{c}^{+}\to \Sigma^{-}K^{+}\pi^{+}$ is measured to be $(3.8\pm1.3_{\rm stat}\pm0.2_{\rm syst})\times 10^{-4}$ in a model-independent approach. This is the first observation of a Cabibbo-suppressed $\Lambda_{c}^{+}$ decay involving $\Sigma^-$ in the final state. The ratio of branching fractions between $\Lambda_{c}^{+}\to \Sigma^{-}K^{+}\pi^{+}$ and the Cabibbo-favored decay $\Lambda_{c}^{+}\to \Sigma^- \pi^+\pi^+$ is calculated to be $(0.4 \pm 0.1)s_{c}^{2}$, where $s_{c} \equiv \sin\theta_c = 0.2248$ with $\theta_c$ the Cabibbo mixing angle. This ratio significantly deviates from $1.0s_{c}^{2}$ and provides important information for the understanding of nonfactorization contributions in $\Lambda_{c}^{+}$ decays.


title: Reply to "Comment on `Validity of path thermodynamic description of reactive systems: Microscopic simulations'

abstract: The Comment's author argues that a correct description of reactive systems should incorporate the explicit interaction with reservoirs, leading to a unified system-reservoirs entity. However, this proposition has two major flaws. Firstly, as we will emphasize, this entity inherently follows a thermodynamic equilibrium distribution. In the Comment, no indication is provided on how to maintain such a system-reservoirs entity in a non-equilibrium state. Secondly, contrary to the author's claim, the inclusion of system-reservoir interaction in traditional stochastic modeling of reactive systems does not automatically alter the limited applicability of path thermodynamics to problematic reactive systems. We will provide a simple demonstration to illustrate that certain elementary reactions may not involve any changes in reservoir components, which seems to have been overlooked by the author.


title: Preempted phonon-mediated superconductivity in the infinite-layer nickelates

abstract: Nickelate superconductors are outstanding materials with intriguing analogies with the cuprates. These analogies suggest that their superconducting mechanism may be unconventional, although this fundamental question is currently under debate. Here, we scrutinize the role played by electronic correlations in enhancing the electron-phonon coupling in the infinite-layer nickelates and the extent to which this may promote superconductivity. Specifically, we use $ab$ $initio$ many-body perturbation theory to perform state-of-the-art $GW$ and Eliashberg-theory calculations. We find that the electron-phonon coupling is effectively enhanced compared to density-functional-theory calculations. This enhancement may lead to low-$T_c$ superconductivity in the parent compounds already. However, it remains marginal in the sense that it cannot explain the record $T_c$s obtained with doping. This circumstance implies that conventional superconductivity is preempted by another pairing mechanism in the infinite-layer nickelates.


title: Algorithms for DC Programming via Polyhedral Approximations of Convex Functions

abstract: There is an existing exact algorithm that solves DC programming problems if one component of the DC function is polyhedral convex (Loehne, Wagner, 2017). Motivated by this, first, we consider two cutting-plane algorithms for generating an $\epsilon$-polyhedral underestimator of a convex function g. The algorithms start with a polyhedral underestimator of g and the epigraph of the current underestimator is intersected with either a single halfspace (Algorithm 1) or with possibly multiple halfspaces (Algorithm 2) in each iteration to obtain a better approximation. We prove the correctness and finiteness of both algorithms, establish the convergence rate of Algorithm 1, and show that after obtaining an $\epsilon$-polyhedral underestimator of the first component of a DC function, the algorithm from (Loehne, Wagner, 2017) can be applied to compute an $\epsilon$ solution of the DC programming problem without further computational effort. We then propose an algorithm (Algorithm 3) for solving DC programming problems by iteratively generating a (not necessarily $\epsilon$-) polyhedral underestimator of g. We prove that Algorithm 3 stops after finitely many iterations and it returns an $\epsilon$-solution to the DC programming problem. Moreover, the sequence $\{x_k\}_{k\geq 0} outputted by Algorithm 3 converges to a global minimizer of the DC problem when $\epsilon$ is set to zero. Computational results based on some test instances from the literature are provided.


title: Eigenstate thermalisation at the edge for Wigner matrices

abstract: We prove the Eigenstate Thermalisation Hypothesis for Wigner matrices uniformly in the entire spectrum, in particular near the spectral edges, with a bound on the fluctuation that is optimal for any observable. This complements earlier works of Cipolloni et. al. (Comm. Math. Phys. 388, 2021; Forum Math., Sigma 10, 2022) and Benigni et. al. (Comm. Math. Phys. 391, 2022; arXiv: 2303.11142) that were restricted either to the bulk of the spectrum or to special observables. As a main ingredient, we prove a new multi-resolvent local law that optimally accounts for the edge scaling.


title: Energy-optimal Timetable Design for Sustainable Metro Railway Networks

abstract: We present our collaboration with Thales Canada Inc, the largest provider of communication-based train control (CBTC) systems worldwide. We study the problem of designing energy-optimal timetables in metro railway networks to minimize the effective energy consumption of the network, which corresponds to simultaneously minimizing total energy consumed by all the trains and maximizing the transfer of regenerative braking energy from suitable braking trains to accelerating trains. We propose a novel data-driven linear programming model that minimizes the total effective energy consumption in a metro railway network, capable of computing the optimal timetable in real-time, even for some of the largest CBTC systems in the world. In contrast with existing works, which are either NP-hard or involve multiple stages requiring extensive simulation, our model is a single linear programming model capable of computing the energy-optimal timetable subject to the constraints present in the railway network. Furthermore, our model can predict the total energy consumption of the network without requiring time-consuming simulations, making it suitable for widespread use in managerial settings. We apply our model to Shanghai Railway Network's Metro Line 8 -- one of the largest and busiest railway services in the world -- and empirically demonstrate that our model computes energy-optimal timetables for thousands of active trains spanning an entire service period of one day in real-time (solution time less than one second on a standard desktop), achieving energy savings between approximately 20.93% and 28.68%. Given the compelling advantages, our model is in the process of being integrated into Thales Canada Inc's industrial timetable compiler.


title: Learning Semantic Segmentation with Query Points Supervision on Aerial Images

abstract: Semantic segmentation is crucial in remote sensing, where high-resolution satellite images are segmented into meaningful regions. Recent advancements in deep learning have significantly improved satellite image segmentation. However, most of these methods are typically trained in fully supervised settings that require high-quality pixel-level annotations, which are expensive and time-consuming to obtain. In this work, we present a weakly supervised learning algorithm to train semantic segmentation algorithms that only rely on query point annotations instead of full mask labels. Our proposed approach performs accurate semantic segmentation and improves efficiency by significantly reducing the cost and time required for manual annotation. Specifically, we generate superpixels and extend the query point labels into those superpixels that group similar meaningful semantics. Then, we train semantic segmentation models, supervised with images partially labeled with the superpixels pseudo-labels. We benchmark our weakly supervised training approach on an aerial image dataset and different semantic segmentation architectures, showing that we can reach competitive performance compared to fully supervised training while reducing the annotation effort.


title: Let them have CAKES: A Cutting-Edge Algorithm for Scalable, Efficient, and Exact Search on Big Data

abstract: The ongoing Big Data explosion has created a demand for efficient and scalable algorithms for similarity search. Most recent work has focused on \textit{approximate} $k$-NN search, and while this may be sufficient for some applications, \textit{exact} $k$-NN search would be ideal for many applications. We present CAKES, a set of three novel, exact algorithms for $k$-NN search. CAKES's algorithms are generic over \textit{any} distance function, and they \textit{do not} scale with the cardinality or embedding dimension of the dataset, but rather with its metric entropy and fractal dimension. We test these claims on datasets from the ANN-Benchmarks suite under commonly-used distance functions, as well as on a genomic dataset with Levenshtein distance and a radio-frequency dataset with Dynamic Time Warping distance. We demonstrate that CAKES exhibits near-constant scaling with cardinality on data conforming to the manifold hypothesis, and has perfect recall on data in \textit{metric} spaces. We also demonstrate that CAKES exhibits significantly higher recall than state-of-the-art $k$-NN search algorithms when the distance function is not a metric. Additionally, we show that indexing and tuning time for CAKES is an order of magnitude, or more, faster than state-of-the-art approaches. We conclude that CAKES is a highly efficient and scalable algorithm for exact $k$-NN search on Big Data. We provide a Rust implementation of CAKES.


title: Majorana fermion induced power-law scaling in the violation of Wiedemann-Franz law

abstract: Violation of the Wiedemann-Franz (WF) law in a 2D topological insulator due to Majorana bound states (MBS) is studied via the Lorenz ratio in the single-particle picture. We study the scaling of the Lorenz ratio in the presence and absence of MBS with inelastic scattering modeled using a Buttiker voltage-temperature probe. We compare our results with that seen in a quantum dot junction in the Luttinger liquid picture operating in the topological Kondo regime. We explore the scaling of the Lorentz ratio in our setup when either inelastic scattering occurs with both phase and momentum relaxation or via phase relaxation alone. This scaling differs from that predicted by the Luttinger liquid picture for both uncoupled and coupled Majorana bound states and depends on the nature of inelastic scattering.

categories: cond-mat.mes-hall cond-mat.str-el math-ph math.MP physics.pop-ph quant-ph


title: Experimental realization of a high Curie temperature CoFeRuSn quaternary Heusler alloy for spintronic applications

abstract: We synthesize CoFeRuSn equiatomic quaternary Heusler alloy using arc-melt technique and investigate its structural, magnetic and transport properties. The room temperature powder X-ray diffraction analysis reveals that CoFeRuSn crystallizes in cubic crystal structure with small amount of DO3 - disorder. The field dependence of magnetization shows non-zero but small hysteresis and saturation behavior up to room temperature, indicating soft ferromagnetic nature of CoFeRuSn. The magnetic moment estimated from the magnetization data is found to be 4.15 {\mu}B / f.u., which is slightly less than the expected Slater-Pauling rule. The deviation in the value of experimentally observed moment from the theoretical value might be due to small disorder in the crystal. The low temperature fit to electrical resistivity data show absence of quadratic temperature dependence of resistivity, suggesting half-metallic behavior of CoFeRuSn. The high Curie temperature and possible half-metallic behavior of CoFeRuSn make it a highly promising candidate for room temperature spintronic applications.


title: CrisisTransformers: Pre-trained language models and sentence encoders for crisis-related social media texts

abstract: Social media platforms play an essential role in crisis communication, but analyzing crisis-related social media texts is challenging due to their informal nature. Transformer-based pre-trained models like BERT and RoBERTa have shown success in various NLP tasks, but they are not tailored for crisis-related texts. Furthermore, general-purpose sentence encoders are used to generate sentence embeddings, regardless of the textual complexities in crisis-related texts. Advances in applications like text classification, semantic search, and clustering contribute to the effective processing of crisis-related texts, which is essential for emergency responders to gain a comprehensive view of a crisis event, whether historical or real-time. To address these gaps in crisis informatics literature, this study introduces CrisisTransformers, an ensemble of pre-trained language models and sentence encoders trained on an extensive corpus of over 15 billion word tokens from tweets associated with more than 30 crisis events, including disease outbreaks, natural disasters, conflicts, and other critical incidents. We evaluate existing models and CrisisTransformers on 18 crisis-specific public datasets. Our pre-trained models outperform strong baselines across all datasets in classification tasks, and our best-performing sentence encoder improves the state-of-the-art by 17.43% in sentence encoding tasks. Additionally, we investigate the impact of model initialization on convergence and evaluate the significance of domain-specific models in generating semantically meaningful sentence embeddings. The models are publicly available at: https://huggingface.co/crisistransformers


title: Right-angled Artin groups and the cohomology basis graph

abstract: Let $\Gamma$ be a finite graph and let $A(\Gamma)$ be the corresponding right-angled Artin group. From an arbitrary basis $\mathcal B$ of $H^1(A(\Gamma),\mathbb F)$ over an arbitrary field, we construct a natural graph $\Gamma_{\mathcal B}$ from the cup product, called the \emph{cohomology basis graph}. We show that $\Gamma_{\mathcal B}$ always contains $\Gamma$ as a subgraph. This provides an effective way to reconstruct the defining graph $\Gamma$ from the cohomology of $A(\Gamma)$, to characterize the planarity of the defining graph from the algebra of $A(\Gamma)$, and to recover many other natural graph-theoretic invariants. We also investigate the behavior of the cohomology basis graph under passage to elementary subminors, and show that it is not well-behaved under edge contraction.


title: Bayesian spatial+: A joint model perspective

abstract: A common phenomenon in spatial regression models is spatial confounding. This phenomenon occurs when spatially indexed covariates modeling the mean of the response are correlated with a spatial effect included in the model. spatial+ Dupont et al. (2022) is a popular approach to reducing spatial confounding. spatial+ is a two-stage frequentist approach that explicitly models the spatial structure in the confounded covariate, removes it, and uses the corresponding residuals in the second stage. In a frequentist setting, there is no uncertainty propagation from the first stage estimation determining the residuals since only point estimates are used. Inference can also be cumbersome in a frequentist setting, and some of the gaps in the original approach can easily be remedied in a Bayesian framework. First, a Bayesian joint model can easily achieve uncertainty propagation from the first to the second stage of the model. In a Bayesian framework, we also have the tools to infer the model's parameters directly. Notably, another advantage of using a Bayesian framework we thoroughly explore is the ability to use prior information to impose restrictions on the spatial effects rather than applying them directly to their posterior. We build a joint prior for the smoothness of all spatial effects that simultaneously shrinks towards a high smoothness of the response and imposes that the spatial effect in the response is a smoother of the confounded covariates' spatial effect. This prevents the response from operating at a smaller scale than the covariate and can help to avoid situations where there is insufficient variation in the residuals resulting from the first stage model. We evaluate the performance of the Bayesian spatial+ via both simulated and real datasets.


title: Personality Detection and Analysis using Twitter Data

abstract: Personality types are important in various fields as they hold relevant information about the characteristics of a human being in an explainable format. They are often good predictors of a person's behaviors in a particular environment and have applications ranging from candidate selection to marketing and mental health. Recently automatic detection of personality traits from texts has gained significant attention in computational linguistics. Most personality detection and analysis methods have focused on small datasets making their experimental observations often limited. To bridge this gap, we focus on collecting and releasing the largest automatically curated dataset for the research community which has 152 million tweets and 56 thousand data points for the Myers-Briggs personality type (MBTI) prediction task. We perform a series of extensive qualitative and quantitative studies on our dataset to analyze the data patterns in a better way and infer conclusions. We show how our intriguing analysis results often follow natural intuition. We also perform a series of ablation studies to show how the baselines perform for our dataset.


title: On Talagrand's functional and generic chaining

abstract: In the study of the supremum of stochastic processes, Talagrand's chaining functionals and his generic chaining method are heavily related to the distribution of stochastic processes. In the present paper, we construct Talagrand's type functionals in the general distribution case and obtain the upper bound for the suprema of all $p$-th moments of the stochastic process using the generic chaining method. As applications, we obtained the Johnson-Lindenstrauss lemma, the upper bound for the supremum of all $p$-th moment of order 2 Gaussian chaos, and convex signal recovery in our setting.


title: Zero-Shot Co-salient Object Detection Framework

abstract: Co-salient Object Detection (CoSOD) endeavors to replicate the human visual system's capacity to recognize common and salient objects within a collection of images. Despite recent advancements in deep learning models, these models still rely on training with well-annotated CoSOD datasets. The exploration of training-free zero-shot CoSOD frameworks has been limited. In this paper, taking inspiration from the zero-shot transfer capabilities of foundational computer vision models, we introduce the first zero-shot CoSOD framework that harnesses these models without any training process. To achieve this, we introduce two novel components in our proposed framework: the group prompt generation (GPG) module and the co-saliency map generation (CMP) module. We evaluate the framework's performance on widely-used datasets and observe impressive results. Our approach surpasses existing unsupervised methods and even outperforms fully supervised methods developed before 2020, while remaining competitive with some fully supervised methods developed before 2022.


title: NeCo@ALQAC 2023: Legal Domain Knowledge Acquisition for Low-Resource Languages through Data Enrichment

abstract: In recent years, natural language processing has gained significant popularity in various sectors, including the legal domain. This paper presents NeCo Team's solutions to the Vietnamese text processing tasks provided in the Automated Legal Question Answering Competition 2023 (ALQAC 2023), focusing on legal domain knowledge acquisition for low-resource languages through data enrichment. Our methods for the legal document retrieval task employ a combination of similarity ranking and deep learning models, while for the second task, which requires extracting an answer from a relevant legal article in response to a question, we propose a range of adaptive techniques to handle different question types. Our approaches achieve outstanding results on both tasks of the competition, demonstrating the potential benefits and effectiveness of question answering systems in the legal field, particularly for low-resource languages.


title: Black-Box Analysis: GPTs Across Time in Legal Textual Entailment Task

abstract: The evolution of Generative Pre-trained Transformer (GPT) models has led to significant advancements in various natural language processing applications, particularly in legal textual entailment. We present an analysis of GPT-3.5 (ChatGPT) and GPT-4 performances on COLIEE Task 4 dataset, a prominent benchmark in this domain. The study encompasses data from Heisei 18 (2006) to Reiwa 3 (2021), exploring the models' abilities to discern entailment relationships within Japanese statute law across different periods. Our preliminary experimental results unveil intriguing insights into the models' strengths and weaknesses in handling legal textual entailment tasks, as well as the patterns observed in model performance. In the context of proprietary models with undisclosed architectures and weights, black-box analysis becomes crucial for evaluating their capabilities. We discuss the influence of training data distribution and the implications on the models' generalizability. This analysis serves as a foundation for future research, aiming to optimize GPT-based models and enable their successful adoption in legal information extraction and entailment applications.


title: Incentivising Demand Side Response through Discount Scheduling using Hybrid Quantum Optimization

abstract: Demand Side Response (DSR) is a strategy that enables consumers to actively participate in managing electricity demand. It aims to alleviate strain on the grid during high demand and promote a more balanced and efficient use of (renewable) electricity resources. We implement DSR through discount scheduling, which involves offering discrete price incentives to consumers to adjust their electricity consumption patterns to times when their local energy mix consists of more renewable energy. Since we tailor the discounts to individual customers' consumption, the Discount Scheduling Problem (DSP) becomes a large combinatorial optimization task. Consequently, we adopt a hybrid quantum computing approach, using D-Wave's Leap Hybrid Cloud. We benchmark Leap against Gurobi, a classical Mixed Integer optimizer in terms of solution quality at fixed runtime and fairness in terms of discount allocation. Furthermore, we propose a large-scale decomposition algorithm/heuristic for the DSP, applied with either quantum or classical computers running the subroutines, which significantly reduces the problem size while maintaining solution quality. Using synthetic data generated from real-world data, we observe that the classical decomposition method obtains the best overall \newp{solution quality for problem sizes up to 3200 consumers, however, the hybrid quantum approach provides more evenly distributed discounts across consumers.


title: Long-Range Transformer Architectures for Document Understanding

abstract: Since their release, Transformers have revolutionized many fields from Natural Language Understanding to Computer Vision. Document Understanding (DU) was not left behind with first Transformer based models for DU dating from late 2019. However, the computational complexity of the self-attention operation limits their capabilities to small sequences. In this paper we explore multiple strategies to apply Transformer based models to long multi-page documents. We introduce 2 new multi-modal (text + layout) long-range models for DU. They are based on efficient implementations of Transformers for long sequences. Long-range models can process whole documents at once effectively and are less impaired by the document's length. We compare them to LayoutLM, a classical Transformer adapted for DU and pre-trained on millions of documents. We further propose 2D relative attention bias to guide self-attention towards relevant tokens without harming model efficiency. We observe improvements on multi-page business documents on Information Retrieval for a small performance cost on smaller sequences. Relative 2D attention revealed to be effective on dense text for both normal and long-range models.


title: Switching global correlations on and off in a many-body quantum state by tuning local entanglement

abstract: A quantum many-body state built on a classical 1D Ising model with locally entangled qubits is considered. This setup can model an infinite-player quantum Prisoner's dilemma game with each site representing two entangled players (or qubits). The local entanglement $\gamma$ between two qubits placed on a site in the 1D Ising model and classical coupling between adjacent sites of the Ising model has an apposite influence on qubits. It points to a counter-intuitive situation wherein local entanglement at a site can exactly cancel global correlations, signaling an artificial quantum many-body state wherein, by locally tuning the entanglement at a particular site, one can transition from a strongly correlated quantum state to an uncorrelated quantum state and then to a correlated classical state. In other words, we can simulate a state similar to a Type II superconducting state via local tuning of entanglement in a 1D Ising chain with entangled qubits.


title: Share Your Representation Only: Guaranteed Improvement of the Privacy-Utility Tradeoff in Federated Learning

abstract: Repeated parameter sharing in federated learning causes significant information leakage about private data, thus defeating its main purpose: data privacy. Mitigating the risk of this information leakage, using state of the art differentially private algorithms, also does not come for free. Randomized mechanisms can prevent convergence of models on learning even the useful representation functions, especially if there is more disagreement between local models on the classification functions (due to data heterogeneity). In this paper, we consider a representation federated learning objective that encourages various parties to collaboratively refine the consensus part of the model, with differential privacy guarantees, while separately allowing sufficient freedom for local personalization (without releasing it). We prove that in the linear representation setting, while the objective is non-convex, our proposed new algorithm \DPFEDREP\ converges to a ball centered around the \emph{global optimal} solution at a linear rate, and the radius of the ball is proportional to the reciprocal of the privacy budget. With this novel utility analysis, we improve the SOTA utility-privacy trade-off for this problem by a factor of $\sqrt{d}$, where $d$ is the input dimension. We empirically evaluate our method with the image classification task on CIFAR10, CIFAR100, and EMNIST, and observe a significant performance improvement over the prior work under the same small privacy budget. The code can be found in this link: https://github.com/shenzebang/CENTAUR-Privacy-Federated-Representation-Learning.


title: Singularity theory of Weyl-point creation and annihilation

abstract: Weyl points (WP) are robust spectral degeneracies, which can not be split by small perturbations, as they are protected by their non-zero topological charge. For larger perturbations, WPs can disappear via pairwise annihilation, where two oppositely charged WPs merge, and the resulting neutral degeneracy disappears. The neutral degeneracy is unstable, meaning that it requires the fine-tuning of the perturbation. Fine-tuning of more than one parameter can lead to more exotic WP mergers. In this work, we reveal and analyze a fundamental connection of the WP mergers and singularity theory: phase boundary points of Weyl phase diagrams, i.e., control parameter values where Weyl point mergers happen, can be classified according to singularity classes of maps between manifolds of equal dimension. We demonstrate this connection on a Weyl--Josephson circuit where the merger of 4 WPs draw a swallowtail singularity, and in a random BdG Hamiltonian which reveal a rich pattern of fold lines and cusp points. Our results predict universal geometrical features of Weyl phase diagrams, and generalize naturally to creation and annihilation of Weyl points in electronic (phononic, magnonic, photonic, etc) band-structure models, where Weyl phase transitions can be triggered by control parameters such as mechanical strain.

categories: math-ph cond-mat.mes-hall math.MP quant-ph