title: Bright solitons in a spin-orbit-coupled dipolar Bose-Einstein condensate trapped within a double-lattice

abstract: By effectively controlling the dipole-dipole interaction, we investigate the characteristics of the ground state of bright solitons in a spin-orbit coupled dipolar Bose-Einstein condensate. The dipolar atoms are trapped within a double-lattice which consists of a linear and a nonlinear lattice. We derive the motion equations of the different spin components, taking the controlling mechanisms of the diolpe-dipole interaction into account. An analytical expression of dipole-dipole interaction is derived. By adjusting the dipole polarization angle, the dipole interaction can be adjusted from attraction to repulsion. On this basis, we study the generation and manipulation of the bright solitons using both the analytical variational method and numerical imaginary time evolution. The stability of the bright solitons is also analyzed and we map out the stability phase diagram. By adjusting the long-range dipole-dipole interaction, one can achieve manipulation of bright solitons in all aspects, including the existence, width, nodes, and stability. Considering the complexity of our system, our results will have enormous potential applications in quantum simulation of complex systems.


title: Some results on fractional vs. expectation thresholds

abstract: A conjecture of Talagrand (2010) states that the so-called expectation and fractional expectation thresholds are always within at most some constant factor from each other. Expectation (resp. fractional expectation) threshold $q$ (resp. $q_f$) for an increasing nontrivial class $\mathcal{F}\subseteq 2^X$ allows to locate the threshold for $\mathcal{F}$ within a logarithmic factor (these are important breakthrough results of Park and Pham (2022), resp. Frankston, Kahn, Narayanan and Park (2019)). We will survey what is known about the relation between $q$ and $q_f$ and prove some further special cases of Talagrand's conjecture.


title: Full characterization of biphotons with a generalized quantum interferometer

abstract: Entangled photons (biphotons) in the time-frequency degree of freedom play a crucial role in both foundational physics and advanced quantum technologies. Fully characterizing them poses a key scientific challenge. Here, we propose a theoretical approach to achieving the complete tomography of biphotons by introducing a frequency shift in one arm of the combination interferometer. Our method, a generalized combination interferometer, enables the reconstruction of the full complex joint spectral amplitude associated with both frequency sum and difference in a single interferometer. In contrast, the generalized Hong-Ou-Mandel and N00N state interferometers only allow for the partial tomography of biphotons, either in frequency difference or frequency sum. This provides an alternative method for full characterization of an arbitrary two-photon state with exchange symmetry and holds potential for applications in high-dimensional quantum information processing.


title: Angular dependence of the interlayer coupling at the interface between two dimensional materials 1T-PtSe$_2$ and graphene

abstract: We present a study by Scanning Tunneling Microscopy, supported by ab initio calculations, of the interaction between graphene and monolayer (semiconducting) PtSe$_2$ as a function of the twist angle ${\theta}$ between the two layers. We analyze the PtSe$_2$ contribution to the hybrid interface states that develop within the bandgap of the semiconductor to probe the interaction. The experimental data indicate that the interlayer coupling increases markedly with the value of ${\theta}$, which is confirmed by ab initio calculations. The moir\'e patterns observed within the gap are consistent with a momentum conservation rule between hybridized states, and the strength of the hybridization can be qualitatively described by a perturbative model.


title: MechAgents: Large language model multi-agent collaborations can solve mechanics problems, generate new data, and integrate knowledge

abstract: Solving mechanics problems using numerical methods requires comprehensive intelligent capability of retrieving relevant knowledge and theory, constructing and executing codes, analyzing the results, a task that has thus far mainly been reserved for humans. While emerging AI methods can provide effective approaches to solve end-to-end problems, for instance via the use of deep surrogate models or various data analytics strategies, they often lack physical intuition since knowledge is baked into the parametric complement through training, offering less flexibility when it comes to incorporating mathematical or physical insights. By leveraging diverse capabilities of multiple dynamically interacting large language models (LLMs), we can overcome the limitations of conventional approaches and develop a new class of physics-inspired generative machine learning platform, here referred to as MechAgents. A set of AI agents can solve mechanics tasks, here demonstrated for elasticity problems, via autonomous collaborations. A two-agent team can effectively write, execute and self-correct code, in order to apply finite element methods to solve classical elasticity problems in various flavors (different boundary conditions, domain geometries, meshes, small/finite deformation and linear/hyper-elastic constitutive laws, and others). For more complex tasks, we construct a larger group of agents with enhanced division of labor among planning, formulating, coding, executing and criticizing the process and results. The agents mutually correct each other to improve the overall team-work performance in understanding, formulating and validating the solution. Our framework shows the potential of synergizing the intelligence of language models, the reliability of physics-based modeling, and the dynamic collaborations among diverse agents, opening novel avenues for automation of solving engineering problems.

categories: cs.AI cond-mat.dis-nn cond-mat.mtrl-sci cs.CL cs.LG


title: SeDe: Balancing Blockchain Privacy and Regulatory Compliance by Selective De-Anonymization

abstract: Privacy is one of the essential pillars for the widespread adoption of blockchains, but public blockchains are transparent by nature. Modern analytics techniques can easily subdue the pseudonymity feature of a blockchain user. Some applications have been able to provide practical privacy protections using privacy-preserving cryptography techniques. However, malicious actors have abused them illicitly, discouraging honest actors from using privacy-preserving applications as "mixing" user interactions and funds with anonymous bad actors, causing compliance and regulatory concerns. In this paper, we propose a framework that balances privacy-preserving features by establishing a regulatory and compliant framework called Selective De-Anonymization (SeDe). The adoption of this framework allows privacy-preserving applications on blockchains to de-anonymize illicit transactions by recursive traversal of subgraphs of linked transactions. Our technique achieves this without leaving de-anonymization decisions or control in the hands of a single entity but distributing it among multiple entities while holding them accountable for their respective actions. To instantiate, our framework uses threshold encryption schemes and Zero-Knowledge Proofs (ZKPs).


title: Time-Uniform Confidence Spheres for Means of Random Vectors

abstract: We derive and study time-uniform confidence spheres -- confidence sphere sequences (CSSs) -- which contain the mean of random vectors with high probability simultaneously across all sample sizes. Inspired by the original work of Catoni and Giulini, we unify and extend their analysis to cover both the sequential setting and to handle a variety of distributional assumptions. Our results include an empirical-Bernstein CSS for bounded random vectors (resulting in a novel empirical-Bernstein confidence interval with asymptotic width scaling proportionally to the true unknown variance), CSSs for sub-$\psi$ random vectors (which includes sub-gamma, sub-Poisson, and sub-exponential), and CSSs for heavy-tailed random vectors (two moments only). Finally, we provide two CSSs that are robust to contamination by Huber noise. The first is a robust version of our empirical-Bernstein CSS, and the second extends recent work in the univariate setting to heavy-tailed multivariate distributions.

categories: math.ST cs.IT math.IT stat.ME stat.ML stat.TH


title: Modeling ionic flow between small targets: insights from diffusion and electro-diffusion theory

abstract: The flow of ions through permeable channels causes voltage drop in physiological nanodomains such as synapses, dendrites and dendritic spines, and other protrusions. How the voltage changes around channels in these nanodomains has remained poorly studied. We focus this book chapter on summarizing recent efforts in computing the steady-state current, voltage and ionic concentration distributions based on the Poisson-Nernst-Planck equations as a model of electro-diffusion. We first consider the spatial distribution of an uncharged particle density and derive asymptotic formulas for the concentration difference by solving the Laplace's equation with mixed boundary conditions. We study a constant particles injection rate modeled by a Neumann flux condition at a channel represented by a small boundary target, while the injected particles can exit at one or several narrow patches. We then discuss the case of two species (positive and negative charges) and take into account motions due to both concentration and electrochemical gradients. The voltage resulting from charge interactions is calculated by solving the Poisson's equation. We show how deep an influx diffusion propagates inside a nanodomain, for populations of both uncharged and charged particles. We estimate the concentration and voltage changes in relations with geometrical parameters and quantify the impact of membrane curvature.


title: Neural Lattice Reduction: A Self-Supervised Geometric Deep Learning Approach

abstract: Lattice reduction is a combinatorial optimization problem aimed at finding the most orthogonal basis in a given lattice. In this work, we address lattice reduction via deep learning methods. We design a deep neural model outputting factorized unimodular matrices and train it in a self-supervised manner by penalizing non-orthogonal lattice bases. We incorporate the symmetries of lattice reduction into the model by making it invariant and equivariant with respect to appropriate continuous and discrete groups.


title: AT 2023prq: A Classical Nova in the Halo of the Andromeda Galaxy

abstract: The classical nova, AT 2023prq, was discovered on 2023 August 15 and is located at a distance of 46 kpc from the Andromeda Galaxy (M 31). Here we report photometry and spectroscopy of the nova. The 'very fast' ($t_{2,r^{\prime}}\sim3.4$ d) and low luminosity ($M_{r^{\prime}}\sim-7.6$) nature of the transient along with the helium in its spectra would indicate that AT 2023prq is a 'faint-and-fast' He/N nova. Additionally, at such a large distance from the centre of M 31, AT 2023prq is a member of the halo nova population.


title: Vision-Language Instruction Tuning: A Review and Analysis

abstract: Instruction tuning is a crucial supervised training phase in Large Language Models (LLMs), aiming to enhance the LLM's ability to generalize instruction execution and adapt to user preferences. With the increasing integration of multi-modal data into LLMs, there is growing interest in Vision-Language Instruction Tuning (VLIT), which presents more complex characteristics compared to pure text instruction tuning. In this paper, we systematically review the latest VLIT settings and corresponding datasets in multi-modal LLMs and provide insights into the intrinsic motivations behind their design. For the first time, we offer a detailed multi-perspective categorization for existing VLIT datasets and identify the characteristics that high-quality VLIT data should possess. By incorporating these characteristics as guiding principles into the existing VLIT data construction process, we conduct extensive experiments and verify their positive impact on the performance of tuned multi-modal LLMs. Furthermore, we discuss the current challenges and future research directions of VLIT, providing insights for the continuous development of this field. The code and dataset related to this paper have been open-sourced at https://github.com/palchenli/VL-Instruction-Tuning.


title: T-wave Inversion through Inhomogeneous Voltage Diffusion within the FK3V Cardiac Model

abstract: The heart beats due to the synchronized contraction of cardiomyocytes triggered by a periodic sequence of electrical signals called action potentials, which originate in the sinoatrial node and spread through the heart's electrical system. A large body of work is devoted to modeling the propagation of the action potential and to reproducing reliably its shape and duration. Connection of computational modeling of cells to macroscopic phenomenological curves such as the electrocardiogram has been also intense, due to its clinical importancce in analyzing cardiovascular diseases. In this work we simulate the dynamics of action potential propagation using the three-variable Fenton-Karma model that can account for both normal and damaged cells through spatially inhomogeneous voltage diffusion coefficient. We monitor the action potential propagation in the cardiac tissue and calculate the pseudo-electrocardiogram that reproduces the R and T waves. The R wave amplitude varies according to a double exponential law as a function of the (spatially homogeneous, for an isotropic tissue) diffusion coefficient. The addition of spatial inhomogeneity in the diffusion coefficient by means of a defected region representing damaged cardiac cells, may result in T-wave inversion in the calculated pseudo-electrocardiogram. The transition from positive to negative polarity of the T-wave is analyzed as a function of the length and the depth of the defected region.


title: The G\=oMartini approach: Revisiting the concept of contact maps and the modelling of protein complexes

abstract: We present a review of a series of contact maps for the determination of native interactions in proteins and nucleic acids based on a distance-threshold. Such contact maps are mostly based on physical and chemical construction, and yet they are sensitive to some parameters (e.g. distances or atomic radii) and can neglect some key interactions. Furthermore, we also comment on a new class of contact maps that only requires geometric arguments. The contact map is a necessary ingredient to build a robust G\=oMartini model for proteins and their complexes in the Martini 3 force field. We present the extension of a popular structure-based G\=o-like approach for the study of protein-sugar complexes, and also limitations of this approach are discussed. The G\=oMartini approach was first introduced by Poma et al. J. Chem. Theory Comput. 2017, 13(3), 1366-1374 in Martini 2 force field and recently, it has gained the status of gold-standard for protein simulation undergoing conformational changes in Martini 3 force field. We discuss several studies that have provided support to this approach in the context of the biophysical community.


title: Microservice API Evolution in Practice: A Study on Strategies and Challenges

abstract: Nowadays, many companies design and develop their software systems as a set of loosely coupled microservices that communicate via their Application Programming Interfaces (APIs). While the loose coupling improves maintainability, scalability, and fault tolerance, it poses new challenges to the API evolution process. Related works identified communication and integration as major API evolution challenges but did not provide the underlying reasons and research directions to mitigate them. In this paper, we aim to identify microservice API evolution strategies and challenges in practice and gain a broader perspective of their relationships. We conducted 17 semi-structured interviews with developers, architects, and managers in 11 companies and analyzed the interviews with open coding used in grounded theory. In total, we identified six strategies and six challenges for REpresentational State Transfer (REST) and event-driven communication via message brokers. The strategies mainly focus on API backward compatibility, versioning, and close collaboration between teams. The challenges include change impact analysis efforts, ineffective communication of changes, and consumer reliance on outdated versions, leading to API design degradation. We defined two important problems in microservice API evolution resulting from the challenges and their coping strategies: tight organizational coupling and consumer lock-in. To mitigate these two problems, we propose automating the change impact analysis and investigating effective communication of changes as open research directions.


title: A deformation-based morphometry framework for disentangling Alzheimer's disease from normal aging using learned normal aging templates

abstract: Alzheimer's Disease and normal aging are both characterized by brain atrophy. The question of whether AD-related brain atrophy represents accelerated aging or a neurodegeneration process distinct from that in normal aging remains unresolved. Moreover, precisely disentangling AD-related brain atrophy from normal aging in a clinical context is complex. In this study, we propose a deformation-based morphometry framework to estimate normal aging and AD-specific atrophy patterns of subjects from morphological MRI scans. We first leverage deep-learning-based methods to create age-dependent templates of cognitively normal (CN) subjects. These templates model the normal aging atrophy patterns in a CN population. Then, we use the learned diffeomorphic registration to estimate the one-year normal aging pattern at the voxel level. We register the testing image to the 60-year-old CN template in the second step. Finally, normal aging and AD-specific scores are estimated by measuring the alignment of this registration with the one-year normal aging pattern. The methodology was developed and evaluated on the OASIS3 dataset with 1,014 T1-weighted MRI scans. Of these, 326 scans were from CN subjects, and 688 scans were from individuals clinically diagnosed with AD at different stages of clinical severity defined by clinical dementia rating (CDR) scores. The results show that ventricles predominantly follow an accelerated normal aging pattern in subjects with AD. In turn, hippocampi and amygdala regions were affected by both normal aging and AD-specific factors. Interestingly, hippocampi and amygdala regions showed more of an accelerated normal aging pattern for subjects during the early clinical stages of the disease, while the AD-specific score increases in later clinical stages. Our code is freely available at https://github.com/Fjr9516/DBM_with_DL.


title: Overcoming the Size Limit of First Principles Molecular Dynamics Simulations with an In-Distribution Substructure Embedding Active Learner

abstract: Large-scale first principles molecular dynamics are crucial for simulating complex processes in chemical, biomedical, and materials sciences. However, the unfavorable time complexity with respect to system sizes leads to prohibitive computational costs when the simulation contains over a few hundred atoms in practice. We present an In-Distribution substructure Embedding Active Learner (IDEAL) to enable efficient simulation of large complex systems with quantum accuracy by maintaining a machine learning force field (MLFF) as an accurate surrogate to the first principles methods. By extracting high-uncertainty substructures into low-uncertainty atom environments, the active learner is allowed to concentrate on and learn from small substructures of interest rather than carrying out intractable quantum chemical computations on large structures. IDEAL is benchmarked on various systems and shows sub-linear complexity, accelerating the simulation thousands of times compared with conventional active learning and millions of times compared with pure first principles simulations. To demonstrate the capability of IDEAL in practical applications, we simulated a polycrystalline lithium system composed of one million atoms and the full ammonia formation process in a Haber-Bosch reaction on a 3-nm Iridium nanoparticle catalyst on a computing node comprising one single A100 GPU and 24 CPU cores.


title: What holes in the gas distribution of nearly face-on galaxies can tell us about the host disk parameters: the case of the NGC 628 South-East superbubble

abstract: Here we explore the impact of all major factors, such as the non-homogeneous gas distribution, galactic rotation and gravity, on the observational appearance of superbubbles in nearly face-on spiral galaxies. The results of our 3D numerical simulations are confronted to the observed gas column density distribution in the largest South-East superbubble in the late-type spiral galaxy NGC 628. We make use of the star formation history inside the bubble derived from the resolved stellar population seen in the HST images to obtain its energy and demonstrate that the results of numerical simulations are in good agreement with the observed gas surface density distribution. We also show that the observed gas column density distribution constraints the gaseous disk scale height and the midplane gas density if the energy input rate could be obtained from observations. This implies that observations of large holes in the interstellar gas distribution and their stellar populations have the potential power to solve the midplane gas density - gaseous disk scale-height degeneracy problem in nearly face-on galaxies. The possible role of superbubbles in driving the secondary star formation in galaxies is also briefly discussed.


title: Semi-Supervised Learning via Swapped Prediction for Communication Signal Recognition

abstract: Deep neural networks have been widely used in communication signal recognition and achieved remarkable performance, but this superiority typically depends on using massive examples for supervised learning, whereas training a deep neural network on small datasets with few labels generally falls into overfitting, resulting in degenerated performance. To this end, we develop a semi-supervised learning (SSL) method that effectively utilizes a large collection of more readily available unlabeled signal data to improve generalization. The proposed method relies largely on a novel implementation of consistency-based regularization, termed Swapped Prediction, which leverages strong data augmentation to perturb an unlabeled sample and then encourage its corresponding model prediction to be close to its original, optimized with a scaled cross-entropy loss with swapped symmetry. Extensive experiments indicate that our proposed method can achieve a promising result for deep SSL of communication signal recognition.


title: Systematics of neutron emission

abstract: Neutron physics is one of the oldest brach of the experimental nuclear physics, but the investigation of the spontaneous neutron emission from the ground state along the neutron dripline is still at its beginning, in spite of the crucial importance for nuclear astrophysics. The proton dripline is much better investigated and a systematics of spontaneous proton half lives is available in terms of the Coulomb parameter, characterizing the outgoing irregular Coulomb wave. Our purpose is to propose a similar systematics of spontaneous neutron half lives, but in terms of the nuclear reduced radius, characterizing the "neutral" spherical irregular Neumann wave.


title: Frame to frame interpolation for high-dimensional data visualisation using the woylier package

abstract: The woylier package implements tour interpolation paths between frames using Givens rotations. This provides an alternative to the geodesic interpolation between planes currently available in the tourr package. Tours are used to visualise high-dimensional data and models, to detect clustering, anomalies and non-linear relationships. Frame-to-frame interpolation can be useful for projection pursuit guided tours when the index is not rotationally invariant. It also provides a way to specifically reach a given target frame. We demonstrate the method for exploring non-linear relationships between currency cross-rates.


title: Self-Evolved Diverse Data Sampling for Efficient Instruction Tuning

abstract: Enhancing the instruction-following ability of Large Language Models (LLMs) primarily demands substantial instruction-tuning datasets. However, the sheer volume of these imposes a considerable computational burden and annotation cost. To investigate a label-efficient instruction tuning method that allows the model itself to actively sample subsets that are equally or even more effective, we introduce a self-evolving mechanism DiverseEvol. In this process, a model iteratively augments its training subset to refine its own performance, without requiring any intervention from humans or more advanced LLMs. The key to our data sampling technique lies in the enhancement of diversity in the chosen subsets, as the model selects new data points most distinct from any existing ones according to its current embedding space. Extensive experiments across three datasets and benchmarks demonstrate the effectiveness of DiverseEvol. Our models, trained on less than 8% of the original dataset, maintain or improve performance compared with finetuning on full data. We also provide empirical evidence to analyze the importance of diversity in instruction data and the iterative scheme as opposed to one-time sampling. Our code is publicly available at https://github.com/OFA-Sys/DiverseEvol.git.


abstract: Quantum error mitigation (QEM) is crucial for near-term quantum devices, as noise inherently exists in physical quantum systems and undermines the accuracy of quantum algorithms. A typical purification-based QEM method, called Virtual Distillation (VD), aims to mitigate state preparation errors and achieve effective exponential suppression using multiple copies of the noisy state. However, imperfect VD circuit implementation may yield negative mitigation outcomes, potentially more severe than those achieved without QEM. To address this, we introduce Circuit-Noise-Resilient Virtual Distillation (CNR-VD). This method, featuring a calibration procedure that utilizes easily-prepared input states, refines the outcomes of VD when its circuit is contaminated by noise, seeking to recover the results of an ideally conducted VD circuit. Simulation results demonstrate that the CNR-VD estimator effectively reduces deviations induced by noise in the VD circuit, showcasing improvements in accuracy by an order of magnitude at most compared to the original VD. Meanwhile, CNR-VD elevates the gate noise threshold for VD, enabling positive effects even in the presence of higher noise levels. Furthermore, the strength of our work lies in its applicability beyond specific QEM algorithms, as the estimator can also be applied to generic Hadamard-Test circuits. The proposed CNR-VD significantly enhances the noise-resilience of VD, and thus is anticipated to elevate the performance of quantum algorithm implementations on near-term quantum devices.


title: DenseLens -- Using DenseNet ensembles and information criteria for finding and rank-ordering strong gravitational lenses,

abstract: Convolutional neural networks (CNNs) are the state-of-the-art technique for identifying strong gravitational lenses. Although they are highly successful in recovering genuine lens systems with a high true-positive rate, the unbalanced nature of the data set (lens systems are rare), still leads to a high false positive rate. For these techniques to be successful in upcoming surveys (e.g. with Euclid) most emphasis should be set on reducing false positives, rather than on reducing false negatives. In this paper, we introduce densely connected neural networks (DenseNets) as the CNN architecture in a new pipeline-ensemble model containing an ensemble of classification CNNs and regression CNNs to classify and rank-order lenses, respectively. We show that DenseNets achieve comparable true positive rates but considerably lower false positive rates (when compared to residual networks; ResNets). Thus, we recommend DenseNets for future missions involving large data sets, such as Euclid, where low false positive rates play a key role in the automated follow-up and analysis of large numbers of strong gravitational lens candidates when human vetting is no longer feasible


title: Predicting Dynamic Memory Requirements for Scientific Workflow Tasks

abstract: With the increasing amount of data available to scientists in disciplines as diverse as bioinformatics, physics, and remote sensing, scientific workflow systems are becoming increasingly important for composing and executing scalable data analysis pipelines. When writing such workflows, users need to specify the resources to be reserved for tasks so that sufficient resources are allocated on the target cluster infrastructure. Crucially, underestimating a task's memory requirements can result in task failures. Therefore, users often resort to overprovisioning, resulting in significant resource wastage and decreased throughput. In this paper, we propose a novel online method that uses monitoring time series data to predict task memory usage in order to reduce the memory wastage of scientific workflow tasks. Our method predicts a task's runtime, divides it into k equally-sized segments, and learns the peak memory value for each segment depending on the total file input size. We evaluate the prototype implementation of our method using workflows from the publicly available nf-core repository, showing an average memory wastage reduction of 29.48% compared to the best state-of-the-art approach.


title: Island in Quark Cloud Model

abstract: We compute the entanglement entropy of Hawking radiation in a bath attached to a deformed eternal AdS black hole dual to field theories where each theory is backreacted by the presence of a uniform static distribution of heavy fundamental quarks. The entanglement entropy of the Hawking radiation increases linearly with time until an island emerges after the Page time, at that point the entanglement entropy saturates to a constant value twice the Bekenstein-Hawking entropy of the deformed black hole resulting in the Page curve. Furthermore, we study the effects of the backreaction on the Page curve and observe that introducing deformation delays the appearance of island and shifts the Page curve to a later time.


title: Competing charge transfer and screening effects in two-dimensional ferroelectric capacitors

abstract: Two-dimensional (2D) ferroelectrics offer the potential for ultrathin flexible nanoelectronics, typically utilizing a metal-ferroelectric-metal sandwich structure as the functional unit. Electrodes can either contribute free carriers to screen the depolarization field, enhancing nanoscale ferroelectricity, or they can induce charge doping, disrupting the long-range crystalline order. Here, we explore the dual roles of electrodes in 2D ferroelectric capacitors, supported by extensive first-principles calculations covering a range of electrode work functions. Our results reveal volcano-type relationships between ferroelectric-electrode binding affinity and work function, which are further unified by a quadratic scaling between the binding energy and the transferred interfacial charge. At the monolayer limit, the charge transfer dictates the ferroelectric stability and switching properties. This is a general characteristic confirmed in various 2D ferroelectrics including $\alpha$-In$_2$Se$_3$, CuInP$_2$S$_6$, and SnTe. As the ferroelectric layer's thickness increases, the stability of the capacitor evolves from a charge transfer-dominated to a screening-dominated state. The delicate interplay between these two effects will have important implications for the applications of 2D ferroelectric capacitors.


title: Fast List Decoding of High-Rate Polar Codes

abstract: Due to the ability to provide superior error-correction performance, the successive cancellation list (SCL) algorithm is widely regarded as one of the most promising decoding algorithms for polar codes with short-to-moderate code lengths. However, the application of SCL decoding in low-latency communication scenarios is limited due to its sequential nature. To reduce the decoding latency, developing tailored fast and efficient list decoding algorithms of specific polar substituent codes (special nodes) is a promising solution. Recently, fast list decoding algorithms are proposed by considering special nodes with low code rates. Aiming to further speedup the SCL decoding, this paper presents fast list decoding algorithms for two types of high-rate special nodes, namely single-parity-check (SPC) nodes and sequence rate one or single-parity-check (SR1/SPC) nodes. In particular, we develop two classes of fast list decoding algorithms for these nodes, where the first class uses a sequential decoding procedure to yield decoding latency that is linear with the list size, and the second further parallelizes the decoding process by pre-determining the redundant candidate paths offline. Simulation results show that the proposed list decoding algorithms are able to achieve up to 70.7\% lower decoding latency than state-of-the-art fast SCL decoders, while exhibiting the same error-correction performance.


title: All Data on the Table: Novel Dataset and Benchmark for Cross-Modality Scientific Information Extraction

abstract: Extracting key information from scientific papers has the potential to help researchers work more efficiently and accelerate the pace of scientific progress. Over the last few years, research on Scientific Information Extraction (SciIE) witnessed the release of several new systems and benchmarks. However, existing paper-focused datasets mostly focus only on specific parts of a manuscript (e.g., abstracts) and are single-modality (i.e., text- or table-only), due to complex processing and expensive annotations. Moreover, core information can be present in either text or tables or across both. To close this gap in data availability and enable cross-modality IE, while alleviating labeling costs, we propose a semi-supervised pipeline for annotating entities in text, as well as entities and relations in tables, in an iterative procedure. Based on this pipeline, we release novel resources for the scientific community, including a high-quality benchmark, a large-scale corpus, and a semi-supervised annotation pipeline. We further report the performance of state-of-the-art IE models on the proposed benchmark dataset, as a baseline. Lastly, we explore the potential capability of large language models such as ChatGPT for the current task. Our new dataset, results, and analysis validate the effectiveness and efficiency of our semi-supervised pipeline, and we discuss its remaining limitations.


title: SAMIHS: Adaptation of Segment Anything Model for Intracranial Hemorrhage Segmentation

abstract: Segment Anything Model (SAM), a vision foundation model trained on large-scale annotations, has recently continued raising awareness within medical image segmentation. Despite the impressive capabilities of SAM on natural scenes, it struggles with performance decline when confronted with medical images, especially those involving blurry boundaries and highly irregular regions of low contrast. In this paper, a SAM-based parameter-efficient fine-tuning method, called SAMIHS, is proposed for intracranial hemorrhage segmentation, which is a crucial and challenging step in stroke diagnosis and surgical planning. Distinguished from previous SAM and SAM-based methods, SAMIHS incorporates parameter-refactoring adapters into SAM's image encoder and considers the efficient and flexible utilization of adapters' parameters. Additionally, we employ a combo loss that combines binary cross-entropy loss and boundary-sensitive loss to enhance SAMIHS's ability to recognize the boundary regions. Our experimental results on two public datasets demonstrate the effectiveness of our proposed method. Code is available at https://github.com/mileswyn/SAMIHS .


title: GEC-DePenD: Non-Autoregressive Grammatical Error Correction with Decoupled Permutation and Decoding

abstract: Grammatical error correction (GEC) is an important NLP task that is currently usually solved with autoregressive sequence-to-sequence models. However, approaches of this class are inherently slow due to one-by-one token generation, so non-autoregressive alternatives are needed. In this work, we propose a novel non-autoregressive approach to GEC that decouples the architecture into a permutation network that outputs a self-attention weight matrix that can be used in beam search to find the best permutation of input tokens (with auxiliary {ins} tokens) and a decoder network based on a step-unrolled denoising autoencoder that fills in specific tokens. This allows us to find the token permutation after only one forward pass of the permutation network, avoiding autoregressive constructions. We show that the resulting network improves over previously known non-autoregressive methods for GEC and reaches the level of autoregressive methods that do not use language-specific synthetic data generation methods. Our results are supported by a comprehensive experimental validation on the ConLL-2014 and Write&Improve+LOCNESS datasets and an extensive ablation study that supports our architectural and algorithmic choices.


title: McDuff factors from amenable actions and dynamical alternating groups

abstract: Given a topologically free action of a countably infinite amenable group on the Cantor set, we prove that, for every subgroup $G$ of the topological full group containing the alternating group, the group von Neumann algebra $\mathscr{L} G$ is a McDuff factor. This yields the first examples of nonamenable simple finitely generated groups $G$ for which $\mathscr{L} G$ is McDuff. Using the same construction we show moreover that if a faithful action $G\curvearrowright X$ of a countable group on a countable set with no finite orbits is amenable then the crossed product of the associated shift action over a given II$_1$ factor is a McDuff factor. In particular, if $H$ is a nontrivial countable ICC group and $G\curvearrowright X$ is a faithful amenable action of a countable ICC group on a countable set with no finite orbits, then the group von Neumann algebra of the generalized wreath product $H\wr_X G$ is a McDuff factor. Our technique can also be applied to show that if $H$ is a nontrivial countable group and $G\curvearrowright X$ is an amenable action of a countable group on a countable set with no finite orbits then the generalized wreath product $H\wr_X G$ is Jones-Schmidt stable.


title: Large deviations in statistics of the convex hull of passive and active particles: A theoretical study

abstract: We investigate analytically the distribution tails of the area A and perimeter L of a convex hull for different types of planar random walks. For N noninteracting Brownian motions of duration T we find that the large-L and A tails behave as $\mathcal{P}\left(L\right)\sim e^{-b_{N}L^{2}/DT}$ and $\mathcal{P}\left(A\right)\sim e^{-c_{N}A/DT}$, while the small-$L$ and $A$ tails behave as $\mathcal{P}\left(L\right)\sim e^{-d_{N}DT/L^{2}}$ and $\mathcal{P}\left(A\right)\sim e^{-e_{N}DT/A}$, where $D$ is the diffusion coefficient. We calculated all of the coefficients ($b_N, c_N, d_N, e_N$) exactly. Strikingly, we find that $b_N$ and $c_N$ are independent of N, for $N\geq 3$ and $N \geq 4$, respectively. We find that the large-L (A) tails are dominated by a single, most probable realization that attains the desired L (A). The left tails are dominated by the survival probability of the particles inside a circle of appropriate size. For active particles and at long times, we find that large-L and A tails are given by $\mathcal{P}\left(L\right)\sim e^{-T\Psi_{N}^{\text{per}}\left(L/T\right)}$ and $\mathcal{P}\left(A\right)\sim e^{-T\Psi_{N}^{\text{area}}\left(\sqrt{A}/T\right)}$ respectively. We calculate the large deviation functions $\Psi_N$ exactly and find that they exhibit multiple singularities. We interpret these as dynamical phase transitions of first order. We extended several of these results to dimensions $d>2$. Our analytic predictions display excellent agreement with existing results that were obtained from extensive numerical simulations.


title: On the Quantum Chromatic Numbers of Small Graphs

abstract: We make two contributions pertaining to the study of the quantum chromatic numbers of small graphs. Firstly, in an elegant paper, Man\v{c}inska and Roberson [\textit{Baltic Journal on Modern Computing}, 4(4), 846-859, 2016] gave an example of a graph $G_{14}$ on 14 vertices with quantum chromatic number 4 and classical chromatic number 5, and conjectured that this is the smallest graph exhibiting a separation between the two parameters. We describe a computer-assisted proof of this conjecture, thereby resolving a longstanding open problem in quantum graph theory. Our second contribution pertains to the study of the rank-$r$ quantum chromatic numbers. While it can now be shown that for every $r$, $\chi_q$ and $\chi^{(r)}_q$ are distinct, few small examples of separations between these parameters are known. We give the smallest known example of such a separation in the form of a graph $G_{21}$ on 21 vertices with $\chi_q(G_{21}) = \chi^{(2)}_q(G_{21}) = 4$ and $ \xi(G_{21}) = \chi^{(1)}_q(G_{21}) = \chi(G_{21}) = 5$. The previous record was held by a graph $G_{msg}$ on 57 vertices that was first considered in the aforementioned paper of Man\v{c}inska and Roberson and which satisfies $\chi_q(G_{msg}) = 3$ and $\chi^{(1)}_q(G_{msg}) = 4$. In addition, $G_{21}$ provides the first provable separation between the parameters $\chi^{(1)}_q$ and $\chi^{(2)}_q$. We believe that our techniques for constructing $G_{21}$ and lower bounding its orthogonal rank could be of independent interest.


title: Automated Fact-Checking in Dialogue: Are Specialized Models Needed?

abstract: Prior research has shown that typical fact-checking models for stand-alone claims struggle with claims made in dialogues. As a solution, fine-tuning these models on labelled dialogue data has been proposed. However, creating separate models for each use case is impractical, and we show that fine-tuning models for dialogue results in poor performance on typical fact-checking. To overcome this challenge, we present techniques that allow us to use the same models for both dialogue and typical fact-checking. These mainly focus on retrieval adaptation and transforming conversational inputs so that they can be accurately predicted by models trained on stand-alone claims. We demonstrate that a typical fact-checking model incorporating these techniques is competitive with state-of-the-art models fine-tuned for dialogue, while maintaining its accuracy on stand-alone claims.


title: Computational homogenization of higher-order electro-mechanical materials with built-in generalized periodicity conditions

abstract: We present a formulation for high-order generalized periodicity conditions in the context of a high-order electromechanical theory including flexoelectricity, strain gradient elasticity and gradient dielectricity, with the goal of studying periodic architected metamaterials. Such theory results in fourth-order governing partial differential equations, and the periodicity conditions involve continuity across the periodic boundary of primal fields (displacement and electric potential) and their normal derivatives, continuity of the corresponding dual generalized forces (tractions, double tractions, surface charge density and double surface charge density). Rather than imposing these conditions numerically as explicit constraints, we develop an approximation space which fulfils generalized periodicity by construction. Our method naturally allows us to impose general macroscopic fields (strains/stresses and electric fields/electric displacements) along arbitrary directions, enabling the characterization of the material anisotropy. We apply the proposed method to study periodic architected metamaterials with apparent piezoelectricity. We first verify the method by directly comparing the results with a large periodic structure, then apply it to evaluate the anisotropic apparently piezoelectricity of a geometrically polarized 2D lattice, and finally demonstrate the application of the method in a 3D architected metamaterial.


title: The Ebin-Marsden toolbox for stochastic PDEs: stochastic Euler equations

abstract: The Ebin-Marsden theory is a powerful geometric framework for many PDEs from fluid dynamics. In this paper we provide a toolbox to apply the Ebin-Marsden approach to stochastic PDEs, combining tools from infinite-dimensional geometry and stochastic analysis. We showcase our approach in the context of incompressible Euler equation for an ideal fluid with additive noise. Among our main results there are: (i) local well-posedness of maximal solutions by using the Ebin-Marsden framework; (ii) a stochastic version of the celebrated no-loss-no-gain theorem.


title: A High-Frequency Load-Store Queue with Speculative Allocations for High-Level Synthesis

abstract: Dynamically scheduled high-level synthesis (HLS) enables the use of load-store queues (LSQs) which can disambiguate data hazards at circuit runtime, increasing throughput in codes with unpredictable memory accesses. However, the increased throughput comes at the price of lower clock frequency and higher resource usage compared to statically scheduled circuits without LSQs. The lower frequency often nullifies any throughput improvements over static scheduling, while the resource usage becomes prohibitively expensive with large queue sizes. This paper presents a method for achieving dynamically scheduled memory operations in HLS without significant clock period and resource usage increase. We present a novel LSQ based on shift-registers enabled by the opportunity to specialize queue sizes to a target code in HLS. We show a method to speculatively allocate addresses to our LSQ, significantly increasing pipeline parallelism in codes that could not benefit from an LSQ before. In stark contrast to traditional load value speculation, we do not require pipeline replays and have no overhead on misspeculation. On a set of benchmarks with data hazards, our approach achieves an average speedup of 11$\times$ against static HLS and 5$\times$ against dynamic HLS that uses a state of the art LSQ from previous work. Our LSQ also uses several times fewer resources, scaling to queues with hundreds of entries, and supports both on-chip and off-chip memory.


title: Diffusion-based generation of Histopathological Whole Slide Images at a Gigapixel scale

abstract: We present a novel diffusion-based approach to generate synthetic histopathological Whole Slide Images (WSIs) at an unprecedented gigapixel scale. Synthetic WSIs have many potential applications: They can augment training datasets to enhance the performance of many computational pathology applications. They allow the creation of synthesized copies of datasets that can be shared without violating privacy regulations. Or they can facilitate learning representations of WSIs without requiring data annotations. Despite this variety of applications, no existing deep-learning-based method generates WSIs at their typically high resolutions. Mainly due to the high computational complexity. Therefore, we propose a novel coarse-to-fine sampling scheme to tackle image generation of high-resolution WSIs. In this scheme, we increase the resolution of an initial low-resolution image to a high-resolution WSI. Particularly, a diffusion model sequentially adds fine details to images and increases their resolution. In our experiments, we train our method with WSIs from the TCGA-BRCA dataset. Additionally to quantitative evaluations, we also performed a user study with pathologists. The study results suggest that our generated WSIs resemble the structure of real WSIs.


title: Using Old Laboratory Equipment with Modern Web-of-Things Standards: a Smart Laboratory with LabThings Retro

abstract: There has been an increasing, and welcome, Open Hardware trend towards science teams building and sharing their designs for new instruments. These devices, often built upon low-cost microprocessors and micro-controllers, can be readily connected to enable complex, automated, and smart experiments. When designed to use open communication web standards, devices from different laboratories and manufacturers can be controlled using a single protocol, and even communicate with each other. However, science labs still have a majority of old, perfectly functional, equipment which tends to use older, and sometimes proprietary, standards for communications. In order to encourage the continued and integrated use of this equipment in modern automated experiments, we develop and demonstrate LabThings Retro. This allows us to retrofit old instruments to use modern web-of-things standards, which we demonstrate with closed-loop feedback involving an optical microscope, digital imaging and fluid pumping.


title: Joint Location Sensing and Channel Estimation for IRS-Aided mmWave ISAC Systems

abstract: In this paper, we investigate a self-sensing intelligent reflecting surface (IRS) aided millimeter wave (mmWave) integrated sensing and communication (ISAC) system. Unlike the conventional purely passive IRS, the self-sensing IRS can effectively reduce the path loss of sensing-related links, thus rendering it advantageous in ISAC systems. Aiming to jointly sense the target/scatterer/user positions as well as estimate the sensing and communication (SAC) channels in the considered system, we propose a two-phase transmission scheme, where the coarse and refined sensing/channel estimation (CE) results are respectively obtained in the first phase (using scanning-based IRS reflection coefficients) and second phase (using optimized IRS reflection coefficients). For each phase, an angle-based sensing turbo variational Bayesian inference (AS-TVBI) algorithm, which combines the VBI, messaging passing and expectation-maximization (EM) methods, is developed to solve the considered joint location sensing and CE problem. The proposed algorithm effectively exploits the partial overlapping structured (POS) sparsity and 2-dimensional (2D) block sparsity inherent in the SAC channels to enhance the overall performance. Based on the estimation results from the first phase, we formulate a Cram\'{e}r-Rao bound (CRB) minimization problem for optimizing IRS reflection coefficients, and through proper reformulations, a low-complexity manifold-based optimization algorithm is proposed to solve this problem. Simulation results are provided to verify the superiority of the proposed transmission scheme and associated algorithms.


title: Federated Skewed Label Learning with Logits Fusion

abstract: Federated learning (FL) aims to collaboratively train a shared model across multiple clients without transmitting their local data. Data heterogeneity is a critical challenge in realistic FL settings, as it causes significant performance deterioration due to discrepancies in optimization among local models. In this work, we focus on label distribution skew, a common scenario in data heterogeneity, where the data label categories are imbalanced on each client. To address this issue, we propose FedBalance, which corrects the optimization bias among local models by calibrating their logits. Specifically, we introduce an extra private weak learner on the client side, which forms an ensemble model with the local model. By fusing the logits of the two models, the private weak learner can capture the variance of different data, regardless of their category. Therefore, the optimization direction of local models can be improved by increasing the penalty for misclassifying minority classes and reducing the attention to majority classes, resulting in a better global model. Extensive experiments show that our method can gain 13\% higher average accuracy compared with state-of-the-art methods.


title: Precise prediction for the W boson mass in U(1) extensions of the standard model

abstract: We present the one-loop correction to the $W$ boson mass in U(1)$_z$ type extensions of the standard model. We compare it to an approximation, often used in high energy physics tools. We point out that if the $Z'$ boson -- predicted in U(1)$_z$ type extensions -- is much heavier than the $Z$ boson, then the use of the complete set of one-loop corrections is necessary.


title: On The Evaluation of Collision Probability along a Path

abstract: Characterizing the risk of operations is a fundamental requirement in robotics, and a crucial ingredient of safe planning. The problem is multifaceted, with multiple definitions arising in the vast recent literature fitting different application scenarios and leading to different computational approaches. A basic element shared by most frameworks is the definition and evaluation of the probability of collision for a mobile object in an environment with obstacles. We observe that, even in basic cases, different interpretations are possible. This paper proposes an index we call Risk Density, which offers a theoretical link between conceptually distant assumptions about the interplay of single collision events along a continuous path. We show how this index can be used to approximate the collision probability in the case where the robot evolves along a nominal continuous curve from random initial conditions. Indeed under this hypothesis the proposed approximation outperforms some well-established methods either in accuracy or computational cost.


title: Increasing the Efficiency of Cryptoasset Investigations by Connecting the Cases

abstract: Law enforcement agencies are confronted with a rapidly growing number of cryptoasset-related cases, often redundantly investigating the same cases without mutual knowledge or shared insights. In this paper, we explore the hypothesis that recognizing and acting upon connections between these cases can significantly streamline investigative processes. Through an analysis of a dataset comprising 34 cyberfraud and 1793 sextortion spam cases, we discovered that 41% of the cyberfraud and 96.9% of the sextortion spam incidents can be interconnected. We introduce a straightforward yet effective tool, which is integrated into a broader cryptoasset forensics workflow and allows investigators to highlight and share case connections. Our research unequivocally demonstrates that recognizing case connections can lead to remarkable efficiencies, especially when extended across crime areas, international borders, and jurisdictions.


title: Human-Centric Autonomous Systems With LLMs for User Command Reasoning

abstract: The evolution of autonomous driving has made remarkable advancements in recent years, evolving into a tangible reality. However, a human-centric large-scale adoption hinges on meeting a variety of multifaceted requirements. To ensure that the autonomous system meets the user's intent, it is essential to accurately discern and interpret user commands, especially in complex or emergency situations. To this end, we propose to leverage the reasoning capabilities of Large Language Models (LLMs) to infer system requirements from in-cabin users' commands. Through a series of experiments that include different LLM models and prompt designs, we explore the few-shot multivariate binary classification accuracy of system requirements from natural language textual commands. We confirm the general ability of LLMs to understand and reason about prompts but underline that their effectiveness is conditioned on the quality of both the LLM model and the design of appropriate sequential prompts. Code and models are public with the link \url{https://github.com/KTH-RPL/DriveCmd_LLM}.


title: Data-driven Control Against False Data Injection Attacks

abstract: The rise of cyber-security concerns has brought significant attention to the analysis and design of cyber-physical systems (CPSs). Among the various types of cyberattacks, denial-of-service (DoS) attacks and false data injection (FDI) attacks can be easily launched and have become prominent threats. While resilient control against DoS attacks has received substantial research efforts, countermeasures developed against FDI attacks have been relatively limited, particularly when explicit system models are not available. To address this gap, the present paper focuses on the design of data-driven controllers for unknown linear systems subject to FDI attacks on the actuators, utilizing input-state data. To this end, a general FDI attack model is presented, which imposes minimally constraints on the switching frequency of attack channels and the magnitude of attack matrices. A dynamic state feedback control law is designed based on offline and online input-state data, which adapts to the channel switching of FDI attacks. This is achieved by solving two data-based semi-definite programs (SDPs) on-the-fly to yield a tight approximation of the set of subsystems consistent with both offline clean data and online attack-corrupted data. It is shown that under mild conditions on the attack, the proposed SDPs are recursively feasible and controller achieves exponential stability. Numerical examples showcase its effectiveness in mitigating the impact of FDI attacks.


title: Modular Representations of Truncated current Lie algebras

abstract: In this paper we consider the structure and representation theory of truncated current algebras $\mathfrak{g}_m = \mathfrak{g}[t]/(t^{m+1})$ associated to the Lie algebra $\mathfrak{g}$ of a standard reductive group over a field of positive characteristic. We classify semisimple and nilpotent elements and describe their associated support varieties. Next, we prove various Morita equivalences for reduced enveloping algebras, including a reduction to nilpotent $p$-characters, analogous to a famous theorem of Friedlander--Parshall. We go on to give precise upper bounds for the dimensions of simple modules for all $p$-characters, and give lower bounds on these dimensions for homogeneous $p$-characters. We then develop the theory of baby Verma modules for homogeneous $p$-characters and, whenever the $p$-character has standard Levi type, we give a full classification of the simple modules. In particular we classify all simple modules with homogeneous $p$-characters for $\mathfrak{g}_m$ when $\mathfrak{g} = \mathfrak{gl}_n$. Finally, we compute the Cartan invariants for the restricted enveloping algebra $U_0(\mathfrak{g}_m)$ and show that they can be described by precise formulae depending on decomposition numbers for $U_0(\mathfrak{g})$.


title: On the formula for the norms of Miyawaki lifts

abstract: The Miyawaki lifting is a lifting of Siegel modular forms introduced by Ikeda in his 2006 paper. In the same paper, he also conjectured a formula for the norms of Miyawaki lifts. In this paper, we show that his conjectural formula can be rewritten into a refined GGP type formula.


title: Thermodynamics of the $S=1/2$ hyperkagome-lattice Heisenberg antiferromagnet

abstract: The $S=1/2$ hyperkagome-lattice Heisenberg antiferromagnet, which for instance is related to the experimentally accessible spinel oxide Na$_4$Ir$_3$O$_8$, allows to study the interplay of geometrical frustration and quantum as well as thermal fluctuations in three dimensions. We use 16 terms of a high-temperature series expansion complemented by the entropy-method interpolation to examine the specific heat and the uniform susceptibility of the $S=1/2$ hyperkagome-lattice Heisenberg antiferromagnet. We obtain thermodynamic quantities for the two possible scenarios of either a gapless or a gapped energy spectrum. We have found that the specific heat $c$ exhibits, besides the high-temperature peak around $T\approx 0.669$, a low-temperature one at $T\approx 0.021\ldots0.033$. The functional form of the uniform susceptibility $\chi$ below about $T=0.5$ depends strongly on whether the energy spectrum is gapless or gapped. The value of the ground-state energy can be estimated to $e_{0}\approx-0.440\ldots-0.435$. In addition to the entropy-method interpolation we use the finite-temperature Lanczos method to calculate $c$ and $\chi$ for finite lattices of $N=24$ and $36$ sites. A combined view on both methods leads us to favour a gapless scenario since then the maximum of the susceptibility agrees better between both methods.


title: Fundamental Limitations within the Selected Cryptographic Scenarios and Supra-Quantum Theories

abstract: The following submission constitutes a guide and an introduction to a collection of articles submitted as a Ph.D. dissertation at the University of Gda\'nsk. In the dissertation, we study the fundamental limitations within the selected quantum and supra-quantum cryptographic scenarios in the form of upper bounds on the achievable key rates. We investigate various security paradigms, bipartite and multipartite settings, as well as single-shot and asymptotic regimes. Our studies, however, extend beyond the derivations of the upper bounds on the secret key rates in the mentioned scenarios. In particular, we propose a novel type of rerouting attack on the quantum Internet for which we find a countermeasure and benchmark its efficiency. Furthermore, we propose several upper bounds on the performance of quantum (key) repeaters settings. We derive a lower bound on the secret key agreement capacity of a quantum network, which we tighten in an important case of a bidirectional quantum network. The squashed nonlocality derived here as an upper bound on the secret key rate is a novel non-faithful measure of nonlocality. Furthermore, the notion of the non-signaling complete extension arising from the complete extension postulate as a counterpart of purification of a quantum state allows us to study analogies between non-signaling and quantum key distribution scenarios.


title: Observation of high-temperature superconductivity in the high-pressure tetragonal phase of La2PrNi2O7-{\delta}

abstract: The recent discovery of high-temperature superconductivity in the Ruddlesden-Popper phase La3Ni2O7 under high pressure marks a significant breakthrough in the field of 3d transition-metal oxide superconductors. For an emerging novel class of high-Tc superconductors, it is crucial to find more analogous superconducting materials with a dedicated effort toward broadening the scope of nickelate superconductors. Here, we report on the observation of high-Tc superconductivity in the high-pressure tetragonal I4/mmm phase of La2PrNi2O7 above ~10 GPa, which is distinct from the reported orthorhombic Fmmm phase of La3Ni2O7 above 14 GPa. For La2PrNi2O7, the onset and the zero-resistance temperatures of superconductivity reach Tconset = 78.2 K and Tczero = 40 K at 15 GPa. This superconducting phase shares the samilar structural symmetry as many cuprate superconductors, providing a fresh platform to investigate underlying mechanisms of nickelate superconductors.


title: Unlock the Power: Competitive Distillation for Multi-Modal Large Language Models

abstract: Recently, multi-modal content generation has attracted lots of attention from researchers by investigating the utilization of visual instruction tuning based on large language models (LLMs). To enhance the performance and generalization ability of such LLMs, the practice of distilling knowledge from pretrained multi-modal models (a.k.a. teachers) to more compact multi-modal LLMs (students) has gained considerable interest. However, the prevailing paradigm of instructiontuning in multi-modal LLMs knowledge distillation is resource-intensive and unidirectional, neglecting the potential for mutual feedback between the student and teacher models. Thus, we propose an innovative Competitive Multi-modal Distillation framework (CoMD), which captures bidirectional feedback between teacher and student models and continually updates the multi-modal capabilities that the student model has learned. It comprises two stages: multi-modal pre-training and multi-modal competitive distillation. The first stage pre-trains the student model on a large number of filtered multi-modal datasets. The second stage facilitates a bidirectional knowledge transfer between the student and teacher models. Our experimental analysis of diverse datasets shows that our knowledge transfer method consistently improves the capabilities of the student model. Finally, the 7B-sized student model after four distillations surpassed the current state-of-the-art model LLaVA-13B on the ScienceQA and LLaVA Test dataset, also outperforms other strong baselines in the zero-shot setting.


title: Frequentist Guarantees of Distributed (Non)-Bayesian Inference

abstract: Motivated by the need to analyze large, decentralized datasets, distributed Bayesian inference has become a critical research area across multiple fields, including statistics, electrical engineering, and economics. This paper establishes Frequentist properties, such as posterior consistency, asymptotic normality, and posterior contraction rates, for the distributed (non-)Bayes Inference problem among agents connected via a communication network. Our results show that, under appropriate assumptions on the communication graph, distributed Bayesian inference retains parametric efficiency while enhancing robustness in uncertainty quantification. We also explore the trade-off between statistical efficiency and communication efficiency by examining how the design and size of the communication graph impact the posterior contraction rate. Furthermore, We extend our analysis to time-varying graphs and apply our results to exponential family models, distributed logistic regression, and decentralized detection models.


title: Electronic plasma diffusion with radiation reaction force and time-dependent electric field

abstract: In this work the explicit solution of the electronic plasma diffusion with radiation reaction force, under the action of an exponential decay external electric field is given. The electron dynamics is described by a classical generalized Langevin equation characterized by an Ornstein-Uhlenbeck-type friction memory kernel, with an effective memory time which accounts for the effective thermal interaction between the electron and its surroundings (thermal collisions between electrons + radiation reaction force). The incident electric field exerts an electric force on the electron, which in turn can induce an additional damping to the braking radiation force, allowing a delay in the electron characteristic time. This fact allows that the effective memory time be finite and positive, and as a consequence, obtaining physically admissible solutions of the stochastic Abraham-Lorentz-like equation. It is shown that the diffusion process is quasi-Markovian which includes the radiation effects.


title: On the Degrees of Freedom of $R^2$ Gravity in Flat Spacetime

abstract: We study the degrees of freedom of $R^2$ gravity in flat spacetime with two approaches. By rewriting the theory a la Stueckelberg, and implementing Lorentz-like gauges to the metric perturbations, we confirm that the pure theory propagates one scalar degree of freedom, while the full theory contains two tensor modes in addition. We then consider the degrees of freedom by directly examining the metric perturbations. We show that the degrees of freedom of the full theory match with those obtained with the manifestly covariant approach. In contrast, we find that the pure $R^2$ gravity has no degrees of freedom. We show that a similar discrepancy between the two approaches appears also in a theory dual to the three-form, and appears due to the Lorentz-like gauges, which lead to the fictitious modes even after the residual gauge redundancy has been taken into account. At first sight, this implies a discontinuity between the full theory and the pure case. By studying the first-order corrections of the full $R^2$ gravity beyond the linear regime, we show that at high-energies, both scalar and tensor degrees of freedom become strongly coupled. This implies that the apparent discontinuity of pure and full $R^2$ gravity is just an artefact of the perturbation theory, and further supports the absence of degrees of freedom in the pure $R^2$ gravity.


title: Peer is Your Pillar: A Data-unbalanced Conditional GANs for Few-shot Image Generation

abstract: Few-shot image generation aims to train generative models using a small number of training images. When there are few images available for training (e.g. 10 images), Learning From Scratch (LFS) methods often generate images that closely resemble the training data while Transfer Learning (TL) methods try to improve performance by leveraging prior knowledge from GANs pre-trained on large-scale datasets. However, current TL methods may not allow for sufficient control over the degree of knowledge preservation from the source model, making them unsuitable for setups where the source and target domains are not closely related. To address this, we propose a novel pipeline called Peer is your Pillar (PIP), which combines a target few-shot dataset with a peer dataset to create a data-unbalanced conditional generation. Our approach includes a class embedding method that separates the class space from the latent space, and we use a direction loss based on pre-trained CLIP to improve image diversity. Experiments on various few-shot datasets demonstrate the advancement of the proposed PIP, especially reduces the training requirements of few-shot image generation.


title: Estimating Conditional Value-at-Risk with Nonstationary Quantile Predictive Regression Models

abstract: This paper develops an asymptotic distribution theory for an endogenous instrumentation approach in quantile predictive regressions when both generated covariates and persistent predictors are used. The generated covariates are obtained from an auxiliary quantile predictive regression model and the statistical problem of interest is the robust estimation and inference of the parameters that correspond to the primary quantile predictive regression in which this generated covariate is added to the set of nonstationary regressors. We find that the proposed doubly IVX corrected estimator is robust to the abstract degree of persistence regardless of the presence of generated regressor obtained from the first stage procedure. The asymptotic properties of the two-stage IVX estimator such as mixed Gaussianity are established while the asymptotic covariance matrix is adjusted to account for the first-step estimation error.


title: Eval-GCSC: A New Metric for Evaluating ChatGPT's Performance in Chinese Spelling Correction

abstract: ChatGPT has demonstrated impressive performance in various downstream tasks. However, in the Chinese Spelling Correction (CSC) task, we observe a discrepancy: while ChatGPT performs well under human evaluation, it scores poorly according to traditional metrics. We believe this inconsistency arises because the traditional metrics are not well-suited for evaluating generative models. Their overly strict length and phonics constraints may lead to underestimating ChatGPT's correction capabilities. To better evaluate generative models in the CSC task, this paper proposes a new evaluation metric: Eval-GCSC. By incorporating word-level and semantic similarity judgments, it relaxes the stringent length and phonics constraints. Experimental results show that Eval-GCSC closely aligns with human evaluations. Under this metric, ChatGPT's performance is comparable to traditional token-level classification models (TCM), demonstrating its potential as a CSC tool. The source code and scripts can be accessed at https://github.com/ktlKTL/Eval-GCSC.


title: State-Dependent Channels with a Message-Cognizant Helper

abstract: The capacity of a state-dependent discrete memoryless channel (SD-DMC) is derived for the setting where a message-cognizant rate-limited helper observes the state sequence noncausally, produces its description, and provides the description to both encoder and decoder.


title: Coupled resonator acoustic waveguides-based acoustic interferometers designed within two-dimensional phononic crystals: experiment and theory

abstract: The acoustic response of defect-based acoustic interferometer-like designs, known as Coupled Resonator Acoustic Waveguides (CRAWs), in two-dimensional phononic crystals (PnCs) is reported. The PnC is composed of steel cylinders arranged in a square lattice within a water matrix with defects induced by selectively removing cylinders to create Mach-Zehnder-like (MZ) defect-based interferometers. Two defect-based acoustic interferometers of MZ-type are fabricated, one with arms oriented horizontally and another one with arms oriented diagonally, and their transmission features are experimentally characterized using ultrasonic spectroscopy. The experimental data are compared with finite element method (FEM) simulations and with tight-binding (TB) calculations in which each defect is treated as a resonator coupled to its neighboring ones. Significantly, the results exhibit excellent agreement indicating the reliability of the proposed approach. This comprehensive match is of paramount importance for accurately predicting and optimizing resonant modes supported by defect arrays, thus enabling the tailoring of phononic structures and defect-based waveguides to meet specific requirements. This successful implementation of FEM and TB calculations in investigating CRAWs systems within phononic crystals paves the way for designing advanced acoustic devices with desired functionalities for various practical applications, demonstrating the application of solid-state electronics principles to underwater acoustic devices description.


title: Softness Matters: Effects of Compression on the Behavior of Adsorbed Microgels at Interfaces

abstract: Deformable colloids and macromolecules adsorb at interfaces, as they decrease the interfacial energy between the two media. The deformability, or softness, of these particles plays a pivotal role in the properties of the interface. In this study, we employ a comprehensive \emph{in situ} approach, combining neutron reflectometry with molecular dynamics simulations, to thoroughly examine the profound influence of softness on the structure of microgel Langmuir monolayers under compression. Lateral compression of both hard and soft microgel particle monolayers induces substantial structural alterations, leading to an amplified protrusion of the microgels into the aqueous phase. However, a critical distinction emerges: hard microgels are pushed away from the interface, in stark contrast to the soft ones, which remain steadfastly anchored to it. Concurrently, on the air-exposed side of the monolayer, lateral compression induces a flattening of the surface of the hard monolayer. This phenomenon is not observed for the soft particles as the monolayer is already extremely flat even in the absence of compression. These findings significantly advance our understanding of the pivotal role of softness on both the equilibrium phase behavior of the monolayer and its effect when soft colloids are used as stabilizers of responsive interfaces and emulsions.


title: Improving Image Captioning via Predicting Structured Concepts

abstract: Having the difficulty of solving the semantic gap between images and texts for the image captioning task, conventional studies in this area paid some attention to treating semantic concepts as a bridge between the two modalities and improved captioning performance accordingly. Although promising results on concept prediction were obtained, the aforementioned studies normally ignore the relationship among concepts, which relies on not only objects in the image, but also word dependencies in the text, so that offers a considerable potential for improving the process of generating good descriptions. In this paper, we propose a structured concept predictor (SCP) to predict concepts and their structures, then we integrate them into captioning, so as to enhance the contribution of visual signals in this task via concepts and further use their relations to distinguish cross-modal semantics for better description generation. Particularly, we design weighted graph convolutional networks (W-GCN) to depict concept relations driven by word dependencies, and then learns differentiated contributions from these concepts for following decoding process. Therefore, our approach captures potential relations among concepts and discriminatively learns different concepts, so that effectively facilitates image captioning with inherited information across modalities. Extensive experiments and their results demonstrate the effectiveness of our approach as well as each proposed module in this work.


title: Stabilizing an ultracold Fermi gas against Fermi acceleration to superdiffusion through localization

abstract: Anderson localization, i.e., destructive quantum interference of multiple-scattering paths, halts transport entirely. Contrarily, time-dependent random forces expedite transport via Fermi acceleration, proposed as a mechanism for high-energy cosmic rays. Their competition creates interesting dynamics, but experimental observations are scarce. Here, we experimentally study the expansion of an ultracold Fermi gas inside time-dependent disorder and observe distinct regimes from sub- to superdiffusion. Unexpectedly, quantum interference counteracts acceleration in strong disorder. Our system enables the investigation of Fermi acceleration in the quantum-transport regime.


title: Uni-COAL: A Unified Framework for Cross-Modality Synthesis and Super-Resolution of MR Images

abstract: Cross-modality synthesis (CMS), super-resolution (SR), and their combination (CMSR) have been extensively studied for magnetic resonance imaging (MRI). Their primary goals are to enhance the imaging quality by synthesizing the desired modality and reducing the slice thickness. Despite the promising synthetic results, these techniques are often tailored to specific tasks, thereby limiting their adaptability to complex clinical scenarios. Therefore, it is crucial to build a unified network that can handle various image synthesis tasks with arbitrary requirements of modality and resolution settings, so that the resources for training and deploying the models can be greatly reduced. However, none of the previous works is capable of performing CMS, SR, and CMSR using a unified network. Moreover, these MRI reconstruction methods often treat alias frequencies improperly, resulting in suboptimal detail restoration. In this paper, we propose a Unified Co-Modulated Alias-free framework (Uni-COAL) to accomplish the aforementioned tasks with a single network. The co-modulation design of the image-conditioned and stochastic attribute representations ensures the consistency between CMS and SR, while simultaneously accommodating arbitrary combinations of input/output modalities and thickness. The generator of Uni-COAL is also designed to be alias-free based on the Shannon-Nyquist signal processing framework, ensuring effective suppression of alias frequencies. Additionally, we leverage the semantic prior of Segment Anything Model (SAM) to guide Uni-COAL, ensuring a more authentic preservation of anatomical structures during synthesis. Experiments on three datasets demonstrate that Uni-COAL outperforms the alternatives in CMS, SR, and CMSR tasks for MR images, which highlights its generalizability to wide-range applications.


title: Prospects for measuring quark polarization and spin correlations in $b\bar b$ and $c\bar c$ samples at the LHC

abstract: Polarization and spin correlations have been studied in detail for top quarks at the LHC, but have been explored very little for the other flavors of quarks. In this paper we consider the processes $pp\to q\bar{q}$ with $q = b$, $c$ or $s$. Utilizing the partial preservation of the quark's spin information in baryons in the jet produced by the quark, we examine possible analysis strategies for ATLAS and CMS to measure the quark polarization and spin correlations. We find polarization measurements for the $b$ and $c$ quarks to be feasible, even with the currently available datasets. Spin correlation measurements for $b\bar b$ are possible using the CMS Run 2 parked data, while such measurements for $c\bar c$ will become possible with higher integrated luminosity. For the $s$ quark, we find the measurements to be challenging with the standard triggers. We also provide leading-order QCD predictions for the polarization and spin correlations expected in the $b\bar b$ and $c\bar c$ samples with the cuts envisioned for the above analyses. Apart from establishing experimentally the existence of spin correlations in $b\bar b$ and $c\bar c$ systems produced in $pp$ collisions, the proposed measurements can provide new information on the polarization transfer from quarks to baryons and might even be sensitive to physics beyond the Standard Model.


title: Prediction of inter packet arrival times for enhanced NR-V2X sidelink scheduling

abstract: A significant limitation of the LTE-V2X and NR-V2X sidelink scheduling mechanisms is their difficulty coping with variations in inter packet arrival times, also known as aperiodic packets. This conflicts with the fundamental characteristics of most V2X services which are triggered based on an event. e.g. ETSI Cooperative Awareness Messages (CAMs) - vehicle kinematics, Cooperative Perception Messages (CPMs) - object sensing and Decentralised Event Notification Messages (DENMs) - event occurrences. Furthermore, network management techniques such as congestion control mechanisms can result in varied inter packet arrival times. To combat this, NR-V2X introduced a dynamic grant mechanism, which we show is ineffective unless there is background periodic traffic to stabilise the sensing history upon which the scheduler makes it decisions. The characteristics of V2X services make it implausible that such periodic application traffic will exist. To overcome this significant drawback, we demonstrate that the standardised scheduling algorithms can be made effective if the event triggered arrival rate of packets can be accurately predicted. These predictions can be used to tune the Resource Reservation Interval (RRI) parameter of the MAC scheduler to negate the negative impact of aperiodicity. Such an approach allows the scheduler to achieve comparable performance to a scenario where packets arrive periodically. To demonstrate the effectiveness of our approach, an ML model has been devised for the prediction of cooperative awareness messages, but the same principle can be abstracted to other V2X service types.


title: Counterfactual Explanation for Regression via Disentanglement in Latent Space

abstract: Counterfactual Explanations (CEs) help address the question: How can the factors that influence the prediction of a predictive model be changed to achieve a more favorable outcome from a user's perspective? Thus, they bear the potential to guide the user's interaction with AI systems since they represent easy-to-understand explanations. To be applicable, CEs need to be realistic and actionable. In the literature, various methods have been proposed to generate CEs. However, the majority of research on CEs focuses on classification problems where questions like "What should I do to get my rejected loan approved?" are raised. In practice, answering questions like "What should I do to increase my salary?" are of a more regressive nature. In this paper, we introduce a novel method to generate CEs for a pre-trained regressor by first disentangling the label-relevant from the label-irrelevant dimensions in the latent space. CEs are then generated by combining the label-irrelevant dimensions and the predefined output. The intuition behind this approach is that the ideal counterfactual search should focus on the label-irrelevant characteristics of the input and suggest changes toward target-relevant characteristics. Searching in the latent space could help achieve this goal. We show that our method maintains the characteristics of the query sample during the counterfactual search. In various experiments, we demonstrate that the proposed method is competitive based on different quality measures on image and tabular datasets in regression problem settings. It efficiently returns results closer to the original data manifold compared to three state-of-the-art methods, which is essential for realistic high-dimensional machine learning applications. Our code will be made available as an open-source package upon the publication of this work.


title: Search for gravitational wave signals from known pulsars in LIGO-Virgo O3 data using the 5n-vector ensemble method

abstract: The 5n-vector ensemble method is a multiple test for the targeted search of continuous gravitational waves from an ensemble of known pulsars. This method can improve the detection probability combining the results from individually undetectable pulsars if few signals are near the detection threshold. In this paper, we apply the 5n-vector ensemble method to the O3 data set from the LIGO and Virgo detectors considering an ensemble of 201 known pulsars. We find no evidence for a signal from the ensemble and set a 95% credible upper limit on the mean ellipticity assuming a common exponential distribution for the pulsars' ellipticities. Using two independent hierarchical Bayesian procedures, we find upper limits of $1.2 \times 10^{-9}$ and $2.5 \times 10^{-9}$ on the mean ellipticity for the 201 analyzed pulsars.


title: Electronic bandstructure of superconducting KTaO3 (111) interfaces

abstract: Two-dimensional electron gases(2DEGs)based on KTaO3 are emerging as a promising platform for spin-orbitronics due to their high Rashba spin-orbit coupling (SOC) and gate-voltage tunability. The recent discovery of a superconducting state in KTaO3 2DEGs now expands their potential towards topological superconductivity. Although the band structure of KTaO3 surfaces of various crystallographic orientations has already been mapped using angle-resolved photoemission spectroscopy(ARPES), this is not the case for superconducting KTaO3 2DEGs. Here, we reveal the electronic structure of superconducting 2DEGs based on KTaO3 (111) single crystals through ARPES measurements. We fit the data with a tight-binding model and compute the associated spin textures to bring insight into the SOC-driven physics of this fascinating system.


title: High Intensity Kaon Experiments (HIKE) at the CERN SPS Proposal for Phases 1 and 2

abstract: A timely and long-term programme of kaon decay measurements at an unprecedented level of precision is presented, leveraging the capabilities of the CERN Super Proton Synchrotron (SPS). The proposed HIKE programme is firmly anchored on the experience built up studying kaon decays at the SPS over the past four decades, and includes rare processes, CP violation, dark sectors, symmetry tests and other tests of the Standard Model. The programme is based on a staged approach involving experiments with charged and neutral kaon beams, as well as operation in beam-dump mode. The various phases will rely on a common infrastructure and set of detectors.


title: Revealing Transition in Fall-off Rates of spin-s Ising Model through Multiqudit Graph states

abstract: A variable-range interacting Ising model with spin-1/2 particles exhibits distinct behavior depending on the fall-off rates in the range of interactions, notably non-local (NL), quasi-local (QL), and local. It is unknown if such a transition occurs in this model with an arbitrary spin quantum number. We establish its existence by analyzing the profiles of entanglement entropy, mutual information, and genuine multipartite entanglement (GME) of the weighted graph state (WGS), which is prepared when the multi-level maximally coherent state at each site evolves according to the spin-s Ising Hamiltonian. Specifically, we demonstrate that the scaling of time-averaged mutual information and the divergence in the first derivative of GME with respect to the fall-off rate in the WGS can indicate the transition point from NL to QL, which scales logarithmically with individual spin dimension. Additionally, we suggest that the existence of a saturation value of a finite number of qudits capable of mimicking the GME pattern of an arbitrarily large system-size can reveal the second transition point between quasi-local and local regions.


title: Conformal Tilings, Combinatorial Curvature, and the Type Problem

abstract: Roughly, a conformal tiling of a Riemann surface is a tiling where each tile is a suitable conformal image of a Euclidean regular polygon. In 1997, Bowers and Stephenson constructed an edge-to-edge conformal tiling of the complex plane using conformally regular pentagons. In contrast, we show that for all $n \geq 7$, there is no edge-to-edge conformal tiling of the complex plane using conformally regular $n$-gons. More generally, we discuss a relationship between the combinatorial curvature at each vertex of the conformal tiling and the universal cover (sphere, plane, or disc) of the underlying Riemann surface. This result follows from the work of Stone (1976) and Oh (2005) through a rich interplay between Riemannian geometry and combinatorial geometry. We provide an exposition of these proofs and some new applications to conformal tilings.


title: Centralized Intermediation in a Decentralized Web3 Economy: Value Accrual and Extraction

abstract: The advent of Web3 has ushered in a new era of decentralized digital economy, promising a shift from centralized authority to distributed, peer-to-peer interactions. However, the underlying infrastructure of this decentralized ecosystem often relies on centralized cloud providers, creating a paradoxical concentration of value and power. This paper investigates the mechanics of value accrual and extraction within the Web3 ecosystem, focusing on the roles and revenues of centralized clouds. Through an analysis of publicly available material, we elucidate the financial implications of cloud services in purportedly decentralized contexts. We further explore the individual's perspective of value creation and accumulation, examining the interplay between user participation and centralized monetization strategies. Key findings indicate that while blockchain technology has the potential to significantly reduce infrastructure costs for financial services, the current Web3 landscape is marked by a substantial reliance on cloud providers for hosting, scalability, and performance.


title: Inference of Probabilistic Programs with Moment-Matching Gaussian Mixtures

abstract: Computing the posterior distribution of a probabilistic program is a hard task for which no one-fit-for-all solution exists. We propose Gaussian Semantics, which approximates the exact probabilistic semantics of a bounded program by means of Gaussian mixtures. It is parametrized by a map that associates each program location with the moment order to be matched in the approximation. We provide two main contributions. The first is a universal approximation theorem stating that, under mild conditions, Gaussian Semantics can approximate the exact semantics arbitrarily closely. The second is an approximation that matches up to second-order moments analytically in face of the generally difficult problem of matching moments of Gaussian mixtures with arbitrary moment order. We test our second-order Gaussian approximation (SOGA) on a number of case studies from the literature. We show that it can provide accurate estimates in models not supported by other approximation methods or when exact symbolic techniques fail because of complex expressions or non-simplified integrals. On two notable classes of problems, namely collaborative filtering and programs involving mixtures of continuous and discrete distributions, we show that SOGA significantly outperforms alternative techniques in terms of accuracy and computational time.


title: MeLo: Low-rank Adaptation is Better than Fine-tuning for Medical Image Diagnosis

abstract: The common practice in developing computer-aided diagnosis (CAD) models based on transformer architectures usually involves fine-tuning from ImageNet pre-trained weights. However, with recent advances in large-scale pre-training and the practice of scaling laws, Vision Transformers (ViT) have become much larger and less accessible to medical imaging communities. Additionally, in real-world scenarios, the deployments of multiple CAD models can be troublesome due to problems such as limited storage space and time-consuming model switching. To address these challenges, we propose a new method MeLo (Medical image Low-rank adaptation), which enables the development of a single CAD model for multiple clinical tasks in a lightweight manner. It adopts low-rank adaptation instead of resource-demanding fine-tuning. By fixing the weight of ViT models and only adding small low-rank plug-ins, we achieve competitive results on various diagnosis tasks across different imaging modalities using only a few trainable parameters. Specifically, our proposed method achieves comparable performance to fully fine-tuned ViT models on four distinct medical imaging datasets using about 0.17% trainable parameters. Moreover, MeLo adds only about 0.5MB of storage space and allows for extremely fast model switching in deployment and inference. Our source code and pre-trained weights are available on our website (https://absterzhu.github.io/melo.github.io/).


title: Explicit Reciprocity Laws in Iwasawa Theory -- A survey with some focus on the Lubin-Tate setting

abstract: Starting from Gau{\ss}' and Legendre's quadratic reciprocity law we want to sketch how it gave rise to the development of higher and generalized reciprocity laws and over all explicit reciprocity formulas in Iwasawa theory.


title: Images of dominant endomorphisms of affine space

abstract: A basic problem in the study of algebraic morphisms is to determine which sets can be realised as the image of an endomorphism of affine space. This paper extends the results previously obtained by the first author on the question of existence of surjective maps $F\colon \mathbb{A}^n \rightarrow \mathbb{A}^n\setminus Z$, where $Z$ is an algebraic subvariety of $\mathbb{A}^n$ of codimension at least 2. In particular, we show that for any (affine) algebraic variety $Z$ of dimension at most $n-2$, there is an algebraic variety $W\subset \mathbb{A}^n$ birational to $Z$ and a surjective algebraic morphism $\mathbb{A}^n\rightarrow \mathbb{A}^n\setminus W$. We also propose a conjectural approach towards resolving unknown cases.


title: Learning Physics-Inspired Regularization for Medical Image Registration with Hypernetworks

abstract: Medical image registration aims at identifying the spatial deformation between images of the same anatomical region and is fundamental to image-based diagnostics and therapy. To date, the majority of the deep learning-based registration methods employ regularizers that enforce global spatial smoothness, e.g., the diffusion regularizer. However, such regularizers are not tailored to the data and might not be capable of reflecting the complex underlying deformation. In contrast, physics-inspired regularizers promote physically plausible deformations. One such regularizer is the linear elastic regularizer which models the deformation of elastic material. These regularizers are driven by parameters that define the material's physical properties. For biological tissue, a wide range of estimations of such parameters can be found in the literature and it remains an open challenge to identify suitable parameter values for successful registration. To overcome this problem and to incorporate physical properties into learning-based registration, we propose to use a hypernetwork that learns the effect of the physical parameters of a physics-inspired regularizer on the resulting spatial deformation field. In particular, we adapt the HyperMorph framework to learn the effect of the two elasticity parameters of the linear elastic regularizer. Our approach enables the efficient discovery of suitable, data-specific physical parameters at test time.


title: Investigating the Encoding of Words in BERT's Neurons using Feature Textualization

abstract: Pretrained language models (PLMs) form the basis of most state-of-the-art NLP technologies. Nevertheless, they are essentially black boxes: Humans do not have a clear understanding of what knowledge is encoded in different parts of the models, especially in individual neurons. The situation is different in computer vision, where feature visualization provides a decompositional interpretability technique for neurons of vision models. Activation maximization is used to synthesize inherently interpretable visual representations of the information encoded in individual neurons. Our work is inspired by this but presents a cautionary tale on the interpretability of single neurons, based on the first large-scale attempt to adapt activation maximization to NLP, and, more specifically, large PLMs. We propose feature textualization, a technique to produce dense representations of neurons in the PLM word embedding space. We apply feature textualization to the BERT model (Devlin et al., 2019) to investigate whether the knowledge encoded in individual neurons can be interpreted and symbolized. We find that the produced representations can provide insights about the knowledge encoded in individual neurons, but that individual neurons do not represent clearcut symbolic units of language such as words. Additionally, we use feature textualization to investigate how many neurons are needed to encode words in BERT.


title: Split-explicit external mode solver in finite volume sea ice ocean model FESOM2

abstract: A novel split-explicit (SE) external mode solver for the Finite volumE Sea ice-Ocean Model (FESOM2) is presented. It is compared with the semi-implicit (SI) solver currently used in FESOM2. The SE solver utilises a dissipative asynchronous (forward-backward) time-stepping scheme. Its implementation with Arbitrary Lagrangian-Eulerian (ALE) vertical coordinates like Z-star and Z-tilde is explored. The comparisons are performed through multiple test cases involving idealised and realistic global simulations. The SE solver demonstrates lower phase errors and dissipation, but maintain a simulated mean ocean state very similar to the SI solver. The SE solver is also shown to possess better run-time performance and parallel scalability across all tested workloads.