title: EpidermaQuant: Unsupervised detection and quantification of epidermal differentiation markers on H-DAB-stained images of reconstructed human epidermis

abstract: The integrity of the reconstructed human epidermis generated in vitro could be assessed using histological analyses combined with immunohistochemical staining of keratinocyte differentiation markers. Computer-based analysis of scanned tissue saves the expert time and may improve the accuracy of quantification by eliminating interrater reliability issues. However, technical differences during the preparation and capture of stained images and the presence of multiple artifacts may influence the outcome of computational methods. Using a dataset with 598 unannotated images showing cross-sections of in vitro reconstructed human epidermis stained with DAB-based immunohistochemistry reaction to visualize 4 different keratinocyte differentiation marker proteins (filaggrin, keratin 10, Ki67, HSPA2) and counterstained with hematoxylin, we developed an unsupervised method for the detection and quantification of immunohistochemical staining. The proposed pipeline includes the following steps: (i) color normalization to reduce the variability of pixel intensity values in different samples; (ii) color deconvolution to acquire color channels of the stains used; (iii) morphological operations to find the background area of the image; (iv) automatic image rotation; and (v) finding markers of human epidermal differentiation with clustering. Also, we created a method to exclude images without DAB-stained areas. The most effective combination of methods includes: (i) Reinhard's normalization; (ii) Ruifrok and Johnston color deconvolution method; (iii) proposed image rotation method based on boundary distribution of image intensity; (iv) k-means clustering using DAB stain intensity. These results should enhance the performance of quantitative analysis of protein markers in reconstructed human epidermis samples and enable comparison of their spatial distribution between different experimental conditions.


title: Dark state transport between unitary Fermi superfluids

abstract: The formation of dark states is an important concept in quantum sciences, but its compatibility with strong interparticle interactions, for example, in a quantum degenerate gas is hardly explored. Here, we realize a dark state in one of the spins of a two-component, resonantly-interacting Fermi gas using a $\Lambda$ system within the $D_2$ transitions of $^6$Li at high magnetic field. The dark state is created in a micrometer-sized region within a one-dimensional channel connecting two superfluid reservoirs. The particle transport between the reservoirs is used as a probe. We observe that atoms are transported in the dark state and the superfluid-assisted fast current is preserved. If the dark state resonant condition is not met, the transport is suppressed by the spontaneous emission. We also uncover an asymmetry in the transport timescale across the two-photon resonance, which is absent in the non-interacting regime. This work raises questions on the interplay of dark states with interparticle interactions and opens up perspectives for optical manipulation of fermionic pairing.


title: Enhancing 3D Lane Detection and Topology Reasoning with 2D Lane Priors

abstract: 3D lane detection and topology reasoning are essential tasks in autonomous driving scenarios, requiring not only detecting the accurate 3D coordinates on lane lines, but also reasoning the relationship between lanes and traffic elements. Current vision-based methods, whether explicitly constructing BEV features or not, all establish the lane anchors/queries in 3D space while ignoring the 2D lane priors. In this study, we propose Topo2D, a novel framework based on Transformer, leveraging 2D lane instances to initialize 3D queries and 3D positional embeddings. Furthermore, we explicitly incorporate 2D lane features into the recognition of topology relationships among lane centerlines and between lane centerlines and traffic elements. Topo2D achieves 44.5% OLS on multi-view topology reasoning benchmark OpenLane-V2 and 62.6% F-Socre on single-view 3D lane detection benchmark OpenLane, exceeding the performance of existing state-of-the-art methods.


title: Reproducing Kernel Thesis of Hankel Operators on Weighted Hardy Spaces

abstract: We study the boundedness of Hankel operators between two weighted spaces, with Muckenhoupt weights. In particular, we consider whether the Reproducing Kernel Thesis for Hankel operators generalizes to the case of two different weights. There, Hankel operators are bounded on the Hardy space if and only if they are bounded when tested on reproducing kernel functions. The supremum of testing the Hankel operator on this special class of functions is called the Garsia norm of the symbol of the Hankel operator, known to be equivalent to the BMO norm of the operator. We formulate a two-weight version of the Garsia norm and prove that testing the Hankel operator on the same reproducing kernel functions and measuring the norm in the two-weight setting is sufficient to prove that the operator is bounded. In the process,we prove that the Garsia norm is equivalent to the weighted Garsia norm, when two weights are the same, and we prove the two-weight version of the Carleson embedding theorem.


title: Heavy Particle Clustering in Inertial Subrange of High--Reynolds Number Turbulence

abstract: Direct numerical simulation of homogeneous isotropic turbulence shows pronounced clustering of inertial particles in the inertial subrange at high Reynolds number, in addition to the clustering typically observed in the near dissipation range. The clustering in the inertial subrange is characterized by the bump in the particle number density spectra and is due to modulation of preferential concentration. The number density spectrum can be modeled by a rational function of the scale-dependent Stokes number.


title: Lepton flavor violating decays $Z\rightarrow l^{\pm}_{i}l^{\mp}_{j}$ in the B-L Supersymmetric Standard Model

abstract: Lepton flavor violation (LFV) represents a clear new physics (NP) signal beyond the standard model (SM). In this paper, we study LFV decays $Z\rightarrow l^{\pm}_{i}l^{\mp}_{j}$ in the B-L Supersymmetric Standard Model(B-LSSM). We calculate these processes separately in the mass eigenstate basis and the electroweak interaction basis, and the latter adopt the mass insertion approximation (MIA) method. The MIA clearly shows the effect of parameters on the LFV decays $Z\rightarrow l^{\pm}_{i}l^{\mp}_{j}$ in the analytic level, which provides a new way for us to analyze the LFV processes. At the same time, the corresponding constraints from the LFV decays $l^{-}_{j} \rightarrow l^{-}_{i} \gamma$ and $(g-2)_{\mu}$ are considered to analyze the numerical results.


title: CAPRI-FAIR: Integration of Multi-sided Fairness in Contextual POI Recommendation Framework

abstract: Point-of-interest (POI) recommendation, a form of context-aware recommendation, takes into account spatio-temporal constraints and contexts like distance, peak business hours, and previous user check-ins. Given the ability of these kinds of systems to influence not just the consumer's travel experience, but also the POI's business, it is important to consider fairness from multiple perspectives. Unfortunately, these systems tend to provide less accurate recommendations to inactive users, and less exposure to unpopular POIs. The goal of this paper is to develop a post-filter methodology that incorporates provider and consumer fairness factors into pre-existing recommendation models, to satisfy fairness metrics like item exposure, and performance metrics like precision and distance, making the system more sustainable to both consumers and providers. Experiments have shown that using a linear scoring model for provider fairness in re-scoring recommended items yields the best tradeoff between performance and long-tail exposure, in some cases without a significant decrease in precision. When attempting to address consumer fairness by recommending more popular POIs to inactive users, the result was an increase in precision for only some recommendation models and datasets. Finally, when considering the tradeoff between both parameters, the combinations that reached the Pareto front of consumer and provider fairness, unfortunately, achieved the lowest precision values. We find that the nature of this tradeoff depends heavily on the model and the dataset.


title: Optimal Control of Semilinear Elliptic Partial Differential Equations with Non-Lipschitzian Nonlinearities

abstract: We study optimal control problems that are governed by semilinear elliptic partial differential equations that involve non-Lipschitzian nonlinearities. It is shown that, for a certain class of such PDEs, the solution map is Fr\'{e}chet differentiable even though the differential operator contains a nondifferentiable term. We exploit this effect to establish first-order necessary optimality conditions for minimizers of the considered control problems. The resulting KKT-conditions take the form of coupled PDE-systems that are posed in non-Muckenhoupt weighted Sobolev spaces and raise interesting questions regarding the regularity of optimal controls, the derivation of second-order optimality conditions, and the analysis of finite element discretizations.


title: Singing Voice Graph Modeling for SingFake Detection

abstract: Detecting singing voice deepfakes, or SingFake, involves determining the authenticity and copyright of a singing voice. Existing models for speech deepfake detection have struggled to adapt to unseen attacks in this unique singing voice domain of human vocalization. To bridge the gap, we present a groundbreaking SingGraph model. The model synergizes the capabilities of the MERT acoustic music understanding model for pitch and rhythm analysis with the wav2vec2.0 model for linguistic analysis of lyrics. Additionally, we advocate for using RawBoost and beat matching techniques grounded in music domain knowledge for singing voice augmentation, thereby enhancing SingFake detection performance. Our proposed method achieves new state-of-the-art (SOTA) results within the SingFake dataset, surpassing the previous SOTA model across three distinct scenarios: it improves EER relatively for seen singers by 13.2%, for unseen singers by 24.3%, and unseen singers using different codecs by 37.1%.


title: Magnetization without spin: effective Lagrangian of itinerant electrons

abstract: Effective Lagrangian of itinerant electron system of finite density at finite magnetic field is found to include Chern-Simons term of electromagnetic potentials of lower scale dimension than those studied before. This term has an origin in many-body wave function and unique topological property that is independent of a spin degree of freedom. The coupling strength is proportional to $\frac{\rho}{eB}$, which is singular at $B=0$ for a constant charge density. The effective Lagrangian at a finite $B$ represents physical effects at $ B \neq 0$ properly. A universal shift of the magnetic field known as Slater-Pauling curve is derived from the effective Lagrangian.


title: Non-diffeomorphic minimal genus relative trisections of the same 4-manifold

abstract: We show the existence of a $4$-manifold with boundary that admits two non-diffeomorphic minimal genus relative trisections of the same $(g,k;p,b)$-type. To prove this, we introduce a simple operation that produces a trisection diagram of a closed $4$-manifold from a relative trisection diagram.


title: Primordial black holes: the asteroid mass window

abstract: Primordial black holes (PBHs) are an attractive dark matter candidate, particularly if they can explain the totality of it. At PBH masses below $\sim 10^{17}$g and above $\sim 10^{23}$g this possibility is excluded from the variety of arguments and with different confidence. The range in between, often referred to as the "asteroid mass window", currently remains unconstrained. The most promising, in our view, way to probe this mass range is to use stars as the PBH detectors. If a star captures even a single PBH it starts being accreted onto it and eventually gets destroyed -- converted into a sub-solar mass black hole. This process may have a variety of signatures form a mere star disappearance to supernova-type explosions of a new kind. The viability of this approach depends crucially on the probability of PBH capture by stars. In this chapter we summarize the existing capture mechanisms and discuss their implications for constraining the abundance of (or perhaps discovering) PBHs in the asteroid mass window.


title: GET: A Generative EEG Transformer for Continuous Context-Based Neural Signals

abstract: Generating continuous electroencephalography (EEG) signals through advanced artificial neural networks presents a novel opportunity to enhance brain-computer interface (BCI) technology. This capability has the potential to significantly enhance applications ranging from simulating dynamic brain activity and data augmentation to improving real-time epilepsy detection and BCI inference. By harnessing generative transformer neural networks, specifically designed for EEG signal generation, we can revolutionize the interpretation and interaction with neural data. Generative AI has demonstrated significant success across various domains, from natural language processing (NLP) and computer vision to content creation in visual arts and music. It distinguishes itself by using large-scale datasets to construct context windows during pre-training, a technique that has proven particularly effective in NLP, where models are fine-tuned for specific downstream tasks after extensive foundational training. However, the application of generative AI in the field of BCIs, particularly through the development of continuous, context-rich neural signal generators, has been limited. To address this, we introduce the Generative EEG Transformer (GET), a model leveraging transformer architecture tailored for EEG data. The GET model is pre-trained on diverse EEG datasets, including motor imagery and alpha wave datasets, enabling it to produce high-fidelity neural signals that maintain contextual integrity. Our empirical findings indicate that GET not only faithfully reproduces the frequency spectrum of the training data and input prompts but also robustly generates continuous neural signals. By adopting the successful training strategies of the NLP domain for BCIs, the GET sets a new standard for the development and application of neural signal generation technologies.


title: The new Herschel/PACS Point Source Catalogue

abstract: Herschel operated as an observatory, therefore it did not cover the whole sky, but still observed ~8% of it. The first version of an overall Herschel/PACS Point Source Catalogue was released in 2017. The data are still unique and are very important for research, especially because no new far-infrared mission is foreseen for at least the next decade. In the framework of the NEMESIS project, we revisited all the photometric observations obtained by the PACS instrument on-board of the Herschel space observatory. We aimed to build the most complete and most accurate Herschel/PACS catalogue to date. Our primary goal was to increase the number of real sources, and decrease the number of spurious sources identified on a strongly variable background. Our goal was to build a blind catalogue, meaning that source extraction is conducted without relying on prior detections at various wavelengths, allowing us to detect sources never catalogued before. We define a hybrid strategy that includes classical and ML source identification and characterisation methods, providing catalogues at much higher completeness levels than before. Quality assessment also involves ML techniques. Our source extraction methodology facilitates a systematic and impartial comparison of sensitivity levels across various Herschel fields, a task that was typically beyond the scope of individual programs. We created a high-reliability and a rejected source catalogue for each PACS passband, i.e., at 70, 100, and 160 {\mu}m. With the high-reliability catalogue, we managed to significantly increase the completeness in all bands. At the same time, while the number of high-reliability detections decreased, the number of sources matching with existing catalogues increased, suggesting that the purity is also higher than before. The photometric accuracy of our pipeline is ~1% based on comparison with the standard star models.


title: VQUNet: Vector Quantization U-Net for Defending Adversarial Atacks by Regularizing Unwanted Noise

abstract: Deep Neural Networks (DNN) have become a promising paradigm when developing Artificial Intelligence (AI) and Machine Learning (ML) applications. However, DNN applications are vulnerable to fake data that are crafted with adversarial attack algorithms. Under adversarial attacks, the prediction accuracy of DNN applications suffers, making them unreliable. In order to defend against adversarial attacks, we introduce a novel noise-reduction procedure, Vector Quantization U-Net (VQUNet), to reduce adversarial noise and reconstruct data with high fidelity. VQUNet features a discrete latent representation learning through a multi-scale hierarchical structure for both noise reduction and data reconstruction. The empirical experiments show that the proposed VQUNet provides better robustness to the target DNN models, and it outperforms other state-of-the-art noise-reduction-based defense methods under various adversarial attacks for both Fashion-MNIST and CIFAR10 datasets. When there is no adversarial attack, the defense method has less than 1% accuracy degradation for both datasets.


title: Impact of the Epoch of Reionization sources on the 21-cm bispectrum

abstract: The morphology of the 21-cm signal emitted by the neutral hydrogen present in the intergalactic medium (IGM) during the Epoch of Reionization (EoR) depends both on the properties of the sources of ionizing radiation and on the underlying physical processes within the IGM. Variation in the morphology of the IGM 21-cm signal due to the different sources of the EoR is expected to have a significant impact on the 21-cm bispectrum, which is one of the crucial observable statistics that can evaluate the non-Gaussianity present in the signal and which can be estimated from radio interferometric observations of the EoR. Here we present the 21-cm bispectrum for different reionization scenarios assuming different simulated models for the sources of reionization. We also demonstrate how well the 21-cm bispectrum can distinguish between different IGM 21-cm signal morphologies, arising due to the differences in the reionization scenarios, which will help us shed light on the nature of the sources of ionizing photons. Our estimated large-scale bispectrum for all unique $k$-triangle shapes shows a significant difference in their magnitude and sign across different reionization scenarios. Additionally, our focused analysis of bispectrum for a few specific $k$-triangle shapes (e.g. squeezed-limit, linear, and shapes in the vicinity of the squeezed-limit) shows that the large scale 21-cm bispectrum can distinguish between reionization scenarios that show inside-out, outside-in and a combination of inside-out and outside-in morphologies. These results highlight the potential of using the 21-cm bispectrum for constraining different reionization scenarios.


title: Automated Verification of Silq Quantum Programs using SMT Solvers

abstract: We present SilVer (Silq Verification), an automated tool for verifying behaviors of quantum programs written in Silq, which is a high-level programming language for quantum computing. The goal of the verification is to ensure correctness of the Silq quantum program against user-defined specifications using SMT solvers. We introduce a programming model that is based on a quantum RAM-style computer as an interface between Silq programs and SMT proof obligations, allowing for control of quantum operations using both classical and quantum conditions. Additionally, users can employ measurement flags within the specification to easily specify conditions that measurement results require to satisfy for being a valid behavior. We provide case studies on the verification of generating entangled states and multiple oracle-based algorithms.


title: RevRIR: Joint Reverberant Speech and Room Impulse Response Embedding using Contrastive Learning with Application to Room Shape Classification

abstract: This paper focuses on room fingerprinting, a task involving the analysis of an audio recording to determine the specific volume and shape of the room in which it was captured. While it is relatively straightforward to determine the basic room parameters from the Room Impulse Responses (RIR), doing so from a speech signal is a cumbersome task. To address this challenge, we introduce a dual-encoder architecture that facilitates the estimation of room parameters directly from speech utterances. During pre-training, one encoder receives the RIR while the other processes the reverberant speech signal. A contrastive loss function is employed to embed the speech and the acoustic response jointly. In the fine-tuning stage, the specific classification task is trained. In the test phase, only the reverberant utterance is available, and its embedding is used for the task of room shape classification. The proposed scheme is extensively evaluated using simulated acoustic environments.


title: MESS: Modern Electronic Structure Simulations

abstract: Electronic structure simulation (ESS) has been used for decades to provide quantitative scientific insights on an atomistic scale, enabling advances in chemistry, biology, and materials science, among other disciplines. Following standard practice in scientific computing, the software packages driving these studies have been implemented in compiled languages such as FORTRAN and C. However, the recent introduction of machine learning (ML) into these domains has meant that ML models must be coded in these languages, or that complex software bridges have to be built between ML models in Python and these large compiled software systems. This is in contrast with recent progress in modern ML frameworks which aim to optimise both ease of use and high performance by harnessing hardware acceleration of tensor programs defined in Python. We introduce MESS: a modern electronic structure simulation package implemented in JAX; porting the ESS code to the ML world. We outline the costs and benefits of following the software development practices used in ML for this important scientific workload. MESS shows significant speedups n widely available hardware accelerators and simultaneously opens a clear pathway towards combining ESS with ML. MESS is available at https://github.com/graphcore-research/mess.


title: Propagation of singularities for anharmonic Schr\"odinger equations

abstract: We consider evolution equations for two classes of generalized anharmonic oscillators and the associated initial value problem in the space of tempered distributions. We prove that the Cauchy problem is well posed in anisotropic Shubin--Sobolev modulation spaces of Hilbert type, and we investigate propagation of suitable notions of singularities.


title: Fully printed flexible perovskite solar modules with improved energy alignment by tin oxide surface modification

abstract: Fully printed flexible perovskite solar cells (f-PSCs) show great potential for the commercialization of perovskite photovoltaics owing to their compatibility with high-throughput roll-to-roll (R2R) production. However, the challenge remains in the deficiency in controlling interfacial recombination losses of the functional layer, causing remarkable loss of power conversion efficiency (PCE) in industrial production. Here, a fullerene-substituted alkylphosphonic acid dipole layer is introduced between the R2R-printed tin oxide electron transport layer and the perovskite active layer to reduce the energetic barrier and to suppress surface recombination at the buried interface. The resulting f-PSCs exhibit a PCE of 17.0% with negligible hysteresis, retain 95% of their initial PCE over 3000 bending cycles and achieve a T95 lifetime of 1200 h under 1 sun and 65 degreeC in nitrogen atmosphere. Moreover, the fully printed flexible perovskite solar mini-modules (f-PSMs) with a 20.25 cm2 aperture area achieve a PCE of 11.6%. The encapsulated f-PSMs retain 90% of their initial PCE after 500 h damp-heat testing at 65 degreeC and 85% relative humidity (ISOS-D3). This work marks an important progress toward the realization of efficient and stable flexible perovskite photovoltaics for commercialization.


title: Taylor-Fourier integration

abstract: In this paper we introduce an algorithm which provides approximate solutions to semi-linear ordinary differential equations with highly oscillatory solutions that after an appropriate change of variables can be written as a non-autonomous system with $(2\pi/\omega)$-periodic dependence on $t$. The proposed approximate solutions are written in closed form as functions $X(t,\omega\, t)$ where $X(t,\theta)$ is, (i) a truncated Fourier series in $\theta$ for fixed $t$, and (ii) a truncated Taylor series in $t$ for fixed $\theta$ (that is the reason for the name of the proposed integrators). Such approximations are intended to be uniformly accurate in $\omega$ (in the sense that their accuracy is not deteriorated as $\omega\to \infty$). This feature implies that Taylor-Fourier approximations become more efficient than the application of standard numerical integrators for sufficiently high basic frequency $\omega$. The main goal of the paper is to propose a procedure to efficiently compute such approximations by combining power series arithmetic techniques and the FFT algorithm. We present numerical experiments that demonstrate the effectiveness of our approximation method through its application to well-known problems of interest.


title: Space Decomposition for Sentence Embedding

abstract: Determining sentence pair similarity is crucial for various NLP tasks. A common technique to address this is typically evaluated on a continuous semantic textual similarity scale from 0 to 5. However, based on a linguistic observation in STS annotation guidelines, we found that the score in the range [4,5] indicates an upper-range sample, while the rest are lower-range samples. This necessitates a new approach to treating the upper-range and lower-range classes separately. In this paper, we introduce a novel embedding space decomposition method called MixSP utilizing a Mixture of Specialized Projectors, designed to distinguish and rank upper-range and lower-range samples accurately. The experimental results demonstrate that MixSP decreased the overlap representation between upper-range and lower-range classes significantly while outperforming competitors on STS and zero-shot benchmarks.


title: Simulation of Proton and Carbon-12 Ion Beam for Tumor/Cancer Treatment

abstract: Treating cancer is one of the most challenging task in medical sciences. Only limited types of cancer treatments are available as their study is still ongoing. The earlier therapies like radiotherapy with x-rays, chemotherapy are associated with lot of side-effects. One of the most desirable cancer treatment is using particle beam therapies. These therapies are quite less risky than other types of cancer and tumor treatments. In this paper we present the proton and carbon-12 ion beam simulation that can help in tumor and cancer treatment. We simulated the proton and carbon-12 ion beam in water and soft tissue using geant4 toolkit. The protons are observed to have much better energy deposition in the water and soft tissue than carbon-12 ion and gamma photon beams.


title: Towards Real-world Scenario: Imbalanced New Intent Discovery

abstract: New Intent Discovery (NID) aims at detecting known and previously undefined categories of user intent by utilizing limited labeled and massive unlabeled data. Most prior works often operate under the unrealistic assumption that the distribution of both familiar and new intent classes is uniform, overlooking the skewed and long-tailed distributions frequently encountered in real-world scenarios. To bridge the gap, our work introduces the imbalanced new intent discovery (i-NID) task, which seeks to identify familiar and novel intent categories within long-tailed distributions. A new benchmark (ImbaNID-Bench) comprised of three datasets is created to simulate the real-world long-tail distributions. ImbaNID-Bench ranges from broad cross-domain to specific single-domain intent categories, providing a thorough representation of practical use cases. Besides, a robust baseline model ImbaNID is proposed to achieve cluster-friendly intent representations. It includes three stages: model pre-training, generation of reliable pseudo-labels, and robust representation learning that strengthens the model performance to handle the intricacies of real-world data distributions. Our extensive experiments on previous benchmarks and the newly established benchmark demonstrate the superior performance of ImbaNID in addressing the i-NID task, highlighting its potential as a powerful baseline for uncovering and categorizing user intents in imbalanced and long-tailed distributions\footnote{\url{https://github.com/Zkdc/i-NID}}.


title: The Weyl Transform of a smooth measure on a real-analytic submanifold

abstract: If $\mu$ is a smooth measure supported on a real-analytic submanifold of $\mathbb{R}^{2n}$ which is not contained in any affine hyperplane, then the Weyl transform of $\mu$ is a compact operator.


title: Enhanced Automotive Object Detection via RGB-D Fusion in a DiffusionDet Framework

abstract: Vision-based autonomous driving requires reliable and efficient object detection. This work proposes a DiffusionDet-based framework that exploits data fusion from the monocular camera and depth sensor to provide the RGB and depth (RGB-D) data. Within this framework, ground truth bounding boxes are randomly reshaped as part of the training phase, allowing the model to learn the reverse diffusion process of noise addition. The system methodically enhances a randomly generated set of boxes at the inference stage, guiding them toward accurate final detections. By integrating the textural and color features from RGB images with the spatial depth information from the LiDAR sensors, the proposed framework employs a feature fusion that substantially enhances object detection of automotive targets. The $2.3$ AP gain in detecting automotive targets is achieved through comprehensive experiments using the KITTI dataset. Specifically, the improved performance of the proposed approach in detecting small objects is demonstrated.


title: Ordinal Mixed-Effects Random Forest

abstract: We propose an innovative statistical method, called Ordinal Mixed-Effect Random Forest (OMERF), that extends the use of random forest to the analysis of hierarchical data and ordinal responses. The model preserves the flexibility and ability of modeling complex patterns of both categorical and continuous variables, typical of tree-based ensemble methods, and, at the same time, takes into account the structure of hierarchical data, modeling the dependence structure induced by the grouping and allowing statistical inference at all data levels. A simulation study is conducted to validate the performance of the proposed method and to compare it to the one of other state-of-the art models. The application of OMERF is exemplified in a case study focusing on predicting students performances using data from the Programme for International Student Assessment (PISA) 2022. The model identifies discriminating student characteristics and estimates the school-effect.


title: Comprehensive Measurement of Three-Dimensional Thermal Conductivity Tensor Using a Beam-Offset Square-Pulsed Source (BO-SPS) Approach

abstract: Accurately measuring the three-dimensional thermal conductivity tensor is essential for understanding and engineering the thermal behavior of anisotropic materials. Existing methods often struggle to isolate individual tensor elements, leading to large measurement uncertainties and time-consuming iterative fitting procedures. In this study, we introduce the Beam-Offset Square-Pulsed Source (BO-SPS) method for comprehensive measurements of three-dimensional anisotropic thermal conductivity tensors. This method uses square-pulsed heating and precise temperature rise measurements to achieve high signal-to-noise ratios, even with large beam offsets and low modulation frequencies, enabling the isolation of thermal conductivity tensor elements. We demonstrate and validate the BO-SPS method by measuring X-cut and AT-cut quartz samples. For X-cut quartz, with a known relationship between in-plane and cross-plane thermal conductivities, we can determine the full thermal conductivity tensor and heat capacity simultaneously. For AT-cut quartz, assuming a known heat capacity, we can determine the entire anisotropic thermal conductivity tensor, even with finite off-diagonal terms. Our results yield consistent principal thermal conductivity values for both quartz types, demonstrating the method's reliability and accuracy. This research highlights the BO-SPS method's potential to advance the understanding of thermal behavior in complex materials.


title: Skew scattering and ratchet effect in photonic graphene

abstract: In this paper we bring up our investigation on the properties of asymmetric scattering in graphene made with the microcavity exciton-polaritons. It is shown by numerical simulations of Gross-Pitaevskii equation that ratchet phenomena occurs in the polariton graphene due to its structural inhomogeneity. Thus, we suggest a way to induce preferential motion of polaritons by the confinement potential engineering.


title: The Harder You Try, The Harder You Fail: The KeyTrap Denial-of-Service Algorithmic Complexity Attacks on DNSSEC

abstract: Availability is a major concern in the design of DNSSEC. To ensure availability, DNSSEC follows Postel's Law [RFC1123]: "Be liberal in what you accept, and conservative in what you send." Hence, nameservers should send not just one matching key for a record set, but all the relevant cryptographic material, e.g., all the keys for all the ciphers that they support and all the corresponding signatures. This ensures that validation succeeds, and hence availability, even if some of the DNSSEC keys are misconfigured, incorrect or correspond to unsupported ciphers. We show that this design of DNSSEC is flawed. Exploiting vulnerable recommendations in the DNSSEC standards, we develop a new class of DNSSEC-based algorithmic complexity attacks on DNS, we dub KeyTrap attacks. All popular DNS implementations and services are vulnerable. With just a single DNS packet, the KeyTrap attacks lead to a 2.000.000x spike in CPU instruction count in vulnerable DNS resolvers, stalling some for as long as 16 hours. This devastating effect prompted major DNS vendors to refer to KeyTrap as the worst attack on DNS ever discovered. Exploiting KeyTrap, an attacker could effectively disable Internet access in any system utilizing a DNSSEC-validating resolver. We disclosed KeyTrap to vendors and operators on November 2, 2023, confidentially reporting the vulnerabilities to a closed group of DNS experts, operators and developers from the industry. Since then we have been working with all major vendors to mitigate KeyTrap, repeatedly discovering and assisting in closing weaknesses in proposed patches. Following our disclosure, the industry-wide umbrella CVE-2023-50387 has been assigned, covering the DNSSEC protocol vulnerabilities we present in this work.


title: Sensitivity-Based Distributed Model Predictive Control for Nonlinear Systems under Inexact Optimization

abstract: This paper presents a distributed model predictive control (DMPC) scheme for nonlinear continuous-time systems. The underlying distributed optimal control problem is cooperatively solved in parallel via a sensitivity-based algorithm. The algorithm is fully distributed in the sense that only one neighbor-to-neighbor communication step per iteration is necessary and that all computations are performed locally. Sufficient conditions are derived for the algorithm to converge towards the central solution. Based on this result, stability is shown for the suboptimal DMPC scheme under inexact minimization with the sensitivity-based algorithm and verified with numerical simulations. In particular, stability can be guaranteed with either a suitable stopping criterion or a fixed number of algorithm iterations in each MPC sampling step which allows for a real-time capable implementation.


title: Very-long-baseline interferometry study of the flaring blazar TXS 1508+572 in the early Universe

abstract: High-redshift blazars provide valuable input to studies of the evolution of active galactic nuclei (AGN) jets and provide constraints on cosmological models. Detections at high energies ($0.1<\mathrm{E}<100$ GeV) of these distant sources are rare, but when they exhibit bright gamma-ray flares, we are able to study them. However, contemporaneous multi-wavelength observations of high-redshift objects ($z>4$) during their different periods of activity have not been carried out so far. An excellent opportunity for such a study arose when the blazar TXS 1508+572 ($z=4.31$) exhibited a $\gamma$-ray flare in 2022 February in the $0.1-300$ GeV range with a flux 25 times brighter than the one reported in the in the fourth catalog of the \textit{Fermi} Large Area Telescope. Our goal is to monitor the morphological changes, spectral index and opacity variations that could be associated with the preceding $\gamma$-ray flare in TXS 1508+572 to find the origin of the high-energy emission in this source. We also plan to compare the source characteristics in the radio band to the blazars in the local Universe ($z<0.1$). In addition, we aim to collect quasi-simultaneous data to our multi-wavelength observations of the object, making TXS 1508+572 the first blazar in the early Universe ($z>4$) with contemporaneous multi-frequency data available in its high state. In order to study the parsec-scale structure of the source, we performed three epochs of very-long-baseline interferometry (VLBI) follow-up observations with the Very Long Baseline Array (VLBA) supplemented with the Effelsberg 100-m Telescope at 15, 22, and 43 GHz, which corresponds to 80, 117, and 228 GHz in the rest frame of TXS 1508+572. In addition, one 86 GHz (456 GHz) measurement was performed by the VLBA and the Green Bank Telescope during the first epoch.


title: Computational Limits of Low-Rank Adaptation (LoRA) for Transformer-Based Models

abstract: We study the computational limits of Low-Rank Adaptation (LoRA) update for finetuning transformer-based models using fine-grained complexity theory. Our key observation is that the existence of low-rank decompositions within the gradient computation of LoRA adaptation leads to possible algorithmic speedup. This allows us to (i) identify a phase transition behavior and (ii) prove the existence of nearly linear algorithms by controlling the LoRA update computation term by term, assuming the Strong Exponential Time Hypothesis (SETH). For the former, we identify a sharp transition in the efficiency of all possible rank-$r$ LoRA update algorithms for transformers, based on specific norms resulting from the multiplications of the input sequence $\mathbf{X}$, pretrained weights $\mathbf{W^\star}$, and adapter matrices $\alpha \mathbf{B} \mathbf{A} / r$. Specifically, we derive a shared upper bound threshold for such norms and show that efficient (sub-quadratic) approximation algorithms of LoRA exist only below this threshold. For the latter, we prove the existence of nearly linear approximation algorithms for LoRA adaptation by utilizing the hierarchical low-rank structures of LoRA gradients and approximating the gradients with a series of chained low-rank approximations. To showcase our theory, we consider two practical scenarios: partial (e.g., only $\mathbf{W}_V$ and $\mathbf{W}_Q$) and full adaptations (e.g., $\mathbf{W}_Q$, $\mathbf{W}_V$, and $\mathbf{W}_K$) of weights in attention heads.


title: Strange Dwarfs: a review on the (in)stability

abstract: White dwarfs are the remnants of stars not massive enough to become supernovae. This review explores the concept of strange dwarfs, a unique class of white dwarfs which contain cores of strange quark matter. Strange dwarfs have different sizes, masses, and evolutionary paths with respect to white dwarfs. They might form through the accumulation of normal matter on strange quark stars or by capture of strangelets. The stability of strange dwarfs has been debated, with initial studies suggesting stability, while later analyses indicated potential instability. This review revisits these discussions, focusing on the critical role of boundary conditions between nuclear and quark matter in determining stability. It also offers insights into their formation, structure, and possible detection in the universe.


title: A Frame-based Attention Interpretation Method for Relevant Acoustic Feature Extraction in Long Speech Depression Detection

abstract: Speech-based depression detection tools could help early screening of depression. Here, we address two issues that may hinder the clinical practicality of such tools: segment-level labelling noise and a lack of model interpretability. We propose a speech-level Audio Spectrogram Transformer to avoid segment-level labelling. We observe that the proposed model significantly outperforms a segment-level model, providing evidence for the presence of segment-level labelling noise in audio modality and the advantage of longer-duration speech analysis for depression detection. We introduce a frame-based attention interpretation method to extract acoustic features from prediction-relevant waveform signals for interpretation by clinicians. Through interpretation, we observe that the proposed model identifies reduced loudness and F0 as relevant signals of depression, which aligns with the speech characteristics of depressed patients documented in clinical studies.


title: Patterns of co-occurrent skills in UK job adverts

abstract: A job usually involves the application of several complementary or synergistic skills to perform its required tasks. Such relationships are implicitly recognised by employers in the skills they demand when recruiting new employees. Here we construct a skills network based on their co-occurrence in a national level data set of 65 million job postings from the UK spanning 2016 to 2022. We then apply multiscale graph-based community detection to obtain data-driven skill clusters at different levels of resolution that reveal a modular structure across scales. Skill clusters display diverse levels of demand and occupy varying roles within the skills network: some have broad reach across the network (high closeness centrality) while others have higher levels of within-cluster containment, yet with high interconnection across clusters and no skill silos. The skill clusters also display varying levels of semantic similarity, highlighting the difference between co-occurrence in adverts and intrinsic thematic consistency. Clear geographic variation is evident in the demand for each skill cluster across the UK, broadly reflecting the industrial characteristics of each region, e.g., London appears as an outlier as an international hub for finance, education and business. Comparison of data from 2016 and 2022 reveals employers are demanding a broader range of skills over time, with more adverts featuring skills spanning different clusters. We also show that our data-driven clusters differ from expert-authored categorisations of skills, indicating that important relationships between skills are not captured by expert assessment alone.


title: Continual Traffic Forecasting via Mixture of Experts

abstract: The real-world traffic networks undergo expansion through the installation of new sensors, implying that the traffic patterns continually evolve over time. Incrementally training a model on the newly added sensors would make the model forget the past knowledge, i.e., catastrophic forgetting, while retraining the model on the entire network to capture these changes is highly inefficient. To address these challenges, we propose a novel Traffic Forecasting Mixture of Experts (TFMoE) for traffic forecasting under evolving networks. The main idea is to segment the traffic flow into multiple homogeneous groups, and assign an expert model responsible for a specific group. This allows each expert model to concentrate on learning and adapting to a specific set of patterns, while minimizing interference between the experts during training, thereby preventing the dilution or replacement of prior knowledge, which is a major cause of catastrophic forgetting. Through extensive experiments on a real-world long-term streaming network dataset, PEMSD3-Stream, we demonstrate the effectiveness and efficiency of TFMoE. Our results showcase superior performance and resilience in the face of catastrophic forgetting, underscoring the effectiveness of our approach in dealing with continual learning for traffic flow forecasting in long-term streaming networks.


title: Floating Anchor Diffusion Model for Multi-motif Scaffolding

abstract: Motif scaffolding seeks to design scaffold structures for constructing proteins with functions derived from the desired motif, which is crucial for the design of vaccines and enzymes. Previous works approach the problem by inpainting or conditional generation. Both of them can only scaffold motifs with fixed positions, and the conditional generation cannot guarantee the presence of motifs. However, prior knowledge of the relative motif positions in a protein is not readily available, and constructing a protein with multiple functions in one protein is more general and significant because of the synergies between functions. We propose a Floating Anchor Diffusion (FADiff) model. FADiff allows motifs to float rigidly and independently in the process of diffusion, which guarantees the presence of motifs and automates the motif position design. Our experiments demonstrate the efficacy of FADiff with high success rates and designable novel scaffolds. To the best of our knowledge, FADiff is the first work to tackle the challenge of scaffolding multiple motifs without relying on the expertise of relative motif positions in the protein. Code is available at https://github.com/aim-uofa/FADiff.


title: On the Power of Randomization in Fair Classification and Representation

abstract: Fair classification and fair representation learning are two important problems in supervised and unsupervised fair machine learning, respectively. Fair classification asks for a classifier that maximizes accuracy on a given data distribution subject to fairness constraints. Fair representation maps a given data distribution over the original feature space to a distribution over a new representation space such that all classifiers over the representation satisfy fairness. In this paper, we examine the power of randomization in both these problems to minimize the loss of accuracy that results when we impose fairness constraints. Previous work on fair classification has characterized the optimal fair classifiers on a given data distribution that maximize accuracy subject to fairness constraints, e.g., Demographic Parity (DP), Equal Opportunity (EO), and Predictive Equality (PE). We refine these characterizations to demonstrate when the optimal randomized fair classifiers can surpass their deterministic counterparts in accuracy. We also show how the optimal randomized fair classifier that we characterize can be obtained as a solution to a convex optimization problem. Recent work has provided techniques to construct fair representations for a given data distribution such that any classifier over this representation satisfies DP. However, the classifiers on these fair representations either come with no or weak accuracy guarantees when compared to the optimal fair classifier on the original data distribution. Extending our ideas for randomized fair classification, we improve on these works, and construct DP-fair, EO-fair, and PE-fair representations that have provably optimal accuracy and suffer no accuracy loss compared to the optimal DP-fair, EO-fair, and PE-fair classifiers respectively on the original data distribution.


title: ZeroPur: Succinct Training-Free Adversarial Purification

abstract: Adversarial purification is a kind of defense technique that can defend various unseen adversarial attacks without modifying the victim classifier. Existing methods often depend on external generative models or cooperation between auxiliary functions and victim classifiers. However, retraining generative models, auxiliary functions, or victim classifiers relies on the domain of the fine-tuned dataset and is computation-consuming. In this work, we suppose that adversarial images are outliers of the natural image manifold and the purification process can be considered as returning them to this manifold. Following this assumption, we present a simple adversarial purification method without further training to purify adversarial images, called ZeroPur. ZeroPur contains two steps: given an adversarial example, Guided Shift obtains the shifted embedding of the adversarial example by the guidance of its blurred counterparts; after that, Adaptive Projection constructs a directional vector by this shifted embedding to provide momentum, projecting adversarial images onto the manifold adaptively. ZeroPur is independent of external models and requires no retraining of victim classifiers or auxiliary functions, relying solely on victim classifiers themselves to achieve purification. Extensive experiments on three datasets (CIFAR-10, CIFAR-100, and ImageNet-1K) using various classifier architectures (ResNet, WideResNet) demonstrate that our method achieves state-of-the-art robust performance. The code will be publicly available.


title: A Combination Model for Time Series Prediction using LSTM via Extracting Dynamic Features Based on Spatial Smoothing and Sequential General Variational Mode Decomposition

abstract: In order to solve the problems such as difficult to extract effective features and low accuracy of sales volume prediction caused by complex relationships such as market sales volume in time series prediction, we proposed a time series prediction method of market sales volume based on Sequential General VMD and spatial smoothing Long short-term memory neural network (SS-LSTM) combination model. Firstly, the spatial smoothing algorithm is used to decompose and calculate the sample data of related industry sectors affected by the linkage effect of market sectors, extracting modal features containing information via Sequential General VMD on overall market and specific price trends; Then, according to the background of different Market data sets, LSTM network is used to model and predict the price of fundamental data and modal characteristics. The experimental results of data prediction with seasonal and periodic trends show that this method can achieve higher price prediction accuracy and more accurate accuracy in specific market contexts compared to traditional prediction methods Describe the changes in market sales volume.


abstract: This paper introduces E(n) Equivariant Message Passing Cellular Networks (EMPCNs), an extension of E(n) Equivariant Graph Neural Networks to CW-complexes. Our approach addresses two aspects of geometric message passing networks: 1) enhancing their expressiveness by incorporating arbitrary cells, and 2) achieving this in a computationally efficient way with a decoupled EMPCNs technique. We demonstrate that EMPCNs achieve close to state-of-the-art performance on multiple tasks without the need for steerability, including many-body predictions and motion capture. Moreover, ablation studies confirm that decoupled EMPCNs exhibit stronger generalization capabilities than their non-topologically informed counterparts. These findings show that EMPCNs can be used as a scalable and expressive framework for higher-order message passing in geometric and topological graphs


title: Tiny models from tiny data: Textual and null-text inversion for few-shot distillation

abstract: Few-shot image classification involves classifying images using very few training examples. Recent vision foundation models show excellent few-shot transfer abilities, but are large and slow at inference. Using knowledge distillation, the capabilities of high-performing but slow models can be transferred to tiny, efficient models. However, common distillation methods require a large set of unlabeled data, which is not available in the few-shot setting. To overcome this lack of data, there has been a recent interest in using synthetic data. We expand on this work by presenting a novel diffusion model inversion technique (TINT) combining the diversity of textual inversion with the specificity of null-text inversion. Using this method in a few-shot distillation pipeline leads to state-of-the-art accuracy among small student models on popular benchmarks, while being significantly faster than prior work. This allows us to push even tiny models to high accuracy using only a tiny application-specific dataset, albeit relying on extra data for pre-training. Popular few-shot benchmarks involve evaluation over a large number of episodes, which is computationally cumbersome for methods involving synthetic data generation. Therefore, we also present a theoretical analysis on how the variance of the accuracy estimator depends on the number of episodes and query examples, and use these results to lower the computational effort required for method evaluation. In addition, to further motivate the use of generative models in few-shot distillation, we demonstrate that our method performs better compared to training on real data mined from the dataset used to train the diffusion model. Source code will be made available at https://github.com/pixwse/tiny2.


title: A dynamical implementation of canonical second quantization on a quantum computer

abstract: We develop theoretical methods for the implementation of creation and destruction operators in separate registers of a quantum computer, allowing for a transparent and dynamical creation and destruction of particle modes in second quantization in problems with variable particle number. We establish theorems for the commutation (anticommutation) relations on a finite memory bank and provide the needed symmetrizing and antisymmetrizing operators. Finally, we provide formulae in terms of these operators for unitary evolution under conventional two- and four-body Hamiltonian terms, as well as terms varying the particle number. In this formalism, the number of qubits needed to codify $n$ particles with $N_p$ modes each is of order $n\log_2 N_p$. Such scaling is more efficient than the Jordan-Wigner transformation which requires $O(N_p)$ qubits, whenever there are a modest number of particles with a large number of states available to each (and less advantageous for a large number of particles with few states available to each). And although less efficient, it is also less cumbersome than compact encoding.


title: Aligning Transformers with Weisfeiler-Leman

abstract: Graph neural network architectures aligned with the $k$-dimensional Weisfeiler--Leman ($k$-WL) hierarchy offer theoretically well-understood expressive power. However, these architectures often fail to deliver state-of-the-art predictive performance on real-world graphs, limiting their practical utility. While recent works aligning graph transformer architectures with the $k$-WL hierarchy have shown promising empirical results, employing transformers for higher orders of $k$ remains challenging due to a prohibitive runtime and memory complexity of self-attention as well as impractical architectural assumptions, such as an infeasible number of attention heads. Here, we advance the alignment of transformers with the $k$-WL hierarchy, showing stronger expressivity results for each $k$, making them more feasible in practice. In addition, we develop a theoretical framework that allows the study of established positional encodings such as Laplacian PEs and SPE. We evaluate our transformers on the large-scale PCQM4Mv2 dataset, showing competitive predictive performance with the state-of-the-art and demonstrating strong downstream performance when fine-tuning them on small-scale molecular datasets. Our code is available at https://github.com/luis-mueller/wl-transformers.


title: On crossed modules of pre-Lie algebras

abstract: Given a Lie algebra $\mathfrak g$ and a $\mathfrak{g}$-module $V$, it is due to Gerstenhaber that there is an isomorphism between $H^3(\mathfrak{g}, V )$ and the group of equivalence classes of crossed modules with kernel $V$ and cokernel $\mathfrak {g}$. The goal of this article is to obtain this result for pre-Lie algebras and their modules.


title: Sample-specific Masks for Visual Reprogramming-based Prompting

abstract: Visual reprogramming (VR) is a prompting technique that aims to re-purpose a pre-trained model (e.g., a classifier on ImageNet) to target tasks (e.g., medical data prediction) by learning a small-scale pattern added into input images instead of tuning considerable parameters within the model. The location of the pattern within input samples is usually determined by a pre-defined mask shared across all samples. In this paper, we show that the shared mask potentially limits VR's generalization and increases its approximation error due to the lack of sample-level adaptation. Motivated by this finding, we design a new framework for VR called sample-specific multi-channel masks (SMM). Specifically, SMM employs a lightweight ConvNet and patch-wise interpolation to generate sample-specific three-channel masks instead of a shared and pre-defined mask. Since we generate different masks for individual samples, SMM is theoretically shown to reduce approximation error for the target tasks compared with existing state-of-the-art VR methods. We also empirically demonstrate its performance gain on both ResNet and ViT. The success of SMM further highlights the broader applicability of VR in leveraging the latent knowledge of pre-trained models for various target tasks. Our code is available at https://github.com/tmlr-group/SMM.


title: Which Side Are You On? A Multi-task Dataset for End-to-End Argument Summarisation and Evaluation

abstract: With the recent advances of large language models (LLMs), it is no longer infeasible to build an automated debate system that helps people to synthesise persuasive arguments. Previous work attempted this task by integrating multiple components. In our work, we introduce an argument mining dataset that captures the end-to-end process of preparing an argumentative essay for a debate, which covers the tasks of claim and evidence identification (Task 1 ED), evidence convincingness ranking (Task 2 ECR), argumentative essay summarisation and human preference ranking (Task 3 ASR) and metric learning for automated evaluation of resulting essays, based on human feedback along argument quality dimensions (Task 4 SQE). Our dataset contains 14k examples of claims that are fully annotated with the various properties supporting the aforementioned tasks. We evaluate multiple generative baselines for each of these tasks, including representative LLMs. We find, that while they show promising results on individual tasks in our benchmark, their end-to-end performance on all four tasks in succession deteriorates significantly, both in automated measures as well as in human-centred evaluation. This challenge presented by our proposed dataset motivates future research on end-to-end argument mining and summarisation. The repository of this project is available at https://github.com/HarrywillDr/ArgSum-Datatset


title: Dynamic Spectral Clustering with Provable Approximation Guarantee

abstract: This paper studies clustering algorithms for dynamically evolving graphs $\{G_t\}$, in which new edges (and potential new vertices) are added into a graph, and the underlying cluster structure of the graph can gradually change. The paper proves that, under some mild condition on the cluster-structure, the clusters of the final graph $G_T$ of $n_T$ vertices at time $T$ can be well approximated by a dynamic variant of the spectral clustering algorithm. The algorithm runs in amortised update time $O(1)$ and query time $o(n_T)$. Experimental studies on both synthetic and real-world datasets further confirm the practicality of our designed algorithm.


title: Effective short distance interaction in Calogero-Sutherland quantum fluids

abstract: We consider the effective conformal field theory with symmetry W-infinity x W-infinity that describes the thermodynamic limit of the Calogero-Sutherland model. In the repulsive regime of the free fermion formulation, we identify an attractive interaction between opposite moving particle-hole pairs that dominates the short distance behavior and that is proposed as responsible for the destabilization of the ground state, leading to a new one of bosonic nature. The process is described by a Bogoliubov transformation of the free fermion bilinear operators into bosonic ones, preserving the form of the W-infinity algebra but decoupling the opposite chirality terms in the hamiltonian, as expected in the low energy limit. In coordinate space this interaction has a short range component that arises due to the quantum regularization of the theory. The described dynamical process may be considered as a mechanism of the emergence of the known charge and quantum statistics fractionalization of the low lying excitations of the theory, as predicted in both first and second quantization studies.

categories: hep-th cond-mat.mes-hall math-ph math.MP


title: Detecting Model Misspecification in Amortized Bayesian Inference with Neural Networks: An Extended Investigation

abstract: Recent advances in probabilistic deep learning enable efficient amortized Bayesian inference in settings where the likelihood function is only implicitly defined by a simulation program (simulation-based inference; SBI). But how faithful is such inference if the simulation represents reality somewhat inaccurately, that is, if the true system behavior at test time deviates from the one seen during training? We conceptualize the types of such model misspecification arising in SBI and systematically investigate how the performance of neural posterior approximators gradually deteriorates as a consequence, making inference results less and less trustworthy. To notify users about this problem, we propose a new misspecification measure that can be trained in an unsupervised fashion (i.e., without training data from the true distribution) and reliably detects model misspecification at test time. Our experiments clearly demonstrate the utility of our new measure both on toy examples with an analytical ground-truth and on representative scientific tasks in cell biology, cognitive decision making, disease outbreak dynamics, and computer vision. We show how the proposed misspecification test warns users about suspicious outputs, raises an alarm when predictions are not trustworthy, and guides model designers in their search for better simulators.


title: Once more Diarization: Improving meeting transcription systems through segment-level speaker reassignment

abstract: Diarization is a crucial component in meeting transcription systems to ease the challenges of speech enhancement and attribute the transcriptions to the correct speaker. Particularly in the presence of overlapping or noisy speech, these systems have problems reliably assigning the correct speaker labels, leading to a significant amount of speaker confusion errors. We propose to add segment-level speaker reassignment to address this issue. By revisiting, after speech enhancement, the speaker attribution for each segment, speaker confusion errors from the initial diarization stage are significantly reduced. Through experiments across different system configurations and datasets, we further demonstrate the effectiveness and applicability in various domains. Our results show that segment-level speaker reassignment successfully rectifies at least 40% of speaker confusion word errors, highlighting its potential for enhancing diarization accuracy in meeting transcription systems.


title: Observation of new charmonium(-like) states in $B^+ \to D^{*\pm} D^{\mp} K^+$ decays

abstract: A study of resonant structures in $B^{+}\rightarrow{D^{\ast+}D^{-}K^{+}}$ and $B^{+}\rightarrow{D^{\ast-}D^{+}K^{+}}$ decays is performed, using proton-proton collision data at centre-of-mass energies of $\sqrt{s}=7, 8$, and $13$ TeV recorded by the LHCb experiment, corresponding to an integrated luminosity of 9 fb$^{-1}$. A simultaneous amplitude fit is performed to the two channels with contributions from resonances decaying to $D^{\ast-}D^{+}$ and $D^{\ast+}D^{-}$ states linked by $C$ parity. This procedure allows the $C$-parities of resonances in the $D^{\ast\pm}D^{\mp}$ mass spectra to be determined. Four charmonium(-like) states are observed decaying into $D^{\ast\pm}D^{\mp}$: $\eta_c(3945)$, $h_c(4000)$, $\chi_{c1}(4010)$ and $h_c(4300)$, with quantum numbers $J^{PC}$ equal to $0^{-+}$, $1^{+-}$, $1^{++}$ and $1^{+-}$, respectively. At least three of these states have not been observed previously. In addition, the existence of the $T_{\bar{c}\bar{s}0}^{*}(2870)^{0}$ and $T_{\bar{c}\bar{s}1}^{*}(2900)^{0}$ resonances in the $D^-K^+$ mass spectrum, already observed in the $B^+ \to D^+ D^- K^+$ decay, is confirmed in a different production channel.


title: A Combination Model Based on Sequential General Variational Mode Decomposition Method for Time Series Prediction

abstract: Accurate prediction of financial time series is a key concern for market economy makers and investors. The article selects online store sales and Australian beer sales as representatives of non-stationary, trending, and seasonal financial time series, and constructs a new SGVMD-ARIMA combination model in a non-linear combination way to predict financial time series. The ARIMA model, LSTM model, and other classic decomposition prediction models are used as control models to compare the accuracy of different models. The empirical results indicate that the constructed combination prediction model has universal advantages over the single prediction model and linear combination prediction model of the control group. Within the prediction interval, our proposed combination model has improved advantages over traditional decomposition prediction control group models.


title: CSS: Contrastive Semantic Similarity for Uncertainty Quantification of LLMs

abstract: Despite the impressive capability of large language models (LLMs), knowing when to trust their generations remains an open challenge. The recent literature on uncertainty quantification of natural language generation (NLG) utilises a conventional natural language inference (NLI) classifier to measure the semantic dispersion of LLMs responses. These studies employ logits of NLI classifier for semantic clustering to estimate uncertainty. However, logits represent the probability of the predicted class and barely contain feature information for potential clustering. Alternatively, CLIP (Contrastive Language-Image Pre-training) performs impressively in extracting image-text pair features and measuring their similarity. To extend its usability, we propose Contrastive Semantic Similarity, the CLIP-based feature extraction module to obtain similarity features for measuring uncertainty for text pairs. We apply this method to selective NLG, which detects and rejects unreliable generations for better trustworthiness of LLMs. We conduct extensive experiments with three LLMs on several benchmark question-answering datasets with comprehensive evaluation metrics. Results show that our proposed method performs better in estimating reliable responses of LLMs than comparable baselines. Results show that our proposed method performs better in estimating reliable responses of LLMs than comparable baselines. The code are available at \url{https://github.com/AoShuang92/css_uq_llms}.


title: Hurry: Dynamic Collaborative Framework For Low-orbit Mega-Constellation Data Downloading

abstract: Low-orbit mega-constellation network, which utilize thousands of satellites to provide a variety of network services and collect a wide range of space information, is a rapidly growing field. Each satellite collects TB-level data daily, including delay-sensitive data used for crucial tasks, such as military surveillance, natural disaster monitoring, and weather forecasting. According to NASA's statement, these data need to be downloaded to the ground for processing within 3 to 5 hours. To reduce the time required for satellite data downloads, the state-of-the-art solution known as CoDld, which is only available for small constellations, uses an iterative method for cooperative downloads via inter-satellite links. However, in LMCN, the time required to download the same amount of data using CoDld will exponentially increase compared to downloading the same amount of data in a small constellation. We have identified and analyzed the reasons for this degradation phenomenon and propose a new satellite data download framework, named Hurry. By modeling and mapping satellite topology changes and data transmission to Time-Expanded Graphs, we implement our algorithm within the Hurry framework to avoid degradation effects. In the fixed data volume download evaluation, Hurry achieves 100% completion of the download task while the CoDld only reached 44% of download progress. In continuous data generation evaluation, the Hurry flow algorithm improves throughput from 11% to 66% compared to the CoDld in different scenarios.


title: Cold molecular ions via autoionization below the dissociation limit

abstract: Several diatomic transition metal oxides, rare-earth metal oxides and fluorides have the unusual property that their bond dissociation energy is larger than their ionization energy. In these molecules, bound levels above the ionization energy can be populated via strong, resonant transitions from the ground state. The only relevant decay channel of these levels is autoionization; predissociation is energetically not possible and radiative decay is many orders of magnitude slower. Starting from translationally cold neutral molecules, translationally cold molecular ions can thus be produced with very high efficiency. By populating bound levels just above the ionization energy, internally cold molecular ions, exclusively occupying the lowest rotational level, are produced. This is experimentally shown here for the dysprosium monoxide molecule, DyO, for which the lowest bond dissociation energy is determined to be 0.0831(6) eV above the ionization energy.


title: Ethical considerations of use of hold-out sets in clinical prediction model management

abstract: Clinical prediction models are statistical or machine learning models used to quantify the risk of a certain health outcome using patient data. These can then inform potential interventions on patients, causing an effect called performative prediction: predictions inform interventions which influence the outcome they were trying to predict, leading to a potential underestimation of risk in some patients if a model is updated on this data. One suggested resolution to this is the use of hold-out sets, in which a set of patients do not receive model derived risk scores, such that a model can be safely retrained. We present an overview of clinical and research ethics regarding potential implementation of hold-out sets for clinical prediction models in health settings. We focus on the ethical principles of beneficence, non-maleficence, autonomy and justice. We also discuss informed consent, clinical equipoise, and truth-telling. We present illustrative cases of potential hold-out set implementations and discuss statistical issues arising from different hold-out set sampling methods. We also discuss differences between hold-out sets and randomised control trials, in terms of ethics and statistical issues. Finally, we give practical recommendations for researchers interested in the use hold-out sets for clinical prediction models.


title: The Curse of Beam-Squint in ISAC: Causes, Implications, and Mitigation Strategies

abstract: Integrated sensing and communications (ISAC) has emerged as a means to efficiently utilize spectrum and thereby save cost and power. At the higher end of the spectrum, ISAC systems operate at wideband using large antenna arrays to meet the stringent demands for high-resolution sensing and enhanced communications capacity. However, the wideband implementation entails beam-squint, that is, deviations in the generated beam directions because of the narrowband assumption in the analog components. This causes significant degradation in the communications capacity, target detection, and parameter estimation. This article presents the design challenges caused by beam-squint and its mitigation in ISAC systems. In this context, we also discuss several ISAC design perspectives including far-/near-field beamforming, channel/direction estimation, sparse array design, and index modulation. There are also several research opportunities in waveform design, beam training, and array processing to adequately address beam-squint in ISAC.


title: Foundation Models for Geophysics: Reviews and Perspectives

abstract: Recently, large models, or foundation models have demonstrated outstanding performance and have been applied in a variety of disciplines, such as chemistry, biology, economics, etc. Foundation models, trained on vast amounts of data, can be adapted to a wide range of use cases. The emergence of foundation models has a significant impact on the research paradigms in these fields. Geophysics is a scientific field dedicated to exploring and understanding the Earth's structures and states through the application of physical principles and the analysis of multimodal geophysical data. In the field of geophysics, the processing and interpretation of geophysical data are characterized by three primary features: extensive data volume, multimodality, and dependence on experience. These characteristics provide a suitable environment as well as challenges for the development and breakthrough of foundation models in the field of geophysics. In this perspective, we discuss the potential applications and research directions of geophysical foundation models (GeoFMs), exploring new research paradigms in geophysics in the era of foundation models. Exploration geophysics is the main focus, while the development of foundation models in remote sensing, seismology, and other related sub-disciplines in geophysics is also discussed. In the meantime, we also propose two strategies for constructing GeoFMs and discuss challenges that may arise during the process of development.


title: Topological Neural Networks go Persistent, Equivariant, and Continuous

abstract: Topological Neural Networks (TNNs) incorporate higher-order relational information beyond pairwise interactions, enabling richer representations than Graph Neural Networks (GNNs). Concurrently, topological descriptors based on persistent homology (PH) are being increasingly employed to augment the GNNs. We investigate the benefits of integrating these two paradigms. Specifically, we introduce TopNets as a broad framework that subsumes and unifies various methods in the intersection of GNNs/TNNs and PH such as (generalizations of) RePHINE and TOGL. TopNets can also be readily adapted to handle (symmetries in) geometric complexes, extending the scope of TNNs and PH to spatial settings. Theoretically, we show that PH descriptors can provably enhance the expressivity of simplicial message-passing networks. Empirically, (continuous and E(n)-equivariant extensions of) TopNets achieve strong performance across diverse tasks, including antibody design, molecular dynamics simulation, and drug property prediction.


title: Floorplanning with I/O assignment via feasibility-seeking and superiorization methods

abstract: The feasibility-seeking approach offers a systematic framework for managing and resolving intricate constraints in continuous problems, making it a promising avenue to explore in the context of floorplanning problems with increasingly heterogeneous constraints. The classic legality constraints can be expressed as the union of convex sets. In implementation, we introduce a resetting strategy aimed at effectively reducing the problem of algorithmic divergence in the projection-based method used for the feasibility-seeking formulation. Furthermore, we introduce the novel application of the superiorization method (SM) to floorplanning, which bridges the gap between feasibility-seeking and constrained optimization. The SM employs perturbations to steer the iterations of the feasibility-seeking algorithm towards feasible solutions with reduced (not necessarily minimal) total wirelength. To evaluate the performance of Per-RMAP, we conduct comprehensive experiments on the MCNC benchmarks and GSRC benchmarks. The results demonstrate that we can obtain legal floorplanning results 166 times faster than the branch-and-bound (B&B) method while incurring only a 5% wirelength increase compared to the optimal results. Furthermore, we evaluate the effectiveness of the algorithmic flow that considers the I/O assignment constraints, which achieves an 6% improvement in wirelength. Besides, considering the soft modules with a larger feasible solution space, we obtain 15% improved runtime compared with PeF, the state-of-the-art analytical method. Moreover, we compared our method with Parquet-4 and Fast-SA on GSRC benchmarks which include larger-scale instances. The results highlight the ability of our approach to maintain a balance between floorplanning quality and efficiency.


title: Alternating paths in oriented graphs with large semidegree

abstract: In new progress on conjectures of Stein, and Addario-Berry, Havet, Linhares Sales, Reed and Thomass\'e, we prove that every oriented graph with all in- and out-degrees greater than 5k/8 contains an alternating path of length k. This improves on previous results of Klimo\v{s}ov\'a and Stein, and Chen, Hou and Zhou.


title: Matroids over tropical extensions of tracts

abstract: A tract $F$ is an algebraic structure where multiplication is defined but addition is only partially defined. They were introduced by Baker and Bowler as a unified framework to study generalisations of matroids, including oriented and valuated matroids. A tropical extension $F[\Gamma]$ is a tract obtained by extending a tract $F$ by an ordered abelian group $\Gamma$. Key examples include the tropical hyperfield as a tropical extension of the Krasner hyperfield, and the signed tropical hyperfield as a tropical extension of the sign hyperfield. We study matroids over tropical extensions of tracts, including valuated matroids and oriented valuated matroids. We generalise the correspondence between valuated matroids and their initial matroids, showing that $M$ is an $F[\Gamma]$-matroid if and only if every initial matroid $M^u$ is an $F$-matroid. We also show analogous results for flag matroids and positroids over tropical extensions, utilising the circuit and covector descriptions we derive for $F[\Gamma]$-matroids. We conclude by studying images of linear spaces in enriched valuations, valuation maps enriched with additional data. These give rise to enriched tropical linear spaces, including signed tropical linear spaces as a key examples. As an application of our results, we prove a structure theorem for enriched tropical linear spaces, generalising the characterisation of projective tropical linear spaces of Brandt-Eur-Zhang.


title: On semi-transitive orientability of circulant graphs

abstract: A graph $G = (V, E)$ is said to be word-representable if a word $w$ can be formed using the letters of the alphabet $V$ such that for every pair of vertices $x$ and $y$, $xy \in E$ if and only if $x$ and $y$ alternate in $w$. A \textit{semi-transitive} orientation is an acyclic directed graph where for any directed path $v_0 \rightarrow v_1 \rightarrow \ldots \rightarrow v_m$, $m \ge 2$ either there is no arc between $v_0$ and $v_m$ or for all $1 \le i < j \le m$ there is an arc between $v_i$ and $v_j$. An undirected graph is semi-transitive if it admits a semi-transitive orientation. For given positive integers $n, a_1, a_2, \ldots, a_k$, we consider the undirected circulant graph with set of vertices $\{0, 1, 2, \ldots, n-1\}$ and the set of edges$\{ij ~ | ~ (i - j) \pmod n$ or $(j-i) \pmod n$ are in $\{a_1, a_2, \ldots, a_k\}\}$, where $ 0 < a_1 < a_2 < \ldots < a_k < (n+1)/2$. Recently, Kitaev and Pyatkin have shown that every $4$-regular circulant graph is semi-transitive. Further, they have posed an open problem regarding the semi-transitive orientability of circulant graphs for which the elements of the set $\{a_1, a_2, \ldots, a_k\}$ are consecutive positive integers. In this paper, we solve the problem mentioned above. In addition, we show that under certain assumptions, some $k(\ge5)$-regular circulant graphs are semi-transitive, and some are not. Moreover, since a semi-transitive orientation is a characterisation of word-representability, we give some upper bound for the representation number of certain $k$-regular circulant graphs.


title: Brief Announcement: Distributed Unconstrained Local Search for Multilevel Graph Partitioning

abstract: Partitioning a graph into blocks of roughly equal weight while cutting only few edges is a fundamental problem in computer science with numerous practical applications. While shared-memory parallel partitioners have recently matured to achieve the same quality as widely used sequential partitioners, there is still a pronounced quality gap between distributed partitioners and their sequential counterparts. In this work, we shrink this gap considerably by describing the engineering of an unconstrained local search algorithm suitable for distributed partitioners. We integrate the proposed algorithm in a distributed multilevel partitioner. Our extensive experiments show that the resulting algorithm scales to thousands of PEs while computing cuts that are, on average, only 3.5% larger than those of a state-of-the-art high-quality shared-memory partitioner. Compared to previous distributed partitioners, we obtain on average 6.8% smaller cuts than the best-performing competitor while being more than 9 times faster.


title: StatBot.Swiss: Bilingual Open Data Exploration in Natural Language

abstract: The potential for improvements brought by Large Language Models (LLMs) in Text-to-SQL systems is mostly assessed on monolingual English datasets. However, LLMs' performance for other languages remains vastly unexplored. In this work, we release the StatBot.Swiss dataset, the first bilingual benchmark for evaluating Text-to-SQL systems based on real-world applications. The StatBot.Swiss dataset contains 455 natural language/SQL-pairs over 35 big databases with varying level of complexity for both English and German. We evaluate the performance of state-of-the-art LLMs such as GPT-3.5-Turbo and mixtral-8x7b-instruct for the Text-to-SQL translation task using an in-context learning approach. Our experimental analysis illustrates that current LLMs struggle to generalize well in generating SQL queries on our novel bilingual dataset.


title: High-Dimensional Kernel Methods under Covariate Shift: Data-Dependent Implicit Regularization

abstract: This paper studies kernel ridge regression in high dimensions under covariate shifts and analyzes the role of importance re-weighting. We first derive the asymptotic expansion of high dimensional kernels under covariate shifts. By a bias-variance decomposition, we theoretically demonstrate that the re-weighting strategy allows for decreasing the variance. For bias, we analyze the regularization of the arbitrary or well-chosen scale, showing that the bias can behave very differently under different regularization scales. In our analysis, the bias and variance can be characterized by the spectral decay of a data-dependent regularized kernel: the original kernel matrix associated with an additional re-weighting matrix, and thus the re-weighting strategy can be regarded as a data-dependent regularization for better understanding. Besides, our analysis provides asymptotic expansion of kernel functions/vectors under covariate shift, which has its own interest.


title: Initialization-enhanced Physics-Informed Neural Network with Domain Decomposition (IDPINN)

abstract: We propose a new physics-informed neural network framework, IDPINN, based on the enhancement of initialization and domain decomposition to improve prediction accuracy. We train a PINN using a small dataset to obtain an initial network structure, including the weighted matrix and bias, which initializes the PINN for each subdomain. Moreover, we leverage the smoothness condition on the interface to enhance the prediction performance. We numerically evaluated it on several forward problems and demonstrated the benefits of IDPINN in terms of accuracy.


title: Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation

abstract: This thesis aims to investigate the feasibility of knowledge transfer between neural networks for medical image segmentation tasks, specifically focusing on the transfer from a larger multi-task "Teacher" network to a smaller "Student" network. In the context of medical imaging, where the data volumes are often limited, leveraging knowledge from a larger pre-trained network could be useful. The primary objective is to enhance the performance of a smaller student model by incorporating knowledge representations acquired by a teacher model that adopts a multi-task pre-trained architecture trained on CT images, to a more resource-efficient student network, which can essentially be a smaller version of the same, trained on a mere 50% of the data than that of the teacher model. To facilitate knowledge transfer between the two models, we devised an architecture incorporating multi-scale feature distillation and supervised contrastive learning. Our study aims to improve the student model's performance by integrating knowledge representations from the teacher model. We investigate whether this approach is particularly effective in scenarios with limited computational resources and limited training data availability. To assess the impact of multi-scale feature distillation, we conducted extensive experiments. We also conducted a detailed ablation study to determine whether it is essential to distil knowledge at various scales, including low-level features from encoder layers, for effective knowledge transfer. In addition, we examine different losses in the knowledge distillation process to gain insights into their effects on overall performance.


title: The Amaterasu particle: constraining the superheavy dark matter origin of UHECRs

abstract: Amaterasu, the second most energetic ($244$ EeV) cosmic ray particle has been recently detected by the Telescope Array (TA) surface detector. The origin of the TA Amaterasu event is puzzling, as its arrival direction points back to a void in the local Universe, lacking conventional astrophysical ultra-high-energy (UHE) cosmic ray (CR) sources. Hence, we explore the possibility if this TA Amaterasu event could have originated from the decay of superheavy dark matter (SHDM) in the Milky Way. Such an origin also opens up multi-messenger detection channels in both UHE gamma-rays and UHE neutrinos. In this present work, using the TA Amaterasu event and the multi-messenger limits/sensitivities from various UHE telescopes, we place stringent constraints on the lifetime and mass of the SHDM. We find that the non-detection of the corresponding gamma-rays at the Pierre Auger Observatory (PAO) and the TA is in severe tension with the SHDM parameter space required to explain the TA Amaterasu event. Additionally, we extend the multi-messenger analysis to the future UHE gamma-ray and UHE neutrino telescopes such as PAO upgrade, GRAND 200k and IceCube-Gen2. We find that the bounds from the future neutrino telescopes will be able to compete with the present UHECR bounds. However, compared to the existing UHE gamma-ray bounds, the future PAO upgrade and the GRAND 200k gamma-ray detectors will improve the bounds on SHDM lifetime by at least one order of magnitude.


title: Dynamic 3D Gaussian Fields for Urban Areas

abstract: We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited visual quality and non-interactive rendering speeds. Recently, rasterization-based approaches have achieved high-quality NVS at impressive speeds. However, these methods are limited to small-scale, homogeneous data, i.e. they cannot handle severe appearance and geometry variations due to weather, season, and lighting and do not scale to larger, dynamic areas with thousands of images. We propose 4DGF, a neural scene representation that scales to large-scale dynamic urban areas, handles heterogeneous input data, and substantially improves rendering speeds. We use 3D Gaussians as an efficient geometry scaffold while relying on neural fields as a compact and flexible appearance model. We integrate scene dynamics via a scene graph at global scale while modeling articulated motions on a local level via deformations. This decomposed approach enables flexible scene composition suitable for real-world applications. In experiments, we surpass the state-of-the-art by over 3 dB in PSNR and more than 200 times in rendering speed.


title: MMCL: Boosting Deformable DETR-Based Detectors with Multi-Class Min-Margin Contrastive Learning for Superior Prohibited Item Detection

abstract: Prohibited Item detection in X-ray images is one of the most effective security inspection methods.However, differing from natural light images, the unique overlapping phenomena in X-ray images lead to the coupling of foreground and background features, thereby lowering the accuracy of general object detectors.Therefore, we propose a Multi-Class Min-Margin Contrastive Learning (MMCL) method that, by clarifying the category semantic information of content queries under the deformable DETR architecture, aids the model in extracting specific category foreground information from coupled features.Specifically, after grouping content queries by the number of categories, we employ the Multi-Class Inter-Class Exclusion (MIE) loss to push apart content queries from different groups. Concurrently, the Intra-Class Min-Margin Clustering (IMC) loss is utilized to attract content queries within the same group, while ensuring the preservation of necessary disparity. As training, the inherent Hungarian matching of the model progressively strengthens the alignment between each group of queries and the semantic features of their corresponding category of objects. This evolving coherence ensures a deep-seated grasp of category characteristics, consequently bolstering the anti-overlapping detection capabilities of models.MMCL is versatile and can be easily plugged into any deformable DETR-based model with dozens of lines of code. Extensive experiments on the PIXray and OPIXray datasets demonstrate that MMCL significantly enhances the performance of various state-of-the-art models without increasing complexity. The code has been released at https://github.com/anonymity0403/MMCL.


title: FAPNet: An Effective Frequency Adaptive Point-based Eye Tracker

abstract: Eye tracking is crucial for human-computer interaction in different domains. Conventional cameras encounter challenges such as power consumption and image quality during different eye movements, prompting the need for advanced solutions with ultra-fast, low-power, and accurate eye trackers. Event cameras, fundamentally designed to capture information about moving objects, exhibit low power consumption and high temporal resolution. This positions them as an alternative to traditional cameras in the realm of eye tracking. Nevertheless, existing event-based eye tracking networks neglect the pivotal sparse and fine-grained temporal information in events, resulting in unsatisfactory performance. Moreover, the energy-efficient features are further compromised by the use of excessively complex models, hindering efficient deployment on edge devices. In this paper, we utilize Point Cloud as the event representation to harness the high temporal resolution and sparse characteristics of events in eye tracking tasks. We rethink the point-based architecture PEPNet with preprocessing the long-term relationships between samples, leading to the innovative design of FAPNet. A frequency adaptive mechanism is designed to realize adaptive tracking according to the speed of the pupil movement and the Inter Sample LSTM module is introduced to utilize the temporal correlation between samples. In the Event-based Eye Tracking Challenge, we utilize vanilla PEPNet, which is the former work to achieve the $p_{10}$ accuracy of 97.95\%. On the SEET synthetic dataset, FAPNet can achieve state-of-the-art while consuming merely 10\% of the PEPNet's computational resources. Notably, the computational demand of FAPNet is independent of the sensor's spatial resolution, enhancing its applicability on resource-limited edge devices.


title: Identification of PK-PD Insulin Models using Experimental GIR Data

abstract: We present a method to estimate parameters in pharmacokinetic (PK) and pharmacodynamic (PD) models for glucose insulin dynamics in humans. The method combines 1) experimental glucose infusion rate (GIR) data from glucose clamp studies and 2) a PK-PD model to estimate parameters such that the model fits the data. Assuming that the glucose clamp is perfect, we do not need to know the details of the controller in the clamp, and the GIR can be computed directly from the PK-PD model. To illustrate the procedure, we use the glucoregulatory model developed by Hovorka and modify it to have a smooth non-negative endogeneous glucose production (EGP) term. We estimate PK-PD parameters for rapid-acting insulin analogs (Fiasp and NovoRapid). We use these PK-PD parameters to illustrate GIR for insulin analogs with 30% and 50% faster absorption time than currently available rapid-acting insulin analogs. We discuss the role of system identification using GIR data from glucose clamp studies and how such identified models can be used in automated insulin dosing (AID) systems with ultra rapid-acting insulin.


title: Sub-diffraction estimation, discrimination and learning of quantum states of light

abstract: The resolution of optical imaging is classically limited by the width of the point-spread function, which in turn is determined by the Rayleigh length. Recently, spatial-mode demultiplexing (SPADE) has been proposed as a method to achieve sub-Rayleigh estimation and discrimination of natural, incoherent sources. Here we show that SPADE is optimal in the broader context of machine learning. To this goal, we introduce a hybrid quantum-classical image classifier that achieves sub-Rayleigh resolution. The algorithm includes a quantum and a classical part. In the quantum part, a physical device (demultiplexer) is used to sort the transverse field, followed by mode-wise photon detection. This part of the algorithm implements a physical pre-processing of the quantum field that cannot be classically simulated without essentially reducing the signal-to-noise ratio. In the classical part of the algorithm, the collected data are fed into an artificial neural network for training and classification. As a case study, we classify images from the MNIST dataset after severe blurring due to diffraction. Our numerical experiments demonstrate the ability to learn highly blurred images that would be otherwise indistinguishable by direct imaging without the physical pre-processing of the quantum field.


title: The FLAMINGO Project: A comparison of galaxy cluster samples selected on mass, X-ray luminosity, Compton-Y parameter, or galaxy richness

abstract: Galaxy clusters provide an avenue to expand our knowledge of cosmology and galaxy evolution. Because it is difficult to accurately measure the total mass of a large number of individual clusters, cluster samples are typically selected using an observable proxy for mass. Selection effects are therefore a key problem in understanding galaxy cluster statistics. We make use of the $(2.8~\rm{Gpc})^3$ FLAMINGO hydrodynamical simulation to investigate how selection based on X-ray luminosity, thermal Sunyaev-Zeldovich effect or galaxy richness influences the halo mass distribution. We define our selection cuts based on the median value of the observable at a fixed mass and compare the resulting samples to a mass-selected sample. We find that all samples are skewed towards lower mass haloes. For X-ray luminosity and richness cuts below a critical value, scatter dominates over the trend with mass and the median mass becomes biased increasingly low with respect to a mass-selected sample. At $z\leq0.5$, observable cuts corresponding to median halo masses between $M_\text{500c}=10^{14}$ and $10^{15}~\rm{M_{\odot}}$ give nearly unbiased median masses for all selection methods, but X-ray selection results in biased medians for higher masses. For cuts corresponding to median masses $<10^{14}$ at $z\leq0.5$ and for all masses at $z\geq1$, only Compton-Y selection yields nearly unbiased median masses. Importantly, even when the median mass is unbiased, the scatter is not because for each selection the sample is skewed towards lower masses than a mass-selected sample. Each selection leads to a different bias in secondary quantities like cool-core fraction, temperature and gas fraction.