title: When Graph Convolution Meets Double Attention: Online Privacy Disclosure Detection with Multi-Label Text Classification

abstract: With the rise of Web 2.0 platforms such as online social media, people's private information, such as their location, occupation and even family information, is often inadvertently disclosed through online discussions. Therefore, it is important to detect such unwanted privacy disclosures to help alert people affected and the online platform. In this paper, privacy disclosure detection is modeled as a multi-label text classification (MLTC) problem, and a new privacy disclosure detection model is proposed to construct an MLTC classifier for detecting online privacy disclosures. This classifier takes an online post as the input and outputs multiple labels, each reflecting a possible privacy disclosure. The proposed presentation method combines three different sources of information, the input text itself, the label-to-text correlation and the label-to-label correlation. A double-attention mechanism is used to combine the first two sources of information, and a graph convolutional network (GCN) is employed to extract the third source of information that is then used to help fuse features extracted from the first two sources of information. Our extensive experimental results, obtained on a public dataset of privacy-disclosing posts on Twitter, demonstrated that our proposed privacy disclosure detection method significantly and consistently outperformed other state-of-the-art methods in terms of all key performance indicators.


title: A comparative study of micromorphic gradient-extensions for anisotropic damage at finite strains

abstract: Modern inelastic material model formulations rely on the use of tensor-valued internal variables. When inelastic phenomena include softening, simulations of the former are prone to localization. Thus, an accurate regularization of the tensor-valued internal variables is essential to obtain physically correct results. Here, we focus on the regularization of anisotropic damage at finite strains. Thus, a flexible anisotropic damage model with isotropic, kinematic, and distortional hardening is equipped with three gradient-extensions using a full and two reduced regularizations of the damage tensor. Theoretical and numerical comparisons of the three gradient-extensions yield excellent agreement between the full and the reduced regularization based on a volumetric-deviatoric regularization using only two nonlocal degrees of freedom.


title: What monads can and cannot do with a bit of extra time

abstract: The delay monad provides a way to introduce general recursion in type theory. To write programs that use a wide range of computational effects directly in type theory, we need to combine the delay monad with the monads of these effects. Here we present a first systematic study of such combinations. We study both the coinductive delay monad and its guarded recursive cousin, giving concrete examples of combining these with well-known computational effects. We also provide general theorems stating which algebraic effects distribute over the delay monad, and which do not. Lastly, we salvage some of the impossible cases by considering distributive laws up to weak bisimilarity.


title: A Fully Data-Driven Approach for Realistic Traffic Signal Control Using Offline Reinforcement Learning

abstract: The optimization of traffic signal control (TSC) is critical for an efficient transportation system. In recent years, reinforcement learning (RL) techniques have emerged as a popular approach for TSC and show promising results for highly adaptive control. However, existing RL-based methods suffer from notably poor real-world applicability and hardly have any successful deployments. The reasons for such failures are mostly due to the reliance on over-idealized traffic simulators for policy optimization, as well as using unrealistic fine-grained state observations and reward signals that are not directly obtainable from real-world sensors. In this paper, we propose a fully Data-Driven and simulator-free framework for realistic Traffic Signal Control (D2TSC). Specifically, we combine well-established traffic flow theory with machine learning to construct a reward inference model to infer the reward signals from coarse-grained traffic data. With the inferred rewards, we further propose a sample-efficient offline RL method to enable direct signal control policy learning from historical offline datasets of real-world intersections. To evaluate our approach, we collect historical traffic data from a real-world intersection, and develop a highly customized simulation environment that strictly follows real data characteristics. We demonstrate through extensive experiments that our approach achieves superior performance over conventional and offline RL baselines, and also enjoys much better real-world applicability.


title: Measurement of associated $J/\psi$-$\psi(2S)$ production cross-section in $pp$ collisions at $\sqrt{s}=13$ TeV

abstract: The cross-section of associated $J/\psi$-$\psi(2S)$ production in proton-proton collisions at a centre-of-mass energy of $\sqrt{s}=13$ TeV is measured using a data sample corresponding to an integrated luminosity of 4.2 fb$^{-1}$, collected by the LHCb experiment. The measurement is performed for both $J/\psi$ and $\psi(2S)$ mesons having transverse momentum $p_{\text{T}}<14$ GeV/$c$ and rapidity $2.0<y<4.5$, assuming negligible polarisation of the $J/\psi$ and $\psi(2S)$ mesons. The production cross-section is measured to be $4.5\pm0.7\pm0.3$ nb, where the first uncertainty is statistical and the second systematic. The differential cross-sections are measured as functions of several kinematic variables of the $J/\psi$-$\psi(2S)$ candidates. The results are combined with a measurement of $J/\psi$-$J/\psi$ production, giving a cross-section ratio between $J/\psi$-$\psi(2S)$ and $J/\psi$-$J/\psi$ production of $0.274\pm0.044\pm0.008$, where the first uncertainty is statistical and the second systematic.


title: Rational unicuspidal plane curves of low degree

abstract: We completely classify all plane curves of degree at most 30 with a unique cuspidal (locally unibranch) singular point and rational normalization in terms of the Newton pairs parameterizing the cusp. We distinguish between prime and composite degree in the classification and study the relationship between prime or composite degree and the number of distinct topological types of cuspidal singularities. Motivated by wall-crossing in moduli of curves, we also survey several geometric properties of rational unicuspidal plane curves.


title: SEINE: SEgment-based Indexing for NEural information retrieval

abstract: Many early neural Information Retrieval (NeurIR) methods are re-rankers that rely on a traditional first-stage retriever due to expensive query time computations. Recently, representation-based retrievers have gained much attention, which learns query representation and document representation separately, making it possible to pre-compute document representations offline and reduce the workload at query time. Both dense and sparse representation-based retrievers have been explored. However, these methods focus on finding the representation that best represents a text (aka metric learning) and the actual retrieval function that is responsible for similarity matching between query and document is kept at a minimum by using dot product. One drawback is that unlike traditional term-level inverted index, the index formed by these embeddings cannot be easily re-used by another retrieval method. Another drawback is that keeping the interaction at minimum hurts retrieval effectiveness. On the contrary, interaction-based retrievers are known for their better retrieval effectiveness. In this paper, we propose a novel SEgment-based Neural Indexing method, SEINE, which provides a general indexing framework that can flexibly support a variety of interaction-based neural retrieval methods. We emphasize on a careful decomposition of common components in existing neural retrieval methods and propose to use segment-level inverted index to store the atomic query-document interaction values. Experiments on LETOR MQ2007 and MQ2008 datasets show that our indexing method can accelerate multiple neural retrieval methods up to 28-times faster without sacrificing much effectiveness.


title: Diagnosis driven Anomaly Detection for CPS

abstract: In Cyber-Physical Systems (CPS) research, anomaly detection (detecting abnormal behavior) and diagnosis (identifying the underlying root cause) are often treated as distinct, isolated tasks. However, diagnosis algorithms require symptoms, i.e. temporally and spatially isolated anomalies, as input. Thus, anomaly detection and diagnosis must be developed together to provide a holistic solution for diagnosis in CPS. We therefore propose a method for utilizing deep learning-based anomaly detection to generate inputs for Consistency-Based Diagnosis (CBD). We evaluate our approach on a simulated and a real-world CPS dataset, where our model demonstrates strong performance relative to other state-of-the-art models.


title: Reinforcement Learning for Wildfire Mitigation in Simulated Disaster Environments

abstract: Climate change has resulted in a year over year increase in adverse weather and weather conditions which contribute to increasingly severe fire seasons. Without effective mitigation, these fires pose a threat to life, property, ecology, cultural heritage, and critical infrastructure. To better prepare for and react to the increasing threat of wildfires, more accurate fire modelers and mitigation responses are necessary. In this paper, we introduce SimFire, a versatile wildland fire projection simulator designed to generate realistic wildfire scenarios, and SimHarness, a modular agent-based machine learning wrapper capable of automatically generating land management strategies within SimFire to reduce the overall damage to the area. Together, this publicly available system allows researchers and practitioners the ability to emulate and assess the effectiveness of firefighter interventions and formulate strategic plans that prioritize value preservation and resource allocation optimization. The repositories are available for download at https://github.com/mitrefireline.


title: Testing the $\mathrm{SU}(2)$ lattice Hamiltonian built from $S_3$ partitionings

abstract: We test a possible digitization of $\mathrm{SU}(2)$ lattice gauge theories based on partitionings of the sphere $S_3$. In our construction the link operators are unitary and diagonal, with eigenvalues determined by the vertices of the partitioning. The canonical momenta are finite difference operators approximating the Lie derivatives on the manifold. In this formalism we implement the standard Wilson Hamiltonian. We show results for a 2-site Schwinger-type model in 1D and a single-plaquette system in 2D. Our calculations are performed on a classical computer, though in principle they can be implemented also on a quantum device.


title: Steady state solutions for the Gierer-Meinhardt system in the whole space

abstract: We are concerned with the study of positive solutions to the Gierer-Meinhardt system $$ \begin{cases} \displaystyle -\Delta u+\lambda u=\frac{u^p}{v^q}+\rho(x) &\quad\mbox{ in }\mathbb{R}^N\, , N\geq 3,\\[0.1in] \displaystyle -\Delta v+\mu v=\frac{u^m}{v^s} &\quad\mbox{ in }\mathbb{R}^N,\\[0.1in] \end{cases} $$ which satisfy $u(x), v(x)\to 0$ as $|x|\to \infty$. In the above system $p,q,m,s>0$, $\lambda, \mu\geq 0$ and $\rho\in C(\mathbb{R}^N)$, $\rho\geq 0$. It is a known fact that posed in a smooth and bounded domain of $\mathbb{R}^N$, the above system subject to homogeneous Neumann boundary conditions has positive solutions if $p>1$ and $\sigma=\frac{mq}{(p-1)(s+1)}>1$. In the present work we emphasize a different phenomenon: we see that for $\lambda, \mu>0$ large, positive solutions with exponential decay exist if $0< \sigma\leq 1$. Further, for $\lambda=\mu=0$ we derive various existence and nonexistence results and underline the role of the critical exponents $p=\frac{N}{N-2}$ and $p=\frac{N+2}{N-2}$.


title: A novel approach to muscle functional recovery monitoring by its free vibration measurement

abstract: The study shows a potential to monitor functional recovery of a muscle by its natural frequency measurement. A novel approach is presented, in which vibrations of the muscle of interest are measured in a contactless manner using laser displacement sensor and the measured vibration signals are analyzed by an advanced technique of experimental modal analysis to extract fundamental natural frequency of the muscle with high accuracy. A case study of functional status recovery monitoring of a rectus femoris muscle, which become anthropic after ACL reconstruction, is presented.


title: The Common Workflow Scheduler Interface: Status Quo and Future Plans

abstract: Nowadays, many scientific workflows from different domains, such as Remote Sensing, Astronomy, and Bioinformatics, are executed on large computing infrastructures managed by resource managers. Scientific workflow management systems (SWMS) support the workflow execution and communicate with the infrastructures' resource managers. However, the communication between SWMS and resource managers is complicated by a) inconsistent interfaces between SMWS and resource managers and b) the lack of support for workflow dependencies and workflow-specific properties. To tackle these issues, we developed the Common Workflow Scheduler Interface (CWSI), a simple yet powerful interface to exchange workflow-related information between a SWMS and a resource manager, making the resource manager workflow-aware. The first prototype implementations show that the CWSI can reduce the makespan already with simple but workflow-aware strategies up to 25%. In this paper, we show how existing workflow resource management research can be integrated into the CWSI.


title: WorldSense: A Synthetic Benchmark for Grounded Reasoning in Large Language Models

abstract: We propose WorldSense, a benchmark designed to assess the extent to which LLMs are consistently able to sustain tacit world models, by testing how they draw simple inferences from descriptions of simple arrangements of entities. Worldsense is a synthetic benchmark with three problem types, each with their own trivial control, which explicitly avoids bias by decorrelating the abstract structure of problems from the vocabulary and expressions, and by decorrelating all problem subparts with the correct response. We run our benchmark on three state-of-the-art chat-LLMs (GPT3.5, GPT4 and Llama2-chat) and show that these models make errors even with as few as three objects. Furthermore, they have quite heavy response biases, preferring certain responses irrespective of the question. Errors persist even with chain-of-thought prompting and in-context learning. Lastly, we show that while finetuning on similar problems does result in substantial improvements -- within- and out-of-distribution -- the finetuned models do not generalise beyond a constraint problem space.


title: Low-Degree Hardness of Detection for Correlated Erd\H{o}s-R\'enyi Graphs

abstract: Given two Erd\H{o}s-R\'enyi graphs with $n$ vertices whose edges are correlated through a latent vertex correspondence, we study complexity lower bounds for the associated correlation detection problem for the class of low-degree polynomial algorithms. We provide evidence that any degree-$O(\rho^{-1})$ polynomial algorithm fails for detection, where $\rho$ is the edge correlation. Furthermore, in the sparse regime where the edge density $q=n^{-1+o(1)}$, we provide evidence that any degree-$d$ polynomial algorithm fails for detection, as long as $\log d=o\big( \frac{\log n}{\log nq} \wedge \sqrt{\log n} \big)$ and the correlation $\rho<\sqrt{\alpha}$ where $\alpha\approx 0.338$ is the Otter's constant. Our result suggests that several state-of-the-art algorithms on correlation detection and exact matching recovery may be essentially the best possible.


title: Valid Wald Inference with Many Weak Instruments

abstract: This paper proposes three novel test procedures that yield valid inference in an environment with many weak instrumental variables (MWIV). It is observed that the t statistic of the jackknife instrumental variable estimator (JIVE) has an asymptotic distribution that is identical to the two-stage-least squares (TSLS) t statistic in the just-identified environment. Consequently, test procedures that were valid for TSLS t are also valid for the JIVE t. Two such procedures, i.e., VtF and conditional Wald, are adapted directly. By exploiting a feature of MWIV environments, a third, more powerful, one-sided VtF-based test procedure can be obtained.


title: A new fuzzy multi-attribute group decision-making method based on TOPSIS and optimization models

abstract: In this paper, a new method based on TOPSIS and optimization models is proposed for multi-attribute group decision-making in the environment of interval-valued intuitionistic fuzzy sets.Firstly, by minimizing the sum of differences between individual evaluations and the overallconsistent evaluations of all experts, a new optimization model is established for determining expert weights. Secondly, based on TOPSIS method, the improved closeness index for evaluating each alternative is obtained. Finally, the attribute weight is determined by establishing an optimization model with the goal of maximizing the closeness of each alternative, and it is brought into the closeness index so that the alternatives can be ranked. Combining all these together, the complete fuzzy multi-attribute group decision-making algorithm is formulated, which can give full play to the advantages of subjective and objective weighting methods. In the end, the feasibility and effectiveness of the provided method are verified by a real case study.


title: Descent with algebraic structures for symplectic cohomology

abstract: We formulate and prove a chain level descent property of symplectic cohomology for involutive covers by compact subsets that take into account the natural algebraic structures that are present. The notion of an involutive cover is reviewed. We indicate the role that the statement plays in mirror symmetry.


title: Proton-unbound states in $^{24}{\rm Al}$ relevant for the $^{23}{\rm Mg}(p,\gamma)$ reaction in novae

abstract: Background: The nucleosynthesis of several proton-rich nuclei is determined by radiative proton-capture reactions on unstable nuclei in nova explosions. One such reaction is $^{23}{\rm Mg}(p,\gamma)^{24}{\rm Al}$, which links the NeNa and MgAl cycles in oxygen-neon (ONe) novae. Purpose: To extract $^{23}{\rm Mg}(p,\gamma)$ resonance strengths from a study of proton-unbound states in $^{24}{\rm Al}$, produced via the $^{24}$Mg($^{3}$He,$t$) reaction. Methods: A beam of $^3 {\rm He}^{2+}$ ions at 50.7 MeV was used to produce the states of interest in $^{24}$Al. Proton-triton angular correlations were measured with a $K=600$ QDD magnetic spectrometer and a silicon detector array, located at iThemba LABS, South Africa. Results: We measured the excitation energies of the four lowest proton-unbound states in $^{24}$Al and place lower-limits on $\Gamma_p/\Gamma$ values for these four states. Together with shell-model calculations of partial gamma widths, the experimental data are also used to determine resonance strengths for the three lowest $^{23}{\rm Mg}(p,\gamma)^{24}{\rm Al}$ resonances. Conclusions: The energy of the dominant first $^{23}{\rm Mg}(p,\gamma)$ resonance is determined to be $E_{r} = 478 \pm 4$ keV, with a resonance strength $\omega \gamma = 19 \pm 9$ meV.


title: Towards Responsible Governance of Biological Design Tools

abstract: Recent advancements in generative machine learning have enabled rapid progress in biological design tools (BDTs) such as protein structure and sequence prediction models. The unprecedented predictive accuracy and novel design capabilities of BDTs present new and significant dual-use risks. For example, their predictive accuracy allows biological agents, whether vaccines or pathogens, to be developed more quickly, while the design capabilities could be used to discover drugs or evade DNA screening techniques. Similar to other dual-use AI systems, BDTs present a wicked problem: how can regulators uphold public safety without stifling innovation? We highlight how current regulatory proposals that are primarily tailored toward large language models may be less effective for BDTs, which require fewer computational resources to train and are often developed in an open-source manner. We propose a range of measures to mitigate the risk that BDTs are misused, across the areas of responsible development, risk assessment, transparency, access management, cybersecurity, and investing in resilience. Implementing such measures will require close coordination between developers and governments.


title: Optimal Transport Aggregation for Visual Place Recognition

abstract: The task of Visual Place Recognition (VPR) aims to match a query image against references from an extensive database of images from different places, relying solely on visual cues. State-of-the-art pipelines focus on the aggregation of features extracted from a deep backbone, in order to form a global descriptor for each image. In this context, we introduce SALAD (Sinkhorn Algorithm for Locally Aggregated Descriptors), which reformulates NetVLAD's soft-assignment of local features to clusters as an optimal transport problem. In SALAD, we consider both feature-to-cluster and cluster-to-feature relations and we also introduce a 'dustbin' cluster, designed to selectively discard features deemed non-informative, enhancing the overall descriptor quality. Additionally, we leverage and fine-tune DINOv2 as a backbone, which provides enhanced description power for the local features, and dramatically reduces the required training time. As a result, our single-stage method not only surpasses single-stage baselines in public VPR datasets, but also surpasses two-stage methods that add a re-ranking with significantly higher cost. Code and models are available at https://github.com/serizba/salad.


title: On Dynamics and Thermodynamics of Moving Media

abstract: In this paper recent results regarding generalized continuum mechanics on oriented Riemannian manifolds are reviewed and summarized. The mass, the momentum and the energy conservation laws are given. Thermodynamics arising in such media is also considered as a Lagrangian manifold endowed with a Riemannian structure. Thermodynamic model of moving media takes into account deformation and stress arising in a media in motion.


title: Unleashing the Power of Prompt-driven Nucleus Instance Segmentation

abstract: Nucleus instance segmentation in histology images is crucial for a broad spectrum of clinical applications. Current dominant algorithms rely on regression of nuclear proxy maps. Distinguishing nucleus instances from the estimated maps requires carefully curated post-processing, which is error-prone and parameter-sensitive. Recently, the Segment Anything Model (SAM) has earned huge attention in medical image segmentation, owing to its impressive generalization ability and promptable property. Nevertheless, its potential on nucleus instance segmentation remains largely underexplored. In this paper, we present a novel prompt-driven framework that consists of a nucleus prompter and SAM for automatic nucleus instance segmentation. Specifically, the prompter learns to generate a unique point prompt for each nucleus while the SAM is fine-tuned to output the corresponding mask for the prompted nucleus. Furthermore, we propose the inclusion of adjacent nuclei as negative prompts to enhance the model's capability to identify overlapping nuclei. Without complicated post-processing, our proposed method sets a new state-of-the-art performance on three challenging benchmarks. Code is available at \url{github.com/windygoo/PromptNucSeg}


title: Physics-informed neural networks for transformed geometries and manifolds

abstract: Physics-informed neural networks (PINNs) effectively embed physical principles into machine learning, but often struggle with complex or alternating geometries. We propose a novel method for integrating geometric transformations within PINNs to robustly accommodate geometric variations. Our method incorporates a diffeomorphism as a mapping of a reference domain and adapts the derivative computation of the physics-informed loss function. This generalizes the applicability of PINNs not only to smoothly deformed domains, but also to lower-dimensional manifolds and allows for direct shape optimization while training the network. We demonstrate the effectivity of our approach on several problems: (i) Eikonal equation on Archimedean spiral, (ii) Poisson problem on surface manifold, (iii) Incompressible Stokes flow in deformed tube, and (iv) Shape optimization with Laplace operator. Through these examples, we demonstrate the enhanced flexibility over traditional PINNs, especially under geometric variations. The proposed framework presents an outlook for training deep neural operators over parametrized geometries, paving the way for advanced modeling with PDEs on complex geometries in science and engineering.


title: Tell2Design: A Dataset for Language-Guided Floor Plan Generation

abstract: We consider the task of generating designs directly from natural language descriptions, and consider floor plan generation as the initial research area. Language conditional generative models have recently been very successful in generating high-quality artistic images. However, designs must satisfy different constraints that are not present in generating artistic images, particularly spatial and relational constraints. We make multiple contributions to initiate research on this task. First, we introduce a novel dataset, \textit{Tell2Design} (T2D), which contains more than $80k$ floor plan designs associated with natural language instructions. Second, we propose a Sequence-to-Sequence model that can serve as a strong baseline for future research. Third, we benchmark this task with several text-conditional image generation models. We conclude by conducting human evaluations on the generated samples and providing an analysis of human performance. We hope our contributions will propel the research on language-guided design generation forward.


title: Individual Nanostructures in an Epsilon-Near-Zero Material Probed with 3D-Sculpted Light

abstract: Epsilon-near-zero (ENZ) materials, i.e., materials with vanishing real part of the permittivity, have become an increasingly desirable platform for exploring linear and nonlinear optical phenomena in nanophotonic and on-chip environments. ENZ materials inherently enhance electric fields for properly chosen interaction scenarios, host extreme nonlinear optical effects, and lead to other intriguing phenomena. To date, studies in the optical domain mainly focused on nanoscopically thin films of ENZ materials and their interaction with light and other nanostructured materials. Here, the optical response of individual nanostructures milled into an ENZ material are explored both experimentally and numerically. For the study, 3D structured light beams are employed, allowing for the full utilization of polarization-dependent field enhancements enabled by a tailored illumination and a vanishing permittivity. This study reveals the underlying intricate interaction mechanisms and showcase the polarization-dependent controllability, paving the way towards experiments in the nonlinear optical regime where the presented effects will enable polarization-controlled nonlinear refractive index based ultra-fast switching on the single nanostructure level.


title: Collinear laser spectroscopy of highly charged ions produced with an electron beam ion source

abstract: Collinear laser spectroscopy has been performed on He-like C$^{4+}$ ions extracted from an electron beam ion source (EBIS). In order to determine the transition frequency with the highest-possible accuracy, the lineshape of the fluorescence response function was studied for pulsed and continuous ion extraction modes of the EBIS in order to optimize its symmetry and linewidth. We found that the best signal-to-noise ratio is obtained using the continuous beam mode for ion extraction. Applying frequency-comb-referenced collinear and anticollinear laser spectroscopy, we achieved a measurement accuracy of better than 2\,MHz including statistical and systematic uncertainties. The origin and size of systematic uncertainties, as well as further applications for other isotopes and elements are discussed.


title: Relativistic periastron advance beyond Einstein theory: analytical solution with applications

abstract: We find a new solution to calculate the orbital periastron advance of a test body subject to a central gravitational force field, for relativistic theories and models beyond Einstein. This analitycal formula has general validity that includes all the post-Newtonian (PN) contributions to the dynamics and is useful for high-precision gravitational tests. The solution is directly applicable to corrective potentials of various forms, without the need for numerical integration. Later, we apply it to the Scalar Tensor Fourth Order Gravity (STFOG) and NonCommutative Geometry, providing corrections to the Newtonian potential of Yukawa-like form $V(r)=\alpha \frac{e^{-\beta r}}{r}$, and we conduct the first analysis involving all the PN terms for these theories. The same work is performed with a Schwarzschild geometry perturbed by a Quintessence Field, leading to a power-law potential $V(r)=\alpha_q {r}^q$. Finally, by using astrometric data of the Solar System planetary precessions and those of S2 star around Sgr A*, we infer new theoretical constraints and improvements in the bounds for $\beta$. The resulting simulated orbits turn out to be compatible with General Relativity.


title: Over-Squashing in Riemannian Graph Neural Networks

abstract: Most graph neural networks (GNNs) are prone to the phenomenon of over-squashing in which node features become insensitive to information from distant nodes in the graph. Recent works have shown that the topology of the graph has the greatest impact on over-squashing, suggesting graph rewiring approaches as a suitable solution. In this work, we explore whether over-squashing can be mitigated through the embedding space of the GNN. In particular, we consider the generalization of Hyperbolic GNNs (HGNNs) to Riemannian manifolds of variable curvature in which the geometry of the embedding space is faithful to the graph's topology. We derive bounds on the sensitivity of the node features in these Riemannian GNNs as the number of layers increases, which yield promising theoretical and empirical results for alleviating over-squashing in graphs with negative curvature.


title: Leveraging deep active learning to identify low-resource mobility functioning information in public clinical notes

abstract: Function is increasingly recognized as an important indicator of whole-person health, although it receives little attention in clinical natural language processing research. We introduce the first public annotated dataset specifically on the Mobility domain of the International Classification of Functioning, Disability and Health (ICF), aiming to facilitate automatic extraction and analysis of functioning information from free-text clinical notes. We utilize the National NLP Clinical Challenges (n2c2) research dataset to construct a pool of candidate sentences using keyword expansion. Our active learning approach, using query-by-committee sampling weighted by density representativeness, selects informative sentences for human annotation. We train BERT and CRF models, and use predictions from these models to guide the selection of new sentences for subsequent annotation iterations. Our final dataset consists of 4,265 sentences with a total of 11,784 entities, including 5,511 Action entities, 5,328 Mobility entities, 306 Assistance entities, and 639 Quantification entities. The inter-annotator agreement (IAA), averaged over all entity types, is 0.72 for exact matching and 0.91 for partial matching. We also train and evaluate common BERT models and state-of-the-art Nested NER models. The best F1 scores are 0.84 for Action, 0.7 for Mobility, 0.62 for Assistance, and 0.71 for Quantification. Empirical results demonstrate promising potential of NER models to accurately extract mobility functioning information from clinical text. The public availability of our annotated dataset will facilitate further research to comprehensively capture functioning information in electronic health records (EHRs).


title: GloNets: Globally Connected Neural Networks

abstract: Deep learning architectures suffer from depth-related performance degradation, limiting the effective depth of neural networks. Approaches like ResNet are able to mitigate this, but they do not completely eliminate the problem. We introduce Globally Connected Neural Networks (GloNet), a novel architecture overcoming depth-related issues, designed to be superimposed on any model, enhancing its depth without increasing complexity or reducing performance. With GloNet, the network's head uniformly receives information from all parts of the network, regardless of their level of abstraction. This enables GloNet to self-regulate information flow during training, reducing the influence of less effective deeper layers, and allowing for stable training irrespective of network depth. This paper details GloNet's design, its theoretical basis, and a comparison with existing similar architectures. Experiments show GloNet's self-regulation ability and resilience to depth-related learning challenges, like performance degradation. Our findings suggest GloNet as a strong alternative to traditional architectures like ResNets.


title: A First Look with JWST Aperture Masking Interferometry (AMI): Resolving Circumstellar Dust around the Wolf-Rayet Binary WR 137 beyond the Rayleigh Limit

abstract: We present infrared aperture masking interferometry (AMI) observations of newly formed dust from the colliding winds of the massive binary system Wolf-Rayet (WR) 137 with JWST using the Near Infrared Imager and Slitless Spectrograph (NIRISS). NIRISS AMI observations of WR 137 and a point-spread-function calibrator star, HD~228337, were taken using the F380M and F480M filters in 2022 July and August as part of the Director's Discretionary Early Release Science (DD-ERS) program 1349. Interferometric observables (squared visibilities and closure phases) from the WR 137 "interferogram" were extracted and calibrated using three independent software tools: ImPlaneIA, AMICAL, and SAMpip. The analysis of the calibrated observables yielded consistent values except for slightly discrepant closure phases measured by ImPlaneIA. Based on all three sets of calibrated observables, images were reconstructed using three independent software tools: BSMEM, IRBis, and SQUEEZE. All reconstructed image combinations generated consistent images in both F380M and F480M filters. The reconstructed images of WR 137 reveal a bright central core with a $\sim300$ mas linear filament extending to the northwest. A geometric colliding-wind model with dust production constrained to the orbital plane of the binary system and enhanced as the system approaches periapsis provided a general agreement with the interferometric observables and reconstructed images. Based on a colliding-wind dust condensation analysis, we suggest that dust formation within the orbital plane of WR 137 is induced by enhanced equatorial mass-loss from the rapidly rotating O9 companion star, whose axis of rotation is aligned with that of the orbit.


title: Improving the Time Resolution of Large-Area LaBr3:Ce Detectors with SiPM Array Readout

abstract: LaBr3:Ce crystals have good scintillation properties for X-ray spectroscopy. Initially, they were introduced for radiation imaging in medical physics with either a photomultiplier or SiPM readout, and they found extensive applications in homeland security and gamma-ray astronomy. We used 1 inch round LaBr3:Ce crystals to realize compact detectors with the SiPM array readout. The aim was a good energy resolution and a fast time response to detect low-energy X-rays around 100 keV. A natural application was found inside the FAMU experiment, at RIKEN RAL. Its aim is a precise measurement of the proton Zemach radius with impinging muons, to contribute to the solution to the so-called proton radius puzzle. Signals to be detected are characteristic X-rays around 130 KeV. A limit for this type of detector, as compared to the ones with a photomultiplier readout, is its poorer timing characteristics due to the large capacity of the SiPM arrays used. In particular, long signal falltimes are a problem in experiments such as FAMU, where a prompt background component must be separated from a delayed one (after 600 ns) in the signal X-rays to be detected. Dedicated studies were pursued to improve the timing characteristics of the used detectors, starting from hybrid ganging of SiPM cells; then developing a suitable zero pole circuit with a parallel ganging, where an increased overvoltage for the SiPM array was used to compensate for the signal decrease; and finally designing ad hoc electronics to split the 1 inch detector SiPM array into four quadrants, thus reducing the involved capacitances. The aim was to improve the detectors timing characteristics, especially falltime, while keeping a good FWHM energy resolution for low-energy X-ray detection.


title: Auto-CsiNet: Scenario-customized Automatic Neural Network Architecture Generation for Massive MIMO CSI Feedback

abstract: Deep learning has revolutionized the design of the channel state information (CSI) feedback module in wireless communications. However, designing the optimal neural network (NN) architecture for CSI feedback can be a laborious and time-consuming process. Manual design can be prohibitively expensive for customizing NNs to different scenarios. This paper proposes using neural architecture search (NAS) to automate the generation of scenario-customized CSI feedback NN architectures, thereby maximizing the potential of deep learning in exclusive environments. By employing automated machine learning and gradient-descent-based NAS, an efficient and cost-effective architecture design process is achieved. The proposed approach leverages implicit scene knowledge, integrating it into the scenario customization process in a data-driven manner, and fully exploits the potential of deep learning for each specific scenario. To address the issue of excessive search, early stopping and elastic selection mechanisms are employed, enhancing the efficiency of the proposed scheme. The experimental results demonstrate that the automatically generated architecture, known as Auto-CsiNet, outperforms manually-designed models in both reconstruction performance (achieving approximately a 14% improvement) and complexity (reducing it by approximately 50%). Furthermore, the paper analyzes the impact of the scenario on the NN architecture and its capacity.


title: Replay across Experiments: A Natural Extension of Off-Policy RL

abstract: Replaying data is a principal mechanism underlying the stability and data efficiency of off-policy reinforcement learning (RL). We present an effective yet simple framework to extend the use of replays across multiple experiments, minimally adapting the RL workflow for sizeable improvements in controller performance and research iteration times. At its core, Replay Across Experiments (RaE) involves reusing experience from previous experiments to improve exploration and bootstrap learning while reducing required changes to a minimum in comparison to prior work. We empirically show benefits across a number of RL algorithms and challenging control domains spanning both locomotion and manipulation, including hard exploration tasks from egocentric vision. Through comprehensive ablations, we demonstrate robustness to the quality and amount of data available and various hyperparameter choices. Finally, we discuss how our approach can be applied more broadly across research life cycles and can increase resilience by reloading data across random seeds or hyperparameter variations.


title: Robust Conditional Wald Inference for Over-Identified IV

abstract: For the over-identified linear instrumental variables model, researchers commonly report the 2SLS estimate along with the robust standard error and seek to conduct inference with these quantities. If errors are homoskedastic, one can control the degree of inferential distortion using the first-stage F critical values from Stock and Yogo (2005), or use the robust-to-weak instruments Conditional Wald critical values of Moreira (2003). If errors are non-homoskedastic, these methods do not apply. We derive the generalization of Conditional Wald critical values that is robust to non-homoskedastic errors (e.g., heteroskedasticity or clustered variance structures), which can also be applied to nonlinear weakly-identified models (e.g. weakly-identified GMM).


title: Fairness in Graph-Theoretical Optimization Problems

abstract: There is arbitrariness in optimum solutions of graph-theoretic problems that can give rise to unfairness. Incorporating fairness in such problems, however, can be done in multiple ways. For instance, fairness can be defined on an individual level, for individual vertices or edges of a given graph, or on a group level. In this work, we analyze in detail two individual-fairness measures that are based on finding a probability distribution over the set of solutions. One measure guarantees uniform fairness, i.e., entities have equal chance of being part of the solution when sampling from this probability distribution. The other measure maximizes the minimum probability for every entity of being selected in a solution. In particular, we reveal that computing these individual-fairness measures is in fact equivalent to computing the fractional covering number and the fractional partitioning number of a hypergraph. In addition, we show that for a general class of problems that we classify as independence systems, these two measures coincide. We also analyze group fairness and how this can be combined with the individual-fairness measures. Finally, we establish the computational complexity of determining group-fair solutions for matching.


title: A Quantitative Approach to Understand Self-Supervised Models as Cross-lingual Feature Extractors

abstract: In this work, we study the features extracted by English self-supervised learning (SSL) models in cross-lingual contexts and propose a new metric to predict the quality of feature representations. Using automatic speech recognition (ASR) as a downstream task, we analyze the effect of model size, training objectives, and model architecture on the models' performance as a feature extractor for a set of topologically diverse corpora. We develop a novel metric, the Phonetic-Syntax Ratio (PSR), to measure the phonetic and synthetic information in the extracted representations using deep generalized canonical correlation analysis. Results show the contrastive loss in the wav2vec2.0 objective facilitates more effective cross-lingual feature extraction. There is a positive correlation between PSR scores and ASR performance, suggesting that phonetic information extracted by monolingual SSL models can be used for downstream tasks in cross-lingual settings. The proposed metric is an effective indicator of the quality of the representations and can be useful for model selection.


title: Faster Bayesian inference with neural network bundles and new results for $f(R)$ models

abstract: In the last few years, there has been significant progress in the development of machine learning methods tailored to astrophysics and cosmology. We have recently applied one of these, namely, the neural network bundle method, to the cosmological scenario. Moreover, we showed that in some cases the computational times of the Bayesian inference process can be reduced. In this paper, we present an improvement to the neural network bundle method that results in a significant reduction of the computational times of the statistical analysis. The novel aspect consists of the use of the neural network bundle method to calculate the luminosity distance of type Ia supernovae, which is usually computed through an integral with numerical methods. In this work, we have applied this improvement to the Hu-Sawicki and Starobinsky $f(R)$ models. We also performed a statistical analysis with data from type Ia supernovae of the Pantheon+ compilation and cosmic chronometers. Another original aspect of this work is the different treatment we provide for the absolute magnitude of type Ia supernovae during the inference process, which results in different estimates of the distortion parameter than the ones obtained in the literature. We show that the statistical analyses carried out with our new method require lower computational times than the ones performed with both the numerical and the neural network method from our previous work. This reduction in time is more significant in the case of a difficult computational problem such as the ones addressed in this work.


title: Combination of searches for resonant Higgs boson pair production using $pp$ collisions at $\sqrt{s}=13$ TeV with the ATLAS detector

abstract: A combination of searches for a new resonance decaying into a Higgs boson pair is presented, using up to 139 fb$^{-1}$ of $pp$ collision data at $\sqrt{s}=13$ TeV recorded with the ATLAS detector at the LHC. The combination includes searches performed in three decay channels: $b\bar{b}b\bar{b}$, $b\bar{b}\tau^+\tau^-$ and $b\bar{b}\gamma\gamma$. No excess above the expected Standard Model background is observed and upper limits are set at the 95% confidence level on the production cross section of Higgs boson pairs originating from the decay of a narrow scalar resonance with mass in the range 251 GeV-5 TeV. The observed (expected) limits are in the range 0.96-600 fb (1.2-390 fb). The limits are interpreted in the Type-I Two-Higgs-Doublet Model and the Minimimal Supersymmetric Standard Model, and constrain parameter space not previously excluded by other searches.


title: Interaction of surface acoustic waves and magnetic thin films

abstract: Surface acoustic waves (SAWs) have emerged as innovative and energy-efficient means to manipulate domain walls (DWs) and skyrmions in thin films with perpendicular magnetic anisotropy (PMA) owing to the magnetoelastic coupling effect. This thesis focuses on the complex interplay between SAWs and magnetic thin films. The effects of the standing SAWs on the magnetisation dynamics in a Ta/Pt/Co/Ir/Ta thin film with PMA were first investigated. SAWs with frequency of 93.35 MHz significantly reduced the coercivity of the thin film by 21% and enhanced the magnetisation reversal speed by 11-fold. Standing SAWs introduce a dynamic energy landscape with a unique spatial distribution, forming striped domain patterns in the thin film. The use of rf signals for generating SAWs inevitably causes a heating effect in the device. This heating effect was examined in situ in a SAW device featuring a Ta/Pt/Co/Ta thin film with PMA using an on-chip platinum thermometer. The temperature increased by 10 K in the presence of SAWs at centre frequency of 48 MHz. The DW velocity was significantly enhanced in the presence of the standing SAWs by a factor of 4 compared to that with temperature change alone owing to the magnetoelastic coupling effect. To understand the SAW-enhanced DW motion, comprehensive micromagnetic simulations were performed on thin films in the presence of travelling SAWs. The findings highlighted that SAW-induced vertical Bloch lines within DWs can simultaneously boost DW depinning and dissipate energy at the DW via spin rotation. The SAW-induced strain gradient can be exploited to control skyrmion motion in a current-free manner. Micromagnetic simulations revealed that the use of orthogonal SAWs, combining horizontal travelling and vertical standing waves, offered a promising approach to direct skyrmion motion along desired trajectories, avoiding undesirable Hall-like motion.


title: Toward a M{\o}lmer S{\o}rensen Gate With .9999 Fidelity

abstract: Realistic fault-tolerant quantum computing at reasonable overhead requires two-qubit gates with the highest possible fidelity. Typically, an infidelity of $\lesssim 10^{-4}$ is recommended in the literature. Focusing on the phase-sensitive architecture used in laboratories and by commercial companies to implement quantum computers, we show that even under noise-free, ideal conditions, neglecting the carrier term and linearizing the Lamb-Dicke term in the Hamiltonian used for control-pulse construction for generating M{\o}lmer-S{\o}rensen XX gates based on the Raman scheme are not justified if the goal is an infidelity target of $10^{-4}$. We obtain these results with a gate simulator code that, in addition to the computational space, explicitly takes the most relevant part of the phonon space into account. With the help of a Magnus expansion carried to the third order, keeping terms up to the fourth order in the Lamb-Dicke parameters, we identify the leading sources of coherent errors, which we show can be eliminated by adding a single linear equation to the phase-space closure conditions and subsequently adjusting the amplitude of the control pulse (calibration). This way, we obtain XX gates with infidelities $< 10^{-4}$.


title: CheapNET: Improving Light-weight speech enhancement network by projected loss function

abstract: Noise suppression and echo cancellation are critical in speech enhancement and essential for smart devices and real-time communication. Deployed in voice processing front-ends and edge devices, these algorithms must ensure efficient real-time inference with low computational demands. Traditional edge-based noise suppression often uses MSE-based amplitude spectrum mask training, but this approach has limitations. We introduce a novel projection loss function, diverging from MSE, to enhance noise suppression. This method uses projection techniques to isolate key audio components from noise, significantly improving model performance. For echo cancellation, the function enables direct predictions on LAEC pre-processed outputs, substantially enhancing performance. Our noise suppression model achieves near state-of-the-art results with only 3.1M parameters and 0.4GFlops/s computational load. Moreover, our echo cancellation model outperforms replicated industry-leading models, introducing a new perspective in speech enhancement.


title: Program Machine Policy: Addressing Long-Horizon Tasks by Integrating Program Synthesis and State Machines

abstract: Deep reinforcement learning (deep RL) excels in various domains but lacks generalizability and interpretability. On the other hand, programmatic RL methods (Trivedi et al., 2021; Liu et al., 2023) reformulate RL tasks as synthesizing interpretable programs that can be executed in the environments. Despite encouraging results, these methods are limited to short-horizon tasks. On the other hand, representing RL policies using state machines (Inala et al., 2020) can inductively generalize to long-horizon tasks; however, it struggles to scale up to acquire diverse and complex behaviors. This work proposes the Program Machine Policy (POMP), which bridges the advantages of programmatic RL and state machine policies, allowing for the representation of complex behaviors and the address of long-term tasks. Specifically, we introduce a method that can retrieve a set of effective, diverse, and compatible programs. Then, we use these programs as modes of a state machine and learn a transition function to transition among mode programs, allowing for capturing repetitive behaviors. Our proposed framework outperforms programmatic RL and deep RL baselines on various tasks and demonstrates the ability to inductively generalize to even longer horizons without any fine-tuning. Ablation studies justify the effectiveness of our proposed search algorithm for retrieving a set of programs as modes.


title: Maximum Likelihood Estimation is All You Need for Well-Specified Covariate Shift

abstract: A key challenge of modern machine learning systems is to achieve Out-of-Distribution (OOD) generalization -- generalizing to target data whose distribution differs from that of source data. Despite its significant importance, the fundamental question of ``what are the most effective algorithms for OOD generalization'' remains open even under the standard setting of covariate shift. This paper addresses this fundamental question by proving that, surprisingly, classical Maximum Likelihood Estimation (MLE) purely using source data (without any modification) achieves the minimax optimality for covariate shift under the well-specified setting. That is, no algorithm performs better than MLE in this setting (up to a constant factor), justifying MLE is all you need. Our result holds for a very rich class of parametric models, and does not require any boundedness condition on the density ratio. We illustrate the wide applicability of our framework by instantiating it to three concrete examples -- linear regression, logistic regression, and phase retrieval. This paper further complement the study by proving that, under the misspecified setting, MLE is no longer the optimal choice, whereas Maximum Weighted Likelihood Estimator (MWLE) emerges as minimax optimal in certain scenarios.


title: Uncertainty Quantification of Set-Membership Estimation in Control and Perception: Revisiting the Minimum Enclosing Ellipsoid

abstract: Set-membership estimation (SME) outputs a set estimator that guarantees to cover the groundtruth. Such sets are, however, defined by (many) abstract (and potentially nonconvex) constraints and therefore difficult to manipulate. We present tractable algorithms to compute simple and tight overapproximations of SME in the form of minimum enclosing ellipsoids (MEE). We first introduce the hierarchy of enclosing ellipsoids proposed by Nie and Demmel (2005), based on sums-of-squares relaxations, that asymptotically converge to the MEE of a basic semialgebraic set. This framework, however, struggles in modern control and perception problems due to computational challenges. We contribute three computational enhancements to make this framework practical, namely constraints pruning, generalized relaxed Chebyshev center, and handling non-Euclidean geometry. We showcase numerical examples on system identification and object pose estimation.


title: From Pixels to Titles: Video Game Identification by Screenshots using Convolutional Neural Networks

abstract: This paper investigates video game identification through single screenshots, utilizing five convolutional neural network (CNN) architectures (MobileNet, DenseNet, EfficientNetB0, EfficientNetB2, and EfficientNetB3) across 22 home console systems, spanning from Atari 2600 to PlayStation 5, totalling 8,796 games and 170,881 screenshots. Confirming the hypothesis, CNNs autonomously extract image features, enabling the identification of game titles from screenshots without additional features. Using ImageNet pre-trained weights as initial weights, EfficientNetB3 achieves the highest average accuracy (74.51%), while DenseNet169 excels in 14 of the 22 systems. Employing alternative initial weights trained in an arcade screenshots dataset boosts accuracy for EfficientNetB2 and EfficientNetB3, with the latter reaching a peak accuracy of 76.36% and demonstrating reduced convergence epochs from 23.7 to 20.5 on average. Overall, the combination of optimal architecture and weights attains 77.67% accuracy, primarily led by EfficientNetB3 in 19 systems. These findings underscore the efficacy of CNNs in video game identification through screenshots.


title: Efficient Pre-training for Localized Instruction Generation of Videos

abstract: Procedural videos, exemplified by recipe demonstrations, are instrumental in conveying step-by-step instructions. However, understanding such videos is challenging as it involves the precise localization of steps and the generation of textual instructions. Manually annotating steps and writing instructions is costly, which limits the size of current datasets and hinders effective learning. Leveraging large but noisy video-transcript datasets for pre-training can boost performance but demands significant computational resources. Furthermore, transcripts contain irrelevant content and differ in style from human-written instructions. To mitigate these issues, we propose a novel technique, Sieve-&-Swap, to automatically generate high quality training data for the recipe domain: (i) Sieve filters irrelevant transcripts and (ii) Swap acquires high quality text by replacing transcripts with human-written instruction from a text-only recipe dataset. The resulting dataset is three orders of magnitude smaller than current web-scale datasets but enables efficient training of large-scale models. Alongside Sieve-&-Swap, we propose Procedure Transformer (ProcX), a model for end-to-end step localization and instruction generation for procedural videos. When pre-trained on our curated dataset, this model achieves state-of-the-art performance on YouCook2 and Tasty while using a fraction of the training data. Our code and dataset will be publicly released.


title: FALCON: Fairness Learning via Contrastive Attention Approach to Continual Semantic Scene Understanding

abstract: Continual Learning in semantic scene segmentation aims to continually learn new unseen classes in dynamic environments while maintaining previously learned knowledge. Prior studies focused on modeling the catastrophic forgetting and background shift challenges in continual learning. However, fairness, another major challenge that causes unfair predictions leading to low performance among major and minor classes, still needs to be well addressed. In addition, prior methods have yet to model the unknown classes well, thus resulting in producing non-discriminative features among unknown classes. This paper presents a novel Fairness Learning via Contrastive Attention Approach to continual learning in semantic scene understanding. In particular, we first introduce a new Fairness Contrastive Clustering loss to address the problems of catastrophic forgetting and fairness. Then, we propose an attention-based visual grammar approach to effectively model the background shift problem and unknown classes, producing better feature representations for different unknown classes. Through our experiments, our proposed approach achieves State-of-the-Art (SOTA) performance on different continual learning benchmarks, i.e., ADE20K, Cityscapes, and Pascal VOC. It promotes the fairness of the continual semantic segmentation model.


title: Towards Transfer Learning for Large-Scale Image Classification Using Annealing-based Quantum Boltzmann Machines

abstract: Quantum Transfer Learning (QTL) recently gained popularity as a hybrid quantum-classical approach for image classification tasks by efficiently combining the feature extraction capabilities of large Convolutional Neural Networks with the potential benefits of Quantum Machine Learning (QML). Existing approaches, however, only utilize gate-based Variational Quantum Circuits for the quantum part of these procedures. In this work we present an approach to employ Quantum Annealing (QA) in QTL-based image classification. Specifically, we propose using annealing-based Quantum Boltzmann Machines as part of a hybrid quantum-classical pipeline to learn the classification of real-world, large-scale data such as medical images through supervised training. We demonstrate our approach by applying it to the three-class COVID-CT-MD dataset, a collection of lung Computed Tomography (CT) scan slices. Using Simulated Annealing as a stand-in for actual QA, we compare our method to classical transfer learning, using a neural network of the same order of magnitude, to display its improved classification performance. We find that our approach consistently outperforms its classical baseline in terms of test accuracy and AUC-ROC-Score and needs less training epochs to do this.


title: Anti-Gauss cubature rules with applications to Fredholm integral equations on the square

abstract: The purpose of this paper is to develop the anti-Gauss cubature rule for approximating integrals defined on the square whose integrand function may have algebraic singularities at the boundaries. An application of such a rule to the numerical solution of second-kind Fredholm integral equations is also explored. The stability, convergence, and conditioning of the proposed Nystr\"om-type method are studied. The numerical solution of the resulting dense linear system is also investigated and several numerical tests are presented.


title: Effects of hyperon potentials and symmetry energy in quark deconfinement

abstract: In this letter we discuss how the results of recent nuclear experiments that correspond to measurements at low densities can affect the equation of state at large densities and temperatures, changing the particle composition and ultimately influencing deconfinement to quark matter. In particular, saturation values of the hyperon potentials affect the hyperon content, while the symmetry energy at saturation directly regulates how the stiffness of the equation of state changes with isospin. We make use of a chiral model that describes nucleons, hyperons, and quarks to show how astrophysical conditions, such as the ones in neutron stars, present the ideal ground to study the effects of these two quantities in dense matter. In this case, for small charge fraction/ large isospin asymmetry, the couplings that reproduce different symmetry energy slopes can significantly modify deconfinement, with quantitative changes in the critical chemical potential depending on the deconfining potential. On the other hand, different values of the parameter that controls the hyperon potentials (kept within a range close to experimental data) do not affect deconfinement significantly.


title: Cavity optomechanics in ultrastrong light matter coupling regime: Self-alignment and collective rotation mediated by Casimir torque

abstract: We theoretically consider an ensemble of quantum dimers placed inside an optical cavity. We predict two effects: first, an exchange of angular momentum between the dimers mediated by the emission and re-absorption of the cavity photons leads to the alignment of dimers. Furthermore, the optical angular momentum of the vacuum state of the chiral cavity is transferred to the ensemble of dimers which leads to the synchronous rotation of the dimers at certain levels of light-matter coupling strength.


title: High-fidelity spin qubit shuttling via large spin-orbit interaction

abstract: Shuttling spins with high fidelity is a key requirement to scale up semiconducting quantum computers, enabling qubit entanglement over large distances and favoring the integration of control electronics on-chip. To decouple the spin from the unavoidable charge noise, state-of-the-art spin shuttlers try to minimize the inhomogeneity of the Zeeman field. However, this decoupling is challenging in otherwise promising quantum computing platforms such as hole spin qubits in silicon and germanium, characterized by a large spin-orbit interaction and electrically-tunable qubit frequency. In this work, we show that, surprisingly, the large inhomogeneity of the Zeeman field stabilizes the coherence of a moving spin state, thus enabling high-fidelity shuttling also in these systems. We relate this enhancement in fidelity to the deterministic dynamics of the spin which filters out the dominant low-frequency contributions of the charge noise. By simulating several different scenarios and noise sources, we show that this is a robust phenomenon generally occurring at large field inhomogeneity. By appropriately adjusting the motion of the quantum dot, we also design realistic protocols enabling faster and more coherent spin shuttling. Our findings are generally applicable to a wide range of setups and could pave the way toward large-scale quantum processors.


title: Supply Chain Due Diligence Risk Assessment for the EU: A Network Approach to estimate expected effectiveness of the planned EU directive

abstract: Globalization has had undesirable effects on the labor standards embedded in the products we consume. This paper proposes an ex-ante evaluation of supply chain due diligence regulations, such as the EU Corporate Sustainable Due Diligence Directive (CSDDD). We construct a full-scale network model derived from structural business statistics of 30 million EU firms to quantify the likelihood of links to firms potentially involved in human rights abuses in the European supply chain. The 900 million supply links of these firms are modeled in a way that is consistent with multiregional input-output data, EU import data, and stylized facts of firm-level production networks. We find that this network exhibits a small world effect with three degrees of separation, meaning that most firms are no more than three steps away from each other in the network. Consequently we find that about 8.5% of EU companies are at risk of having child or forced labor in the first tier of their supply chains, about 82.4% are likely to have such offenders at the second tier and more than 99.1% have such offenders at the third tier. We also profile companies by country, sector, and size for the likelihood of having human rights violations or child and forced labor violations at a given tier in their supply chain, revealing considerable heterogeneity across EU companies. Our results show that supply chain due diligence regulations that focus on monitoring individual buyer-supplier links, as currently proposed in the CSDDD, are likely to be ineffective due to a high degree of redundancy and the fact that individual company value chains cannot be properly isolated from the global supply network. Rather, to maximize cost-effectiveness without compromising due diligence coverage, we suggest that regulations should focus on monitoring individual suppliers.


title: Optically Induced Monopoles, Knots, and Skyrmions in Quantum Gases

abstract: We propose, and theoretically analyze, a practical protocol for the creation of topological monopole configurations, quantum knots, and skyrmions in Bose--Einstein condensates by employing fictitious magnetic fields induced by the interaction of the atomic cloud with coherent light fields. It is observed that a single coherent field is not enough for this purpose, but instead we find incoherent superpositions of several coherent fields that introduce topological point charges. We numerically estimate the experimentally achievable strengths and gradients of the induced fictitious magnetic fields and find them to be adjustable at will to several orders of magnitude greater than those of the physical magnetic fields employed in previous experimental studies. This property together with ultrafast control of the optical fields paves the way for advanced engineering of topological defects in quantum gases.


title: Quantum simulation of entanglement dynamics in a quantum processor

abstract: We implement a five-qubit protocol in IBM quantum processors to get entanglement dynamics in a two qubit system in the presence of an environment. Specifically, two qubits represent the main system, another two qubits the environment, and an additional qubit is used as an auxiliary qubit to perform the quantum entanglement estimation. We focus on measuring, in this superconducting quantum processor, the sudden death and sudden birth of entanglement. We obtain the quantum entanglement evolution of the main system qubits and the environment qubits as the average of $N=10$ independent experiments in the same quantum device, observing that the noisy nature of current quantum processors produce a shift on times signaling sudden death o sudden birth of entanglement. This work takes relevance showing the usefulness of current noisy quantum devices to test fundamental concepts in quantum information.


title: Adaptive Agents and Data Quality in Agent-Based Financial Markets

abstract: We present our Agent-Based Market Microstructure Simulation (ABMMS), an Agent-Based Financial Market (ABFM) that captures much of the complexity present in the US National Market System for equities (NMS). Agent-Based models are a natural choice for understanding financial markets. Financial markets feature a constrained action space that should simplify model creation, produce a wealth of data that should aid model validation, and a successful ABFM could strongly impact system design and policy development processes. Despite these advantages, ABFMs have largely remained an academic novelty. We hypothesize that two factors limit the usefulness of ABFMs. First, many ABFMs fail to capture relevant microstructure mechanisms, leading to differences in the mechanics of trading. Second, the simple agents that commonly populate ABFMs do not display the breadth of behaviors observed in human traders or the trading systems that they create. We investigate these issues through the development of ABMMS, which features a fragmented market structure, communication infrastructure with propagation delays, realistic auction mechanisms, and more. As a baseline, we populate ABMMS with simple trading agents and investigate properties of the generated data. We then compare the baseline with experimental conditions that explore the impacts of market topology or meta-reinforcement learning agents. The combination of detailed market mechanisms and adaptive agents leads to models whose generated data more accurately reproduce stylized facts observed in actual markets. These improvements increase the utility of ABFMs as tools to inform design and policy decisions.


title: Insurance pricing for breast cancer under different multiple state models

abstract: In this paper we consider pricing of insurance contracts for breast cancer risk based on three multiple state models. Using population data in England and data from the medical literature, we calibrate a collection of semi-Markov and Markov models. Considering an industry-based Markov model as a baseline model, we demonstrate the strengths of a more detailed model while showing the importance of accounting for duration dependence in transition rates. We quantify age-specific cancer incidence and cancer survival by stage along with type-specific mortality rates based on the semi-Markov model which accounts for unobserved breast cancer cases and progression through breast cancer stages. Using the developed models, we obtain actuarial net premiums for a specialised critical illness and life insurance product. Our analysis shows that the semi-Markov model leads to results aligned with empirical evidence. Our findings point out the importance of accounting for the time spent with diagnosed or undiagnosed pre-metastatic breast cancer in actuarial applications.


title: A Quantitative Selberg's Lemma

abstract: We show that an arithmetic lattice $\Gamma$ in a semi-simple Lie group $G$ contains a torsion-free subgroup of index $\delta(v)$ where $v = \mu (G/\Gamma)$ is the co-volume of the lattice. We prove that $\delta$ is polynomial in general and poly-logarithmic under GRH. We then show that this poly-logarithmic bound is almost optimal, by constructing certain lattices with torsion elements of order $\sim \frac{\log v}{\log \log v}$.


title: Text2Loc: 3D Point Cloud Localization from Natural Language

abstract: We tackle the problem of 3D point cloud localization based on a few natural linguistic descriptions and introduce a novel neural network, Text2Loc, that fully interprets the semantic relationship between points and text. Text2Loc follows a coarse-to-fine localization pipeline: text-submap global place recognition, followed by fine localization. In global place recognition, relational dynamics among each textual hint are captured in a hierarchical transformer with max-pooling (HTM), whereas a balance between positive and negative pairs is maintained using text-submap contrastive learning. Moreover, we propose a novel matching-free fine localization method to further refine the location predictions, which completely removes the need for complicated text-instance matching and is lighter, faster, and more accurate than previous methods. Extensive experiments show that Text2Loc improves the localization accuracy by up to $2\times$ over the state-of-the-art on the KITTI360Pose dataset. Our project page is publicly available at \url{https://yan-xia.github.io/projects/text2loc/}.


title: IMRPhenomXP_NRTidalv2: An improved frequency-domain precessing binary neutron star waveform model

abstract: We present two new frequency-domain gravitational waveform models for the analysis of signals emitted by binary neutron star coalescences: IMRPhenomXAS_NRTidalv2 and IMRPhenomXP_NRTidalv2. Both models are available through the public algorithm library LALSuite and represent the first extensions of IMRPhenomX models including matter effects. We show here that these two models represent a significant advancement in efficiency and accuracy with respect to their phenomenological predecessors, IMRPhenomD_NRTidalv2 and IMRPhenomPv2_NRTidalv2. The computational efficiency of the new models is achieved through the application of the same multibanding technique previously applied to binary black hole models. Furthermore, IMRPhenomXP_NRTidalv2 implements a more accurate description of the precession dynamics, including double-spin effects and, optionally, matter effects in the twisting-up construction. The latter are available through an option to use a numerical integration of the post-Newtonian precession equations. We show that the new precession descriptions allow the model to better reproduce the phenomenology observed in numerical-relativity simulations of precessing binary neutron stars. Finally, we present some applications of the new models to Bayesian parameter estimation studies, including a reanalysis of GW170817 and a study of simulated observations using numerical relativity waveforms for nonprecessing binary neutron stars with highly spinning components. We find that in these cases the new models make a negligible difference in the results. Nevertheless, by virtue of the aforementioned improvements, the new models represent valuable tools for the study of future detections of coalescing binary neutron stars.


title: Soil Organic Carbon Estimation from Climate-related Features with Graph Neural Network

abstract: Soil organic carbon (SOC) plays a pivotal role in the global carbon cycle, impacting climate dynamics and necessitating accurate estimation for sustainable land and agricultural management. While traditional methods of SOC estimation face resolution and accuracy challenges, recent technological solutions harness remote sensing, machine learning, and high-resolution satellite mapping. Graph Neural Networks (GNNs), especially when integrated with positional encoders, can capture complex relationships between soil and climate. Using the LUCAS database, this study compared four GNN operators in the positional encoder framework. Results revealed that the PESAGE and PETransformer models outperformed others in SOC estimation, indicating their potential in capturing the complex relationship between SOC and climate features. Our findings confirm the feasibility of applications of GNN architectures in SOC prediction, establishing a framework for future explorations of this topic with more advanced GNN models.


title: Direct2.5: Diverse Text-to-3D Generation via Multi-view 2.5D Diffusion

abstract: Recent advances in generative AI have unveiled significant potential for the creation of 3D content. However, current methods either apply a pre-trained 2D diffusion model with the time-consuming score distillation sampling (SDS), or a direct 3D diffusion model trained on limited 3D data losing generation diversity. In this work, we approach the problem by employing a multi-view 2.5D diffusion fine-tuned from a pre-trained 2D diffusion model. The multi-view 2.5D diffusion directly models the structural distribution of 3D data, while still maintaining the strong generalization ability of the original 2D diffusion model, filling the gap between 2D diffusion-based and direct 3D diffusion-based methods for 3D content generation. During inference, multi-view normal maps are generated using the 2.5D diffusion, and a novel differentiable rasterization scheme is introduced to fuse the almost consistent multi-view normal maps into a consistent 3D model. We further design a normal-conditioned multi-view image generation module for fast appearance generation given the 3D geometry. Our method is a one-pass diffusion process and does not require any SDS optimization as post-processing. We demonstrate through extensive experiments that, our direct 2.5D generation with the specially-designed fusion scheme can achieve diverse, mode-seeking-free, and high-fidelity 3D content generation in only 10 seconds. Project page: https://nju-3dv.github.io/projects/direct25.


title: Quantum kinetic approach to the Schwinger production of scalar particles in an expanding universe

abstract: We study the Schwinger pair creation of scalar charged particles by a homogeneous electric field in an expanding universe in the quantum kinetic approach. We introduce an adiabatic vacuum for the scalar field based on the Wentzel-Kramers-Brillouin solution to the mode equation in conformal time and apply the formalism of Bogolyubov coefficients to derive a system of quantum Vlasov equations for three real kinetic functions. Compared to the analogous system of equations previously reported in the literature, the new one has two advantages. First, its solutions exhibit a faster decrease at large momenta which makes it more suitable for numerical computations. Second, it predicts no particle creation in the case of conformally coupled massless scalar field in the vanishing electric field, i.e., it respects the conformal symmetry of the system. We identify the ultraviolet divergences in the electric current and energy-momentum tensor of produced particles and introduce the corresponding counterterms in order to cancel them.


title: Stab-GKnock: Controlled variable selection for partially linear models using generalized knockoffs

abstract: The recently proposed fixed-X knockoff is a powerful variable selection procedure that controls the false discovery rate (FDR) in any finite-sample setting, yet its theoretical insights are difficult to show beyond Gaussian linear models. In this paper, we make the first attempt to extend the fixed-X knockoff to partially linear models by using generalized knockoff features, and propose a new stability generalized knockoff (Stab-GKnock) procedure by incorporating selection probability as feature importance score. We provide FDR control and power guarantee under some regularity conditions. In addition, we propose a two-stage method under high dimensionality by introducing a new joint feature screening procedure, with guaranteed sure screening property. Extensive simulation studies are conducted to evaluate the finite-sample performance of the proposed method. A real data example is also provided for illustration.


title: SPIN: Sparsifying and Integrating Internal Neurons in Large Language Models for Text Classification

abstract: Among the many tasks that Large Language Models (LLMs) have revolutionized is text classification. Current text classification paradigms, however, rely solely on the output of the final layer in the LLM, with the rich information contained in internal neurons largely untapped. In this study, we present SPIN: a model-agnostic framework that sparsifies and integrates internal neurons of intermediate layers of LLMs for text classification. Specifically, SPIN sparsifies internal neurons by linear probing-based salient neuron selection layer by layer, avoiding noise from unrelated neurons and ensuring efficiency. The cross-layer salient neurons are then integrated to serve as multi-layered features for the classification head. Extensive experimental results show our proposed SPIN significantly improves text classification accuracy, efficiency, and interpretability.


title: Extraction of the microscopic properties of quasi-particles using deep neural networks

abstract: We use deep neural networks (DNN) to obtain the microscopic characteristics of partons in terms of dynamical degrees of freedom on the basis of an off-shell quasiparticle description. We aim to infer masses and widths of quasi-gluons, up/down, and strange quarks using constraints on the macroscopic thermodynamic observables obtained by the first-principles calculations lattice QCD. In this work, we use 3 independent dimensionless thermodynamic observables from lQCD for minimization. First, we train our DNN using the DQPM (Dynamical QuasiParticle Model) Ansatz for the masses and widths. Furthermore, we use the DNN capabilities to generalize this Ansatz, to evaluate which quasiparticle characteristics are desirable to describe different thermodynamic functions simultaneously. To evaluate consistently the microscopic properties obtained by the DNN in the case of off-shell quarks and gluons, we compute transport coefficients using the spectral function within Kubo-Zubarev formalism in different setups. In particular, we make a comprehensive comparison in the case of the dimensionless ratios of shear viscosity over entropy density $\eta/s$ and electric conductivity over temperature $\sigma_Q/T$, which provide additional constraints for the parameter generalization of the considered models.


title: Value-Based Reinforcement Learning for Digital Twins in Cloud Computing

abstract: The setup considered in the paper consists of sensors in a Networked Control System that are used to build a digital twin (DT) model of the system dynamics. The focus is on control, scheduling, and resource allocation for sensory observation to ensure timely delivery to the DT model deployed in the cloud. Low latency and communication timeliness are instrumental in ensuring that the DT model can accurately estimate and predict system states. However, acquiring data for efficient state estimation and control computing poses a non-trivial problem given the limited network resources, partial state vector information, and measurement errors encountered at distributed sensors. We propose the REinforcement learning and Variational Extended Kalman filter with Robust Belief (REVERB), which leverages a reinforcement learning solution combined with a Value of Information-based algorithm for performing optimal control and selecting the most informative sensors to satisfy the prediction accuracy of DT. Numerical results demonstrate that the DT platform can offer satisfactory performance while reducing the communication overhead up to five times.


title: On rank two theories with eight supercharges part II: Lefschetz pencils

abstract: The global Seiberg-Witten (SW) geometries for rank two theories with eight supercharges are studied. The theory is deformed generically so that there are only simplest $I_1$ or $\tilde{I}_1$ singularities on the Coulomb branch, which then geometrically gives the so-called Lefchetz pencils, The local singularity was shown to be determined by the conjugacy class of mapping class group (MCG); The global study is then reduced to the questions about MCG: a) Find the factorization of the MCG element of the singular fiber into positive products of Dehn twists (which gives the $I_1$ singularity or $\tilde{I}_1$ singularity); b) Find the factorization of identity element in terms of Dehn twists. We solved above two MCG problems for most rank two theories.The results are very helpful in determining IR physics for all vacua of 4d SCFTs. Our approach is combinatorial and many aspects can be straightforwardly generalized to the study of higher rank theory.


title: Synthesizing gas-filled fiber Raman lines enables access to the molecular fingerprint region

abstract: The synthesis of multiple narrow optical spectral lines, precisely and independently tuned across the near- to mid-infrared (IR) region, is a pivotal research area that enables selective and real-time detection of trace gas species within complex gas mixtures. However, existing methods for developing such light sources suffer from limited flexibility and very low pulse energy, particularly in the mid-IR domain. Here, we introduce a new concept based on the gas-filled anti-resonant hollow-core fiber (ARHCF) technology that enables the synthesis of multiple independently tunable spectral lines with high pulse energy of >1 {\mu}J and a few nanoseconds pulse width in the near- and mid-IR region. The number and wavelengths of the generated spectral lines can be dynamically reconfigured. A proof-of-concept laser beam synthesized of two narrow spectral lines at 3.99 {\mu}m and 4.25 {\mu}m wavelengths is demonstrated and combined with photoacoustic (PA) modality for real-time SO2 and CO2 detection. The proposed concept also constitutes a promising way for IR multispectral microscopic imaging.


title: A novel CFA+EFA model to detect aberrant respondents

abstract: Aberrant respondents are common but yet extremely detrimental to the quality of social surveys or questionnaires. Recently, factor mixture models have been employed to identify individuals providing deceptive or careless responses. We propose a comprehensive factor mixture model that combines confirmatory and exploratory factor models to represent both the non-aberrant and aberrant components of the responses. The flexibility of the proposed solution allows for the identification of two of the most common aberant response styles, namely faking and careless responding. We validated our approach by means of two simulations and two case studies. The results indicate the effectiveness of the proposed model in handling with aberrant responses in social and behavioral surveys.


title: Volume filtered FEM-DEM framework for simulating particle-laden flows in complex geometries

abstract: We present a computational framework for modeling large-scale particle-laden flows in complex domains with the goal of enabling simulations in medical-image derived patient specific geometries. The framework is based on a volume-filtered Eulerian-Lagrangian method that uses a finite element method (FEM) to solve for the fluid phase coupled with a discrete element method (DEM) for the particle phase, with varying levels of coupling between the phases. The fluid phase is solved on a three-dimensional unstructured grid using a stabilized FEM. The particle phase is modeled as rigid spheres and their motion is calculated according to Newton's second law for translation and rotation. We propose an efficient and conservative particle-fluid coupling scheme compatible with the FEM basis that enables convergence under grid refinement of the two-way coupling terms. Efficient algorithms for neighbor detection for particle-particle collision and particle-wall collisions are adopted. The method is applied to a few different test cases and the results are analyzed qualitatively. The results demonstrate the capabilities of the implementation and the potential of the method for simulating large-scale particle-laden flows in complex geometries.


title: Should We Learn Most Likely Functions or Parameters?

abstract: Standard regularized training procedures correspond to maximizing a posterior distribution over parameters, known as maximum a posteriori (MAP) estimation. However, model parameters are of interest only insomuch as they combine with the functional form of a model to provide a function that can make good predictions. Moreover, the most likely parameters under the parameter posterior do not generally correspond to the most likely function induced by the parameter posterior. In fact, we can re-parametrize a model such that any setting of parameters can maximize the parameter posterior. As an alternative, we investigate the benefits and drawbacks of directly estimating the most likely function implied by the model and the data. We show that this procedure leads to pathological solutions when using neural networks and prove conditions under which the procedure is well-behaved, as well as a scalable approximation. Under these conditions, we find that function-space MAP estimation can lead to flatter minima, better generalization, and improved robustness to overfitting.


title: DiffAnt: Diffusion Models for Action Anticipation

abstract: Anticipating future actions is inherently uncertain. Given an observed video segment containing ongoing actions, multiple subsequent actions can plausibly follow. This uncertainty becomes even larger when predicting far into the future. However, the majority of existing action anticipation models adhere to a deterministic approach, neglecting to account for future uncertainties. In this work, we rethink action anticipation from a generative view, employing diffusion models to capture different possible future actions. In this framework, future actions are iteratively generated from standard Gaussian noise in the latent space, conditioned on the observed video, and subsequently transitioned into the action space. Extensive experiments on four benchmark datasets, i.e., Breakfast, 50Salads, EpicKitchens, and EGTEA Gaze+, are performed and the proposed method achieves superior or comparable results to state-of-the-art methods, showing the effectiveness of a generative approach for action anticipation. Our code and trained models will be published on GitHub.


title: Neutron stars in accreting systems -- signatures of the QCD phase transition

abstract: Neutron stars (NS) that are born in binary systems with a main-sequence star companion can experience mass transfer, resulting in the accumulation of material at the surface of the NS. This, in turn, leads to the continuous growth of the NS mass and the associated steepening of the gravitational potential. Supposing the central density surpasses the onset for the phase transition from nuclear, generally hadronic matter to deconfined quark-gluon plasma, which is a quantity currently constrained solely from an upper limit by asymptotic freedom in quantum chromodynamics (QCD), the system may experience a dynamic response due to the appearance of additional degrees of freedom in the equation of state (EOS). This dynamical response might give rise to a rapid softening of the EOS during the transition in the hadron-quark matter co-existence region. While this phenomenon has long been studied in the context of hydrostatic configurations, the dynamical implications of this problem are still incompletely understood. It is the purpose of the present paper to simulate the dynamics of NSs with previously accreted envelopes caused by the presence of a first-order QCD phase transition. Therefore, we employed the neutrino radiation hydrodynamics treatment based on the fully general relativistic approach in spherical symmetry, implementing a three-flavor Boltzmann neutrino transport and a microscopic model EOS that contains a first-order hadron-quark phase transition. The associated neutrino signal shows a sudden rise in the neutrino fluxes and average energies, becoming observable for the present generation of neutrino detectors for a galactic event, and a gravitational wave mode analysis revealed the behaviors of the dominant $f$ mode and the first and the second gravity $g$ modes that are excited during the NS evolution across the QCD phase transition.


title: Unified Batch Normalization: Identifying and Alleviating the Feature Condensation in Batch Normalization and a Unified Framework

abstract: Batch Normalization (BN) has become an essential technique in contemporary neural network design, enhancing training stability. Specifically, BN employs centering and scaling operations to standardize features along the batch dimension and uses an affine transformation to recover features. Although standard BN has shown its capability to improve deep neural network training and convergence, it still exhibits inherent limitations in certain cases. Current enhancements to BN typically address only isolated aspects of its mechanism. In this work, we critically examine BN from a feature perspective, identifying feature condensation during BN as a detrimental factor to test performance. To tackle this problem, we propose a two-stage unified framework called Unified Batch Normalization (UBN). In the first stage, we employ a straightforward feature condensation threshold to mitigate condensation effects, thereby preventing improper updates of statistical norms. In the second stage, we unify various normalization variants to boost each component of BN. Our experimental results reveal that UBN significantly enhances performance across different visual backbones and different vision tasks, and notably expedites network training convergence, particularly in early training stages. Notably, our method improved about 3% in accuracy on ImageNet classification and 4% in mean average precision on both Object Detection and Instance Segmentation on COCO dataset, showing the effectiveness of our approach in real-world scenarios.


title: Adversarial Doodles: Interpretable and Human-drawable Attacks Provide Describable Insights

abstract: DNN-based image classification models are susceptible to adversarial attacks. Most previous adversarial attacks do not focus on the interpretability of the generated adversarial examples, and we cannot gain insights into the mechanism of the target classifier from the attacks. Therefore, we propose Adversarial Doodles, which have interpretable shapes. We optimize black b\'ezier curves to fool the target classifier by overlaying them onto the input image. By introducing random perspective transformation and regularizing the doodled area, we obtain compact attacks that cause misclassification even when humans replicate them by hand. Adversarial doodles provide describable and intriguing insights into the relationship between our attacks and the classifier's output. We utilize adversarial doodles and discover the bias inherent in the target classifier, such as "We add two strokes on its head, a triangle onto its body, and two lines inside the triangle on a bird image. Then, the classifier misclassifies the image as a butterfly."


title: Sensitivity-Based Layer Insertion for Residual and Feedforward Neural Networks

abstract: The training of neural networks requires tedious and often manual tuning of the network architecture. We propose a systematic method to insert new layers during the training process, which eliminates the need to choose a fixed network size before training. Our technique borrows techniques from constrained optimization and is based on first-order sensitivity information of the objective with respect to the virtual parameters that additional layers, if inserted, would offer. We consider fully connected feedforward networks with selected activation functions as well as residual neural networks. In numerical experiments, the proposed sensitivity-based layer insertion technique exhibits improved training decay, compared to not inserting the layer. Furthermore, the computational effort is reduced in comparison to inserting the layer from the beginning. The code is available at \url{https://github.com/LeonieKreis/layer_insertion_sensitivity_based}.


title: Closing the ODE-SDE gap in score-based diffusion models through the Fokker-Planck equation

abstract: Score-based diffusion models have emerged as one of the most promising frameworks for deep generative modelling, due to their state-of-the art performance in many generation tasks while relying on mathematical foundations such as stochastic differential equations (SDEs) and ordinary differential equations (ODEs). Empirically, it has been reported that ODE based samples are inferior to SDE based samples. In this paper we rigorously describe the range of dynamics and approximations that arise when training score-based diffusion models, including the true SDE dynamics, the neural approximations, the various approximate particle dynamics that result, as well as their associated Fokker--Planck equations and the neural network approximations of these Fokker--Planck equations. We systematically analyse the difference between the ODE and SDE dynamics of score-based diffusion models, and link it to an associated Fokker--Planck equation. We derive a theoretical upper bound on the Wasserstein 2-distance between the ODE- and SDE-induced distributions in terms of a Fokker--Planck residual. We also show numerically that conventional score-based diffusion models can exhibit significant differences between ODE- and SDE-induced distributions which we demonstrate using explicit comparisons. Moreover, we show numerically that reducing the Fokker--Planck residual by adding it as an additional regularisation term leads to closing the gap between ODE- and SDE-induced distributions. Our experiments suggest that this regularisation can improve the distribution generated by the ODE, however that this can come at the cost of degraded SDE sample quality.