title: NEO-KD: Knowledge-Distillation-Based Adversarial Training for Robust Multi-Exit Neural Networks

abstract: While multi-exit neural networks are regarded as a promising solution for making efficient inference via early exits, combating adversarial attacks remains a challenging problem. In multi-exit networks, due to the high dependency among different submodels, an adversarial example targeting a specific exit not only degrades the performance of the target exit but also reduces the performance of all other exits concurrently. This makes multi-exit networks highly vulnerable to simple adversarial attacks. In this paper, we propose NEO-KD, a knowledge-distillation-based adversarial training strategy that tackles this fundamental challenge based on two key contributions. NEO-KD first resorts to neighbor knowledge distillation to guide the output of the adversarial examples to tend to the ensemble outputs of neighbor exits of clean data. NEO-KD also employs exit-wise orthogonal knowledge distillation for reducing adversarial transferability across different submodels. The result is a significantly improved robustness against adversarial attacks. Experimental results on various datasets/models show that our method achieves the best adversarial accuracy with reduced computation budgets, compared to the baselines relying on existing adversarial training or knowledge distillation techniques for multi-exit networks.


title: Crop Disease Classification using Support Vector Machines with Green Chromatic Coordinate (GCC) and Attention based feature extraction for IoT based Smart Agricultural Applications

abstract: Crops hold paramount significance as they serve as the primary provider of energy, nutrition, and medicinal benefits for the human population. Plant diseases, however, can negatively affect leaves during agricultural cultivation, resulting in significant losses in crop output and economic value. Therefore, it is crucial for farmers to identify crop diseases. However, this method frequently necessitates hard work, a lot of planning, and in-depth familiarity with plant pathogens. Given these numerous obstacles, it is essential to provide solutions that can easily interface with mobile and IoT devices so that our farmers can guarantee the best possible crop development. Various machine learning (ML) as well as deep learning (DL) algorithms have been created & studied for the identification of plant disease detection, yielding substantial and promising results. This article presents a novel classification method that builds on prior work by utilising attention-based feature extraction, RGB channel-based chromatic analysis, Support Vector Machines (SVM) for improved performance, and the ability to integrate with mobile applications and IoT devices after quantization of information. Several disease classification algorithms were compared with the suggested model, and it was discovered that, in terms of accuracy, Vision Transformer-based feature extraction and additional Green Chromatic Coordinate feature with SVM classification achieved an accuracy of (GCCViT-SVM) - 99.69%, whereas after quantization for IoT device integration achieved an accuracy of - 97.41% while almost reducing 4x in size. Our findings have profound implications because they have the potential to transform how farmers identify crop illnesses with precise and fast information, thereby preserving agricultural output and ensuring food security.


title: Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

abstract: As the size of pre-trained speech recognition models increases, running these large models in low-latency or resource-constrained environments becomes challenging. In this work, we leverage pseudo-labelling to assemble a large-scale open-source dataset which we use to distill the Whisper model into a smaller variant, called Distil-Whisper. Using a simple word error rate (WER) heuristic, we select only the highest quality pseudo-labels for training. The distilled model is 5.8 times faster with 51% fewer parameters, while performing to within 1% WER on out-of-distribution test data in a zero-shot transfer setting. Distil-Whisper maintains the robustness of the Whisper model to difficult acoustic conditions, while being less prone to hallucination errors on long-form audio. Distil-Whisper is designed to be paired with Whisper for speculative decoding, yielding a 2 times speed-up while mathematically ensuring the same outputs as the original model. To facilitate further research in this domain, we make our training code, inference code and models publicly accessible.


title: Rigidity of bounded type cubic Siegel polynomials

abstract: We prove that if two non-renormalizable cubic Siegel polynomials with bounded type rotation numbers are combinatorially equivalent, then they are also conformally equivalent. As a consequence, we show that in the one-parameter slice of cubic Siegel polynomials considered by Zakeri, the locus of non-renormalizable maps is homeomorphic to a double-copy of a quadratic Siegel filled Julia set (minus the Siegel disk) glued along the Siegel boundary. This verifies the the conjecture of Blokh-Oversteegen-Ptacek-Timorin for bounded type rotation numbers.


title: Misaligned magnetized accretion flows onto spinning black holes: magneto-spin alignment, outflow power and intermittent jets

abstract: Magnetic fields regulate black hole (BH) accretion, governing both the inflow and outflow dynamics. When a BH becomes saturated with large-scale vertical magnetic flux, it enters a magnetically-arrested disk (MAD) state. The dynamically-important BH magnetic flux powers highly efficient relativistic outflows (or jets) and sporadically erupts from the BH into the disk midplane. Here we explore the evolution of MADs when the BH and gas angular momentum are misaligned, which is expected to be more common. Using numerical simulations, we find that jets from rapidly spinning, prograde BHs force the inner accretion flow into alignment with the BH spin via the magneto-spin alignment mechanism for disks initially misaligned at $\mathcal{T}\lesssim 60^{\circ}$. Extremely misaligned MAD disks, on the other hand, exhibit intermittent jets that blow out parts of the disk to $\approx 100$ gravitational radii before collapsing, leaving behind hot cavities and magnetized filaments. These intermittent jet mechanism forms a mini-feedback cycle and could explain some cases of X-ray and radio quasi-periodic eruptions observed in dim AGN. Further, we find that (i) for BHs with low power jets, the BH spin and initial disk tilt angle changes the amount of horizon magnetic flux, and (ii) geometrically-thick, misaligned accretion flows do not undergo sustained Lense-Thirring (LT) precession. Thereby, we suggest that low-luminosity accreting BHs ($\dot{M}\ll 10^{-3} \dot{M}_{\rm Edd}$) are not likely to exhibit quasi-periodic oscillations in lightcurves due to LT precession, in agreement with observations of BH X-ray binaries and AGN in the low-hard/quiescent state. Instead, we suggest that magnetic flux eruptions can mimic precession-like motion, such as observed in the M87 jet, by driving large-scale surface waves in the jets.


title: Decentralized PI-control and Anti-windup in Resource Sharing Networks

abstract: We consider control of multiple stable first-order \review{agents} which have a control coupling described by an M-matrix. These agents are subject to incremental sector-bounded \review{input} nonlinearities. We show that such plants can be globally asymptotically stabilized to a unique equilibrium using fully decentralized proportional-integral controllers equipped with anti-windup and subject to local tuning rules. In addition, we show that when the nonlinearities correspond to the saturation function, the closed loop asymptotically minimizes a weighted 1-norm of the agents state mismatch. The control strategy is finally compared to other state-of-the-art controllers on a numerical district heating example.


title: Event-based Background-Oriented Schlieren

abstract: Schlieren imaging is an optical technique to observe the flow of transparent media, such as air or water, without any particle seeding. However, conventional frame-based techniques require both high spatial and temporal resolution cameras, which impose bright illumination and expensive computation limitations. Event cameras offer potential advantages (high dynamic range, high temporal resolution, and data efficiency) to overcome such limitations due to their bio-inspired sensing principle. This paper presents a novel technique for perceiving air convection using events and frames by providing the first theoretical analysis that connects event data and schlieren. We formulate the problem as a variational optimization one combining the linearized event generation model with a physically-motivated parameterization that estimates the temporal derivative of the air density. The experiments with accurately aligned frame- and event camera data reveal that the proposed method enables event cameras to obtain on par results with existing frame-based optical flow techniques. Moreover, the proposed method works under dark conditions where frame-based schlieren fails, and also enables slow-motion analysis by leveraging the event camera's advantages. Our work pioneers and opens a new stack of event camera applications, as we publish the source code as well as the first schlieren dataset with high-quality frame and event data. https://github.com/tub-rip/event_based_bos


title: Stabilization of divisors in high-dimensional contact manifolds

abstract: A stabilization operation is defined for codimension $2$ contact submanifolds in $\dim \geq 5$ contact manifolds $(M, \xi)$. The definition is such that (1) a given $(M, \xi)$ is overtwisted iff its standard transverse unknot is stabilized and (2) transverse stabilization preserves the formal contact isotopy class and intrinsic contact structure of a link. We prove that many transverse links are non-simple.


title: Enhancing Traffic Object Detection in Variable Illumination with RGB-Event Fusion

abstract: Traffic object detection under variable illumination is challenging due to the information loss caused by the limited dynamic range of conventional frame-based cameras. To address this issue, we introduce bio-inspired event cameras and propose a novel Structure-aware Fusion Network (SFNet) that extracts sharp and complete object structures from the event stream to compensate for the lost information in images through cross-modality fusion, enabling the network to obtain illumination-robust representations for traffic object detection. Specifically, to mitigate the sparsity or blurriness issues arising from diverse motion states of traffic objects in fixed-interval event sampling methods, we propose the Reliable Structure Generation Network (RSGNet) to generate Speed Invariant Frames (SIF), ensuring the integrity and sharpness of object structures. Next, we design a novel Adaptive Feature Complement Module (AFCM) which guides the adaptive fusion of two modality features to compensate for the information loss in the images by perceiving the global lightness distribution of the images, thereby generating illumination-robust representations. Finally, considering the lack of large-scale and high-quality annotations in the existing event-based object detection datasets, we build a DSEC-Det dataset, which consists of 53 sequences with 63,931 images and more than 208,000 labels for 8 classes. Extensive experimental results demonstrate that our proposed SFNet can overcome the perceptual boundaries of conventional cameras and outperform the frame-based method by 8.0% in mAP50 and 5.9% in mAP50:95. Our code and dataset will be available at https://github.com/YN-Yang/SFNet.


title: Untangling Graphs on Surfaces

abstract: Consider a graph drawn on a surface (for example, the plane minus a finite set of obstacle points), possibly with crossings. We provide an algorithm to decide whether such a drawing can be untangled, namely, if one can slide the vertices and edges of the graph on the surface (avoiding the obstacles) to remove all crossings; in other words, whether the drawing is homotopic to an embedding. While the problem boils down to planarity testing when the surface is the sphere or the disk (or equivalently the plane without any obstacle), the other cases have never been studied before, except when the input graph is a cycle, in an abundant literature in topology and more recently by Despr\'e and Lazarus [SoCG 2017, J. ACM 2019]. Our algorithm runs in O(m + poly(g+b) n log n) time, where g >= 0 and b >= 0 are the genus and the number of boundary components of the input orientable surface S, and n is the size of the input graph drawing, lying on some fixed graph of size m cellularly embedded on S. We use various techniques from two-dimensional computational topology and from the theory of hyperbolic surfaces. Most notably, we introduce reducing triangulations, a novel discrete analog of hyperbolic surfaces in the spirit of systems of quads by Lazarus and Rivaud [FOCS 2012] and Erickson and Whittlesey [SODA 2013], which have the additional benefit that reduced paths are unique and stable upon reversal; they are likely of independent interest. Tailored data structures are needed to achieve certain homotopy tests efficiently on these triangulations. As a key subroutine, we rely on an algorithm to test the weak simplicity of a graph drawn on a surface by Akitaya, Fulek, and T\'oth [SODA 2018, TALG 2019].


title: Geometric rigidity for incompatible fields in the multi-well case and an application to strain-gradient plasticity

abstract: We derive a quantitative rigidity estimate for a multi-well problem in nonlinear elasticity with dislocations. Precisely, we show that the $L^{1^{*}}$-distance of a possibly incompatible strain field $\beta$ from a single well is controlled in terms of the $L^{1^{*}}$-distance from a finite set of wells, of ${\rm curl}\beta$, and of ${\rm div}\beta$. As a consequence, we derive a strain-gradient plasticity model as $\Gamma$-limit of a nonlinear finite dislocation model, containing a singular perturbation term accounting for the divergence of the strain field. This can also be seen as a generalization of the result of (Alicandro et al. 2018) to the case of incompatible vector fields.


title: Robustify and Tighten the Lee Bounds: A Sample Selection Model under Stochastic Monotonicity and Symmetry Assumptions

abstract: In the presence of sample selection, Lee's (2009) nonparametric bounds are a popular tool for estimating a treatment effect. However, the Lee bounds rely on the monotonicity assumption, whose empirical validity is sometimes unclear. Furthermore, the bounds are often regarded to be wide and less informative even under monotonicity. To address these issues, this study introduces a stochastic version of the monotonicity assumption alongside a nonparametric distributional shape constraint. The former enhances the robustness of the Lee bounds with respect to monotonicity, while the latter helps tighten these bounds. The obtained bounds do not rely on the exclusion restriction and can be root-$n$ consistently estimable, making them practically viable. The potential usefulness of the proposed methods is illustrated by their application on experimental data from the after-school instruction programme studied by Muralidharan, Singh, and Ganimian (2019).


title: Maximum $k$- vs. $\ell$-colourings of graphs

abstract: We present polynomial-time SDP-based algorithms for the following problem: For fixed $k \leq \ell$, given a real number $\epsilon>0$ and a graph $G$ that admits a $k$-colouring with a $\rho$-fraction of the edges coloured properly, it returns an $\ell$-colouring of $G$ with an $(\alpha \rho - \epsilon)$-fraction of the edges coloured properly in polynomial time in $G$ and $1 / \epsilon$. Our algorithms are based on the algorithms of Frieze and Jerrum [Algorithmica'97] and of Karger, Motwani and Sudan [JACM'98]. For $k = 2, \ell = 3$, our algorithm achieves an approximation ratio $\alpha = 1$, which is the best possible. When $k$ is fixed and $\ell$ grows large, our algorithm achieves an approximation ratio of $\alpha = 1 - o(1 / \ell)$. When $k, \ell$ are both large, our algorithm achieves an approximation ratio of $\alpha = 1 - 1 / \ell + 2 \ln \ell / k \ell - o(\ln \ell / k \ell) - O(1 / k^2)$; if we fix $d = \ell - k$ and allow $k, \ell$ to grow large, this is $\alpha = 1 - 1 / \ell + 2 \ln \ell / k \ell - o(\ln \ell / k \ell)$. By extending the results of Khot, Kindler, Mossel and O'Donnell [SICOMP'07] to the promise setting, we show that for large $k$ and $\ell$, assuming Khot's Unique Games Conjecture (UGC), it is \NP-hard to achieve an approximation ratio $\alpha$ greater than $1 - 1 / \ell + 2 \ln \ell / k \ell + o(\ln \ell / k \ell)$, provided that $\ell$ is bounded by a function that is $o(\exp(\sqrt[3]{k}))$. For the case where $d = \ell - k$ is fixed, this bound matches the performance of our algorithm up to $o(\ln \ell / k \ell)$. Furthermore, by extending the results of Guruswami and Sinop [ToC'13] to the promise setting, we prove that it is NP-hard to achieve an approximation ratio greater than $1 - 1 / \ell + 8 \ln \ell / k \ell + o(\ln \ell / k \ell)$, provided again that $\ell$ is bounded as before (but this time without assuming the UGC).


title: Improving Robustness for Vision Transformer with a Simple Dynamic Scanning Augmentation

abstract: Vision Transformer (ViT) has demonstrated promising performance in computer vision tasks, comparable to state-of-the-art neural networks. Yet, this new type of deep neural network architecture is vulnerable to adversarial attacks limiting its capabilities in terms of robustness. This article presents a novel contribution aimed at further improving the accuracy and robustness of ViT, particularly in the face of adversarial attacks. We propose an augmentation technique called `Dynamic Scanning Augmentation' that leverages dynamic input sequences to adaptively focus on different patches, thereby maintaining performance and robustness. Our detailed investigations reveal that this adaptability to the input sequence induces significant changes in the attention mechanism of ViT, even for the same image. We introduce four variations of Dynamic Scanning Augmentation, outperforming ViT in terms of both robustness to adversarial attacks and accuracy against natural images, with one variant showing comparable results. By integrating our augmentation technique, we observe a substantial increase in ViT's robustness, improving it from $17\%$ to $92\%$ measured across different types of adversarial attacks. These findings, together with other comprehensive tests, indicate that Dynamic Scanning Augmentation enhances accuracy and robustness by promoting a more adaptive type of attention. In conclusion, this work contributes to the ongoing research on Vision Transformers by introducing Dynamic Scanning Augmentation as a technique for improving the accuracy and robustness of ViT. The observed results highlight the potential of this approach in advancing computer vision tasks and merit further exploration in future studies.


title: Virtual-Peripheral-in-the-Loop : A Hardware-in-the-Loop Strategy to Bridge the VP/RTL Design-Gap

abstract: Virtual Prototypes act as an executable specification model, offering a unified behavior reference model for SW and HW engineers. However, between the VP and the HW still exists a gap, as the step from an architectural level VP implementation on the Transaction Level Modeling to the Register Transfer Layer implementation is considerably big. Especially when a company wants to focus on their Unique Selling-Point, the HW Design Space Exploration and acceptance tests should start as early as possible. Traditionally, this can only start once the rest of the System-on-Chip is also implemented in the RTL. As SoCs consist of many common subsystems like processors, memories, and peripherals, this may impact the time-to-market considerably. This is avoidable, however: In this paper we propose a Hardware-in-the-Loop strategy that allows to bridge the gap between the VP and RTL design that empowers engineers to focus on their USP while leveraging an existing suite of TLM Intellectual Properties for the common base-system components. We show how VPs and partial RTL implementations of a SoC can be combined in a Hardware-in-the-Loop simulation environment utilizing Field-Programmable Gate Arrays. The proposed approach allows early DSE, validation, and verification of SoC subsystems, which bridges the TLM/RTL gap. We evaluate our approach with a lightweight implementation of the proposed protocol, and three case-studies with real-world peripherals and accelerators on HW. Furthermore, we assess the capabilities of our approach and offer practical considerations for engineers utilizing this HIL approach for SoC design; and finally propose further extensions that can boost the approach for specialized applications like high-performance accelerators and computation.


title: Quantifying stress distribution in ultra-large graphene drums through mode shape imaging

abstract: Suspended drums made of 2D materials hold potential for sensing applications. However, the industrialization of these applications is hindered by significant device-to-device variations presumably caused by non-uniform stress distributions induced by the fabrication process. Here we introduce a new methodology to determine the stress distribution from their mechanical resonance frequencies and corresponding mode shapes as measured by a laser Doppler vibrometer (LDV). To avoid limitations posed by the optical resolution of the LDV, we leverage a unique manufacturing process to create ultra-large graphene drums with diameters of up to 1000 um. We solve the inverse problem of a F\"oppl--von K\'arm\'an plate model by an iterative procedure to obtain the stress distribution within the drums from the experimental data. Our results show that the generally used uniform pre-tension assumption overestimates the pre-stress value, exceeding the averaged stress obtained by more than 47%. Moreover, it is is found that the reconstructed stress distributions are bi-axial, which likely originates from the transfer process. The introduced metholodogy allows one to estimate the tension distribution in drum resonators from their mechanical response and thereby paves the way for linking the used fabrication processes to the resulting device performance.


title: Form follows Function: Text-to-Text Conditional Graph Generation based on Functional Requirements

abstract: This work focuses on the novel problem setting of generating graphs conditioned on a description of the graph's functional requirements in a downstream task. We pose the problem as a text-to-text generation problem and focus on the approach of fine-tuning a pretrained large language model (LLM) to generate graphs. We propose an inductive bias which incorporates information about the structure of the graph into the LLM's generation process by incorporating message passing layers into an LLM's architecture. To evaluate our proposed method, we design a novel set of experiments using publicly available and widely studied molecule and knowledge graph data sets. Results suggest our proposed approach generates graphs which more closely meet the requested functional requirements, outperforming baselines developed on similar tasks by a statistically significant margin.


title: A Systematic Comparison of Syllogistic Reasoning in Humans and Language Models

abstract: A central component of rational behavior is logical inference: the process of determining which conclusions follow from a set of premises. Psychologists have documented several ways in which humans' inferences deviate from the rules of logic. Do language models, which are trained on text generated by humans, replicate such human biases, or are they able to overcome them? Focusing on the case of syllogisms -- inferences from two simple premises -- we show that, within the PaLM2 family of transformer language models, larger models are more logical than smaller ones, and also more logical than humans. At the same time, even the largest models make systematic errors, some of which mirror human reasoning biases: they show sensitivity to the (irrelevant) ordering of the variables in the syllogism, and draw confident but incorrect inferences from particular syllogisms (syllogistic fallacies). Overall, we find that language models often mimic the human biases included in their training data, but are able to overcome them in some cases.


title: Weyl Group Representation of Billiard Trajectories for One-dimensional Hard Sphere Dynamics

abstract: We present an exact formula for the dynamics of $N$ hard spheres of radius $r>0$ on an infinite line which evolve under the assumption that total linear momentum and kinetic energy of the system is conserved for all times. This model is commonly known as the one-dimensional Tonks gas or the hard rod gas model. Our exact formula is expressed as a sum over the Weyl group associated to the root system $A_{N-1}$ and is valid for all initial data in a full-measure subset of the tangent bundle of the hard sphere table. As an application of our explicit formula, we produce a simple proof that the associated billiard flow admits the Liouville measure on the tangent bundle of the hard sphere table as an invariant measure.


title: On the Opportunities of Green Computing: A Survey

abstract: Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades, and is widely used in many areas including computing vision, natural language processing, time-series analysis, speech synthesis, etc. During the age of deep learning, especially with the arise of Large Language Models, a large majority of researchers' attention is paid on pursuing new state-of-the-art (SOTA) results, resulting in ever increasing of model size and computational complexity. The needs for high computing power brings higher carbon emission and undermines research fairness by preventing small or medium-sized research institutions and companies with limited funding in participating in research. To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic. In this survey, we give a systematic overview of the technologies used in Green Computing. We propose the framework of Green Computing and devide it into four key components: (1) Measures of Greenness, (2) Energy-Efficient AI, (3) Energy-Efficient Computing Systems and (4) AI Use Cases for Sustainability. For each components, we discuss the research progress made and the commonly used techniques to optimize the AI efficiency. We conclude that this new research direction has the potential to address the conflicts between resource constraints and AI development. We encourage more researchers to put attention on this direction and make AI more environmental friendly.


title: Artificial Intelligence-Facilitated Online Adaptive Proton Therapy Using Pencil Beam Scanning Proton Therapy

abstract: We propose an oAPT workflow that incorporates all these functionalities and validate its clinical implementation feasibility with prostate patients. AI-based auto-segmentation tool AccuContourTM (Manteia, Xiamen, China) was seamlessly integrated into oAPT. Initial spot arrangement tool on the vCT for re-optimization was implemented using raytracing. An LET-based biological effect evaluation tool was developed to assess the overlap region of high dose and high LET in selected OARs. Eleven prostate cancer patients were retrospectively selected to verify the efficacy and efficiency of the proposed oAPT workflow. The time cost of each component in the workflow was recorded for analysis. The verification plan showed significant degradation of the CTV coverage and rectum and bladder sparing due to the interfractional anatomical changes. Re-optimization on the vCT resulted in great improvement of the plan quality. No overlap regions of high dose and high LET distributions were observed in bladder or rectum in re-plans. 3D Gamma analyses in PSQA confirmed the accuracy of the re-plan doses before delivery (Gamma passing rate = 99.57%), and after delivery (98.59%). The robustness of the re-plans passed all clinical requirements. The average time for the complete execution of the workflow was 9.12minutes, excluding manual intervention time. The AI-facilitated oAPT workflow was demonstrated to be both efficient and effective by generating a re-plan that significantly improved the plan quality in prostate cancer treated with PBSPT.


title: Progress in the partial-wave analysis methods at COMPASS

abstract: We study the excitation spectrum of light and strange mesons in diffractive scattering. We identify different hadron resonances through partial wave analysis, which inherently relies on analysis models. Besides statistical uncertainties, the model dependence of the analysis introduces dominant systematic uncertainties. We discuss several of their sources for the $\pi^-\pi^-\pi^+$ and $K^0_S K^-$ final states and present methods to reduce them. We have developed a new approach exploiting a-priori knowledge of signal continuity over adjacent final-state-mass bins to stably fit a large pool of partial-waves to our data, allowing a clean identification of very small signals in our large data sets. For two-body final states of scalar particles, such as $K^0_S K^-$, mathematical ambiguities in the partial-wave decomposition lead to the same intensity distribution for different combinations of amplitude values. We will discuss these ambiguities and present solutions to resolve or at least reduce the number of possible solutions. Resolving these issues will allow for a complementary analysis of the $a_J$-like resonance sector in these two final states.


title: Nuclear PDFs After the First Decade of LHC Data

abstract: We present a review of the conceptual basis, present knowledge and recent progress in the field of global analysis of nuclear parton distribution functions (PDFs). After introducing the theoretical foundations and methodological approaches for the extraction of nuclear PDFs from experimental data, we discuss how different measurements in fixed-target and collider experiments provide increasingly precise constraints on various aspects of nuclear PDFs, including shadowing, antishadowing, the EMC effect, Fermi motion, flavor separation, deuteron binding, target-mass and other higher-twist effects. Particular emphasis is given to measurements carried out in proton-lead collisions at the Large Hadron Collider, which have revolutionized the global analysis during the past decade. These measurements include electroweak-boson, jet, light-hadron, and heavy-flavor observables. Finally, we outline the expected impact of the future Electron Ion Collider and discuss the role and interplay of nuclear PDFs with other branches of nuclear, particle and astroparticle physics.


title: Discourse Relations Classification and Cross-Framework Discourse Relation Classification Through the Lens of Cognitive Dimensions: An Empirical Investigation

abstract: Existing discourse formalisms use different taxonomies of discourse relations, which require expert knowledge to understand, posing a challenge for annotation and automatic classification. We show that discourse relations can be effectively captured by some simple cognitively inspired dimensions proposed by Sanders et al.(2018). Our experiments on cross-framework discourse relation classification (PDTB & RST) demonstrate that it is possible to transfer knowledge of discourse relations for one framework to another framework by means of these dimensions, in spite of differences in discourse segmentation of the two frameworks. This manifests the effectiveness of these dimensions in characterizing discourse relations across frameworks. Ablation studies reveal that different dimensions influence different types of discourse relations. The patterns can be explained by the role of dimensions in characterizing and distinguishing different relations. We also report our experimental results on automatic prediction of these dimensions.


title: Hessian Eigenvectors and Principal Component Analysis of Neural Network Weight Matrices

abstract: This study delves into the intricate dynamics of trained deep neural networks and their relationships with network parameters. Trained networks predominantly continue training in a single direction, known as the drift mode. This drift mode can be explained by the quadratic potential model of the loss function, suggesting a slow exponential decay towards the potential minima. We unveil a correlation between Hessian eigenvectors and network weights. This relationship, hinging on the magnitude of eigenvalues, allows us to discern parameter directions within the network. Notably, the significance of these directions relies on two defining attributes: the curvature of their potential wells (indicated by the magnitude of Hessian eigenvalues) and their alignment with the weight vectors. Our exploration extends to the decomposition of weight matrices through singular value decomposition. This approach proves practical in identifying critical directions within the Hessian, considering both their magnitude and curvature. Furthermore, our examination showcases the applicability of principal component analysis in approximating the Hessian, with update parameters emerging as a superior choice over weights for this purpose. Remarkably, our findings unveil a similarity between the largest Hessian eigenvalues of individual layers and the entire network. Notably, higher eigenvalues are concentrated more in deeper layers. Leveraging these insights, we venture into addressing catastrophic forgetting, a challenge of neural networks when learning new tasks while retaining knowledge from previous ones. By applying our discoveries, we formulate an effective strategy to mitigate catastrophic forgetting, offering a possible solution that can be applied to networks of varying scales, including larger architectures.


title: CLIP-AD: A Language-Guided Staged Dual-Path Model for Zero-shot Anomaly Detection

abstract: This paper considers zero-shot Anomaly Detection (AD), performing AD without reference images of the test objects. We propose a framework called CLIP-AD to leverage the zero-shot capabilities of the large vision-language model CLIP. Firstly, we reinterpret the text prompts design from a distributional perspective and propose a Representative Vector Selection (RVS) paradigm to obtain improved text features. Secondly, we note opposite predictions and irrelevant highlights in the direct computation of the anomaly maps. To address these issues, we introduce a Staged Dual-Path model (SDP) that leverages features from various levels and applies architecture and feature surgery. Lastly, delving deeply into the two phenomena, we point out that the image and text features are not aligned in the joint embedding space. Thus, we introduce a fine-tuning strategy by adding linear layers and construct an extended model SDP+, further enhancing the performance. Abundant experiments demonstrate the effectiveness of our approach, e.g., on MVTec-AD, SDP outperforms the SOTA WinCLIP by +4.2/+10.7 in segmentation metrics F1-max/PRO, while SDP+ achieves +8.3/+20.5 improvements.


title: Nucleation patterns of polymer crystals analyzed by machine learning models

abstract: We use machine learning algorithms to detect the crystalline phase in undercooled melts in molecular dynamics simulations. Our classification method is based on local conformation and environmental fingerprints of individual monomers. In particular, we employ self-supervised auto-encoders to compress the fingerprint information and a Gaussian mixture model to distinguish ordered states from disordered ones. The resulting identification of crystalline monomers agrees to a large extent with human-defined classifiers such as the stem-length-based classification scheme as developed in our previous work [C. Luo and J.-U. Sommer, Macromolecules 44 (2011), 1523], but does not require any foreknowledge about the structure of semi-crystalline polymers. Because of its local sensitivity, the method allows the resolution of detailed time patterns of crystalline order before an apparent signature of the transition is visible in thermodynamic properties such as for the specific volume. At a pre-transition point, we observe the highest crystallization efficiency using the fraction of monomers being conserved in the crystalline phase as compared to the number of monomers joining that phase.


title: Progressive Recurrent Network for Shadow Removal

abstract: Single-image shadow removal is a significant task that is still unresolved. Most existing deep learning-based approaches attempt to remove the shadow directly, which can not deal with the shadow well. To handle this issue, we consider removing the shadow in a coarse-to-fine fashion and propose a simple but effective Progressive Recurrent Network (PRNet). The network aims to remove the shadow progressively, enabing us to flexibly adjust the number of iterations to strike a balance between performance and time. Our network comprises two parts: shadow feature extraction and progressive shadow removal. Specifically, the first part is a shallow ResNet which constructs the representations of the input shadow image on its original size, preventing the loss of high-frequency details caused by the downsampling operation. The second part has two critical components: the re-integration module and the update module. The proposed re-integration module can fully use the outputs of the previous iteration, providing input for the update module for further shadow removal. In this way, the proposed PRNet makes the whole process more concise and only uses 29% network parameters than the best published method. Extensive experiments on the three benchmarks, ISTD, ISTD+, and SRD, demonstrate that our method can effectively remove shadows and achieve superior performance.


title: Partial Eruption of Solar Filaments. I. Configuration and Formation of Double-decker Filaments

abstract: Partial eruptions of solar filaments are the typical representative of solar eruptive behavior diversity. Here we investigate a typical filament partial eruption event and present integrated evidence for configuration of the pre-eruption filament and its formation. The CHASE H$\alpha$ observations reveal structured Doppler velocity distribution within the pre-eruption filament, where distinct redshift only appeared in the east narrow part of the south filament region and then disappeared after the partial eruption while the north part dominated by blueshift remained. Combining the SDO, ASO-S observations, and NLFFF modeling results, we verify that there were two independent material flow systems within the pre-flare filament, whose magnetic topology is a special double-decker configuration consisting of two magnetic flux ropes (MFRs) with opposite magnetic twist. During the formation of this filament system, continuous magnetic flux cancellation and footpoint motion were observed around its north end. Therefore, we propose a new double-decker formation scenario that the two MFRs composing such double-decker configuration originated from two magnetic systems with different initial connections and opposite magnetic twist. Subsequent magnetic reconnection with surrounding newly-emerging fields resulted in the motion of footpoint of the upper MFR to the region around footpoint of the lower MFR, thus leading to eventual formation of the double-decker configuration consisting of two MFRs with similar footpoints but opposite signs of magnetic twist. These results provide a potential way to determine unambiguously the progenitor configuration of a partial-eruptive filament and reveal a special type of double-decker MFR configuration and a new double-decker formation scenario.


title: Single-view 3D Scene Reconstruction with High-fidelity Shape and Texture

abstract: Reconstructing detailed 3D scenes from single-view images remains a challenging task due to limitations in existing approaches, which primarily focus on geometric shape recovery, overlooking object appearances and fine shape details. To address these challenges, we propose a novel framework for simultaneous high-fidelity recovery of object shapes and textures from single-view images. Our approach utilizes the proposed Single-view neural implicit Shape and Radiance field (SSR) representations to leverage both explicit 3D shape supervision and volume rendering of color, depth, and surface normal images. To overcome shape-appearance ambiguity under partial observations, we introduce a two-stage learning curriculum incorporating both 3D and 2D supervisions. A distinctive feature of our framework is its ability to generate fine-grained textured meshes while seamlessly integrating rendering capabilities into the single-view 3D reconstruction model. This integration enables not only improved textured 3D object reconstruction by 27.7% and 11.6% on the 3D-FRONT and Pix3D datasets, respectively, but also supports the rendering of images from novel viewpoints. Beyond individual objects, our approach facilitates composing object-level representations into flexible scene representations, thereby enabling applications such as holistic scene understanding and 3D scene editing. We conduct extensive experiments to demonstrate the effectiveness of our method.


title: Measurement of the Ratio of Partial Branching Fractions of Inclusive $\overline{B} \to X_u \ell \overline{\nu}$ to $\overline{B} \to X_{c} \ell \overline{\nu}$ and the Ratio of their Spectra with Hadronic Tagging

abstract: We present a measurement of the ratio of partial branching fractions of the semi-leptonic inclusive decays, $\overline{B} \to X_{u} \ell \overline{\nu}$ to $\overline{B} \to X_{c} \ell \overline{\nu}$, where $\ell = (e, \mu)$, using the full Belle sample of $772 \times 10^{6}$ $B \kern 0.18em\overline{\kern -0.18em B}$ pairs collected at the $\Upsilon(4S)$ resonance. The ratio is measured via a two-dimensional fit to the squared four-momentum transfer to the lepton pair, and the charged lepton energy in the $B$ meson rest frame, where the latter must be larger than $1$ Ge\kern -0.1em V, covering approximately $86\%$ and $78\%$ of the $\overline{B} \to X_{u} \ell \overline{\nu}$ and $\overline{B} \to X_{c} \ell \overline{\nu}$ phase space, respectively. We find $\Delta \mathcal{B}(\overline{B} \to X_{u} \ell \overline{\nu})/ \Delta \mathcal{B}(\overline{B} \to X_{c} \ell \overline{\nu}) = 0.0196(1 \pm 8.4\%_{\rm stat} \pm 7.9\%_{\rm syst})$ where the uncertainties are statistical and systematic, respectively. In addition, we report the partial branching fractions separately for charged and neutral $B$ meson decays, and for electron and muon decay channels. We place a limit on isospin breaking in $\overline{B} \to X_{u} \ell \overline{\nu}$ decays, and find no indication of lepton flavor universality violation in either the charmed or charmless mode. Furthermore, we unfold the $\overline{B} \to X_{u} \ell \overline{\nu}$ and $\overline{B} \to X_{c} \ell \overline{\nu}$ yields and report the differential ratio in lepton energy and four-momentum transfer squared.


title: The algebraic and geometric classification of transposed Poisson algebras

abstract: The algebraic and geometric classification of all complex $3$-dimensional transposed Poisson algebras is obtained. Also, we discuss strong special $3$-dimensional transposed Poisson algebras.


title: Optimal Budgeted Rejection Sampling for Generative Models

abstract: Rejection sampling methods have recently been proposed to improve the performance of discriminator-based generative models. However, these methods are only optimal under an unlimited sampling budget, and are usually applied to a generator trained independently of the rejection procedure. We first propose an Optimal Budgeted Rejection Sampling (OBRS) scheme that is provably optimal with respect to \textit{any} $f$-divergence between the true distribution and the post-rejection distribution, for a given sampling budget. Second, we propose an end-to-end method that incorporates the sampling scheme into the training procedure to further enhance the model's overall performance. Through experiments and supporting theory, we show that the proposed methods are effective in significantly improving the quality and diversity of the samples.


title: Light Shift Suppression in Coherent-Population-Trapping Atomic Clocks in the Field of Two Circularly Polarized Light Beams

abstract: The state-of-the-art miniature atomic clocks (MACs) are based on the phenomenon of coherent population trapping (CPT) in alkali-metal atomic vapors (Rb or Cs). Increasing frequency stability of the clocks is an urgent issue that will lead to significant progress in many fields of application. Here, we examine a light field configuration composed of two bichromatic light beams with opposite handedness of their circular polarization. The beams are in resonance with optical transitions in the Cs D$_1$ line ($\lambda$$\approx$$895$ nm). This configuration has already been known for observing CPT resonances of an increased contrast compared to a standard single-beam scheme. However, in contrast to previous studies, we use a scheme with two independent pump and probe beams, where the probe beam transmission is separately monitored. The experiments are carried out with a buffer-gas-filled $5$$\times$$5$$\times$$5$ mm$^3$ vapor cell. It is shown that the resonance's line shape acquires asymmetry which can be efficiently controlled by a microwave (Raman) phase between the beams. As a proof of concept, we study the way how this asymmetry can help to significantly mitigate the influence of ac Stark (light) shift on a long-term frequency stability of CPT clocks. The experimental verification is performed both with a distributed-Bragg-reflector (DBR) laser and a vertical-cavity surface-emitting laser (VCSEL). The latter has a particular importance for developing MACs. The results of experiments are in qualitative agreement with analytical theory based on a double $\Lambda$ scheme of atomic energy levels.


title: Leveraging Hyperbolic Embeddings for Coarse-to-Fine Robot Design

abstract: Multi-cellular robot design aims to create robots comprised of numerous cells that can be efficiently controlled to perform diverse tasks. Previous research has demonstrated the ability to generate robots for various tasks, but these approaches often optimize robots directly in the vast design space, resulting in robots with complicated morphologies that are hard to control. In response, this paper presents a novel coarse-to-fine method for designing multi-cellular robots. Initially, this strategy seeks optimal coarse-grained robots and progressively refines them. To mitigate the challenge of determining the precise refinement juncture during the coarse-to-fine transition, we introduce the Hyperbolic Embeddings for Robot Design (HERD) framework. HERD unifies robots of various granularity within a shared hyperbolic space and leverages a refined Cross-Entropy Method for optimization. This framework enables our method to autonomously identify areas of exploration in hyperbolic space and concentrate on regions demonstrating promise. Finally, the extensive empirical studies on various challenging tasks sourced from EvoGym show our approach's superior efficiency and generalization capability.


title: Robust and Conjugate Gaussian Process Regression

abstract: To enable closed form conditioning, a common assumption in Gaussian process (GP) regression is independent and identically distributed Gaussian observation noise. This strong and simplistic assumption is often violated in practice, which leads to unreliable inferences and uncertainty quantification. Unfortunately, existing methods for robustifying GPs break closed-form conditioning, which makes them less attractive to practitioners and significantly more computationally expensive. In this paper, we demonstrate how to perform provably robust and conjugate Gaussian process (RCGP) regression at virtually no additional cost using generalised Bayesian inference. RCGP is particularly versatile as it enables exact conjugate closed form updates in all settings where standard GPs admit them. To demonstrate its strong empirical performance, we deploy RCGP for problems ranging from Bayesian optimisation to sparse variational Gaussian processes.


title: Multi-target search in bounded and heterogeneous environments: a lattice random walk perspective

abstract: For more than a century lattice random walks have been employed ubiquitously, both as a theoretical laboratory to develop intuition of more complex stochastic processes and as a tool to interpret a vast array of empirical observations. Recent advances in lattice random walk theory in bounded and heterogeneous environments have opened up opportunities to cope with the finely resolved spatio-temporal nature of modern movement data. We review such advances and their formalisms to represent analytically the walker spatio-temporal dynamics in arbitrary dimensions and geometries. As new findings, we derive the exact spatio-temporal representation of biased walks in a periodic hexagon, we use the discrete Feynman-Kac equation to describe a walker's interaction with a radiation boundary, and we unearth a disorder indifference phenomenon. To demonstrate the power of the formalism we uncover the appearance of multiple first-passage peaks with biased walkers in a periodic hexagon, we display the dependence of the first-transmission probability on the proximity transfer efficiency between two resetting walkers in a one-dimensional periodic lattice, we present an example of spatial disorder in a two-dimensional square lattice that strongly affects the splitting probabilities to either of two targets, and we study the first-reaction dynamics in an unbounded one-dimensional lattice.


title: Asynchronous SGD on Graphs: a Unified Framework for Asynchronous Decentralized and Federated Optimization

abstract: Decentralized and asynchronous communications are two popular techniques to speedup communication complexity of distributed machine learning, by respectively removing the dependency over a central orchestrator and the need for synchronization. Yet, combining these two techniques together still remains a challenge. In this paper, we take a step in this direction and introduce Asynchronous SGD on Graphs (AGRAF SGD) -- a general algorithmic framework that covers asynchronous versions of many popular algorithms including SGD, Decentralized SGD, Local SGD, FedBuff, thanks to its relaxed communication and computation assumptions. We provide rates of convergence under much milder assumptions than previous decentralized asynchronous works, while still recovering or even improving over the best know results for all the algorithms covered.


title: Parameterized covering in semi-ladder-free hypergraphs

abstract: In this article, we study the parameterized complexity of the Set Cover problem restricted to semi-ladder-free hypergraphs, a class defined by Fabianski et al. [Proceedings of STACS 2019]. We observe that two algorithms introduced by Langerman and Morin [Discrete & Computational Geometry 2005] in the context of geometric covering problems can be adapted to this setting, yielding simple FPT and kernelization algorithms for Set Cover in semi-ladder-free hypergraphs. We complement our algorithmic results with a compression lower bound for the problem, which proves the tightness of our kernelization under standard complexity-theoretic assumptions.


abstract: We compute the Hofer-Zehnder capacity of magnetic disc tangent bundles over constant curvature surfaces. We use the fact that the magnetic geodesic flow is totally periodic and can be reparametrized to obtain a Hamiltonian circle action. The oscillation of the Hamiltonian generating the circle action immediately yields a lower bound of the Hofer-Zehnder capacity. The upper bound is obtained from Lu's bounds of the Hofer-Zehnder capacity using the theory of pseudo-holomorphic curves. In our case the gradient spheres of the Hamiltonian will give rise to the non-vanishing Gromov-Witten invariant needed.


title: Alternative Frenkel liquid Lagrangian

abstract: Based on the Caldirola-Canai approach, we endeavor to propose a dissipative scalar field theory in Minkowski space-time. We present its free particle solutions for complex $\omega^\mu$ components, and we find three profiles of dispersion relations, two of them support gapped momentum states. We also present an alternative view of this model, where dissipation acts as a geometric effect, and an effective negative scalar curvature space-time emerges. Finally, we illustrate how the present model could be adapted to describe shear waves in Frenkel liquids.


title: Dual Conditioned Diffusion Models for Out-Of-Distribution Detection: Application to Fetal Ultrasound Videos

abstract: Out-of-distribution (OOD) detection is essential to improve the reliability of machine learning models by detecting samples that do not belong to the training distribution. Detecting OOD samples effectively in certain tasks can pose a challenge because of the substantial heterogeneity within the in-distribution (ID), and the high structural similarity between ID and OOD classes. For instance, when detecting heart views in fetal ultrasound videos there is a high structural similarity between the heart and other anatomies such as the abdomen, and large in-distribution variance as a heart has 5 distinct views and structural variations within each view. To detect OOD samples in this context, the resulting model should generalise to the intra-anatomy variations while rejecting similar OOD samples. In this paper, we introduce dual-conditioned diffusion models (DCDM) where we condition the model on in-distribution class information and latent features of the input image for reconstruction-based OOD detection. This constrains the generative manifold of the model to generate images structurally and semantically similar to those within the in-distribution. The proposed model outperforms reference methods with a 12% improvement in accuracy, 22% higher precision, and an 8% better F1 score.


title: Universal symmetry of optimal control at the microscale

abstract: Optimizing the energy efficiency of driving processes provides valuable insights into the underlying physics and is of crucial importance for numerous applications, from biological processes to the design of machines and robots. Knowledge of optimal driving protocols is particularly valuable at the microscale, where energy supply is often limited. Here we investigate experimentally and theoretically the paradigmatic optimization problem of moving a potential carrying a load through a fluid, in a finite time and over a given distance, in such a way that the required work is minimal. An important step towards more realistic systems is the consideration of memory effects in the surrounding fluid, which are ubiquitous in real-world applications. Therefore, our experiments were performed in viscous and viscoelastic media, which are typical environments for synthetic and biological processes on the microscale. Despite marked differences between the protocols in both fluids, we find that the optimal control protocol and the corresponding average particle trajectory always obey a time-reversal symmetry. We show that this symmetry, which surprisingly applies here to a class of processes far from thermal equilibrium, holds universally for various systems, including active, granular, and long-range correlated media in their linear regimes. The uncovered symmetry provides a rigorous and versatile criterion for optimal control that greatly facilitates the search for energy-efficient transport strategies in a wide range of systems. Using a machine learning algorithm, we demonstrate that the algorithmic exploitation of time-reversal symmetry can significantly enhance the performance of numerical optimization algorithms.


title: Multi-GeV Wakefield Acceleration in a Plasma-Modulated Plasma Accelerator

abstract: We investigate the accelerator stage of a Plasma-Modulated Plasma Accelerator (P-MoPA) [Phys. Rev. Lett. 127, 184801 (2021)] using both the paraxial wave equation and particle-in-cell (PIC) simulations. We show that adjusting the laser and plasma parameters of the modulator stage of a P-MoPA allows the temporal profile of pulses within the pulse train to be controlled, which in turn allows the wake amplitude in the accelerator stage to be as much as 72% larger than that generated by a plasma beat-wave accelerator with the same total drive laser energy. Our analysis shows that Rosenbluth-Liu detuning is unimportant in a P-MoPA if the number of pulses in the train is less than $\sim$ 30, and that this detuning is also partially counteracted by increased red-shifting, and hence increased pulse spacing, towards the back of the train. An analysis of transverse mode oscillations of the driving pulse train is found to be in good agreement with 2D PIC simulations. PIC simulations demonstrating energy gains of $\sim$ 1.5 GeV ($\sim$ 2.5 GeV) for drive pulse energies of 2.4 J (5.0 J) are presented. Our results suggest that P-MoPAs driven by few-joule, picosecond pulses, such as those provided by high-repetition-rate thin-disk lasers, could accelerate electron bunches to multi-GeV energies at pulse repetition rates in the kilohertz range.


title: The Structure of the Solar Cycle and of the Activity Cycles of Late-Type Stars

abstract: It is shown that the description of the solar cycle that takes into account the odd zonal harmonic of the solar magnetic field allows us to deepen our knowledge of two important aspects of the solar activity. First, to clarify and expand predictions of the evolution of the cyclic activity of the Sun in the near future. Second, to develop a program for monitoring the spectrophotometric characteristics of radiation of the solar-type stars aimed at obtaining new information about their magnetic fields.


title: On a lifting of $t$-adic symmetric multiple zeta values

abstract: The $t$-adic symmetric multiple zeta value is a generalization of the symmetric multiple zeta value from the perspective of the Kaneko-Zagier conjecture. In this paper, we introduce a further generalization with a new parameter $s$, which we call the $(s,t)$-adic symmetric multiple zeta value. Then, the $(s,t)$-adic version of the $t$-adic double shuffle relations, duality and cyclic sum formula are established. A finite counterpart of the $(s,t)$-adic symmetric multiple zeta value is also discussed.


title: Diffusion models for probabilistic programming

abstract: We propose Diffusion Model Variational Inference (DMVI), a novel method for automated approximate inference in probabilistic programming languages (PPLs). DMVI utilizes diffusion models as variational approximations to the true posterior distribution by deriving a novel bound to the marginal likelihood objective used in Bayesian modelling. DMVI is easy to implement, allows hassle-free inference in PPLs without the drawbacks of, e.g., variational inference using normalizing flows, and does not make any constraints on the underlying neural network model. We evaluate DMVI on a set of common Bayesian models and show that its posterior inferences are in general more accurate than those of contemporary methods used in PPLs while having a similar computational cost and requiring less manual tuning.


title: Style Locality for Controllable Generation with kNN Language Models

abstract: Recent language models have been improved by the addition of external memory. Nearest neighbor language models retrieve similar contexts to assist in word prediction. The addition of locality levels allows a model to learn how to weight neighbors based on their relative location to the current text in source documents, and have been shown to further improve model performance. Nearest neighbor models have been explored for controllable generation but have not examined the use of locality levels. We present a novel approach for this purpose and evaluate it using automatic and human evaluation on politeness, formality, supportiveness, and toxicity textual data. We find that our model is successfully able to control style and provides a better fluency-style trade-off than previous work.


title: Group Distributionally Robust Knowledge Distillation

abstract: Knowledge distillation enables fast and effective transfer of features learned from a bigger model to a smaller one. However, distillation objectives are susceptible to sub-population shifts, a common scenario in medical imaging analysis which refers to groups/domains of data that are underrepresented in the training set. For instance, training models on health data acquired from multiple scanners or hospitals can yield subpar performance for minority groups. In this paper, inspired by distributionally robust optimization (DRO) techniques, we address this shortcoming by proposing a group-aware distillation loss. During optimization, a set of weights is updated based on the per-group losses at a given iteration. This way, our method can dynamically focus on groups that have low performance during training. We empirically validate our method, GroupDistil on two benchmark datasets (natural images and cardiac MRIs) and show consistent improvement in terms of worst-group accuracy.


title: Massive star-formation in the hub-filament system of RCW 117

abstract: We present a multiwavelength investigation of the hub-filament system RCW 117 (IRAS 17059-4132), which shows intricate filamentary features in the far-infrared, mapped using Herschel images. We obtain the column density and dust temperature maps for the region using the Herschel images, and identify 88 cores and 12 filaments from the column density map of the region ($18'\times18'$). We employ the ThrUMMS $^{13}$CO (J=1-0) data for probing the kinematics in RCW 117, and find velocity gradients ($\sim 0.3-1$ km s$^{-1}$ pc$^{-1}$) with hints of matter inflow along the filamentary structures. Ionised gas emission from the associated HII region is examined using the Giant Metrewave Radio Telescope (GMRT) at 610 and 1280 MHz, and is found to be of extent $5 \times 3$ pc$^2$ with intensity being brightest towards the hub. We estimate the peak electron density towards the hub to be $\sim 750$ cm$^{-3}$. Thirty four Class 0/I young stellar objects (YSOs) have been identified in the region using the Spitzer GLIMPSE colour-colour diagram, with many lying along the filamentary structures. Based on the (i) presence of filamentary structures, (ii) distribution of cores across the region, with $\sim39$% found along the filamentary structures, (iii) massive star-formation tracers in the hub, and (iv) the kinematics, we believe that global hierarchical collapse can plausibly explain the observed features in RCW 117.


title: Large Energy Shifts of Crystal-field Excitations in Erbium Orthoferrite Driven by Internal Magnetic Fields

abstract: Due to the complex interactions between rare-earth elements and transition metals, as well as between themselves, rare-earth transition-metal oxides are likely to exhibit highly intriguing and novel magnetic structures and dynamic behaviours. Rare-earth elements in these compounds frequently demonstrate unusual behaviours in their crystal-field (CF) excitations, which necessitate thorough studies for in-depth comprehensions. When cooling from 10 K to 1.5 K through the magnetic ordering temperature of $Er^{3+}$ at 4.1 K, we observed a significant energy shift of the low-lying CF excitation of $Er^{3+}$ in erbium orthoferrite ($ErFeO_3$) from 0.32 meV to 0.75 meV utilizing the inelastic neutron-scattering technique. A sound CF model was proposed for $Er^{3+}$ in $ErFeO_3$ by fitting to the observed CF excitation peaks, which enables to explain all the observed experimental results in a very consistent manner. According to the model, the ground crystal field level of $Er^{3+}$, which corresponds to the lowest Kramers doublet supposed to be at zero energy transfer, has been shifted by the internal magnetic fields induced by both $Er^{3+}$ and $Fe^{3+}$ spin orders below and above the $Er^{3+}$ ordering temperature, respectively. Additional measurements in various magnetic fields offer compelling evidence in favour of this hypothesis. The measured external field dependence of the CF excitation energy led to a derivation of the internal field of $Er^{3+}$ as 0.54 T, which is strongly corroborated by theoretical modelling. Additionally, the g-factor for the $Er^{3+}$ ground state in $ErFeO_3$ shows an exceptionally significant anisotropy.


title: Peaks and widths of radio-frequency spectra: An analysis of the phase diagram of ultra-cold Fermi gases

abstract: We provide a comprehensive theoretical study of the radio-frequency (rf) spectra of a two-component Fermi gas with balanced populations in the normal region of the temperature-vs-coupling phase diagram. In particular, rf spectra are analyzed in terms of two characteristic peaks, which can be either distinct or overlapping. On the BEC side of the crossover, these two contributions are associated with a fermionic quasi-particle peak and a bosonic-like contribution due to pairing. On the BCS side of the crossover, the two peaks are instead associated with interactions between particles occurring, respectively, at high or low relative momenta. Through this two-peak analysis, we show how and to what extent the correlation between the widths of the rf spectra and the pair size, previously identified in the superfluid phase at low temperature, can be extended to the normal phase, as well as how the temperature-vs-coupling phase diagram of the BCS-BEC crossover can be partitioned in a number of distinct physical sectors. Several analytic results for the shape and widths of the rf spectra are also derived in appropriate temperature and coupling limits.


title: Comparative analysis of taper models for Pinus nigra: A study across parametric, semi-parametric, and non-parametric models using terrestrial laser scanner acquired data

abstract: Taper equations are indispensable tools for characterizing the stem profile of trees, providing valuable insights for forest management, timber inventory, and optimal assortments allocation. The recent progress in Terrestrial Laser Scanning (TLS) has revolutionized forest inventory practices by enabling non-destructive data collection. In this study, four taper models from three different model categories were established based on point cloud data of 219 Pinus nigra trees. The taper equations fitted with TLS data were used to predict the diameter at specific stem heights and the total stem volume. The results show that among fitted models, the Max and Burkhart segmented model calibrated by the means of a mixed-effects approach provided the best estimate of the diameter at different heights and the total stem volume evaluated for different diameter at breast height (DBH) classes. In numerical terms, this model estimated the diameter and the volume with a respective overall error of 0.781 cm and 0.021 m3. The predicted profile also shows that above a relative height of 0.7, the diameter error tends to increase due to the low reliability of data collected beyond the base of the crown primarily caused by interference from branches and leaves. Nevertheless, this study shows that TLS technology presents a compelling opportunity and a promising non-destructive alternative for generating taper profiles and estimating tree volume.


title: Fixed-Budget Best-Arm Identification in Sparse Linear Bandits

abstract: We study the best-arm identification problem in sparse linear bandits under the fixed-budget setting. In sparse linear bandits, the unknown feature vector $\theta^*$ may be of large dimension $d$, but only a few, say $s \ll d$ of these features have non-zero values. We design a two-phase algorithm, Lasso and Optimal-Design- (Lasso-OD) based linear best-arm identification. The first phase of Lasso-OD leverages the sparsity of the feature vector by applying the thresholded Lasso introduced by Zhou (2009), which estimates the support of $\theta^*$ correctly with high probability using rewards from the selected arms and a judicious choice of the design matrix. The second phase of Lasso-OD applies the OD-LinBAI algorithm by Yang and Tan (2022) on that estimated support. We derive a non-asymptotic upper bound on the error probability of Lasso-OD by carefully choosing hyperparameters (such as Lasso's regularization parameter) and balancing the error probabilities of both phases. For fixed sparsity $s$ and budget $T$, the exponent in the error probability of Lasso-OD depends on $s$ but not on the dimension $d$, yielding a significant performance improvement for sparse and high-dimensional linear bandits. Furthermore, we show that Lasso-OD is almost minimax optimal in the exponent. Finally, we provide numerical examples to demonstrate the significant performance improvement over the existing algorithms for non-sparse linear bandits such as OD-LinBAI, BayesGap, Peace, LinearExploration, and GSE.


title: A Portable Ultrasound Imaging Pipeline Implementation with GPU Acceleration on Nvidia CLARA AGX

abstract: In this paper, we present a GPU-accelerated prototype implementation of a portable ultrasound imaging pipeline on an Nvidia CLARA AGX development kit. The raw data is acquired with nonsteered plane wave transmit using a programmable handheld open platform that supports 128-channel transmit and 64-channel receive. The received signals are transferred to the Nvidia CLARA AGX developer platform through a host system for accelerated imaging. GPU-accelerated implementation of the conventional delay and sum (DAS) beamformer along with two adaptive nonlinear beamformers and two Fourier-based techniques was performed. The feasibility of the complete pipeline and its imaging performance was evaluated with in-vitro phantom imaging experiments and the efficacy is demonstrated with preliminary in-vivo scans. The image quality quantified by the standard contrast and resolution metrics was comparable with that of the CPU implementation. The execution speed of the implemented beamformers was also investigated for different sizes of imaging grids and a significant speedup as high as 180 times that of the CPU implementation was observed. Since the proposed pipeline involves Nvidia CLARA AGX, there is always the potential for easy incorporation of online/active learning approaches.


title: DEFN: Dual-Encoder Fourier Group Harmonics Network for Three-Dimensional Indistinct-Boundary Object Segmentation

abstract: The precise spatial and quantitative delineation of indistinct-boundary medical objects is paramount for the accuracy of diagnostic protocols, efficacy of surgical interventions, and reliability of postoperative assessments. Despite their significance, the effective segmentation and instantaneous three-dimensional reconstruction are significantly impeded by the paucity of representative samples in available datasets and noise artifacts. To surmount these challenges, we introduced Stochastic Defect Injection (SDi) to augment the representational diversity of challenging indistinct-boundary objects within training corpora. Consequently, we propose the Dual-Encoder Fourier Group Harmonics Network (DEFN) to tailor noise filtration, amplify detailed feature recognition, and bolster representation across diverse medical imaging scenarios. By incorporating Dynamic Weight Composing (DWC) loss dynamically adjusts model's focus based on training progression, DEFN achieves SOTA performance on the OIMHS public dataset, showcasing effectiveness in indistinct boundary contexts. Source code for DEFN is available at: https://github.com/IMOP-lab/DEFN-pytorch.


title: A unifying Rayleigh-Plesset-type equation for bubbles in viscoelastic media

abstract: Understanding the ultrasound pressure-driven dynamics of microbubbles confined in viscoelastic materials is relevant for multiple biomedical applications, ranging from contrast-enhanced ultrasound imaging to ultrasound-assisted drug delivery. The volumetric oscillations of spherical bubbles is analyzed using the Rayleigh-Plesset equation, which describes the conservation of mass and momentum in the surrounding medium. Several studies have considered an extension of the Rayleigh-Plesset equation for bubbles embedded into viscoelastic media, but these are restricted to a particular choice of constitutive model and/or to small deformations. Here, we derive a unifying equation applicable to bubbles in viscoelastic media with arbitrary complex moduli and that can account for large bubble deformations. To derive this equation, we borrow concepts from finite-strain theory. We validate our approach by comparing the result of our model to previously published results and extend it to show how microbubbles behave in arbitrary viscoelastic materials. In particular, we use our viscoelastic Rayleigh-Plesset model to compute the bubble dynamics in benchmarked viscoelastic liquids and solids.


title: A Moment Map for the Space of Maps to a Balanced Manifold

abstract: Given a complex balanced manifold $X$ and a compact complex manifold $S$ equipped with a positive volume form $dV>0$ and satisfying an extra condition such that $\mbox{dim}\,S\geq\mbox{dim}\,X -1$, we construct a moment map for the action of the Lie group of biholomorphisms of $S$ that preserve $dV$ onto the space of holomorphic maps $f:S\longrightarrow X$ that satisfy a certain condition with respect to the Bott-Chern cohomology class of the balanced metric of $X$. The purpose is twofold: to study such maps as a possible addition to some very recent hyperbolicity notions involving holomorphic maps with a certain type of growth from some $\C^p$, rather than $S$, to $X$; and to lay the groundwork for a possible future construction of balanced quotients as an analogue of the classical symplectic quotients.


title: Coherent electroproduction of vector mesons on spinless targets

abstract: The amplitude ratios of vector-meson production by heavy photons on spinless targets are shown to can be explicitly expressed in terms of the spin-density-matrix elements (SDMEs) only if the lepton beam is longitudinally polarized. Making use of the amplitude ratios as free fit parameters instead of the SDMEs reduces the number of the real parameters in data description from 23 to 8. The exact formula for $R = \frac{d \sigma_L}{d t}/\frac{d \sigma_T}{d t}$ in terms of the SDMEs is obtained for spinless targets and the new approximate formula for $R$ is proposed for nucleon targets.


title: Echo-evolution data generation for quantum error mitigation via neural networks

abstract: Neural networks provide a prospective tool for error mitigation in quantum simulation of physical systems. However, we need both noisy and noise-free data to train neural networks to mitigate errors in quantum computing results. Here, we propose a physics-motivated method to generate training data for quantum error mitigation via neural networks, which does not require classical simulation and target circuit simplification. In particular, we propose to use the echo evolution of a quantum system to collect noisy and noise-free data for training a neural network. Under this method, the initial state evolves forward and backward in time, returning to the initial state at the end of evolution. When run on the noisy quantum processor, the resulting state will be influenced by with quantum noise accumulated during evolution. Having a vector of observable values of the initial (noise-free) state and the resulting (noisy) state allows us to compose training data for a neural network. We demonstrate that a feed-forward fully connected neural network trained on echo-evolution-generated data can correct results of forward-in-time evolution. Our findings can enhance the application of neural networks to error mitigation in quantum computing.


title: Comparing Optimization Targets for Contrast-Consistent Search

abstract: We investigate the optimization target of Contrast-Consistent Search (CCS), which aims to recover the internal representations of truth of a large language model. We present a new loss function that we call the Midpoint-Displacement (MD) loss function. We demonstrate that for a certain hyper-parameter value this MD loss function leads to a prober with very similar weights to CCS. We further show that this hyper-parameter is not optimal and that with a better hyper-parameter the MD loss function attains a higher test accuracy than CCS.


title: Deep Neural Networks for Automatic Speaker Recognition Do Not Learn Supra-Segmental Temporal Features

abstract: While deep neural networks have shown impressive results in automatic speaker recognition and related tasks, it is dissatisfactory how little is understood about what exactly is responsible for these results. Part of the success has been attributed in prior work to their capability to model supra-segmental temporal information (SST), i.e., learn rhythmic-prosodic characteristics of speech in addition to spectral features. In this paper, we (i) present and apply a novel test to quantify to what extent the performance of state-of-the-art neural networks for speaker recognition can be explained by modeling SST; and (ii) present several means to force respective nets to focus more on SST and evaluate their merits. We find that a variety of CNN- and RNN-based neural network architectures for speaker recognition do not model SST to any sufficient degree, even when forced. The results provide a highly relevant basis for impactful future research into better exploitation of the full speech signal and give insights into the inner workings of such networks, enhancing explainability of deep learning for speech technologies.


title: Accelerated particle beams in a 3D simulation of the quiet Sun. Effects of advanced beam propagation modelling

abstract: Charged particles are constantly accelerated to non-thermal energies by the reconnecting magnetic field in the solar atmosphere. Our understanding of the interactions between the particles and their environment can benefit from three-dimensional atmospheric simulations accounting for non-thermal particle beams. In a previous publication, we presented the first results from such a simulation. However, the original treatment of beam propagation ignores potentially important phenomena. Here, we present a more general beam propagation model incorporating magnetic gradient forces, the return current, acceleration by the ambient electric field, and temperature-dependent collision rates. Neglecting collisional velocity randomisation makes the model sufficiently lightweight to simulate millions of beams. We investigate how each new physical effect changes beam energy transport in a three-dimensional atmosphere. We applied the method of characteristics to the steady-state continuity equation for electron flux to derive ordinary differential equations for the mean evolution of energy, pitch angle, and flux with distance. For each beam, we solved these numerically for a range of initial energies to obtain the evolving flux spectrum, from which we computed the energy deposited into the ambient plasma. Magnetic gradient forces significantly influence the deposition of beam energy. The strong magnetic field convergence leads to a small coronal deposition peak followed by a heavy dip caused by the onset of magnetic mirroring. Mirrored electrons carry away 5 to 10% of the injected beam energy on average. The transition region peak produced by the remaining energetic electrons occurs slightly deeper than in a uniform magnetic field. An initial diverging magnetic field enhances the subsequent impact of mirroring. The other new physical effects are less significant for the studied atmospheric conditions.


title: Bayes-enhanced Multi-view Attention Networks for Robust POI Recommendation

abstract: POI recommendation is practically important to facilitate various Location-Based Social Network services, and has attracted rising research attention recently. Existing works generally assume the available POI check-ins reported by users are the ground-truth depiction of user behaviors. However, in real application scenarios, the check-in data can be rather unreliable due to both subjective and objective causes including positioning error and user privacy concerns, leading to significant negative impacts on the performance of the POI recommendation. To this end, we investigate a novel problem of robust POI recommendation by considering the uncertainty factors of the user check-ins, and proposes a Bayes-enhanced Multi-view Attention Network. Specifically, we construct personal POI transition graph, the semantic-based POI graph and distance-based POI graph to comprehensively model the dependencies among the POIs. As the personal POI transition graph is usually sparse and sensitive to noise, we design a Bayes-enhanced spatial dependency learning module for data augmentation from the local view. A Bayesian posterior guided graph augmentation approach is adopted to generate a new graph with collaborative signals to increase the data diversity. Then both the original and the augmented graphs are used for POI representation learning to counteract the data uncertainty issue. Next, the POI representations of the three view graphs are input into the proposed multi-view attention-based user preference learning module. By incorporating the semantic and distance correlations of POIs, the user preference can be effectively refined and finally robust recommendation results are achieved. The results of extensive experiments show that BayMAN significantly outperforms the state-of-the-art methods in POI recommendation when the available check-ins are incomplete and noisy.


title: Evaluating scattering amplitudes with pySecDec 1.6

abstract: pSecDec is a computer tool to evaluate Feynman integrals and their weighted sums (amplitudes) using the method of sector decomposition and numerical integration. The new release of pySecDec version 1.6 comes with a significant performance boost (3x-9x in common scenarios), and new features to make the evaluation and asymptotic expansion of amplitudes and integrals easier and faster. In this article we briefly review these features.


title: The stability of deep learning for 21cm foreground removal across various sky models and frequency-dependent systematics

abstract: Deep learning (DL) has recently been proposed as a novel approach for 21cm foreground removal. Before applying DL to real observations, it is essential to assess its consistency with established methods, its performance across various simulation models and its robustness against instrumental systematics. This study develops a commonly used U-Net and evaluates its performance for post-reionisation foreground removal across three distinct sky simulation models based on pure Gaussian realisations, the Lagrangian perturbation theory, and the Planck sky model. Stable outcomes across the models are achieved provided that training and testing data align with the same model. On average, the residual foreground in the U-Net reconstructed data is $\sim$10% of the signal across angular scales at the considered redshift range. Comparable results are found with traditional approaches. However, blindly using a network trained on one model for data from another model yields inaccurate reconstructions, emphasising the need for consistent training data. The study then introduces frequency-dependent Gaussian beams and gain drifts to the test data. The network struggles to denoise data affected by "unexpected" systematics without prior information. However, after re-training consistently with systematics-contaminated data, the network effectively restores its reconstruction accuracy. This highlights the importance of incorporating prior systematics knowledge during training for successful denoising. Our work provides critical guidelines for using DL for 21cm foreground removal, tailored to specific data attributes. Notably, it is the first time that DL has been applied to the Planck sky model being most realistic foregrounds at present.


title: Symmetry-Resolved Entanglement Entropy for Local and Non-local QFTs

abstract: In this paper, we study symmetry-resolved entanglement entropy in free bosonic quantum many-body systems. Precisely, by making use of the lattice regularization scheme, we compute symmetry-resolved R\'enyi entropies for free complex scalar fields as well as for a simple class of non-local field theories in which entanglement entropy exhibits volume-law scaling. We present effective and approximate eigenvalues for the correlation matrix used to compute the symmetry-resolved entanglement entropy and show that they are consistent with the numerical results. Furthermore, we explore the equipartition of entanglement entropy and verify an effective equipartition in the massless limit. Finally, we make a comment on the entanglement entropy in the non-local quantum field theories and write down an explicit expression for the symmetry-resolved R\'enyi entropies.


title: Studying the production mechanisms of light meson resonances in two-pion photoproduction

abstract: A theoretical model of two-pion photoproduction is presented. The model encodes the prominent $\rho(770)$ resonance and the expected leading background contribution coming from the Deck mechanism. To validate the model, angular moments are computed and compared with the CLAS dataset. After fitting a number of free parameters, the model provides a good description of the data.


title: Generating HSR Bogie Vibration Signals via Pulse Voltage-Guided Conditional Diffusion Model

abstract: Generative Adversarial Networks (GANs) for producing realistic signals, have substantially improved fault diagnosis algorithms in various Internet of Things (IoT) systems. However, challenges such as training instability and dynamical inaccuracy limit their utility in high-speed rail (HSR) bogie fault diagnosis. To address these challenges, we introduce the Pulse Voltage-Guided Conditional Diffusion Model (VGCDM). Unlike traditional implicit GANs, VGCDM adopts a sequential U-Net architecture, facilitating multi-phase denoising diffusion for generation, which bolsters training stability and mitigate convergence issues. VGCDM also incorporates control pulse voltage by cross-attention mechanism to ensure the alignment of vibration with voltage signals, enhancing the Conditional Diffusion Model's progressive controlablity. Consequently, solely straightforward sampling of control voltages, ensuring the efficient transformation from Gaussian Noise to vibration signals. This adaptability remains robust even in scenarios with time-varying speeds. To validate the effectiveness, we conducted two case studies using SQ dataset and high-simulation HSR bogie dataset. The results of our experiments unequivocally confirm that VGCDM outperforms other generative models, achieving the best RSME, PSNR, and FSCS, showing its superiority in conditional HSR bogie vibration signal generation. For access, our code is available at https://github.com/xuanliu2000/VGCDM.


title: Segregation and Collisions in Galactic Nuclei: Rates of Destructive Events Near a Supermassive Black Hole

abstract: The centers of galaxies host a supermassive black hole surrounded by a dense stellar cluster. The cluster is expected to develop mass segregation, in which gravitational scatterings among the stars cause heavier objects to sink closer to the central black hole, while lighter objects will tend to be overconcentrated in the outer regions. This work focuses on the implications of mass segregation on the different channels for violent destruction of stars in the cluster: tidal disruptions, gravitational-wave-driven inspirals and high-velocity destructive collisions between stars. All such events occur close to the central black hole, where the heavier objects congregate. The analysis is based on a simplified Monte Carlo simulation, which evolves a two-mass population in a cluster surrounding a Milky Way-like super massive black hole. The simulation is based on the single-mass scheme used by \citet{SariFragione2019} and \citet{BalbergYassur2023}, which has been extended to allow for the dynamical friction effects typical of unequal mass populations. The effects of mass segregation on the rates of the different destruction channels are analyzed self-consistently in the overall evolution of the cluster. Also considered are stars which are injected into the cluster after being disrupted from a binary system by the supermassive black hole (SMBH). Such stars are captured in the inner regions of the cluster, and so their orbital evolution, as well as their destruction rate, are therefore influenced by heavy objects that might be abundant in the vicinity of the SMBH.


title: Measuring the Electric and Magnetic Form Factors of Protons and Antiprotons at small $Q^2$ and the charge radii of hadrons

abstract: Charge radii of hadrons are back in the focus since precision spectroscopic measurements in muonic hydrogen revealed a proton charge radius considerably smaller than generally accepted ever since R.~Hofstaedter's pioneering experiments. Recent experimental results also point to an underestimation of systematic uncertainties in most previous measurements. A new method was thus proposed by AMBER at CERN using elastic scattering by very high energy muons using an active hydrogen target. With a simplified setup we may resume elastic scattering of $\pi$ and K mesons on electrons in inverse kinematics, and, for the first time, probe antiprotons with few percent precision for their charge radius. Applying this method also for protons allows a separation of $G_E^p(Q^2)$ and $G_M^p(Q^2)$ down to $Q^2=10^{-3}(GeV/c)^2$.


title: The limit theory of the energy-critical complex Ginzburg-Landau equation

abstract: We study the limit behavior of the solutions to energy-critical complex Ginzburg-Landau equation. We give a rigorous theory of the zero-dispersion limit from energy-critical complex Ginzburg-Landau equation to energy-critical nonlinear heat equation for dimensions 3 and 4 in both the defocusing and focusing cases by energy method. Furthermore, we also show the invisicid limit of energy-critical complex Ginzburg-Landau equation to energy-critical nonlinear Schr\"odinger equation for dimension 4 in the focusing case.


title: Intriguing Properties of Data Attribution on Diffusion Models

abstract: Data attribution seeks to trace model outputs back to training data. With the recent development of diffusion models, data attribution has become a desired module to properly assign valuations for high-quality or copyrighted training samples, ensuring that data contributors are fairly compensated or credited. Several theoretically motivated methods have been proposed to implement data attribution, in an effort to improve the trade-off between computational scalability and effectiveness. In this work, we conduct extensive experiments and ablation studies on attributing diffusion models, specifically focusing on DDPMs trained on CIFAR-10 and CelebA, as well as a Stable Diffusion model LoRA-finetuned on ArtBench. Intriguingly, we report counter-intuitive observations that theoretically unjustified design choices for attribution empirically outperform previous baselines by a large margin, in terms of both linear datamodeling score and counterfactual evaluation. Our work presents a significantly more efficient approach for attributing diffusion models, while the unexpected findings suggest that at least in non-convex settings, constructions guided by theoretical assumptions may lead to inferior attribution performance. The code is available at https://github.com/sail-sg/D-TRAK.


title: Magnetic properties of multi-domain epitaxial EuPd$_2$ thin films

abstract: Europium intermetallic compounds show a variety of different ground states and anomalous physical properties due to the interactions between the localized 4f electrons and the delocalized electronic states. Europium is also the most reactive of the rare earth metals which might be the reason why very few works are concerned with the properties of Eu-based thin films. Here we address the low-temperature magnetic properties of ferromagnetic EuPd$_2$ thin films prepared by molecular beam epitaxy. The epitaxial (111)-oriented thin films grow on MgO (100) with eight different domain orientations. We analyze the low-temperature magnetic hysteresis behavior by means of micromagnetic simulations taking the multi-domain morphology explicitly into account and quantify the magnetic crystal anisotropy contribution. By ab initio calculations we trace back the microscopic origin of the magnetic anisotropy to thin film-induced biaxial strain.


title: Efficient LLM Inference on CPUs

abstract: Large language models (LLMs) have demonstrated remarkable performance and tremendous potential across a wide range of tasks. However, deploying these models has been challenging due to the astronomical amount of model parameters, which requires a demand for large memory capacity and high memory bandwidth. In this paper, we propose an effective approach that can make the deployment of LLMs more efficiently. We support an automatic INT4 weight-only quantization flow and design a special LLM runtime with highly-optimized kernels to accelerate the LLM inference on CPUs. We demonstrate the general applicability of our approach on popular LLMs including Llama2, Llama, GPT-NeoX, and showcase the extreme inference efficiency on CPUs. The code is publicly available at: https://github.com/intel/intel-extension-for-transformers.


title: Ray computational ghost imaging based on rotational modulation method

abstract: The CGI (CGI) has the potential of low cost, low dose, and high resolution, which is very attractive for the development of radiation imaging field. However, many sub-coding plates must be used in the modulation process, which greatly affects the development of CGI technology. In order to reduce the coding plates, we refer to the rotation method of computed tomography (CT), then propose a novel CGI method based on rotational modulation method of a single-column striped coding plate. This method utilizes the spatial variation of a single sub-coding plate (rotation) to realize multiple modulation of the ray field and improves the utilization rate of a single sub-coding plate. However, for this rotation scheme of CGI, the traditional binary modulation matrix is no longer applicable. To obtain the system matrix of the rotated striped coding plate, an area model based on beam boundaries is established. Subsequently, numerical and Monte Carlo simulations were conducted. The results reveal that our scheme enables high-quality imaging of N*N resolution objects using only N sub-coding plates, under both full-sampling and under-sampling scenarios. Moreover, our scheme demonstrates superiority over the Hadamard scheme in both imaging quality and the number of required sub-coding plates, whether in scenarios of full-sampling or under-sampling. Finally, an {\alpha} ray imaging platform was established to further demonstrate the feasibility of the rotational modulation method. By employing our scheme, a mere 8 sub-coding plates were employed to achieve CGI of the radiation source intensity distribution, achieving a resolution of 8*8. Therefore, the novel ray CGI based on rotational modulation method can achieve high-quality imaging effect with fewer sub-coding plates, which has important practical value and research significance for promoting single-pixel radiation imaging technology.


title: A complementary experimental study of epitaxial La0.67Sr0.33MnO3 to identify morphological and chemical disorder

abstract: Gaining insight into the characteristics of epitaxial complex oxide films is essential to control the behavior of devices and catalytic processes. It is known that substrate induced strain, doping, and layer growth can affect the electronic and magnetic properties of the film's bulk. In this study, we demonstrate a clear distinction between the bulk and surface of thin films of La0.67Sr0.33MnO3 in terms of chemical composition, electronic disorder, and surface morphology. We employed a combined experimental approach of X-ray based characterization methods and scanning probe microscopy. X-ray diffraction and resonant X-ray reflectivity revealed surface non-stochiometry in the strontium and lanthanum, as well as an accumulation of oxygen vacancies. Scanning tunneling microscopy showed a staggered growth surface morphology accompanied by an electronic phase separation (EPS) related to this non-stochiometry. The EPS is likely responsible for the temperature-dependent resistivity transition and is a cause of a proposed mixed-phase ferromagnetic and paramagnetic state near room temperature in these thin films.