title: Circuit Knitting Faces Exponential Sampling Overhead Scaling Bounded by Entanglement Cost

abstract: Circuit knitting, a method for connecting quantum circuits across multiple processors to simulate nonlocal quantum operations, is a promising approach for distributed quantum computing. While various techniques have been developed for circuit knitting, we uncover fundamental limitations to the scalability of this technology. We prove that the sampling overhead of circuit knitting is exponentially lower bounded by the exact entanglement cost of the target bipartite dynamic, even for asymptotic overhead in the parallel cut regime. Specifically, we prove that the regularized sampling overhead assisted with local operations and classical communication (LOCC), of any bipartite quantum channel is lower bounded by the exponential of its exact entanglement cost under separable preserving operations. Furthermore, we show that the regularized sampling overhead for simulating a general bipartite channel via LOCC is lower bounded by $\kappa$-entanglement and max-Rains information, providing efficiently computable benchmarks. Our work reveals a profound connection between virtual quantum information processing via quasi-probability decomposition and quantum Shannon theory, highlighting the critical role of entanglement in distributed quantum computing.


title: LCM-Lookahead for Encoder-based Text-to-Image Personalization

abstract: Recent advancements in diffusion models have introduced fast sampling methods that can effectively produce high-quality images in just one or a few denoising steps. Interestingly, when these are distilled from existing diffusion models, they often maintain alignment with the original model, retaining similar outputs for similar prompts and seeds. These properties present opportunities to leverage fast sampling methods as a shortcut-mechanism, using them to create a preview of denoised outputs through which we can backpropagate image-space losses. In this work, we explore the potential of using such shortcut-mechanisms to guide the personalization of text-to-image models to specific facial identities. We focus on encoder-based personalization approaches, and demonstrate that by tuning them with a lookahead identity loss, we can achieve higher identity fidelity, without sacrificing layout diversity or prompt alignment. We further explore the use of attention sharing mechanisms and consistent data generation for the task of personalization, and find that encoder training can benefit from both.


title: Identifying Quasars from the DESI Bright Galaxy Survey

abstract: The Dark Energy Spectroscopic Instrument (DESI) cosmology survey includes a Bright Galaxy Survey (BGS) which will yield spectra for over ten million bright galaxies (r<20.2 AB mag). The resulting sample will be valuable for both cosmological and astrophysical studies. However, the star/galaxy separation criterion implemented in the nominal BGS target selection algorithm excludes quasar host galaxies in addition to bona fide stars. While this excluded population is comparatively rare (~3-4 per square degrees), it may hold interesting clues regarding galaxy and quasar physics. Therefore, we present a target selection strategy that was implemented to recover these missing active galactic nuclei (AGN) from the BGS sample. The design of the selection criteria was both motivated and confirmed using spectroscopy. The resulting BGS-AGN sample is uniformly distributed over the entire DESI footprint. According to DESI survey validation data, the sample comprises 93% quasi-stellar objects (QSOs), 3% narrow-line AGN or blazars with a galaxy contamination rate of 2% and a stellar contamination rate of 2%. Peaking around redshift z=0.5, the BGS-AGN sample is intermediary between quasars from the rest of the BGS and those from the DESI QSO sample in terms of redshifts and AGN luminosities. The stacked spectrum is nearly identical to that of the DESI QSO targets, confirming that the sample is dominated by quasars. We highlight interesting small populations reaching z>2 which are either faint quasars with nearby projected companions or very bright quasars with strong absorption features including the Lyman-apha forest, metal absorbers and/or broad absorption lines.


title: Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models

abstract: Large language models (LLMs) have exhibited impressive performance in language comprehension and various reasoning tasks. However, their abilities in spatial reasoning, a crucial aspect of human cognition, remain relatively unexplored. Human possess a remarkable ability to create mental images of unseen objects and actions through a process known as the Mind's Eye, enabling the imagination of the unseen world. Inspired by this cognitive capacity, we propose Visualization-of-Thought (VoT) prompting. VoT aims to elicit spatial reasoning of LLMs by visualizing their reasoning traces, thereby guiding subsequent reasoning steps. We employed VoT for multi-hop spatial reasoning tasks, including natural language navigation, visual navigation, and visual tiling in 2D grid worlds. Experimental results demonstrated that VoT significantly enhances the spatial reasoning abilities of LLMs. Notably, VoT outperformed existing multimodal large language models (MLLMs) in these tasks. While VoT works surprisingly well on LLMs, the ability to generate mental images to facilitate spatial reasoning resembles the mind's eye process, suggesting its potential viability in MLLMs.


title: Unveiling LLMs: The Evolution of Latent Representations in a Temporal Knowledge Graph

abstract: Large Language Models (LLMs) demonstrate an impressive capacity to recall a vast range of common factual knowledge information. However, unravelling the underlying reasoning of LLMs and explaining their internal mechanisms of exploiting this factual knowledge remain active areas of investigation. Our work analyzes the factual knowledge encoded in the latent representation of LLMs when prompted to assess the truthfulness of factual claims. We propose an end-to-end framework that jointly decodes the factual knowledge embedded in the latent space of LLMs from a vector space to a set of ground predicates and represents its evolution across the layers using a temporal knowledge graph. Our framework relies on the technique of activation patching which intervenes in the inference computation of a model by dynamically altering its latent representations. Consequently, we neither rely on external models nor training processes. We showcase our framework with local and global interpretability analyses using two claim verification datasets: FEVER and CLIMATE-FEVER. The local interpretability analysis exposes different latent errors from representation to multi-hop reasoning errors. On the other hand, the global analysis uncovered patterns in the underlying evolution of the model's factual knowledge (e.g., store-and-seek factual information). By enabling graph-based analyses of the latent representations, this work represents a step towards the mechanistic interpretability of LLMs.


title: Standardizing Knowledge Engineering Practices with a Reference Architecture

abstract: Knowledge engineering is the process of creating and maintaining knowledge-producing systems. Throughout the history of computer science and AI, knowledge engineering workflows have been widely used given the importance of high-quality knowledge for reliable intelligent agents. Meanwhile, the scope of knowledge engineering, as apparent from its target tasks and use cases, has been shifting, together with its paradigms such as expert systems, semantic web, and language modeling. The intended use cases and supported user requirements between these paradigms have not been analyzed globally, as new paradigms often satisfy prior pain points while possibly introducing new ones. The recent abstraction of systemic patterns into a boxology provides an opening for aligning the requirements and use cases of knowledge engineering with the systems, components, and software that can satisfy them best. This paper proposes a vision of harmonizing the best practices in the field of knowledge engineering by leveraging the software engineering methodology of creating reference architectures. We describe how a reference architecture can be iteratively designed and implemented to associate user needs with recurring systemic patterns, building on top of existing knowledge engineering workflows and boxologies. We provide a six-step roadmap that can enable the development of such an architecture, providing an initial design and outcome of the definition of architectural scope, selection of information sources, and analysis. We expect that following through on this vision will lead to well-grounded reference architectures for knowledge engineering, will advance the ongoing initiatives of organizing the neurosymbolic knowledge engineering space, and will build new links to the software architectures and data science communities.


title: Universal Time-Entanglement Trade-off in Open Quantum Systems

abstract: We demonstrate a surprising connection between pure steady state entanglement and relaxation timescales in an extremely broad class of Markovian open systems, where two (possibly many-body) systems $A$ and $B$ interact locally with a common dissipative environment. This setup also encompases a broad class of adaptive quantum dynamics based on continuous measurement and feedback. As steady state entanglement increases, there is generically an emergent strong symmetry that leads to a dynamical slow down. Using this we can prove rigorous bounds on relaxation times set by steady state entanglement. We also find that this time must necessarily diverge for maximal entanglement. To test our bound, we consider the dynamics of a random ensemble of local Lindbladians that support pure steady states, finding that the bound does an excellent job of predicting how the dissipative gap varies with the amount of entanglement. Our work provides general insights into how dynamics and entanglement are connected in open systems, and has specific relevance to quantum reservoir engineering.


title: Training LLMs over Neurally Compressed Text

abstract: In this paper, we explore the idea of training large language models (LLMs) over highly compressed text. While standard subword tokenizers compress text by a small factor, neural text compressors can achieve much higher rates of compression. If it were possible to train LLMs directly over neurally compressed text, this would confer advantages in training and serving efficiency, as well as easier handling of long text spans. The main obstacle to this goal is that strong compression tends to produce opaque outputs that are not well-suited for learning. In particular, we find that text na\"ively compressed via Arithmetic Coding is not readily learnable by LLMs. To overcome this, we propose Equal-Info Windows, a novel compression technique whereby text is segmented into blocks that each compress to the same bit length. Using this method, we demonstrate effective learning over neurally compressed text that improves with scale, and outperforms byte-level baselines by a wide margin on perplexity and inference speed benchmarks. While our method delivers worse perplexity than subword tokenizers for models trained with the same parameter count, it has the benefit of shorter sequence lengths. Shorter sequence lengths require fewer autoregressive generation steps, and reduce latency. Finally, we provide extensive analysis of the properties that contribute to learnability, and offer concrete suggestions for how to further improve the performance of high-compression tokenizers.


title: Injective norm of real and complex random tensors I: From spin glasses to geometric entanglement

abstract: The injective norm is a natural generalization to tensors of the operator norm of a matrix. In quantum information, the injective norm is one important measure of genuine multipartite entanglement of quantum states, where it is known as the geometric entanglement. In this paper, we give a high-probability upper bound on the injective norm of real and complex Gaussian random tensors, corresponding to a lower bound on the geometric entanglement of random quantum states, and to a bound on the ground-state energy of a particular multispecies spherical spin glass model. For some cases of our model, previous work used $\epsilon$-net techniques to identify the correct order of magnitude; in the present work, we use the Kac--Rice formula to give a one-sided bound on the constant which we believe to be tight.


title: A Canonical Quantization of Poisson Manifolds: a 2-Groupoid Scheme

abstract: We canonically quantize a Poisson manifold to a Lie 2-groupoid, complete with a quantization map, and show that it relates geometric and deformation quantization: the perturbative expansion in $\hbar$ of the (formal) convolution of two quantized functions yields Kontsevich's star product. Meanwhile, we can push forward this quantization map (by integrating over homotopies of paths) to obtain a quantization map in traditional geometric quantization. This gives a polarization-free, path integral definition of the quantization map, which does not have a prior prescription for Poisson manifolds and which only has a partial prescription for symplectic manifolds. We show that in conventional quantum mechanics our operators are defined on the entire prequantum Hilbert space and that they all preserve polarized sections, contrary to the Kostant-Souriau approach.


title: ROBUST: 221 Bugs in the Robot Operating System

abstract: As robotic systems such as autonomous cars and delivery drones assume greater roles and responsibilities within society, the likelihood and impact of catastrophic software failure within those systems is increased.To aid researchers in the development of new methods to measure and assure the safety and quality of robotics software, we systematically curated a dataset of 221 bugs across 7 popular and diverse software systems implemented via the Robot Operating System (ROS). We produce historically accurate recreations of each of the 221 defective software versions in the form of Docker images, and use a grounded theory approach to examine and categorize their corresponding faults, failures, and fixes. Finally, we reflect on the implications of our findings and outline future research directions for the community.


title: Lie-algebraic K\"ahler sigma models with the U(1) isotropy

abstract: We discuss various questions which emerge in connection with the Lie-algebraic deformation of $\mathbb{CP}^1$ sigma model in two dimensions. First we supersymmetrize the original model endowing it with the minimal ${\cal N}=(0,2)$ and extended ${\cal N}=(2,2)$ supersymmetries. Then we derive the general hypercurrent anomaly in the both cases. In the latter case this anomaly is one-loop but is somewhat different from the standard expressions one can find in the literature because the target manifold is non-symmetric. We also show how to introduce the twisted masses and the $\theta$ term, and study the BPS equation for instantons, in particular the value of the topological charge. Then we demonstrate that the second loop in the $\beta$ function of the non-supersymmetric Lie-algebraic sigma model is due to an infrared effect. To this end we use a supersymmetric regularization. We also conjecture that the above statement is valid for higher loops too, similar to the parallel phenomenon in four-dimensional ${\cal N}=1$ super-Yang-Mills. In the second part of the paper we develop a special dimensional reduction -- namely, starting from the two-dimensional Lie-algebraic model we arrive at a quasi-exactly solvable quantum-mechanical problem of the Lam\'e type.


title: Robust Concept Erasure Using Task Vectors

abstract: With the rapid growth of text-to-image models, a variety of techniques have been suggested to prevent undesirable image generations. Yet, these methods often only protect against specific user prompts and have been shown to allow unsafe generations with other inputs. Here we focus on unconditionally erasing a concept from a text-to-image model rather than conditioning the erasure on the user's prompt. We first show that compared to input-dependent erasure methods, concept erasure that uses Task Vectors (TV) is more robust to unexpected user inputs, not seen during training. However, TV-based erasure can also affect the core performance of the edited model, particularly when the required edit strength is unknown. To this end, we propose a method called Diverse Inversion, which we use to estimate the required strength of the TV edit. Diverse Inversion finds within the model input space a large set of word embeddings, each of which induces the generation of the target concept. We find that encouraging diversity in the set makes our estimation more robust to unexpected prompts. Finally, we show that Diverse Inversion enables us to apply a TV edit only to a subset of the model weights, enhancing the erasure capabilities while better maintaining the core functionality of the model.


title: Reference-Based 3D-Aware Image Editing with Triplane

abstract: Generative Adversarial Networks (GANs) have emerged as powerful tools not only for high-quality image generation but also for real image editing through manipulation of their interpretable latent spaces. Recent advancements in GANs include the development of 3D-aware models such as EG3D, characterized by efficient triplane-based architectures enabling the reconstruction of 3D geometry from single images. However, scant attention has been devoted to providing an integrated framework for high-quality reference-based 3D-aware image editing within this domain. This study addresses this gap by exploring and demonstrating the effectiveness of EG3D's triplane space for achieving advanced reference-based edits, presenting a unique perspective on 3D-aware image editing through our novel pipeline. Our approach integrates the encoding of triplane features, spatial disentanglement and automatic localization of features in the triplane domain, and fusion learning for desired image editing. Moreover, our framework demonstrates versatility across domains, extending its effectiveness to animal face edits and partial stylization of cartoon portraits. The method shows significant improvements over relevant 3D-aware latent editing and 2D reference-based editing methods, both qualitatively and quantitatively. Project page: https://three-bee.github.io/triplane_edit


title: Existence and asymptotic behaviour of solutions for a multi-dimensional fractional thin-film equation

abstract: In this paper, we discuss existence and finite speed of propagation for the solutions to an initial-boundary value problem for a family of fractional thin-film equations in a bounded domain in $\mathbb{R}^d$. The nonlocal operator we consider is the spectral fractional Laplacian with Neumann boundary conditions. In the case of a "strong slippage" regime with "complete wetting" interfacial conditions, we prove local entropy estimates that entail finite speed of propagation of the support and a lower bound for the waiting time phenomenon.


title: PreAfford: Universal Affordance-Based Pre-Grasping for Diverse Objects and Environments

abstract: Robotic manipulation of ungraspable objects with two-finger grippers presents significant challenges due to the paucity of graspable features, while traditional pre-grasping techniques, which rely on repositioning objects and leveraging external aids like table edges, lack the adaptability across object categories and scenes. Addressing this, we introduce PreAfford, a novel pre-grasping planning framework that utilizes a point-level affordance representation and a relay training approach to enhance adaptability across a broad range of environments and object types, including those previously unseen. Demonstrated on the ShapeNet-v2 dataset, PreAfford significantly improves grasping success rates by 69% and validates its practicality through real-world experiments. This work offers a robust and adaptable solution for manipulating ungraspable objects.


title: WorDepth: Variational Language Prior for Monocular Depth Estimation

abstract: Three-dimensional (3D) reconstruction from a single image is an ill-posed problem with inherent ambiguities, i.e. scale. Predicting a 3D scene from text description(s) is similarly ill-posed, i.e. spatial arrangements of objects described. We investigate the question of whether two inherently ambiguous modalities can be used in conjunction to produce metric-scaled reconstructions. To test this, we focus on monocular depth estimation, the problem of predicting a dense depth map from a single image, but with an additional text caption describing the scene. To this end, we begin by encoding the text caption as a mean and standard deviation; using a variational framework, we learn the distribution of the plausible metric reconstructions of 3D scenes corresponding to the text captions as a prior. To "select" a specific reconstruction or depth map, we encode the given image through a conditional sampler that samples from the latent space of the variational text encoder, which is then decoded to the output depth map. Our approach is trained alternatingly between the text and image branches: in one optimization step, we predict the mean and standard deviation from the text description and sample from a standard Gaussian, and in the other, we sample using a (image) conditional sampler. Once trained, we directly predict depth from the encoded text using the conditional sampler. We demonstrate our approach on indoor (NYUv2) and outdoor (KITTI) scenarios, where we show that language can consistently improve performance in both.


title: High Compression Blue-Detuned Magneto-Optical Trap of Polyatomic Molecules

abstract: We demonstrate a blue-detuned magneto-optical trap (MOT) of a polyatomic molecule, calcium monohydroxide (CaOH). We identify a novel MOT frequency configuration that produces high spatial compression of the molecular cloud. This high compression MOT achieves a cloud radius of $59(5)~\mu\text{m}$ and a peak density of $8(2) \times 10^8~\text{cm}^{-3}$, the highest reported density for a molecular MOT to date. We compare our experimental studies of blue-detuned MOTs for CaOH and compare with Monte-Carlo simulations, finding good agreement.


title: Sequential Recommendation for Optimizing Both Immediate Feedback and Long-term Retention

abstract: In the landscape of Recommender System (RS) applications, reinforcement learning (RL) has recently emerged as a powerful tool, primarily due to its proficiency in optimizing long-term rewards. Nevertheless, it suffers from instability in the learning process, stemming from the intricate interactions among bootstrapping, off-policy training, and function approximation. Moreover, in multi-reward recommendation scenarios, designing a proper reward setting that reconciles the inner dynamics of various tasks is quite intricate. In response to these challenges, we introduce DT4IER, an advanced decision transformer-based recommendation model that is engineered to not only elevate the effectiveness of recommendations but also to achieve a harmonious balance between immediate user engagement and long-term retention. The DT4IER applies an innovative multi-reward design that adeptly balances short and long-term rewards with user-specific attributes, which serve to enhance the contextual richness of the reward sequence ensuring a more informed and personalized recommendation process. To enhance its predictive capabilities, DT4IER incorporates a high-dimensional encoder, skillfully designed to identify and leverage the intricate interrelations across diverse tasks. Furthermore, we integrate a contrastive learning approach within the action embedding predictions, a strategy that significantly boosts the model's overall performance. Experiments on three real-world datasets demonstrate the effectiveness of DT4IER against state-of-the-art Sequential Recommender Systems (SRSs) and Multi-Task Learning (MTL) models in terms of both prediction accuracy and effectiveness in specific tasks. The source code is accessible online to facilitate replication


title: Cooperation between electron-phonon coupling and electronic interaction in bilayer nickelates La$_3$Ni$_2$O$_7$

abstract: The recent observation of high-T$_c$ superconductivity in the bilayer nickelate La$_3$Ni$_2$O$_7$ under pressure has garnered significant interests. While researches have predominantly focused on the role of electron-electron interactions in the superconducting mechanism, the impact of electron-phonon coupling (EPC) has remained elusive. In this work, we perform first-principles calculations to study the phonon spectrum and electron-phonon coupling within La$_3$Ni$_2$O$_7$ under pressure and explore of the interplay between EPC and electronic interactions on the superconductivity by employing functional renormalization group approach. Our calculations reveal that EPC alone is insufficient to trigger superconductivity in La$_3$Ni$_2$O$_7$ under pressure. We identify unique out-of-plane and in-plane breathing phonon modes which selectively couple with the Ni $d_{z^2}$ and $d_{x^2-y^2}$ orbitals, showcasing an orbital-selective EPC. Within the bilayer two-orbital model, it is revealed that solely electronic interactions foster $s_{\pm}$-wave pairing characterized by notable frustration in the band space, leading to a low transition temperature. Remarkably, we find that this out-of-plane EPC can act in concert with electronic interactions to promote the onsite and interlayer pairing in the $d_{z^2}$ orbital, partially releasing the pairing frustration and thus elevating T$_c$. In contrast, the inclusion of in-plane EPC only marginally affects the superconductivity, distinct from the cuprates. Potential experimental implications in La$_3$Ni$_2$O$_7$ are also discussed.


title: On-demand higher-harmonic generation through nonlinear Hall effects in curved nanomembranes

abstract: The high-order Hall effects, which go beyond the ordinary, unlock more possibilities of electronic transport properties and functionalities. Pioneer works focus on the manufacture of complex nanostructures with low lattice symmetry to produce them. In this paper, we theoretically show that such high-order Hall effects can alternatively be generated by curving a conducting nanomembrane which is highly tunable and also enables anisotropy. Its Hall response can be tuned from first to fourth order by simply varying the direction and magnitude of the applied magnetic field. The dominant Hall current frequency can also be altered from zero to double, or even four times that of the applied alternating electric field. This phenomenon is critically dependent on the occurrence of high-order snake orbits associated with the effective magnetic-field dipoles and quadruples induced by the curved geometry. Our results offer pathways for spatially engineering magnetotransport, current rectification, and frequency multiplication in the bent conducting nanomembrane.


title: Representation theory of the reflection equation algebra I: A quantization of Sylvester's law of inertia

abstract: We prove a version of Sylvester's law of inertia for the Reflection Equation Algebra (=REA). We will only be concerned with the REA constructed from the $R$-matrix associated to the standard $q$-deformation of $GL(N,\mathbb{C})$. For $q$ positive, this particular REA comes equipped with a natural $*$-structure, by which it can be viewed as a $q$-deformation of the $*$-algebra of polynomial functions on the space of self-adjoint $N$-by-$N$-matrices. We will show that this REA satisfies a type $I$-condition, so that its irreducible representations can in principle be classified. Moreover, we will show that, up to the adjoint action of quantum $GL(N,\mathbb{C})$, any irreducible representation of the REA is determined by its \emph{extended signature}, which is a classical signature vector extended by a parameter in $\mathbb{R}/\mathbb{Z}$. It is this latter result that we see as a quantized version of Sylvester's law of inertia.


title: Amortized Analysis via Coalgebra

abstract: Amortized analysis is a cost analysis technique for data structures in which cost is studied in aggregate, rather than considering the maximum cost of a single operation. Traditionally, amortized analysis has been phrased inductively, in terms of finite sequences of operations. Connecting to prior work on coalgebraic semantics for data structures, we develop the perspective that amortized analysis is naturally viewed coalgebraically in the category of algebras for a cost monad, where a morphism of coalgebras serves as a first-class generalization of potential function suitable for integrating cost and behavior. Using this simple definition, we consider amortization of other sample effects, non-commutative printing and randomization. To support imprecise amortized upper bounds, we adapt our discussion to the bicategorical setting, where a potential function is a colax morphism of coalgebras. We support parallel data structure usage patterns by using coalgebras for an endoprofunctor instead of an endofunctor, combining potential using a monoidal structure on the underlying category. Finally, we compose amortization arguments in the indexed category of coalgebras to implement one amortized data structure in terms of others.


title: DiffBody: Human Body Restoration by Imagining with Generative Diffusion Prior

abstract: Human body restoration plays a vital role in various applications related to the human body. Despite recent advances in general image restoration using generative models, their performance in human body restoration remains mediocre, often resulting in foreground and background blending, over-smoothing surface textures, missing accessories, and distorted limbs. Addressing these challenges, we propose a novel approach by constructing a human body-aware diffusion model that leverages domain-specific knowledge to enhance performance. Specifically, we employ a pretrained body attention module to guide the diffusion model's focus on the foreground, addressing issues caused by blending between the subject and background. We also demonstrate the value of revisiting the language modality of the diffusion model in restoration tasks by seamlessly incorporating text prompt to improve the quality of surface texture and additional clothing and accessories details. Additionally, we introduce a diffusion sampler tailored for fine-grained human body parts, utilizing local semantic information to rectify limb distortions. Lastly, we collect a comprehensive dataset for benchmarking and advancing the field of human body restoration. Extensive experimental validation showcases the superiority of our approach, both quantitatively and qualitatively, over existing methods.


title: Exploring scalar contributions with $K^+ \to \pi^+ \ell^+ \ell^-$

abstract: The rare kaon decay $K^+ \to \pi^+\ell^+\ell^-$ offers insights into Standard Model (SM) physics and beyond. Driven by vector form factor in the SM, it can also probe non-standard contributions. In this letter we study the scalar contribution, $f_S$. Using differential decay width and Forward-Backward Asymmetry we propose a simultaneous fit to vector and scalar contributions which is necessary for a consistent analysis. Novel bounds on $|f_S|$ are presented for the first time through a reinterpretation of the E865, NA48/2, and NA62 experimental results. The analysis results in the most precise bound $f_S < 7.9\times 10^{-6}$ at 90$\%$ confidence level.


title: Hamiltonian simulation for low-energy states with optimal time dependence

abstract: We consider the task of simulating time evolution under a Hamiltonian $H$ within its low-energy subspace. Assuming access to a block-encoding of $H'=(H-E)/\lambda$ for some $E \in \mathbb R$, the goal is to implement an $\epsilon$-approximation to $e^{-itH}$ when the initial state is confined to the subspace corresponding to eigenvalues $[-1, -1+\Delta/\lambda]$ of $H'$. We present a quantum algorithm that uses $O(t\sqrt{\lambda\Gamma} + \sqrt{\lambda/\Gamma}\log(1/\epsilon))$ queries to the block-encoding for any $\Gamma$ such that $\Delta \leq \Gamma \leq \lambda$. When $\log(1/\epsilon) = o(t\lambda)$ and $\Delta/\lambda = o(1)$, this result improves over generic methods with query complexity $\Omega(t\lambda)$. Our quantum algorithm leverages spectral gap amplification and the quantum singular value transform. Using standard access models for $H$, we show that the ability to efficiently block-encode $H'$ is equivalent to $H$ being what we refer to as a "gap-amplifiable" Hamiltonian. This includes physically relevant examples such as frustration-free systems, and it encompasses all previously considered settings of low-energy simulation algorithms. We also provide lower bounds for low-energy simulation. In the worst case, we show that the low-energy condition cannot be used to improve the runtime of Hamiltonian simulation. For gap-amplifiable Hamiltonians, we prove that our algorithm is tight in the query model with respect to $t$, $\Delta$, and $\lambda$. In the practically relevant regime where $\log (1/\epsilon) = o(t\Delta)$ and $\Delta/\lambda = o(1)$, we also prove a matching lower bound in gate complexity (up to log factors). To establish the query lower bounds, we consider $\mathrm{PARITY}\circ\mathrm{OR}$ and degree bounds on trigonometric polynomials. To establish the lower bound on gate complexity, we use a circuit-to-Hamiltonian reduction acting on a low-energy state.


title: Decoupling Static and Hierarchical Motion Perception for Referring Video Segmentation

abstract: Referring video segmentation relies on natural language expressions to identify and segment objects, often emphasizing motion clues. Previous works treat a sentence as a whole and directly perform identification at the video-level, mixing up static image-level cues with temporal motion cues. However, image-level features cannot well comprehend motion cues in sentences, and static cues are not crucial for temporal perception. In fact, static cues can sometimes interfere with temporal perception by overshadowing motion cues. In this work, we propose to decouple video-level referring expression understanding into static and motion perception, with a specific emphasis on enhancing temporal comprehension. Firstly, we introduce an expression-decoupling module to make static cues and motion cues perform their distinct role, alleviating the issue of sentence embeddings overlooking motion cues. Secondly, we propose a hierarchical motion perception module to capture temporal information effectively across varying timescales. Furthermore, we employ contrastive learning to distinguish the motions of visually similar objects. These contributions yield state-of-the-art performance across five datasets, including a remarkable $\textbf{9.2%}$ $\mathcal{J\&F}$ improvement on the challenging $\textbf{MeViS}$ dataset. Code is available at https://github.com/heshuting555/DsHmp.


title: Locating and Editing Factual Associations in Mamba

abstract: We investigate the mechanisms of factual recall in the Mamba state space model. Our work is inspired by previous findings in autoregressive transformer language models suggesting that their knowledge recall is localized to particular modules at specific token locations; we therefore ask whether factual recall in Mamba can be similarly localized. To investigate this, we conduct four lines of experiments on Mamba. First, we apply causal tracing or interchange interventions to localize key components inside Mamba that are responsible for recalling facts, revealing that specific components within middle layers show strong causal effects at the last token of the subject, while the causal effect of intervening on later layers is most pronounced at the last token of the prompt, matching previous findings on autoregressive transformers. Second, we show that rank-one model editing methods can successfully insert facts at specific locations, again resembling findings on transformer models. Third, we examine the linearity of Mamba's representations of factual relations. Finally we adapt attention-knockout techniques to Mamba to dissect information flow during factual recall. We compare Mamba directly to a similar-sized transformer and conclude that despite significant differences in architectural approach, when it comes to factual recall, the two architectures share many similarities.


title: Capabilities of Large Language Models in Control Engineering: A Benchmark Study on GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra

abstract: In this paper, we explore the capabilities of state-of-the-art large language models (LLMs) such as GPT-4, Claude 3 Opus, and Gemini 1.0 Ultra in solving undergraduate-level control problems. Controls provides an interesting case study for LLM reasoning due to its combination of mathematical theory and engineering design. We introduce ControlBench, a benchmark dataset tailored to reflect the breadth, depth, and complexity of classical control design. We use this dataset to study and evaluate the problem-solving abilities of these LLMs in the context of control engineering. We present evaluations conducted by a panel of human experts, providing insights into the accuracy, reasoning, and explanatory prowess of LLMs in control engineering. Our analysis reveals the strengths and limitations of each LLM in the context of classical control, and our results imply that Claude 3 Opus has become the state-of-the-art LLM for solving undergraduate control problems. Our study serves as an initial step towards the broader goal of employing artificial general intelligence in control engineering.


title: AutoWebGLM: Bootstrap And Reinforce A Large Language Model-based Web Navigating Agent

abstract: Large language models (LLMs) have fueled many intelligent agent tasks, such as web navigation -- but most existing agents perform far from satisfying in real-world webpages due to three factors: (1) the versatility of actions on webpages, (2) HTML text exceeding model processing capacity, and (3) the complexity of decision-making due to the open-domain nature of web. In light of the challenge, we develop AutoWebGLM, a GPT-4-outperforming automated web navigation agent built upon ChatGLM3-6B. Inspired by human browsing patterns, we design an HTML simplification algorithm to represent webpages, preserving vital information succinctly. We employ a hybrid human-AI method to build web browsing data for curriculum training. Then, we bootstrap the model by reinforcement learning and rejection sampling to further facilitate webpage comprehension, browser operations, and efficient task decomposition by itself. For testing, we establish a bilingual benchmark -- AutoWebBench -- for real-world web browsing tasks. We evaluate AutoWebGLM across diverse web navigation benchmarks, revealing its improvements but also underlying challenges to tackle real environments. Related code, model, and data will be released at \url{https://github.com/THUDM/AutoWebGLM}.


title: Toric Promotion with Reflections and Refractions

abstract: Inspired by recent work on refraction billiards in dynamics, we introduce a notion of refraction for combinatorial billiards. This allows us to define a generalization of toric promotion that we call toric promotion with reflections and refractions, which is a dynamical system defined via a graph $G$ whose edges are partitioned into a set of reflection edges and a set of refraction edges. This system is a discretization of a billiards system in which a beam of light can pass through, reflect off of, or refract through each toric hyperplane in a toric arrangement. Vastly generalizing the main theorem known about toric promotion, we give a simple formula for the orbit structure of toric promotion with reflections and refractions when $G$ is a forest. We also completely describe the orbit sizes when $G$ is a cycle with an even number of refraction edges; this result is new even for ordinary toric promotion (i.e., when there are no refraction edges). When $G$ is a cycle of even size with no reflection edges, we obtain an interesting instance of the cyclic sieving phenomenon.


title: OpenNeRF: Open Set 3D Neural Scene Segmentation with Pixel-Wise Features and Rendered Novel Views

abstract: Large visual-language models (VLMs), like CLIP, enable open-set image segmentation to segment arbitrary concepts from an image in a zero-shot manner. This goes beyond the traditional closed-set assumption, i.e., where models can only segment classes from a pre-defined training set. More recently, first works on open-set segmentation in 3D scenes have appeared in the literature. These methods are heavily influenced by closed-set 3D convolutional approaches that process point clouds or polygon meshes. However, these 3D scene representations do not align well with the image-based nature of the visual-language models. Indeed, point cloud and 3D meshes typically have a lower resolution than images and the reconstructed 3D scene geometry might not project well to the underlying 2D image sequences used to compute pixel-aligned CLIP features. To address these challenges, we propose OpenNeRF which naturally operates on posed images and directly encodes the VLM features within the NeRF. This is similar in spirit to LERF, however our work shows that using pixel-wise VLM features (instead of global CLIP features) results in an overall less complex architecture without the need for additional DINO regularization. Our OpenNeRF further leverages NeRF's ability to render novel views and extract open-set VLM features from areas that are not well observed in the initial posed images. For 3D point cloud segmentation on the Replica dataset, OpenNeRF outperforms recent open-vocabulary methods such as LERF and OpenScene by at least +4.9 mIoU.


title: Multipartite edge modes and tensor networks

abstract: Holographic tensor networks model AdS/CFT, but so far they have been limited by involving only systems that are very different from gravity. Unfortunately, we cannot straightforwardly discretize gravity to incorporate it, because that would break diffeomorphism invariance. In this note, we explore a resolution. In low dimensions gravity can be written as a topological gauge theory, which can be discretized without breaking gauge-invariance. However, new problems arise. Foremost, we now need a qualitatively new kind of "area operator," which has no relation to the number of links along the cut and is instead topological. Secondly, the inclusion of matter becomes trickier. We successfully construct a tensor network both including matter and with this new type of area. Notably, while this area is still related to the entanglement in "edge mode" degrees of freedom, the edge modes are no longer bipartite entangled pairs. Instead they are highly multipartite. Along the way, we calculate the entropy of novel subalgebras in a particular topological gauge theory. We also show that the multipartite nature of the edge modes gives rise to non-commuting area operators, a property that other tensor networks do not exhibit.


title: The More You See in 2D, the More You Perceive in 3D

abstract: Humans can infer 3D structure from 2D images of an object based on past experience and improve their 3D understanding as they see more images. Inspired by this behavior, we introduce SAP3D, a system for 3D reconstruction and novel view synthesis from an arbitrary number of unposed images. Given a few unposed images of an object, we adapt a pre-trained view-conditioned diffusion model together with the camera poses of the images via test-time fine-tuning. The adapted diffusion model and the obtained camera poses are then utilized as instance-specific priors for 3D reconstruction and novel view synthesis. We show that as the number of input images increases, the performance of our approach improves, bridging the gap between optimization-based prior-less 3D reconstruction methods and single-image-to-3D diffusion-based methods. We demonstrate our system on real images as well as standard synthetic benchmarks. Our ablation studies confirm that this adaption behavior is key for more accurate 3D understanding.


title: CoMat: Aligning Text-to-Image Diffusion Model with Image-to-Text Concept Matching

abstract: Diffusion models have demonstrated great success in the field of text-to-image generation. However, alleviating the misalignment between the text prompts and images is still challenging. The root reason behind the misalignment has not been extensively investigated. We observe that the misalignment is caused by inadequate token attention activation. We further attribute this phenomenon to the diffusion model's insufficient condition utilization, which is caused by its training paradigm. To address the issue, we propose CoMat, an end-to-end diffusion model fine-tuning strategy with an image-to-text concept matching mechanism. We leverage an image captioning model to measure image-to-text alignment and guide the diffusion model to revisit ignored tokens. A novel attribute concentration module is also proposed to address the attribute binding problem. Without any image or human preference data, we use only 20K text prompts to fine-tune SDXL to obtain CoMat-SDXL. Extensive experiments show that CoMat-SDXL significantly outperforms the baseline model SDXL in two text-to-image alignment benchmarks and achieves start-of-the-art performance.


title: RaFE: Generative Radiance Fields Restoration

abstract: NeRF (Neural Radiance Fields) has demonstrated tremendous potential in novel view synthesis and 3D reconstruction, but its performance is sensitive to input image quality, which struggles to achieve high-fidelity rendering when provided with low-quality sparse input viewpoints. Previous methods for NeRF restoration are tailored for specific degradation type, ignoring the generality of restoration. To overcome this limitation, we propose a generic radiance fields restoration pipeline, named RaFE, which applies to various types of degradations, such as low resolution, blurriness, noise, compression artifacts, or their combinations. Our approach leverages the success of off-the-shelf 2D restoration methods to recover the multi-view images individually. Instead of reconstructing a blurred NeRF by averaging inconsistencies, we introduce a novel approach using Generative Adversarial Networks (GANs) for NeRF generation to better accommodate the geometric and appearance inconsistencies present in the multi-view images. Specifically, we adopt a two-level tri-plane architecture, where the coarse level remains fixed to represent the low-quality NeRF, and a fine-level residual tri-plane to be added to the coarse level is modeled as a distribution with GAN to capture potential variations in restoration. We validate RaFE on both synthetic and real cases for various restoration tasks, demonstrating superior performance in both quantitative and qualitative evaluations, surpassing other 3D restoration methods specific to single task. Please see our project website https://zkaiwu.github.io/RaFE-Project/.


title: Magnetic fields from small-scale primordial perturbations

abstract: Weak magnetic fields must have existed in the early Universe, as they were sourced by the cross product of electron density and temperature gradients through the Biermann-battery mechanism. In this paper we calculate the magnetic fields generated at cosmic dawn by a variety of small-scale primordial perturbations, carefully computing the evolution of electron density and temperature fluctuations, and consistently accounting for relative velocities between baryons and dark matter. We first compute the magnetic field resulting from standard, nearly scale-invariant primordial adiabatic perturbations, making significant improvements to previous calculations. This "standard" primordial field has a root mean square (rms) of $\sim10^{-15}$ nG at $20\lesssim z \lesssim 100$, with fluctuations on $\sim$ kpc comoving scales, and could serve as the seed of present-day magnetic fields observed in galaxies and galaxy clusters. In addition, we consider early-Universe magnetic fields as a possible probe of non-standard initial conditions of the Universe on small scales $k \sim 1-10^3$ Mpc$^{-1}$. To this end, we compute the maximally-allowed magnetic fields within current upper limits on small-scale adiabatic and isocurvature perturbations. Under the current Cosmic Microwave Background spectral-distortion constraints magnetic fields could be produced with a rms of $\sim 5\times 10^{-11}$ nG at $z = 20$. Uncorrelated small-scale isocurvature perturbations within current Big-Bang Nucleosynthesis bounds could potentially enhance the magnetic field to $\sim 10^{-14}-10^{-10}$ nG at $z = 20$, depending on the specific isocurvature mode considered. While these very weak fields remain well below current observational capabilities, our work points out that magnetic fields could potentially provide an interesting window into the poorly constrained small-scale initial conditions of the Universe.


title: MVD-Fusion: Single-view 3D via Depth-consistent Multi-view Generation

abstract: We present MVD-Fusion: a method for single-view 3D inference via generative modeling of multi-view-consistent RGB-D images. While recent methods pursuing 3D inference advocate learning novel-view generative models, these generations are not 3D-consistent and require a distillation process to generate a 3D output. We instead cast the task of 3D inference as directly generating mutually-consistent multiple views and build on the insight that additionally inferring depth can provide a mechanism for enforcing this consistency. Specifically, we train a denoising diffusion model to generate multi-view RGB-D images given a single RGB input image and leverage the (intermediate noisy) depth estimates to obtain reprojection-based conditioning to maintain multi-view consistency. We train our model using large-scale synthetic dataset Obajverse as well as the real-world CO3D dataset comprising of generic camera viewpoints. We demonstrate that our approach can yield more accurate synthesis compared to recent state-of-the-art, including distillation-based 3D inference and prior multi-view generation methods. We also evaluate the geometry induced by our multi-view depth prediction and find that it yields a more accurate representation than other direct 3D inference approaches.


title: OW-VISCap: Open-World Video Instance Segmentation and Captioning

abstract: Open-world video instance segmentation is an important video understanding task. Yet most methods either operate in a closed-world setting, require an additional user-input, or use classic region-based proposals to identify never before seen objects. Further, these methods only assign a one-word label to detected objects, and don't generate rich object-centric descriptions. They also often suffer from highly overlapping predictions. To address these issues, we propose Open-World Video Instance Segmentation and Captioning (OW-VISCap), an approach to jointly segment, track, and caption previously seen or unseen objects in a video. For this, we introduce open-world object queries to discover never before seen objects without additional user-input. We generate rich and descriptive object-centric captions for each detected object via a masked attention augmented LLM input. We introduce an inter-query contrastive loss to ensure that the object queries differ from one another. Our generalized approach matches or surpasses state-of-the-art on three tasks: open-world video instance segmentation on the BURST dataset, dense video object captioning on the VidSTG dataset, and closed-world video instance segmentation on the OVIS dataset.


title: Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning

abstract: Recovering the 3D scene geometry from a single view is a fundamental yet ill-posed problem in computer vision. While classical depth estimation methods infer only a 2.5D scene representation limited to the image plane, recent approaches based on radiance fields reconstruct a full 3D representation. However, these methods still struggle with occluded regions since inferring geometry without visual observation requires (i) semantic knowledge of the surroundings, and (ii) reasoning about spatial context. We propose KYN, a novel method for single-view scene reconstruction that reasons about semantic and spatial context to predict each point's density. We introduce a vision-language modulation module to enrich point features with fine-grained semantic information. We aggregate point representations across the scene through a language-guided spatial attention mechanism to yield per-point density predictions aware of the 3D semantic context. We show that KYN improves 3D shape recovery compared to predicting density for each 3D point in isolation. We achieve state-of-the-art results in scene and object reconstruction on KITTI-360, and show improved zero-shot generalization compared to prior work. Project page: https://ruili3.github.io/kyn.


title: Federated Unlearning for Human Activity Recognition

abstract: The rapid evolution of Internet of Things (IoT) technology has spurred the widespread adoption of Human Activity Recognition (HAR) in various daily life domains. Federated Learning (FL) is frequently utilized to build a global HAR model by aggregating user contributions without transmitting raw individual data. Despite substantial progress in user privacy protection with FL, challenges persist. Regulations like the General Data Protection Regulation (GDPR) empower users to request data removal, raising a new query in FL: How can a HAR client request data removal without compromising other clients' privacy? In response, we propose a lightweight machine unlearning method for refining the FL HAR model by selectively removing a portion of a client's training data. Our method employs a third-party dataset unrelated to model training. Using KL divergence as a loss function for fine-tuning, we aim to align the predicted probability distribution on forgotten data with the third-party dataset. Additionally, we introduce a membership inference evaluation method to assess unlearning effectiveness. Experimental results across diverse datasets show our method achieves unlearning accuracy comparable to \textit{retraining} methods, resulting in speedups ranging from hundreds to thousands.


title: Machine Learning in Proton Exchange Membrane Water Electrolysis -- Part I: A Knowledge-Integrated Framework

abstract: In this study, we propose to adopt a novel framework, Knowledge-integrated Machine Learning, for advancing Proton Exchange Membrane Water Electrolysis (PEMWE) development. Given the significance of PEMWE in green hydrogen production and the inherent challenges in optimizing its performance, our framework aims to meld data-driven models with domain-specific insights systematically to address the domain challenges. We first identify the uncertainties originating from data acquisition conditions, data-driven model mechanisms, and domain expertise, highlighting their complementary characteristics in carrying information from different perspectives. Building upon this foundation, we showcase how to adeptly decompose knowledge and extract unique information to contribute to the data augmentation, modeling process, and knowledge discovery. We demonstrate a hierarchical three-level framework, termed the "Ladder of Knowledge-integrated Machine Learning", in the PEMWE context, applying it to three case studies within a context of cell degradation analysis to affirm its efficacy in interpolation, extrapolation, and information representation. This research lays the groundwork for more knowledge-informed enhancements in ML applications in engineering.


title: Benchmarking formalisms for dynamic structure system Modeling and Simulation

abstract: Modeling and simulation of complex systems is key to explore systems dynamics. Many scientific approaches were developed to represent dynamic structure systems but most of these approaches are efficient for some kinds of systems and inefficient for others. Which approach can be adopted for different dynamic structure systems categories is a topic of interest for many researchers and until now has not been fully resolved. Therefore it is essential to explore the existing approaches, understand them, and identify gaps. To fulfil this goal, we identified criteria at stake for a smooth flow from model creation to its simulation for dynamic structure systems. Using these criteria, we benchmark the existing modeling formalisms focusing more on DEVS extensions, and use the results to identify approaches gaps and discuss them.


title: X-lifecycle Learning for Cloud Incident Management using LLMs

abstract: Incident management for large cloud services is a complex and tedious process and requires significant amount of manual efforts from on-call engineers (OCEs). OCEs typically leverage data from different stages of the software development lifecycle [SDLC] (e.g., codes, configuration, monitor data, service properties, service dependencies, trouble-shooting documents, etc.) to generate insights for detection, root causing and mitigating of incidents. Recent advancements in large language models [LLMs] (e.g., ChatGPT, GPT-4, Gemini) created opportunities to automatically generate contextual recommendations to the OCEs assisting them to quickly identify and mitigate critical issues. However, existing research typically takes a silo-ed view for solving a certain task in incident management by leveraging data from a single stage of SDLC. In this paper, we demonstrate that augmenting additional contextual data from different stages of SDLC improves the performance of two critically important and practically challenging tasks: (1) automatically generating root cause recommendations for dependency failure related incidents, and (2) identifying ontology of service monitors used for automatically detecting incidents. By leveraging 353 incident and 260 monitor dataset from Microsoft, we demonstrate that augmenting contextual information from different stages of the SDLC improves the performance over State-of-The-Art methods.


title: Spike-driven Transformer V2: Meta Spiking Neural Network Architecture Inspiring the Design of Next-generation Neuromorphic Chips

abstract: Neuromorphic computing, which exploits Spiking Neural Networks (SNNs) on neuromorphic chips, is a promising energy-efficient alternative to traditional AI. CNN-based SNNs are the current mainstream of neuromorphic computing. By contrast, no neuromorphic chips are designed especially for Transformer-based SNNs, which have just emerged, and their performance is only on par with CNN-based SNNs, offering no distinct advantage. In this work, we propose a general Transformer-based SNN architecture, termed as ``Meta-SpikeFormer", whose goals are: 1) Lower-power, supports the spike-driven paradigm that there is only sparse addition in the network; 2) Versatility, handles various vision tasks; 3) High-performance, shows overwhelming performance advantages over CNN-based SNNs; 4) Meta-architecture, provides inspiration for future next-generation Transformer-based neuromorphic chip designs. Specifically, we extend the Spike-driven Transformer in \citet{yao2023spike} into a meta architecture, and explore the impact of structure, spike-driven self-attention, and skip connection on its performance. On ImageNet-1K, Meta-SpikeFormer achieves 80.0\% top-1 accuracy (55M), surpassing the current state-of-the-art (SOTA) SNN baselines (66M) by 3.7\%. This is the first direct training SNN backbone that can simultaneously supports classification, detection, and segmentation, obtaining SOTA results in SNNs. Finally, we discuss the inspiration of the meta SNN architecture for neuromorphic chip design. Source code and models are available at \url{https://github.com/BICLab/Spike-Driven-Transformer-V2}.


title: LLMs in the Heart of Differential Testing: A Case Study on a Medical Rule Engine

abstract: The Cancer Registry of Norway (CRN) uses an automated cancer registration support system (CaReSS) to support core cancer registry activities, i.e, data capture, data curation, and producing data products and statistics for various stakeholders. GURI is a core component of CaReSS, which is responsible for validating incoming data with medical rules. Such medical rules are manually implemented by medical experts based on medical standards, regulations, and research. Since large language models (LLMs) have been trained on a large amount of public information, including these documents, they can be employed to generate tests for GURI. Thus, we propose an LLM-based test generation and differential testing approach (LLMeDiff) to test GURI. We experimented with four different LLMs, two medical rule engine implementations, and 58 real medical rules to investigate the hallucination, success, time efficiency, and robustness of the LLMs to generate tests, and these tests' ability to find potential issues in GURI. Our results showed that GPT-3.5 hallucinates the least, is the most successful, and is generally the most robust; however, it has the worst time efficiency. Our differential testing revealed 22 medical rules where implementation inconsistencies were discovered (e.g., regarding handling rule versions). Finally, we provide insights for practitioners and researchers based on the results.


title: Serial Parallel Reliability Redundancy Allocation Optimization for Energy Efficient and Fault Tolerant Cloud Computing

abstract: Serial-parallel redundancy is a reliable way to ensure service and systems will be available in cloud computing. That method involves making copies of the same system or program, with only one remaining active. When an error occurs, the inactive copy can step in as a backup right away, this provides continuous performance and uninterrupted operation. This approach is called parallel redundancy, otherwise known as active-active redundancy, and its exceptional when it comes to strategy. It creates duplicates of a system or service that are all running at once. By doing this fault tolerance increases since if one copy fails, the workload can be distributed across any replica thats functioning properly. Reliability allocation depends on features in a system and the availability and fault tolerance you want from it. Serial redundancy or parallel redundancies can be applied to increase the dependability of systems and services. To demonstrate how well this concept works, we looked into fixed serial parallel reliability redundancy allocation issues followed by using an innovative hybrid optimization technique to find the best possible allocation for peak dependability. We then measured our findings against other research.


title: Exploring the Frontiers: Challenges and Theories Beyond the Standard Model

abstract: Quantum Field Theory (QFT) forms the bedrock of the Standard Model (SM) of particle physics, a powerful framework that delineates the fundamental constituents and interactions of the universe. However, the SM's narrative is incomplete, as it conspicuously fails to account for several empirical phenomena that challenge our current understanding of particle physics. This review meticulously examines three paramount anomalies that elude SM predictions: the elusive nature of dark matter, the Higgs boson's anomalously low mass, and the intricate puzzle of neutrino masses. Through a critical analysis, it delves into the forefront of theoretical advancements proposed to bridge these gaps, notably the Weakly Interacting Massive Particles (WIMPs), Supersymmetry (SUSY), and the intriguing hypothesis of right-handed neutrinos. By synthesizing current research and theoretical models, this review not only elucidates these profound mysteries but also underscores the imperative for a more comprehensive and unified theory of particle physics, setting the stage for future discoveries and theoretical breakthroughs.


title: 4D Track Reconstruction on Free-Streaming Data at PANDA at FAIR

abstract: A new generation of experiments is being developed, where the challenge of separating rare signal processes from background at high intensities requires a change of trigger paradigm. At the future PANDA experiment at FAIR, hardware triggers will be abandoned and instead a purely software-based system will be used. This requires novel reconstruction methods with the ability to process data from many events simultaneously. A 4D tracking algorithm based on the cellular automaton has been developed which will utilize the timing information from detector signals. Simulation studies have been performed to test its performance on the foreseen free-streaming data from the PANDA detector. For this purpose, a quality assurance procedure for tracking on free-streaming data was implemented in the PANDA software. The studies show that at higher interaction rates, 4D tracking performs better than the 3D algorithm in terms of efficiency, 84% compared to 77%. The fake track suppression is also greatly improved, compared to the 3D tracking with roughly a 50% decrease in the ghost rate.


title: A Note on the Ideals E^a Which Are Discrete

abstract: This note looks at two mistakes in the paper "Some characterizations of the ideals Ea which are discrete" by Khabaoui et al., published in "Rend. Circ. Mat. Palermo, II. Ser 72, 1325-1336 (2023)".


title: On the transition stage of pulsar pulsed radio emission and its potential association with radio pulsar nulling

abstract: While the precise mechanism of generating pulsed coherent radio emission from pulsars remains elusive, certain gap-invoking models (especially, the inner gap model) offer a comprehensive and plausible explanation for the genesis and termination of such emissions. However, the transition stage between the period of persistent radio emission and the period of radio quiet remains poorly understood, despite observations indicating that a radio pulsar in the pulse nulling state is undergoing the transition stage. In this study, we present a qualitative explanation for the elusive transition stage by modeling pulsar magnetospheres analytically as equivalent RC circuits based on the inner gap model. Our result indicates that, due to lengthy spin-down, older radio pulsars will gradually shift from the state of persistent radio emission to a certain type of pulse nulling state by delayed sparks within their inner gaps.


title: Solving Min-Cost Concave Generalized Dynamic Flows and Approximating Dynamic Optimal Power Flows

abstract: Assuming power travels instantaneously, can be steered by us, and is lost quadratically in each power line, the dynamic optimal power flow problem simplifies to a min-cost dynamic generalized flow with quadratic losses (MCDGFWQL) problem. As this is a special case of the min-cost concave dynamic generalized flow (MCCDGF) problem, we derive both general results for the MCCDGF problem and stronger results for the MCDGFWQL problem. Our main contribution is a fully polynomial-time approximation scheme for a mild restriction of the MCDGFWQL problem. We also implement and benchmark a slight modification of this algorithm, finding it to be efficient in practice, with a slightly superlinear and possibly subquadratic dependence of execution time on the edge count of the input graph. Our secondary contributions are the derivation of a reduction from the MCCDGF problem to a convex program and a corresponding sensitivity analysis of the MCCDGF problem. We also provide a brief comparison of our dynamic optimal power flow simplification and the classic direct current simplification and point out some interesting directions for future research.


title: Central Engine and Spectral Energy Distribution Properties of High Redshift Gamma Ray Blazars

abstract: We report on the properties of central engines in the $\gamma$-ray blazars located at high redshifts beyond z~>~0.4, where the extra-galactic background light (EBL) starts affecting their $\gamma$-ray spectra. The physical engine that provides power to the blazars of very high bolometric luminosity is assumed to be a highly collimated jet of matter moving relativistically away from the supermassive black hole (SMBH), located in the central region of the host galaxy, in a direction aligned toward the Earth. Due to their peculiar geometry and special physical conditions, blazars at redshifts beyond z~>~0.4 are bright enough to be detected in the $\gamma$-ray energy band. In this work, we investigate the physical properties of high-$z$ $\gamma$-ray blazars detected by the Large Area Telescope (LAT) on board the \emph{Fermi} satellite. We also study the properties of their emission regions and the central engines and discuss cosmological and astrophysical implications.


title: On self-similar solutions of a multi-phase Stefan problem in the half-line

abstract: We study self-similar solutions of a multi-phase Stefan problem for a heat equation on the half-line $x>0$ with a constant initial data and with Dirichlet or Neumann boundary conditions. In the case of Dirichlet boundary condition we prove that a nonlinear algebraic system for determination of the free boundaries is gradient one and the corresponding potential is an explicitly written strictly convex and coercive function. Therefore, there exists a unique minimum point of the potential, coordinates of this point determine free boundaries and provide the desired solution. This result is also extended to the case of infinitely many phase transitions. In the case of Neumann boundary condition we demonstrate that the problem may have solutions with different numbers (called types) of phase transitions. For each fixed type $n$ the system for determination of the free boundaries is again gradient and the corresponding potential is proved to be strictly convex and coercive, but in some wider non-physical domain. On the base of these properties it is proved that there exists a unique solution of Stefan-Neumann problem, and we also provide precise conditions to specify the type of the solution. Bibliography$:$ $5$ titles.


title: RL for Consistency Models: Faster Reward Guided Text-to-Image Generation

abstract: Reinforcement learning (RL) has improved guided image generation with diffusion models by directly optimizing rewards that capture image quality, aesthetics, and instruction following capabilities. However, the resulting generative policies inherit the same iterative sampling process of diffusion models that causes slow generation. To overcome this limitation, consistency models proposed learning a new class of generative models that directly map noise to data, resulting in a model that can generate an image in as few as one sampling iteration. In this work, to optimize text-to-image generative models for task specific rewards and enable fast training and inference, we propose a framework for fine-tuning consistency models via RL. Our framework, called Reinforcement Learning for Consistency Model (RLCM), frames the iterative inference process of a consistency model as an RL procedure. Comparing to RL finetuned diffusion models, RLCM trains significantly faster, improves the quality of the generation measured under the reward objectives, and speeds up the inference procedure by generating high quality images with as few as two inference steps. Experimentally, we show that RLCM can adapt text-to-image consistency models to objectives that are challenging to express with prompting, such as image compressibility, and those derived from human feedback, such as aesthetic quality. Our code is available at https://rlcm.owenoertell.com.


title: Target normal single-spin asymmetry in inclusive electron-nucleon scattering in the 1/Nc expansion

abstract: The target normal single-spin asymmetry in electron nucleon scattering is studied in the framework of the 1/Nc expansion of QCD, which allows for a rigorous description in the energy range that includes the Delta resonance and below the second baryon resonance region. The asymmetry is driven by the absorptive part of the two-photon exchange component of the scattering amplitude, being therefore the most unambiguous two-photon exchange effect. Such amplitude is shown to be described up to the next to leading order in the 1/Nc expansion only in terms of the charge and magnetic form factors of the nucleons, consequence of the approximate $SU(4)$ spin flavor symmetry valid in the large Nc limit for baryons. A discussion is provided of the 1/Nc expansion framework along with the results for the asymmetries in elastic, inelastic, and inclusive electron-nucleon scattering.


title: Deciphering Accretion-Driven Starquakes in Recycled Millisecond Pulsars using Gravitational Waves

abstract: Recycled millisecond pulsars are susceptible to starquakes as they are continuously accreting matter from their binary companion. A starquake happens when the rotational frequency of the star crosses its breaking frequency. In this study, we perform a model analysis of an accreting neutron star suffering a starquake. We analyze two models: a spherical star with accreting mountains and a deformed star with accreting mountains. We find that as the star crosses the breaking frequency and suffers a starquake there is a sudden change in the continuous gravitational wave signal arriving from them. It is interesting to note that the amplitude of the gravitational wave signals increases suddenly for the spherical star. In contrast, for the deformed star, the amplitude of the continuous gravitational wave signal decreases suddenly. This sudden change in the continuous gravitational wave signal in recycled millisecond pulsars can be a unique signature for such pulsars undergoing a starquake.


title: Neural Information Organizing and Processing -- Neural Machines

abstract: The informational synthesis of neural structures, processes, parameters and characteristics that allow a unified description and modeling as neural machines of natural and artificial neural systems is presented. The general informational parameters as the global quantitative measure of the neural systems computing potential as absolute and relative neural power were proposed. Neural information organizing and processing follows the way in which nature manages neural information by developing functions, functionalities and circuits related to different internal or peripheral components and also to the whole system through a non-deterministic memorization, fragmentation and aggregation of afferent and efferent information, deep neural information processing representing multiple alternations of fragmentation and aggregation stages. The relevant neural characteristics were integrated into a neural machine type model that incorporates unitary also peripheral or interface components as the central ones. The proposed approach allows overcoming the technical constraints in artificial computational implementations of neural information processes and also provides a more relevant description of natural ones.


title: Status of the production of GEM chambers for the CMS experiment at Large Hadron Collider

abstract: The High Luminosity LHC phase includes an upgrade to the muon stations for the CMS Experiment. CMS trigger and muon identification performance will be crucial, and it is, therefore, necessary to install new GEM stations to extend acceptance in the high-{\eta} region. An explanation of the quality control test and an update on the status of production will be provided.


title: Machine learning augmented diagnostic testing to identify sources of variability in test performance

abstract: Diagnostic tests which can detect pre-clinical or sub-clinical infection, are one of the most powerful tools in our armoury of weapons to control infectious diseases. Considerable effort has been therefore paid to improving diagnostic testing for human, plant and animal diseases, including strategies for targeting the use of diagnostic tests towards individuals who are more likely to be infected. Here, we follow other recent proposals to further refine this concept, by using machine learning to assess the situational risk under which a diagnostic test is applied to augment its interpretation . We develop this to predict the occurrence of breakdowns of cattle herds due to bovine tuberculosis, exploiting the availability of exceptionally detailed testing records. We show that, without compromising test specificity, test sensitivity can be improved so that the proportion of infected herds detected by the skin test, improves by over 16 percentage points. While many risk factors are associated with increased risk of becoming infected, of note are several factors which suggest that, in some herds there is a higher risk of infection going undetected, including effects that are correlated to the veterinary practice conducting the test, and number of livestock moved off the herd.


title: Pulse Shape Discrimination in JSNS$^2$

abstract: JSNS$^2$ (J-PARC Sterile Neutrino Search at J-PARC Spallation Neutron Source) is an experiment that is searching for sterile neutrinos via the observation of $\bar{\nu}_{\mu} \rightarrow \bar{\nu}_e$ appearance oscillations using neutrinos with muon decay-at-rest. For this search, rejecting cosmic-ray-induced neutron events by Pulse Shape Discrimination (PSD) is essential because the JSNS$^2$ detector is located above ground, on the third floor of the building. We have achieved 95$\%$ rejection of neutron events while keeping 90$\%$ of signal, electron-like events using a data driven likelihood method.


title: Muon Track Reconstruction in the Scintillator Phase of SNO+

abstract: The large depth of the SNO+ experiment (2070 m, 6010 m.w.e.) means that only a few muons per day pass through the detector. However, their high energy causes muon induced backgrounds which can affect multiple physics analyses. Reconstructing the muon track would allow for improved rejection for these induced backgrounds. Currently there is no muon tracker for the scintillator phase of SNO+. This poster presents a novel method of muon track reconstruction by using the high photon sampling from muons and the assumption that each PMT first registers a hit from a photon that takes the fastest possible path from the muon entry point to the PMT.


title: Muon beamtest results of high-density glass scintillator tiles

abstract: To achieve the physics goal of precisely measure the Higgs, Z, W bosons and the top quark, future electron-positron colliders require that their detector system has excellent jet energy resolution. One feasible technical option is the high granular calorimetery based on the particle flow algorithm (PFA). A new high-granularity hadronic calorimeter with glass scintillator tiles (GSHCAL) has been proposed, which focus on the significant improvement of hadronic energy resolution with a notable increase of the energy sampling fraction by using high-density glass scintillator tiles. The minimum ionizing particle (MIP) response of a glass scintillator tile is crucial to the hadronic calorimeter, so a dedicated beamtest setup was developed for testing the first batch of large-size glass scintillators. The maximum MIP response of the first batch of glass scintillator tiles can reach up to 107 p.e./MIP, which essentially meets the design requirements of the CEPC GSHCAL. An optical simulation model of a single glass scintillator tile has been established, and the simulation results are consistent with the beamtest results.


title: Thermodynamics and Perturbative Analysis of Some Newly Developed $\mathcal{F}(R,L_m, T)$ Theories Under the Scenario of Conserved Energy-momentum Tensor

abstract: The present work is devoted to explore some interesting cosmological features of a newly proposed theory of gravity namely $\mathcal{F}(R,L_m,T)$ theory, where $R$ and $T$ represent the Ricci scalar and trace of energy momentum-tensor, respectively. Firstly, a non-equilibrium thermodynamical description is considered on the apparent horizon of the Friedmann's cosmos. The Friedmann equations are demonstrated to be equivalent to the first law of thermodynamics, i.e., ${T_{Ah}d\varepsilon_{h}^\prime+T_{Ah}d_{i}\varepsilon_{h}^\prime=-d\hat{E}+\hat{W}dV}$, where ${d_{i}\varepsilon_{h}^\prime}$ refers to entropy production term. We also formulate the constraint for validity of generalized second law of thermodynamics and check it for some simple well-known forms of generic function $\mathcal{F}(R,L_m,T)$. Next, we develop the energy bounds for this framework and constraint the free variables by finding the validity regions for NEC and WEC. Further, we reconstruct some interesting cosmological solutions namely power law, $\Lambda$CDM and de Sitter models in this theory. The reconstructed solutions are then examined by checking the validity of GSLT and energy bounds. Lastly, we analyze the stability of all reconstructed solutions by introducing suitable perturbations in the field equations. It is concluded that obtained solutions are stable and cosmologically viable.


title: Stream of Search (SoS): Learning to Search in Language

abstract: Language models are rarely shown fruitful mistakes while training. They then struggle to look beyond the next token, suffering from a snowballing of errors and struggling to predict the consequence of their actions several steps ahead. In this paper, we show how language models can be taught to search by representing the process of search in language, as a flattened string -- a stream of search (SoS). We propose a unified language for search that captures an array of different symbolic search strategies. We demonstrate our approach using the simple yet difficult game of Countdown, where the goal is to combine input numbers with arithmetic operations to reach a target number. We pretrain a transformer-based language model from scratch on a dataset of streams of search generated by heuristic solvers. We find that SoS pretraining increases search accuracy by 25% over models trained to predict only the optimal search trajectory. We further finetune this model with two policy improvement methods: Advantage-Induced Policy Alignment (APA) and Self-Taught Reasoner (STaR). The finetuned SoS models solve 36% of previously unsolved problems, including problems that cannot be solved by any of the heuristic solvers. Our results indicate that language models can learn to solve problems via search, self-improve to flexibly use different search strategies, and potentially discover new ones.


title: Relativistic jet ejections from slim disks

abstract: An ejection mechanism of relativistic jets from slim disks is studied. Since the radiation pressure is dominant in the slim disk, radiative energy flow arises along the pressure gradient in the vertical direction. The divergence of the radiative flux tells us that the radiative energy flow from a bottom layer near the equatorial plane is absorbed by another layer upper than the boundary surface. The absorbed energy accumulates in the upper layer as the matter advances inward and calculations show that the specific energy of the flow in the upper layer can be as large as $\sim c^{2}$ near the black hole when the accretion rate through the upper layer is relatively low. Since the specific energy $\sim c^{2}$ is much larger than the gravitational energy, the height of the upper layer could significantly increase then. Hence, the innermost part of the upper layer after almost all the angular momentum has been removed could have a much larger height than the black hole size and collide with one another around the central axis of the disk, bouncing back from the axis as simultaneously expanding along the axis. The flow is expected to go outward along the central axis and to become supersonic due to the cross-section-change of the flow, getting the relativistic jets finally.


title: Cooperative Evolutionary Pressure and Diminishing Returns Might Explain the Fermi Paradox: On What Super-AIs Are Like

abstract: With an evolutionary approach, the basis of morality can be explained as adaptations to problems of cooperation. With 'evolution' taken in a broad sense, evolving AIs that satisfy the conditions for evolution to apply will be subject to the same cooperative evolutionary pressure as biological entities. Here the adaptiveness of increased cooperation as material safety and wealth increase is discussed -- for humans, for other societies, and for AIs. Diminishing beneficial returns from increased access to material resources also suggests the possibility that, on the whole, there will be no incentive to for instance colonize entire galaxies, thus providing a possible explanation of the Fermi paradox, wondering where everybody is. It is further argued that old societies could engender, give way to, super-AIs, since it is likely that super-AIs are feasible, and fitter. Closing is an aside on effective ways for morals and goals to affect life and society, emphasizing environments, cultures, and laws, and exemplified by how to eat. Appended are an algorithm for colonizing for example a galaxy quickly, models of the evolution of cooperation and fairness under diminishing returns, and software for simulating signaling development. It is also noted that there can be no exponential colonization or reproduction, for mathematical reasons, as each entity takes up a certain amount of space.


title: Securing Social Spaces: Harnessing Deep Learning to Eradicate Cyberbullying

abstract: In today's digital world, cyberbullying is a serious problem that can harm the mental and physical health of people who use social media. This paper explains just how serious cyberbullying is and how it really affects indi-viduals exposed to it. It also stresses how important it is to find better ways to detect cyberbullying so that online spaces can be safer. Plus, it talks about how making more accurate tools to spot cyberbullying will be really helpful in the future. Our paper introduces a deep learning-based ap-proach, primarily employing BERT and BiLSTM architectures, to effective-ly address cyberbullying. This approach is designed to analyse large vol-umes of posts and predict potential instances of cyberbullying in online spaces. Our results demonstrate the superiority of the hateBERT model, an extension of BERT focused on hate speech detection, among the five mod-els, achieving an accuracy rate of 89.16%. This research is a significant con-tribution to "Computational Intelligence for Social Transformation," prom-ising a safer and more inclusive digital landscape.


title: DRIVE: Dual Gradient-Based Rapid Iterative Pruning

abstract: Modern deep neural networks (DNNs) consist of millions of parameters, necessitating high-performance computing during training and inference. Pruning is one solution that significantly reduces the space and time complexities of DNNs. Traditional pruning methods that are applied post-training focus on streamlining inference, but there are recent efforts to leverage sparsity early on by pruning before training. Pruning methods, such as iterative magnitude-based pruning (IMP) achieve up to a 90% parameter reduction while retaining accuracy comparable to the original model. However, this leads to impractical runtime as it relies on multiple train-prune-reset cycles to identify and eliminate redundant parameters. In contrast, training agnostic early pruning methods, such as SNIP and SynFlow offer fast pruning but fall short of the accuracy achieved by IMP at high sparsities. To bridge this gap, we present Dual Gradient-Based Rapid Iterative Pruning (DRIVE), which leverages dense training for initial epochs to counteract the randomness inherent at the initialization. Subsequently, it employs a unique dual gradient-based metric for parameter ranking. It has been experimentally demonstrated for VGG and ResNet architectures on CIFAR-10/100 and Tiny ImageNet, and ResNet on ImageNet that DRIVE consistently has superior performance over other training-agnostic early pruning methods in accuracy. Notably, DRIVE is 43$\times$ to 869$\times$ faster than IMP for pruning.


title: Beam test of a baseline vertex detector prototype for CEPC

abstract: The Circular Electron Positron Collider (CEPC) has been proposed to enable more thorough and precise measurements of the properties of Higgs, W, and Z bosons, as well as to search for new physics. In response to the stringent performance requirements of the vertex detector for the CEPC, a baseline vertex detector prototype was tested and characterized for the first time using a 6 GeV electron beam at DESY II Test Beam Line 21. The baseline vertex detector prototype is designed with a cylindrical barrel structure that contains six double-sided detector modules (ladders). Each side of the ladder includes TaichuPix-3 sensors based on Monolithic Active Pixel Sensor (MAPS) technology, a flexible printed circuit, and a carbon fiber support structure. Additionally, the readout electronics and the Data Acquisition system were also examined during this beam test. The performance of the prototype was evaluated using an electron beam that passed through six ladders in a perpendicular direction. The offline data analysis indicates a spatial resolution of about 5 um, with detection efficiency exceeding 99 % and an impact parameter resolution of about 5.1 um. These promising results from this baseline vertex detector prototype mark a significant step toward realizing the optimal vertex detector for the CEPC.


title: A Tutorial on Gaussian Process Learning-based Model Predictive Control

abstract: This tutorial provides a systematic introduction to Gaussian process learning-based model predictive control (GP-MPC), an advanced approach integrating Gaussian process (GP) with model predictive control (MPC) for enhanced control in complex systems. It begins with GP regression fundamentals, illustrating how it enriches MPC with enhanced predictive accuracy and robust handling of uncertainties. A central contribution of this tutorial is the first detailed, systematic mathematical formulation of GP-MPC in literature, focusing on deriving the approximation of means and variances propagation for GP multi-step predictions. Practical applications in robotics control, such as path-following for mobile robots in challenging terrains and mixed-vehicle platooning, are discussed to demonstrate the real-world effectiveness and adaptability of GP-MPC. This tutorial aims to make GP-MPC accessible to researchers and practitioners, enriching the learning-based control field with in-depth theoretical and practical insights and fostering further innovations in complex system control.


title: CYG$\nu$S: Detecting solar neutrinos with directional gas time projection chambers

abstract: CYGNUS is a proposed global network of large-scale gas time projection chambers (TPCs) with the capability of directionally detecting nuclear and electron recoils at $\gtrsim$keV energies. The primary focus of CYGNUS so far has been the detection of dark matter, with directional sensitivity providing a means of circumventing the so-called neutrino fog. However, the excellent background rejection and electron/nuclear recoil discrimination provided by directionality could turn the solar neutrino background into an interesting signal in its own right. For example, directionality would facilitate the simultaneous spectroscopy of multiple different flux sources. Here, we evaluate the possibility of measuring solar neutrinos using the same network of gas TPCs built from $10$ m$^3$-scale modules operating under conditions that enable simultaneous sensitivity to both dark matter and neutrinos. We focus in particular on electron recoils, which provide access to low-energy neutrino fluxes like $pp$, $pep$, $^7$Be, and CNO. An appreciable event rate is already detectable in experiments consisting of a single $10$ m$^3$ module, assuming standard fill gases such as CF$_4$ mixed with helium at atmospheric pressure. With total volumes around 1000 m$^3$ or higher, the TPC network could be complementary to dedicated neutrino observatories, whilst entering the dark-matter neutrino fog via the nuclear recoil channel. We evaluate the required directional performance and background conditions to observe, discriminate, and perform spectroscopy on neutrino events. We find that, under reasonable projections for planned technology that will enable 10--30-degree angular resolution and $\sim 10$\% fractional energy resolution, CYGNUS could be a competitive directional neutrino experiment.


title: Upgrade of NaI(Tl) crystal encapsulation for the NEON experiment

abstract: The Neutrino Elastic-scattering Observation with NaI(Tl) experiment (NEON) aims to detect coherent elastic neutrino-nucleus scattering~(CE$\nu$NS) in a NaI(Tl) crystal using reactor anti-electron neutrinos at the Hanbit nuclear power plant complex. A total of 13.3 kg of NaI(Tl) crystals were initially installed in December 2020 at the tendon gallery, 23.7$\pm$0.3\,m away from the reactor core, which operates at a thermal power of 2.8\,GW. Initial engineering operation was performed from May 2021 to March 2022 and observed unexpected photomultiplier-induced noise and a decreased light yield that were induced by leakage of liquid scintillator into the detector due to weakness of detector encapsulation. We upgraded the detector encapsulation design to prevent leakage of the liquid scintillator. Meanwhile two small size detectors were replaced with large size detectors returning a total mass of 16.7\,kg. With this new design implementation, the detector system has been operating stably since April 2022 for over a year without detector gain drop. In this paper, we present an improved crystal encapsulation design and stability of the NEON experiment.


title: Re-assessing special aspects of Dirac fermions in presence of Lorentz-symmetry violation

abstract: This paper focuses on additional inspections concerning the fermionic sector of the Standard Model Extension (SME). In this context, our main effort in this contribution is to investigate effects of Lorentz-symmetry violation (LSV) on the Klein Paradox, the Zitterbewegung and its phenomenology in connection to Condensed Matter Physics, Atomic Physics, and Astrophysics. Finally, we discuss a particular realization of LSV in the Dirac equation, considering an asymmetry between space and time due to a scale factor present in the linear momentum of the fermion, but which does not touch its time derivative. We go further and extend the implications of this asymmetry in the situation the scale factor becomes space-time dependent to compute its influence on the kinematics of the Compton effect with the extended dispersion relation for the fermion that scatters the photon.


title: Improve Knowledge Distillation via Label Revision and Data Selection

abstract: Knowledge distillation (KD) has become a widely used technique in the field of model compression, which aims to transfer knowledge from a large teacher model to a lightweight student model for efficient network development. In addition to the supervision of ground truth, the vanilla KD method regards the predictions of the teacher as soft labels to supervise the training of the student model. Based on vanilla KD, various approaches have been developed to further improve the performance of the student model. However, few of these previous methods have considered the reliability of the supervision from teacher models. Supervision from erroneous predictions may mislead the training of the student model. This paper therefore proposes to tackle this problem from two aspects: Label Revision to rectify the incorrect supervision and Data Selection to select appropriate samples for distillation to reduce the impact of erroneous supervision. In the former, we propose to rectify the teacher's inaccurate predictions using the ground truth. In the latter, we introduce a data selection technique to choose suitable training samples to be supervised by the teacher, thereby reducing the impact of incorrect predictions to some extent. Experiment results demonstrate the effectiveness of our proposed method, and show that our method can be combined with other distillation approaches, improving their performance.


title: Cultural influence on autonomous vehicles acceptance

abstract: Autonomous vehicles and other intelligent transport systems have been evolving rapidly and are being increasingly deployed worldwide. Previous work has shown that perceptions of autonomous vehicles and attitudes towards them depend on various attributes, including the respondent's age, education level and background. These findings with respect to age and educational level are generally uniform, such as showing that younger respondents are typically more accepting of autonomous vehicles, as are those with higher education levels. However the influence of factors such as culture are much less clear cut. In this paper we analyse the relationship between acceptance of autonomous vehicles and national culture by means of the well-known Hofstede cultural model.


title: Constructing $\omega$-free Hardy fields

abstract: We show that every Hardy field extends to an $\omega$-free Hardy field. This result relates to classical oscillation criteria for second-order homogeneous linear differential equations. It is essential in [12], and here we apply it to answer questions of Boshernitzan, and to generalize a theorem of his.


title: Convolutional variational autoencoders for secure lossy image compression in remote sensing

abstract: The volume of remote sensing data is experiencing rapid growth, primarily due to the plethora of space and air platforms equipped with an array of sensors. Due to limited hardware and battery constraints the data is transmitted back to Earth for processing. The large amounts of data along with security concerns call for new compression and encryption techniques capable of preserving reconstruction quality while minimizing the transmission cost of this data back to Earth. This study investigates image compression based on convolutional variational autoencoders (CVAE), which are capable of substantially reducing the volume of transmitted data while guaranteeing secure lossy image reconstruction. CVAEs have been demonstrated to outperform conventional compression methods such as JPEG2000 by a substantial margin on compression benchmark datasets. The proposed model draws on the strength of the CVAEs capability to abstract data into highly insightful latent spaces, and combining it with the utilization of an entropy bottleneck is capable of finding an optimal balance between compressibility and reconstruction quality. The balance is reached by optimizing over a composite loss function that represents the rate-distortion curve.