title: Mathematical analysis of a model-constrained inverse problem for the reconstruction of early states of prostate cancer growth

abstract: The availability of cancer measurements over time enables the personalised assessment of tumour growth and therapeutic response dynamics. However, many tumours are treated after diagnosis without collecting longitudinal data, and cancer monitoring protocols may include infrequent measurements. To facilitate the estimation of disease dynamics and better guide ensuing clinical decisions, we investigate an inverse problem enabling the reconstruction of earlier tumour states by using a single spatial tumour dataset and a biomathematical model describing disease dynamics. We focus on prostate cancer, since aggressive cases of this disease are usually treated after diagnosis. We describe tumour dynamics with a phase-field model driven by a generic nutrient ruled by reaction-diffusion dynamics. The model is completed with another reaction-diffusion equation for the local production of prostate-specific antigen, which is a key prostate cancer biomarker. We first improve previous well-posedness results by further showing that the solution operator is continuously Fr\'echet differentiable. We then analyse the backward inverse problem concerning the reconstruction of earlier tumour states starting from measurements of the model variables at the final time. Since this problem is severely ill-posed, only very weak conditional stability of logarithmic type can be recovered from the terminal data. However, by restricting the unknowns to a compact subset of a finite-dimensional subspace, we can derive an optimal Lipschitz stability estimate.


title: Axion Dark Matter from Heavy Quarks

abstract: We propose simple scenarios where the observed dark matter abundance arises from decays and scatterings of heavy quarks through freeze-in of an axion-like particle with mass in the $10 {\rm \, keV} - 1 {\rm \, MeV}$ range. These models can be tested by future X-ray telescopes, and in some cases will be almost entirely probed by searches for two-body decays $K \to \pi + {\rm invis.}$ at NA62. As a byproduct, we discuss the cancellation of IR divergencies in flavor-violating scattering processes relevant for thermal axion production, and derive the general contribution to axion-photon couplings from all three light quarks.


title: Metamaterial-induced-transparency engineering through quasi-bound states in the continuum by using dielectric cross-shaped trimers

abstract: This study presents a novel approach to activate a narrowband transparency line within a reflecting broadband window in all-dielectric metasurfaces, in analogy to the electromagnetically-induced transparency effect, by means of a quasi-bound state in the continuum (qBIC). We demonstrate that the resonance overlapping of a bright mode and a qBIC-based nearly-dark mode with distinct Q-factor can be fully governed by a silicon trimer-based unit cell with broken-inversion-symmetry cross shape, thus providing the required response under normal incidence of a linearly-polarized light. Our analysis that is derived from the far-field multipolar decomposition and near-field electromagnetic distributions uncovers the main contributions of different multipoles on the qBIC resonance, with governing magnetic dipole and electric quadrupole terms supplied by distinct parts of the dielectric ``molecule.'' The findings extracted from this research open up new avenues for the development of polarization-dependent technologies, with particular interest in its capabilities for sensing and biosensing.


title: Infinite unrestricted sumsets of the form $B+B$ in sets with large density

abstract: For a set $A \subset \mathbb{N}$ we characterize in terms of its density when there exists an infinite set $B \subset \mathbb{N}$ and $t \in \{0,1\}$ such that $B+B \subset A-t$, where $B+B : =\{b_1+b_2\colon b_1,b_2 \in B\}$. Specifically, when the lower density $\underline{d}(A) >1/2$ or the upper density $\overline{d}(A)> 3/4$, the existence of such a set $B\subset \mathbb{N}$ and $t\in \{0,1\}$ is assured. Furthermore, whenever $\underline{d}(A) > 3/4$ or $\overline{d}(A)>5/6$, we show that the shift $t$ is unnecessary and we also provide examples to show that these bounds are sharp. Finally, we construct a syndetic three-coloring of the natural numbers that does not contain a monochromatic $B+B+t$ for any infinite set $B \subset \mathbb{N}$ and number $t \in \mathbb{N}$.


title: Reflections on the denialism of the Earth's curvature based on the general public participation in the collective reproduction of Eratosthenes' experiment

abstract: In this paper, we propose the replication of scientific experiments, with the participation of the general public, as one of the possible strategies to confront science deniers. Using the social media of the Federal University of Lavras (UFLA), the project entitled : The Magic of Physics and the Universe, invited the public to reproduce the experiment carried out by the Greek Eratosthenes over 2,100 years ago, which he proved that the Earth is spherical. We present a report of this experience to suggest that it is possible for citizens to experience scientific knowledge and observe the phenomena in a simple way, in order to develop a critical interpretation of false information that circulates in society. This proposal distinctively geeks to deconstruct the denial of the Earth's curvature through direct and collective participation of citizens in Eratosthenes' experiment, which permit more reflection on how the scientific method used to study this subject works.


title: GraFIQs: Face Image Quality Assessment Using Gradient Magnitudes

abstract: Face Image Quality Assessment (FIQA) estimates the utility of face images for automated face recognition (FR) systems. We propose in this work a novel approach to assess the quality of face images based on inspecting the required changes in the pre-trained FR model weights to minimize differences between testing samples and the distribution of the FR training dataset. To achieve that, we propose quantifying the discrepancy in Batch Normalization statistics (BNS), including mean and variance, between those recorded during FR training and those obtained by processing testing samples through the pretrained FR model. We then generate gradient magnitudes of pretrained FR weights by backpropagating the BNS through the pretrained model. The cumulative absolute sum of these gradient magnitudes serves as the FIQ for our approach. Through comprehensive experimentation, we demonstrate the effectiveness of our training-free and quality labeling-free approach, achieving competitive performance to recent state-of-theart FIQA approaches without relying on quality labeling, the need to train regression networks, specialized architectures, or designing and optimizing specific loss functions.


title: Minimum saturated graphs for unions of cliques

abstract: Let $H$ be a fixed graph. A graph $G$ is called {\it $H$-saturated} if $H$ is not a subgraph of $G$ but the addition of any missing edge to $G$ results in an $H$-subgraph. The {\it saturation number} of $H$, denoted $sat(n,H)$, is the minimum number of edges over all $H$-saturated graphs of order $n$, and $Sat(n,H)$ denote the family of $H$-saturated graphs with $sat(n,H)$ edges and $n$ vertices. In this paper, we resolve a conjecture of Chen and Yuan in[Discrete Math. 347(2024)113868] by determining $Sat(n,K_p\cup (t-1)K_q)$ for every $2\le p\le q$ and $t\ge 2$.


title: Tracing Pareto-optimal points for multi-objective shape optimization applied to electric machines

abstract: In the context of the optimization of rotating electric machines, many different objective functions are of interest and considering this during the optimization is of crucial importance. While evolutionary algorithms can provide a Pareto front straightforwardly and are widely used in this context, derivative-based optimization algorithms can be computationally more efficient. In this case, a Pareto front can be obtained by performing several optimization runs with different weights. In this work, we focus on a free-form shape optimization approach allowing for arbitrary motor geometries. In particular, we propose a way to efficiently obtain Pareto-optimal points by moving along to the Pareto front exploiting a homotopy method based on second order shape derivatives.


title: Attosecond dynamics of electron scattering by an absorbing layer

abstract: Attosecond dynamics of electron reflection from a thin film is studied based on a one-dimensional jellium model. Following the Eisenbud-Wigner-Smith concept, the reflection time delay $\Delta\tau_{\rm R}$ is calculated as the energy derivative of the phase of the complex reflection amplitude $r$. For a purely elastic scattering by a jellium slab of a finite thickness $d$ the transmission probability $T$ oscillates with the momentum $K$ in the solid with a period $\pi/d$, and $\Delta\tau_{\rm R}$ closely follows these oscillations. The reflection delay averaged over an energy interval grows with $d$, but in the limit of $d\to\infty$ the amplitude $r$ becomes real, so $\Delta\tau_{\rm R}$ vanishes. This picture changes substantially with the inclusion of an absorbing potential $-iV_{\rm i}$: As expected, for a sufficiently thick slab the reflection amplitude now tends to its asymptotic value for a semi-infinite crystal. Interestingly, for $V_{\rm i} \ne 0$, around the $T(E)$ maxima, the $\Delta\tau_{\rm R}(E)$ curve strongly deviates from $T(E)$, showing a narrow dip just at the $\Delta\tau_{\rm R}(E)$ maximum for $V_{\rm i}=0$. An analytical theory of this counterintuitive behavior is developed.


title: Spin-1 Haldane chains of superconductor-semiconductor hybrids

abstract: We theoretically explore the possibility of realizing the symmetry-protected topological Haldane phase of spin-1 chains in a tunable hybrid platform of superconducting islands (SIs) and quantum dots (QDs). Inspired by recent findings suggesting that an appropriately tuned QD-SI-QD block may behave as a robust spin-1 unit, we study the behavior of many such units tunnel-coupled into linear chains. Our efficient and fully microscopic modeling of long chains with several tens of units is enabled by the use of the surrogate model solver [Phys. Rev. B 108, L220506 (2023); arXiv:2402.18357]. Our numerical findings indicate that the QD-SI-QD chains exhibit emblematic features of the Haldane phase, such as fractional spin-1/2 edge states and non-vanishing string order parameters, and that these persist over a sizeable region of parameter space.


title: The Explicit values of the UBCT, the LBCT and the DBCT of the inverse function

abstract: Substitution boxes (S-boxes) play a significant role in ensuring the resistance of block ciphers against various attacks. The Upper Boomerang Connectivity Table (UBCT), the Lower Boomerang Connectivity Table (LBCT) and the Double Boomerang Connectivity Table (DBCT) of a given S-box are crucial tools to analyze its security concerning specific attacks. However, there are currently no related results for this research. The inverse function is crucial for constructing S-boxes of block ciphers with good cryptographic properties in symmetric cryptography. Therefore, extensive research has been conducted on the inverse function, exploring various properties related to standard attacks. Thanks to the recent advancements in boomerang cryptanalysis, particularly the introduction of concepts such as UBCT, LBCT, and DBCT, this paper aims to further investigate the properties of the inverse function $F(x)=x^{2^n-2}$ over $\gf_{2^n}$ for arbitrary $n$. As a consequence, by carrying out certain finer manipulations of solving specific equations over $\gf_{2^n}$, we give all entries of the UBCT, LBCT of $F(x)$ over $\gf_{2^n}$ for arbitrary $n$. Besides, based on the results of the UBCT and LBCT for the inverse function, we determine that $F(x)$ is hard when $n$ is odd. Furthermore, we completely compute all entries of the DBCT of $F(x)$ over $\gf_{2^n}$ for arbitrary $n$. Additionally, we provide the precise number of elements with a given entry by means of the values of some Kloosterman sums. Further, we determine the double boomerang uniformity of $F(x)$ over $\gf_{2^n}$ for arbitrary $n$. Our in-depth analysis of the DBCT of $F(x)$ contributes to a better evaluation of the S-box's resistance against boomerang attacks.


title: Partial-to-Partial Shape Matching with Geometric Consistency

abstract: Finding correspondences between 3D shapes is an important and long-standing problem in computer vision, graphics and beyond. A prominent challenge are partial-to-partial shape matching settings, which occur when the shapes to match are only observed incompletely (e.g. from 3D scanning). Although partial-to-partial matching is a highly relevant setting in practice, it is rarely explored. Our work bridges the gap between existing (rather artificial) 3D full shape matching and partial-to-partial real-world settings by exploiting geometric consistency as a strong constraint. We demonstrate that it is indeed possible to solve this challenging problem in a variety of settings. For the first time, we achieve geometric consistency for partial-to-partial matching, which is realized by a novel integer non-linear program formalism building on triangle product spaces, along with a new pruning algorithm based on linear integer programming. Further, we generate a new inter-class dataset for partial-to-partial shape-matching. We show that our method outperforms current SOTA methods on both an established intra-class dataset and our novel inter-class dataset.


title: An Experimental Study on Exploring Strong Lightweight Vision Transformers via Masked Image Modeling Pre-Training

abstract: Masked image modeling (MIM) pre-training for large-scale vision transformers (ViTs) has enabled promising downstream performance on top of the learned self-supervised ViT features. In this paper, we question if the \textit{extremely simple} lightweight ViTs' fine-tuning performance can also benefit from this pre-training paradigm, which is considerably less studied yet in contrast to the well-established lightweight architecture design methodology. We use an observation-analysis-solution flow for our study. We first systematically observe different behaviors among the evaluated pre-training methods with respect to the downstream fine-tuning data scales. Furthermore, we analyze the layer representation similarities and attention maps across the obtained models, which clearly show the inferior learning of MIM pre-training on higher layers, leading to unsatisfactory transfer performance on data-insufficient downstream tasks. This finding is naturally a guide to designing our distillation strategies during pre-training to solve the above deterioration problem. Extensive experiments have demonstrated the effectiveness of our approach. Our pre-training with distillation on pure lightweight ViTs with vanilla/hierarchical design ($5.7M$/$6.5M$) can achieve $79.4\%$/$78.9\%$ top-1 accuracy on ImageNet-1K. It also enables SOTA performance on the ADE20K segmentation task ($42.8\%$ mIoU) and LaSOT tracking task ($66.1\%$ AUC) in the lightweight regime. The latter even surpasses all the current SOTA lightweight CPU-realtime trackers.


title: Anomalous diffusion and effective shear modulus in a semi-solid membrane

abstract: From the perspective of physical properties, the cell membrane is an exotic two-dimensional material that has a dual nature: it exhibits characteristics of fluids, i.e., lipid molecules show lateral diffusion, while also demonstrating properties of solids, evidenced by a non-zero shear modulus. We construct a model for such a $\textit{semi-solid}$ $\textit{membrane}$. Our model is a fluctuating randomly triangulated mesh with two different kinds of nodes. The solid nodes never change their neighbors, while the fluid nodes do. As the area fraction occupied by the solid nodes ($\Phi$) is increased the motion of fluid nodes transition from diffusion to localization via subdiffusion. Next, the solid nodes are pinned to mimic the pinning of the plasma membrane to the cytoskeleton. For the pinned membrane, there exists a range of $\Phi$ over which the model has both a non-zero shear modulus and a non-zero lateral diffusivity. The bending modulus, measured through the spectrum of height fluctuations remains unchanged.


title: Detection and prebiotic chemistry of possible glycine precursor molecule methylenimine towards the hot molecular core G10.47+0.03

abstract: Amino acids are essential for the synthesis of protein. Amino acids contain both amine (R$-$NH$_{2}$) and carboxylic acid (R$-$COOH) functional groups, which help to understand the possible formation mechanism of life in the universe. Among the 20 types of amino acids, glycine (NH$_{2}$CH$_{2}$COOH) is known as the simplest non-essential amino acid. In the last 40 years, all surveys of NH$_{2}$CH$_{2}$COOH in the interstellar medium, especially in the star-formation regions, have failed at the millimeter and sub-millimeter wavelengths. We aimed to identify the possible precursors of NH$_{2}$CH$_{2}$COOH, because it is highly challenging to identify NH$_{2}$CH$_{2}$COOH in the interstellar medium. Many laboratory experiments have suggested that methylenimine (CH$_{2}$NH) plays a key role as a possible precursor of NH$_{2}$CH$_{2}$COOH in the star-formation regions via the Strecker synthesis reaction. After spectral analysis using the local thermodynamic equilibrium (LTE) model, we successfully identified the rotational emission lines of CH$_{2}$NH towards the hot molecular core G10.47+0.03 using the Atacama Compact Array (ACA). The estimated column density of CH$_{2}$NH towards G10.47+0.03 is (3.40$\pm$0.2)$\times$10$^{15}$ cm$^{-2}$ with a rotational temperature of 218.70$\pm$20 K, which is estimated from the rotational diagram. The fractional abundance of CH$_{2}$NH with respect to H$_{2}$ towards G10.47+0.03 is 2.61$\times$10$^{-8}$. We found that the derived abundance of CH$_{2}$NH agree fairly well with the existing two-phase warm-up chemical modelling abundance value of CH$_{2}$NH. We discuss the possible formation pathways of CH$_{2}$NH within the context of hot molecular cores, and we find that CH$_{2}$NH is likely mainly formed via neutral-neutral gas-phase reactions of CH$_{3}$ and NH radicals towards G10.47+0.03.


title: Investigating Variance Definitions for Mirror Descent with Relative Smoothness

abstract: Mirror Descent is a popular algorithm, that extends Gradients Descent (GD) beyond the Euclidean geometry. One of its benefits is to enable strong convergence guarantees through smooth-like analyses, even for objectives with exploding or vanishing curvature. This is achieved through the introduction of the notion of relative smoothness, which holds in many of the common use-cases of Mirror descent. While basic deterministic results extend well to the relative setting, most existing stochastic analyses require additional assumptions on the mirror, such as strong convexity (in the usual sense), to ensure bounded variance. In this work, we revisit Stochastic Mirror Descent (SMD) proofs in the (relatively-strongly-) convex and relatively-smooth setting, and introduce a new (less restrictive) definition of variance which can generally be bounded (globally) under mild regularity assumptions. We then investigate this notion in more details, and show that it naturally leads to strong convergence guarantees for stochastic mirror descent. Finally, we leverage this new analysis to obtain convergence guarantees for the Maximum Likelihood Estimator of a Gaussian with unknown mean and variance.


title: Income Shocks and their Transmission into Consumption

abstract: This article reviews the economics literature of, primarily, the last 20 years, that studies the link between income shocks and consumption fluctuations at the household level. We identify three broad approaches through which researchers estimate the consumption response to income shocks: 1.) structural methods in which a fully or partially specified model helps identify the consumption response to income shocks from the data; 2.) natural experiments in which the consumption response of one group who receives an income shock is compared to another group who does not; 3.) elicitation surveys in which consumers are asked how they expect to react to various hypothetical events.


title: Quantifying Aleatoric and Epistemic Uncertainty with Proper Scoring Rules

abstract: Uncertainty representation and quantification are paramount in machine learning and constitute an important prerequisite for safety-critical applications. In this paper, we propose novel measures for the quantification of aleatoric and epistemic uncertainty based on proper scoring rules, which are loss functions with the meaningful property that they incentivize the learner to predict ground-truth (conditional) probabilities. We assume two common representations of (epistemic) uncertainty, namely, in terms of a credal set, i.e. a set of probability distributions, or a second-order distribution, i.e., a distribution over probability distributions. Our framework establishes a natural bridge between these representations. We provide a formal justification of our approach and introduce new measures of epistemic and aleatoric uncertainty as concrete instantiations.


title: ProTA: Probabilistic Token Aggregation for Text-Video Retrieval

abstract: Text-video retrieval aims to find the most relevant cross-modal samples for a given query. Recent methods focus on modeling the whole spatial-temporal relations. However, since video clips contain more diverse content than captions, the model aligning these asymmetric video-text pairs has a high risk of retrieving many false positive results. In this paper, we propose Probabilistic Token Aggregation (ProTA) to handle cross-modal interaction with content asymmetry. Specifically, we propose dual partial-related aggregation to disentangle and re-aggregate token representations in both low-dimension and high-dimension spaces. We propose token-based probabilistic alignment to generate token-level probabilistic representation and maintain the feature representation diversity. In addition, an adaptive contrastive loss is proposed to learn compact cross-modal distribution space. Based on extensive experiments, ProTA achieves significant improvements on MSR-VTT (50.9%), LSMDC (25.8%), and DiDeMo (47.2%).


title: Broadband microwave waveform generation with programmable chirp shapes via recirculating phase-modulated optical fiber loop controlled by low-speed electronics

abstract: Broadband microwave waveforms with programmable chirp shapes are captivating in numerous practical applications. Compared with electronic technology, photonic-assisted solutions exhibit excellent performance in bandwidth and flexibility, but still suffer from complex architecture and requirement of high-speed electronics. Besides, rapid manipulation of chirp shape is still a challenge in the scientific community. In this paper, we propose and demonstrate a novel concept for generating broadband microwave waveforms with programmable chirp shapes. This concept is realized on a simple fiber-optic platform involving a continuous-wave laser source, a recirculating phase-modulated optical fiber loop, and low-speed electronics with a sampling rate at the level of MS/s. Based on this method, chirped microwave waveforms with a bandwidth up to tens of GHz can be generated, where the chirp shape is identical to the low-frequency driving waveform of the recirculating phase-modulated optical fiber loop. In addition, all the parameters of the generated chirped microwave waveforms can be easily reconfigured in real time, including the bandwidth, the central frequency, and the temporal duration. In the experiment, broadband microwave waveforms with customized chirp shapes are generated, where the center frequency and bandwidth tuning ranges exceed 21 GHz, the temporal duration is tuned in the range of 9 ns to 180 ns, and the coherent time of the generated microwave waveform is larger than 100 {\mu}s. This simple fiber-optic platform paves a way to generate broadband microwave waveforms with user-definable chirp shapes, which can find applications in broadband radar systems, electronic warfare and wireless communications.


title: Traveling strings of active dipolar colloids

abstract: We study an intriguing new type of self-assembled active colloidal polymer system in 3D. It is obtained from a suspension of Janus particles in an electric field that induces parallel dipoles in the particles as well as self-propulsion in the plane perpendicular to the field. At low packing fractions, in experiment, the particles self-assemble into 3D columns that are self-propelled in 2D. Explicit numerical simulations combining dipolar interactions and active self-propulsion find an activity dependent transition to a string phase by increasing dipole strength. We classify the collective dynamics of strings as a function of rotational and translational diffusion. Using an anisotropic version of the Rouse model of polymers with active driving, we analytically compute the strings' collective dynamics and centre of mass motion, which matches simulations and is consistent with experimental data. We also discover long range correlations of the fluctuations along the string contour that grow with the active persistence time, a purely active effect that disappears in the thermal limit.


title: A Quadrature Approach for General-Purpose Batch Bayesian Optimization via Probabilistic Lifting

abstract: Parallelisation in Bayesian optimisation is a common strategy but faces several challenges: the need for flexibility in acquisition functions and kernel choices, flexibility dealing with discrete and continuous variables simultaneously, model misspecification, and lastly fast massive parallelisation. To address these challenges, we introduce a versatile and modular framework for batch Bayesian optimisation via probabilistic lifting with kernel quadrature, called SOBER, which we present as a Python library based on GPyTorch/BoTorch. Our framework offers the following unique benefits: (1) Versatility in downstream tasks under a unified approach. (2) A gradient-free sampler, which does not require the gradient of acquisition functions, offering domain-agnostic sampling (e.g., discrete and mixed variables, non-Euclidean space). (3) Flexibility in domain prior distribution. (4) Adaptive batch size (autonomous determination of the optimal batch size). (5) Robustness against a misspecified reproducing kernel Hilbert space. (6) Natural stopping criterion.


title: Hybrid Dynamics Modeling and Trajectory Planning for a Cable-Trailer System with a Quadruped Robot

abstract: Inspired by the utilization of dogs in sled-pulling for transportation, we introduce a cable-trailer system with a quadruped robot. The motion planning of the proposed robot system presents challenges arising from the nonholonomic constraints of the trailer, system underactuation, and hybrid interaction through the cable. To tackle these challenges, we develop a hybrid dynamics model that accounts for the cable's taut/slack status. Since it is computationally intense to directly optimize the trajectory, we first propose a search algorithm to compute a sub-optimal trajectory as the initial solution. Then, a novel collision avoidance constraint based on the geometric shapes of objects is proposed to formulate the trajectory optimization problem for the hybrid system. The proposed trajectory planning method is implemented on a Unitree A1 quadruped robot with a customized cable-trailer and validated through experiments.


title: Unipotent normal subgroups of algebraic groups

abstract: Let $G$ be an affine algebraic group scheme over a field $k$. We show there exists a unipotent normal subgroup of $G$ which contains all other such subgroups; we call it the restricted unipotent radical $\mathrm{Rad}_u(G)$ of $G$. We investigate some properties of $\mathrm{Rad}_u(G)$, and study those $G$ for which $\mathrm{Rad}_u(G)$ is trivial. In particular, we relate these notions to their well-known analogues for smooth connected affine $k$-groups.


title: Entangled states from arborescent knots

abstract: In this paper we discuss how to use arborescent knots to construct entangled multi-qubit states. We show that Bell-states, GHZ-states and cluster states can be constructed from such knots. The latter are particularly interesting since they form a base for the measurement-based quantum computers.


title: Images of Kerr-MOG black holes surrounded by geometrically thick magnetized equilibrium tori

abstract: We adopt general relativistic ray-tracing (GRRT) schemes to study images of Kerr-MOG black holes surrounded by geometrically thick magnetized equilibrium tori, which belong to steady-state solutions of thick accretion disks within the framework of general relativistic magnetohydrodynamics (GRMHD). The black hole possesses an extra dimensionless MOG parameter described its deviation from usual Kerr one. Our results show that the presence of the MOG parameter leads to smaller disks in size, but enhances the total flux density and peak brightness in their images. Combining with observation data of black hole M87* from the Event Horizon Telescope (EHT), we make a constraint on parameters of the Kerr-MOG black hole and find that the presence of the MOG parameter broadens the allowable range of black hole spin.


title: Length Generalization of Causal Transformers without Position Encoding

abstract: Generalizing to longer sentences is important for recent Transformer-based language models. Besides algorithms manipulating explicit position features, the success of Transformers without position encodings (NoPE) provides a new way to overcome the challenge. In this paper, we study the length generalization property of NoPE. We find that although NoPE can extend to longer sequences than the commonly used explicit position encodings, it still has a limited context length. We identify a connection between the failure of NoPE's generalization and the distraction of attention distributions. We propose a parameter-efficient tuning for searching attention heads' best temperature hyper-parameters, which substantially expands NoPE's context size. Experiments on long sequence language modeling, the synthetic passkey retrieval task and real-world long context tasks show that NoPE can achieve competitive performances with state-of-the-art length generalization algorithms. The source code is publicly accessible


title: The semi-invariant ring as the Cox ring of a GIT quotient

abstract: We study GIT quotients $X_\theta=V\!/\!\!/\!_\theta G$ whose linearisation map defines an isomorphism between the group of characters of $G$ and the Picard group of $X_\theta$ modulo torsion. Our main result establishes that the Cox ring of $X_\theta$ is isomorphic to the semi-invariant ring of the $\theta$-stable locus in $V$. This applies to quiver flag varieties, Nakajima quiver varieties, hypertoric varieties, and crepant resolutions of threefold Gorenstein quotient singularities with fibre dimension at most one. As an application, we present a simple, explicit calculation of the Cox ring of the Hilbert scheme of $n$-points in the affine plane.


title: A cooperative strategy for diagnosing the root causes of quality requirement violations in multiagent systems

abstract: Many modern software systems are built as a set of autonomous software components (also called agents) that collaborate with each other and are situated in an environment. To keep these multiagent systems operational under abnormal circumstances, it is crucial to make them resilient. Existing solutions are often centralised and rely on information manually provided by experts at design time, making such solutions rigid and limiting the autonomy and adaptability of the system. In this work, we propose a cooperative strategy focused on the identification of the root causes of quality requirement violations in multiagent systems. This strategy allows agents to cooperate with each other in order to identify whether these violations come from service providers, associated components, or the communication infrastructure. From this identification process, agents are able to adapt their behaviour in order to mitigate and solve existing abnormalities with the aim of normalising system operation. This strategy consists of an interaction protocol that, together with the proposed algorithms, allow agents playing the protocol roles to diagnose problems to be repaired. We evaluate our proposal with the implementation of a service-oriented system. The results demonstrate that our solution enables the correct identification of different sources of failures, favouring the selection of the most suitable actions to be taken to overcome abnormal situations.


title: A Photoionization model for the Infrared Coronal Line Emission in the Classical Nova V1716 Scorpii

abstract: A near-infrared spectrum of nova V1716 Scorpii (PNV J17224490-4137160), a recent bright (V_max = 7.3 mag), Fermi-LAT detected gamma-ray source, was modeled using the photoionization code CLOUDY. Abundances were estimated for He, C, N, O, Si, Al, Mg, Fe, Ne, S, Ca, and P. Notably, P (a factor of 120) and N (a factor of 248) are highly overabundant. It was necessary to assume the ejecta consist of two components (with a cylindrical geometry): a dense component from which the bulk of the H, He, and neutral O~I and N emission arises and a more diffuse component from which most of the coronal lines arise. Some of the coronal lines are found to originate from both the dense and diffuse components. The mass of the ejecta, including neutral and ionized gas, is ~ 4.19e-4 solar masses. Our analysis indicates that in the case of V1716 Sco (which has a carbon-oxygen white dwarf), a fraction of 25% white dwarf matter rather than 50% is favored for the mixing between white dwarf and the accreted envelope before the outburst. This mixing ratio is like that found for Oxygen-Neon novae where a 25% mixing fraction is also indicated. Helium hydride -- the first molecule to form after the Big Bang -- may have formed in the ejecta of V1716 Sco based on photoionization modeling. This prediction suggests that novae may be potential formation sites of this important molecular ion.


title: Relationship Discovery for Drug Recommendation

abstract: Medication recommendation systems are designed to deliver personalized drug suggestions that are closely aligned with individual patient needs. Previous studies have primarily concentrated on developing medication embeddings, achieving significant progress. Nonetheless, these approaches often fall short in accurately reflecting individual patient profiles, mainly due to challenges in distinguishing between various patient conditions and the inability to establish precise correlations between specific conditions and appropriate medications. In response to these issues, we introduce DisMed, a model that focuses on patient conditions to enhance personalization. DisMed employs causal inference to discern clear, quantifiable causal links. It then examines patient conditions in depth, recognizing and adapting to the evolving nuances of these conditions, and mapping them directly to corresponding medications. Additionally, DisMed leverages data from multiple patient visits to propose combinations of medications. Comprehensive testing on real-world datasets demonstrates that DisMed not only improves the customization of patient profiles but also surpasses leading models in both precision and safety.


title: A minimal base or a direct base? That is the question!

abstract: In this paper we revisit the problem of computing the closure of a set of attributes, given a set of Armstrong dependencies. This problem is of main interest in logics, in the relational database model, in lattice theory and in Formal Concept Analysis as well. We consider here three main closure algorithms, namely Closure, LinClosure and Wild's Closure, which are combined with implication bases which may have different characteristics, among which being "minimal", e.g., the Duquenne-Guigues basis, and being "direct", e.g., the Canonical Basis and the D-basis. The impacts of minimality and directness on the closure algorithms are then deeply studied also experimentally. The results are extensively analyzed and propose a different and fresh look at computing the closure of a set of attributes. This paper has been submitted to the International Journal of Approximate Reasoning.


title: Estimates for the quantized tensor train ranks for the power functions

abstract: In this work we provide theoretical estimates for the ranks of the power functions $f(k) = k^{-\alpha}$, $\alpha>1$ in the quantized tensor train (QTT) format for $k = 1, 2, 3, \ldots, 2^{d}$. Such functions and their several generalizations (e.~g. $f(k) = k^{-\alpha} \cdot e^{-\lambda k}, \lambda > 0$) play an important role in studies of the asymptotic solutions of the aggregation-fragmentation kinetic equations. In order to support the constructed theory we verify the values of QTT-ranks of these functions in practice with the use of the TTSVD procedure and show an agreement between the numerical and analytical results.


title: Projections of Hopf braces

abstract: This paper is devoted to the study of Hopf braces projections in a monoidal setting. Given a cocommutative Hopf brace ${\mathbb H}$ in a strict symmetric monoidal category ${\sf C}$, we define the braided monoidal category of left Yetter-Drinfeld modules over ${\mathbb H}$. For a Hopf brace ${\mathbb A}$ in this category, we introduce the concept of bosonizable Hopf brace and we prove that its bosonization ${\mathbb A}\blacktriangleright\hspace{-0.15cm}\blacktriangleleft {\mathbb H}$ is a new Hopf brace in ${\sf C}$ that gives rise to a projection of Hopf braces satisfying certain properties. Finally, taking these properties into account, we introduce the notions of v$_{i}$-strong projection over ${\mathbb H}$, $i=1,2,3,4$, and we prove that there is a categorical equivalence between the categories of bosonizable Hopf braces in the category of left Yetter-Drinfeld modules over ${\mathbb H}$ and the category of v$_{4}$-strong projections over ${\mathbb H}$.


title: Model geometries of porous materials

abstract: We describe a method for modeling the geometry of porous materials. The approach enables the independent selection of crucial parameters, including porosity, pore size distribution, pore shape, and connectivity. Consequently, it can effectively model a wide range of porous systems. Due to the diverse and systematic variation possibilities, the method is suitable for developing and optimizing porous structures. The geometries can be exported as triangular meshes, facilitating their immediate use in numerical simulation and further digital processing. We showcase the method's capabilities by minimizing the foam structure's thermal conductivity through geometry optimization.


title: Constraining Higgs sectors of BSM models -- the case of 95 GeV "Higgs"

abstract: In view of lack of the direct experimental evidence for a Beyond the Standard Model (BSM) physics, accommodating a SM-like Higgs boson is on the most important constraints that a BSM model must fulfill. Already for some time the FlexibleSUSY spectrum generator generator allowed for a reliable prediction of masses and decay patterns of the BSM Higgs boson in a large class of user defined supersymmetric and non-supersymmetric models. However, no easy way to compare those predictions with experimental data existed. To that end we present here an interface between FlexibleSUSY and HiggsTools, a computer program assessing in a statistically meaningful way consistency of a BSM Higgs sector with experiments. Motivated by the recent ATLAS and CMS observation of the di-photon excess at a mass of $\sim$95 GeV we demonstrate the capabilities of our framework by investigating whether the observed low mass excesses around 95 GeV seen in the data can be explained as the lightest scalar of the Minimal R-symmetric Supersymmetric Standard Model, without spoiling the SM-like properties of the second-to-lightest state. We also briefly comment on the light dark matter candidate which is a necessarily ingredient of such a setup.


title: Quantitative homogenization and hydrodynamic limit of non-gradient exclusion process

abstract: For the non-gradient exclusion process, we prove the quantitative homogenization in the approximation of the diffusion matrix and the conductivity by local functions. The proof relies on the renormalization approach developed by Armstrong, Kuusi, Mourrat, and Smart, while the new challenge here is the hard core constraint of particle number on every site. Therefore, a coarse-grained method is proposed to lift the configuration to a larger space without exclusion, and a gradient coupling between two systems is applied to capture the spatial cancellation. We then strengthen the convergence rate to be uniform concerning the density and integrate it into the work by Funaki, Uchiyama, and Yau [IMA Vol. Math. Appl., 77 (1996), pp. 1-40.] to yield a quantitative hydrodynamic limit. Our new approach avoids showing the characterization of closed forms and provides stronger results. The extension is discussed for the model in the presence of disorder on the bonds.


title: Beyond Average: Individualized Visual Scanpath Prediction

abstract: Understanding how attention varies across individuals has significant scientific and societal impacts. However, existing visual scanpath models treat attention uniformly, neglecting individual differences. To bridge this gap, this paper focuses on individualized scanpath prediction (ISP), a new attention modeling task that aims to accurately predict how different individuals shift their attention in diverse visual tasks. It proposes an ISP method featuring three novel technical components: (1) an observer encoder to characterize and integrate an observer's unique attention traits, (2) an observer-centric feature integration approach that holistically combines visual features, task guidance, and observer-specific characteristics, and (3) an adaptive fixation prioritization mechanism that refines scanpath predictions by dynamically prioritizing semantic feature maps based on individual observers' attention traits. These novel components allow scanpath models to effectively address the attention variations across different observers. Our method is generally applicable to different datasets, model architectures, and visual tasks, offering a comprehensive tool for transforming general scanpath models into individualized ones. Comprehensive evaluations using value-based and ranking-based metrics verify the method's effectiveness and generalizability.


title: Qubit dynamics driven by smooth pulses of finite duration

abstract: We present a study of the dynamics of a qubit driven by a pulsed field of finite duration. The pulse shape starts and ends linearly in time. The most typical example of such a shape is the sine function between two of its nodes, but several other pulse shapes are also studied. All of them present smooth alternatives to the commonly used rectangular pulse shape, resulting in much weaker power broadening, much faster vanishing wings in the excitation line profile and hence much reduced sidebands. In the same time, such shapes with a well-defined finite duration do not suffer from the spurious effects arising when truncating a pulse of infinite duration, e.g. Gaussian. We derive two approximate analytic solutions which describe the ensuing quantum dynamics. Both approximations assume that the field changes linearly at the beginning and the end of the driving pulse, and adiabatically in between. The first approximation matches the linear and adiabatic parts at an appropriate instant of time and is expressed in terms of Weber's parabolic cylinder functions. The second, much simpler, approximation uses the asymptotics of the Weber function in order to replace it by simpler functions, and some additional transformations. Both approximations prove highly accurate when compared to experimental data obtained with two of the IBM Quantum processors. Both the greatly reduced power broadening and the greatly suppressed sidebands are observed for all pulse shapes, in a nearly complete agreement between theory and experiment.


title: De-DSI: Decentralised Differentiable Search Index

abstract: This study introduces De-DSI, a novel framework that fuses large language models (LLMs) with genuine decentralization for information retrieval, particularly employing the differentiable search index (DSI) concept in a decentralized setting. Focused on efficiently connecting novel user queries with document identifiers without direct document access, De-DSI operates solely on query-docid pairs. To enhance scalability, an ensemble of DSI models is introduced, where the dataset is partitioned into smaller shards for individual model training. This approach not only maintains accuracy by reducing the number of data each model needs to handle but also facilitates scalability by aggregating outcomes from multiple models. This aggregation uses a beam search to identify top docids and applies a softmax function for score normalization, selecting documents with the highest scores for retrieval. The decentralized implementation demonstrates that retrieval success is comparable to centralized methods, with the added benefit of the possibility of distributing computational complexity across the network. This setup also allows for the retrieval of multimedia items through magnet links, eliminating the need for platforms or intermediaries.


title: Neural Networks with Causal Graph Constraints: A New Approach for Treatment Effects Estimation

abstract: In recent years, there has been a growing interest in using machine learning techniques for the estimation of treatment effects. Most of the best-performing methods rely on representation learning strategies that encourage shared behavior among potential outcomes to increase the precision of treatment effect estimates. In this paper we discuss and classify these models in terms of their algorithmic inductive biases and present a new model, NN-CGC, that considers additional information from the causal graph. NN-CGC tackles bias resulting from spurious variable interactions by implementing novel constraints on models, and it can be integrated with other representation learning methods. We test the effectiveness of our method using three different base models on common benchmarks. Our results indicate that our model constraints lead to significant improvements, achieving new state-of-the-art results in treatment effects estimation. We also show that our method is robust to imperfect causal graphs and that using partial causal information is preferable to ignoring it.


title: The formation of transiting circumplanetary debris discs from the disruption of satellite systems during planet-planet scattering

abstract: Several stars show deep transits consistent with discs of roughly 1 Solar radius seen at moderate inclinations, likely surrounding planets on eccentric orbits. We show that this configuration arises naturally as a result of planet-planet scattering when the planets possess satellite systems. Planet-planet scattering explains the orbital eccentricities of the discs' host bodies, while the close encounters during scattering lead to the exchange of satellites between planets and/or their destabilisation. This leads to collisions between satellites and their tidal disruption close to the planet. Both of these events lead to large quantities of debris being produced, which in time will settle into a disc such as those observed. The mass of debris required is comparable to a Ceres-sized satellite. Through N-body simulations of planets with clones of the Galilean satellite system undergoing scattering, we show that 90 percent of planets undergoing scattering will possess debris from satellite destruction. Extrapolating to smaller numbers of satellites suggests that tens of percent of such planets should still possess circumplanetary debris discs. The debris trails arising from these events are often tilted at tens of degrees to the planetary orbit, consistent with the inclinations of the observed discs. Disruption of satellite systems during scattering thus simultaneously explains the existence of debris, the tilt of the discs, and the eccentricity of the planets they orbit.


title: A Time-Inhomogeneous Markov Model for Resource Availability under Sparse Observations

abstract: Accurate spatio-temporal information about the current situation is crucial for smart city applications such as modern routing algorithms. Often, this information describes the state of stationary resources, e.g. the availability of parking bays, charging stations or the amount of people waiting for a vehicle to pick them up near a given location. To exploit this kind of information, predicting future states of the monitored resources is often mandatory because a resource might change its state within the time until it is needed. To train an accurate predictive model, it is often not possible to obtain a continuous time series on the state of the resource. For example, the information might be collected from traveling agents visiting the resource with an irregular frequency. Thus, it is necessary to develop methods which work on sparse observations for training and prediction. In this paper, we propose time-inhomogeneous discrete Markov models to allow accurate prediction even when the frequency of observation is very rare. Our new model is able to blend recent observations with historic data and also provide useful probabilistic estimates for future states. Since resources availability in a city is typically time-dependent, our Markov model is time-inhomogeneous and cyclic within a predefined time interval. To train our model, we propose a modified Baum-Welch algorithm. Evaluations on real-world datasets of parking bay availability show that our new method indeed yields good results compared to methods being trained on complete data and non-cyclic variants.


title: Introducing v0.5 of the AI Safety Benchmark from MLCommons

abstract: This paper introduces v0.5 of the AI Safety Benchmark, which has been created by the MLCommons AI Safety Working Group. The AI Safety Benchmark has been designed to assess the safety risks of AI systems that use chat-tuned language models. We introduce a principled approach to specifying and constructing the benchmark, which for v0.5 covers only a single use case (an adult chatting to a general-purpose assistant in English), and a limited set of personas (i.e., typical users, malicious users, and vulnerable users). We created a new taxonomy of 13 hazard categories, of which 7 have tests in the v0.5 benchmark. We plan to release version 1.0 of the AI Safety Benchmark by the end of 2024. The v1.0 benchmark will provide meaningful insights into the safety of AI systems. However, the v0.5 benchmark should not be used to assess the safety of AI systems. We have sought to fully document the limitations, flaws, and challenges of v0.5. This release of v0.5 of the AI Safety Benchmark includes (1) a principled approach to specifying and constructing the benchmark, which comprises use cases, types of systems under test (SUTs), language and context, personas, tests, and test items; (2) a taxonomy of 13 hazard categories with definitions and subcategories; (3) tests for seven of the hazard categories, each comprising a unique set of test items, i.e., prompts. There are 43,090 test items in total, which we created with templates; (4) a grading system for AI systems against the benchmark; (5) an openly available platform, and downloadable tool, called ModelBench that can be used to evaluate the safety of AI systems on the benchmark; (6) an example evaluation report which benchmarks the performance of over a dozen openly available chat-tuned language models; (7) a test specification for the benchmark.


title: CMNEE: A Large-Scale Document-Level Event Extraction Dataset based on Open-Source Chinese Military News

abstract: Extracting structured event knowledge, including event triggers and corresponding arguments, from military texts is fundamental to many applications, such as intelligence analysis and decision assistance. However, event extraction in the military field faces the data scarcity problem, which impedes the research of event extraction models in this domain. To alleviate this problem, we propose CMNEE, a large-scale, document-level open-source Chinese Military News Event Extraction dataset. It contains 17,000 documents and 29,223 events, which are all manually annotated based on a pre-defined schema for the military domain including 8 event types and 11 argument role types. We designed a two-stage, multi-turns annotation strategy to ensure the quality of CMNEE and reproduced several state-of-the-art event extraction models with a systematic evaluation. The experimental results on CMNEE fall shorter than those on other domain datasets obviously, which demonstrates that event extraction for military domain poses unique challenges and requires further research efforts. Our code and data can be obtained from https://github.com/Mzzzhu/CMNEE.


title: A non-singular universe out of Hayward black hole

abstract: We construct a (quantum mechanically) modified model for the Oppenheimer-Snyder collapse scenario where the exterior of the collapsing dust ball is a Hayward black hole spacetime and the interior is a dust Friedmann-Robertson-Walker cosmology. This interior cosmology is entirely determined by the junction conditions with the exterior black hole. It turns out to be non-singular, displaying a power-law contraction which precedes a de Sitter phase or, reversely, a power-law expansion followed by a de Sitter era. We also analyse the global causal structure and the viability of the model.


title: PyTOaCNN: Topology optimization using an adaptive convolutional neural network in Python

abstract: This paper introduces an adaptive convolutional neural network (CNN) architecture capable of automating various topology optimization (TO) problems with diverse underlying physics. The proposed architecture has an encoder-decoder-type structure with dense layers added at the bottleneck region to capture complex geometrical features. The network is trained using datasets obtained by the problem-specific open-source TO codes. Tensorflow and Keras are the main libraries employed to develop and to train the model. Effectiveness and robustness of the proposed adaptive CNN model are demonstrated through its performance in compliance minimization problems involving constant and design-dependent loads and in addressing bulk modulus optimization. Once trained, the model takes user's input of the volume fraction as an image and instantly generates an output image of optimized design. The proposed CNN produces high-quality results resembling those obtained via open-source TO codes with negligible performance and volume fraction errors. The paper includes complete associated Python code (Appendix A) for the proposed CNN architecture and explains each part of the code to facilitate reproducibility and ease of learning.


title: Binding of $TMPyP^{3+}$ porphyrin to poly(A)-poly(U) polynucleotide: a spectroscopic study

abstract: The porphyrins are macrocyclic compounds widely used as photosensitizers in anticancer photodynamic therapy. The binding of a tricationic meso-tris(N-methylpyridinium)-porphyrin, $TMPyP^{3+}$, to poly(A)-poly(U) polynucleotide has been studied in neutral buffered solution, pH6.9, of low and near-physiological ionic strength in a wide range of molar phosphate-to-dye ratios (P/D). Effective $TMPyP^{3+}$ binding to the biopolymer was established using absorption spectroscopy, polarized fluorescence, fluorimetric titration and resonance light scattering. We propose a model in which $TMPyP^{3+}$ binds to the polynucleotide in two competitive binding modes: at low P/D ratios (< 4) external binding of the porphyrin to polynucleotide backbone without self-stacking dominates, and at higher P/D (> 30) the partially stacked porphyrin J-dimers are embedded into the polymer groove. Enhancement of the porphyrin emission was observed upon binding in all P/D range, contrasting the binding of this porphyrin to poly(G)-poly(C) with significant quenching of the porphyrin fluorescence at low P/D ratios. This observation indicates that $TMPyP^{3+}$ can discriminate between poly(A)-poly(U) and poly(G)-poly(C) polynucleotides at low P/D ratios. Formation of highly scattering extended porphyrin aggregates was observed near the stoichiometric in charge binding ratio, P/D = 3. It was revealed that the efficiency of the porphyrin external binding and aggregation is reduced in the solution of near-physiological ionic strength.


title: Blind Localization and Clustering of Anomalies in Textures

abstract: Anomaly detection and localization in images is a growing field in computer vision. In this area, a seemingly understudied problem is anomaly clustering, i.e., identifying and grouping different types of anomalies in a fully unsupervised manner. In this work, we propose a novel method for clustering anomalies in largely stationary images (textures) in a blind setting. That is, the input consists of normal and anomalous images without distinction and without labels. What contributes to the difficulty of the task is that anomalous regions are often small and may present only subtle changes in appearance, which can be easily overshadowed by the genuine variance in the texture. Moreover, each anomaly type may have a complex appearance distribution. We introduce a novel scheme for solving this task using a combination of blind anomaly localization and contrastive learning. By identifying the anomalous regions with high fidelity, we can restrict our focus to those regions of interest; then, contrastive learning is employed to increase the separability of different anomaly types and reduce the intra-class variation. Our experiments show that the proposed solution yields significantly better results compared to prior work, setting a new state of the art. Project page: https://reality.tf.fau.de/pub/ardelean2024blind.html.


title: How Thick is the Air-Water Interface? -- A Direct Experimental Measurement of the Decay Length of the Interfacial Structural Anisotropy

abstract: The air-water interface is a highly prevalent phase boundary with a far-reaching impact on natural and industrial processes. Water molecules behave differently at the interface compared to the bulk, exhibiting anisotropic orientational distributions, reduced intermolecular connectivity in the hydrogen bond network, and significantly slower dynamics. Despite many decades of research, the thickness of the structural anisotropy in the interfacial layer remains controversial, with a direct experimental measurement being absent. In this study, we utilise an advancement in non-linear vibrational spectroscopy to gain access to this important parameter. Combining phase-resolved sum- and difference-frequency generation (SFG and DFG) responses, we directly measure the decay in structural anisotropy of the air-water interface. We find a decay length of ~6-8\r{A}, in excellent agreement with depth-resolved SFG spectra calculated from ab initio parameterised molecular dynamics (MD) simulations. The result reveals surprisingly short anisotropic orientational correlations from the interfacial layer that are even shorter than in the bulk. Furthermore, the recorded SFG and DFG responses are decomposed into a vibrationally resonant and non-resonant contribution through isotopic exchange measurements. Through their separate analysis, we show that the resonant response is a sensitive probe of the structural anisotropy at the interface whereas the non-resonant contribution contains a significant isotropic contribution from the bulk and therefore only partially reports on the interfacial structure. This finding places stringent restrictions on the insight available through both purely non-resonant and second-order intensity studies.


title: The quantum gravity seeds for laws of nature

abstract: We discuss the challenges that the standard (Humean and non-Humean) accounts of laws face within the framework of quantum gravity where space and time may not be fundamental. This paper identifies core (meta)physical features that cut across a number of quantum gravity approaches and formalisms and that provide seeds for articulating updated conceptions that could account for QG laws not involving any spatio-temporal notions. To this aim, we will in particular highlight the constitutive roles of quantum entanglement, quantum transition amplitudes and quantum causal histories. These features also stress the fruitful overlap between quantum gravity and quantum information theory.


title: An approach to Hamiltonian Floer theory for maps from surfaces

abstract: In $n$-dimensional classical field theory one studies maps from $n$-dimensional manifolds in such a way that classical mechanics is recovered for $n=1$. In previous papers we have shown that the standard polysymplectic framework in which field theory is described, is not suitable for variational techniques. In this paper, we introduce for $n=2$ a Lagrange-Hamilton formalism that allows us to define a generalization of Hamiltonian Floer theory. As an application, we prove a cuplength estimate for our Hamiltonian equations that yields a lower bound on the number of solutions to Laplace equations with nonlinearity. We also discuss the relation with holomorphic Floer theory.


title: Effects of Reduced Interlayer Interactions on the K-point Excitons of MoS$_2$ Nanoscrolls

abstract: Transition metal dichalcogenide (TMD) nanoscrolls (NS) exhibit significant photoluminescence (PL) signals despite their multilayer structure, which cannot be explained by the strained multilayer description of NS. Here, we investigate the interlayer interactions in NS to address this discrepancy. The reduction of interlayer interactions in NS is attributed to two factors: (1) the symmetry-broken mixed stacking order between neighbouring layers due to misalignment, and (2) the high inhomogeneity in the strain landscape resulting from the unique Archimedean spiral-like geometry with positive eccentricity. These were confirmed through transmission electron microscopy, field emission scanning electron microscopy and atomic force microscopy. To probe the effect of reduction of interlayer interactions in multilayered MoS$_2$ nanoscrolls, low-temperature PL spectroscopy was employed investigating the behaviour of K-point excitons. The effects of reduced interlayer interactions on exciton-phonon coupling (EXPC), exciton energy, and exciton oscillator strength are discussed, providing insights into the unique properties of TMD nanoscrolls.


title: Dynamic Modality and View Selection for Multimodal Emotion Recognition with Missing Modalities

abstract: The study of human emotions, traditionally a cornerstone in fields like psychology and neuroscience, has been profoundly impacted by the advent of artificial intelligence (AI). Multiple channels, such as speech (voice) and facial expressions (image), are crucial in understanding human emotions. However, AI's journey in multimodal emotion recognition (MER) is marked by substantial technical challenges. One significant hurdle is how AI models manage the absence of a particular modality - a frequent occurrence in real-world situations. This study's central focus is assessing the performance and resilience of two strategies when confronted with the lack of one modality: a novel multimodal dynamic modality and view selection and a cross-attention mechanism. Results on the RECOLA dataset show that dynamic selection-based methods are a promising approach for MER. In the missing modalities scenarios, all dynamic selection-based methods outperformed the baseline. The study concludes by emphasizing the intricate interplay between audio and video modalities in emotion prediction, showcasing the adaptability of dynamic selection methods in handling missing modalities.


title: Deep Gaussian mixture model for unsupervised image segmentation

abstract: The recent emergence of deep learning has led to a great deal of work on designing supervised deep semantic segmentation algorithms. As in many tasks sufficient pixel-level labels are very difficult to obtain, we propose a method which combines a Gaussian mixture model (GMM) with unsupervised deep learning techniques. In the standard GMM the pixel values with each sub-region are modelled by a Gaussian distribution. In order to identify the different regions, the parameter vector that minimizes the negative log-likelihood (NLL) function regarding the GMM has to be approximated. For this task, usually iterative optimization methods such as the expectation-maximization (EM) algorithm are used. In this paper, we propose to estimate these parameters directly from the image using a convolutional neural network (CNN). We thus change the iterative procedure in the EM algorithm replacing the expectation-step by a gradient-step with regard to the networks parameters. This means that the network is trained to minimize the NLL function of the GMM which comes with at least two advantages. As once trained, the network is able to predict label probabilities very quickly compared with time consuming iterative optimization methods. Secondly, due to the deep image prior our method is able to partially overcome one of the main disadvantages of GMM, which is not taking into account correlation between neighboring pixels, as it assumes independence between them. We demonstrate the advantages of our method in various experiments on the example of myocardial infarct segmentation on multi-sequence MRI images.


title: Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing

abstract: Despite the impressive capabilities of Large Language Models (LLMs) on various tasks, they still struggle with scenarios that involves complex reasoning and planning. Recent work proposed advanced prompting techniques and the necessity of fine-tuning with high-quality data to augment LLMs' reasoning abilities. However, these approaches are inherently constrained by data availability and quality. In light of this, self-correction and self-learning emerge as viable solutions, employing strategies that allow LLMs to refine their outputs and learn from self-assessed rewards. Yet, the efficacy of LLMs in self-refining its response, particularly in complex reasoning and planning task, remains dubious. In this paper, we introduce AlphaLLM for the self-improvements of LLMs, which integrates Monte Carlo Tree Search (MCTS) with LLMs to establish a self-improving loop, thereby enhancing the capabilities of LLMs without additional annotations. Drawing inspiration from the success of AlphaGo, AlphaLLM addresses the unique challenges of combining MCTS with LLM for self-improvement, including data scarcity, the vastness search spaces of language tasks, and the subjective nature of feedback in language tasks. AlphaLLM is comprised of prompt synthesis component, an efficient MCTS approach tailored for language tasks, and a trio of critic models for precise feedback. Our experimental results in mathematical reasoning tasks demonstrate that AlphaLLM significantly enhances the performance of LLMs without additional annotations, showing the potential for self-improvement in LLMs.


title: Omnidirectional 3D printing of PEDOT:PSS aerogels with tunable electromechanical performance for unconventional stretchable interconnects and thermoelectrics

abstract: The next generation of soft electronics will expand to the third dimension. This will require the integration of mechanically-compliant three-dimensional functional structures with stretchable materials. This study demonstrates omnidirectional direct ink writing (DIW) of Poly(3,4-ethylenedioxythiophene) polystyrene sulfonate (PEDOT:PSS) aerogels with tunable electrical and mechanical performance, which can be integrated with soft substrates. Several PEDOT:PSS hydrogels were formulated for DIW and freeze-dried directly on stretchable substrates to form integrated aerogels displaying high shape fidelity and minimal shrinkage. The effect of additives and processing in the PEDOT:PSS hydro and aerogels morphology, and the link with their electromechanical properties was elucidated. This technology demonstrated 3D-structured stretchable interconnects and planar thermoelectric generators (TEGs) for skin electronics, as well as vertically-printed high aspect ratio thermoelectric pillars with a high ZT value of 3.2 10^-3 and ultra-low thermal conductivity of 0.065 W/(m K). Despite their comparatively low ZT, the aerogel pillars outpowered their dense counterparts in realistic energy harvesting scenarios where contact resistances cannot be ignored, and produced up to 26 nW/cm2 (corresponding to a gravimetric power density of 0.76 mW/kg) for a difference of temperature of 15 K. This work suggests promising advancements in soft and energy-efficiency electronic systems relevant to soft robotics and wearable.


title: Star-by-star dynamical evolution of the physical pair of the Collinder 135 and UBC 7 open clusters

abstract: In a previous paper using Gaia DR2 data, we demonstrated that the two closely situated open clusters Collinder 135 and UBC 7 might have formed together about 50 Myr ago. In this work, we performed star-by-star dynamical modelling of the evolution of the open clusters Collinder 135 and UBC 7 from their supposed initial state to their present-day state, reproducing observational distributions of members. Modelling of the Collinder 135 and UBC 7 dynamical evolution was done using the high-order parallel N-body code \phi-GPU with up-to-date stellar evolution. Membership and characteristics of the clusters were acquired based on Gaia DR3 data. The comparison of the present-day radial cumulative star count obtained from the N-body simulations with the current observational data gave us full consistency of the model with observational data, especially in the central 8 pc, where 80% of the stars reside. The proper motion velocity components obtained from the N-body simulations of the stars are also quite consistent with the observed distributions and error bars. These results show that our numerical modelling is able to reproduce the open clusters' current complex 6D observed phase-space distributions with a high level of confidence. Thus, the model demonstrates that the hypothesis of a common origin of Collinder 135 and UBC 7 complies with present-day observational data.


title: An Online Spatial-Temporal Graph Trajectory Planner for Autonomous Vehicles

abstract: The autonomous driving industry is expected to grow by over 20 times in the coming decade and, thus, motivate researchers to delve into it. The primary focus of their research is to ensure safety, comfort, and efficiency. An autonomous vehicle has several modules responsible for one or more of the aforementioned items. Among these modules, the trajectory planner plays a pivotal role in the safety of the vehicle and the comfort of its passengers. The module is also responsible for respecting kinematic constraints and any applicable road constraints. In this paper, a novel online spatial-temporal graph trajectory planner is introduced to generate safe and comfortable trajectories. First, a spatial-temporal graph is constructed using the autonomous vehicle, its surrounding vehicles, and virtual nodes along the road with respect to the vehicle itself. Next, the graph is forwarded into a sequential network to obtain the desired states. To support the planner, a simple behavioral layer is also presented that determines kinematic constraints for the planner. Furthermore, a novel potential function is also proposed to train the network. Finally, the proposed planner is tested on three different complex driving tasks, and the performance is compared with two frequently used methods. The results show that the proposed planner generates safe and feasible trajectories while achieving similar or longer distances in the forward direction and comparable comfort ride.


title: Food Portion Estimation via 3D Object Scaling

abstract: Image-based methods to analyze food images have alleviated the user burden and biases associated with traditional methods. However, accurate portion estimation remains a major challenge due to the loss of 3D information in the 2D representation of foods captured by smartphone cameras or wearable devices. In this paper, we propose a new framework to estimate both food volume and energy from 2D images by leveraging the power of 3D food models and physical reference in the eating scene. Our method estimates the pose of the camera and the food object in the input image and recreates the eating occasion by rendering an image of a 3D model of the food with the estimated poses. We also introduce a new dataset, SimpleFood45, which contains 2D images of 45 food items and associated annotations including food volume, weight, and energy. Our method achieves an average error of 31.10 kCal (17.67%) on this dataset, outperforming existing portion estimation methods.


title: DeepLocalization: Using change point detection for Temporal Action Localization

abstract: In this study, we introduce DeepLocalization, an innovative framework devised for the real-time localization of actions tailored explicitly for monitoring driver behavior. Utilizing the power of advanced deep learning methodologies, our objective is to tackle the critical issue of distracted driving-a significant factor contributing to road accidents. Our strategy employs a dual approach: leveraging Graph-Based Change-Point Detection for pinpointing actions in time alongside a Video Large Language Model (Video-LLM) for precisely categorizing activities. Through careful prompt engineering, we customize the Video-LLM to adeptly handle driving activities' nuances, ensuring its classification efficacy even with sparse data. Engineered to be lightweight, our framework is optimized for consumer-grade GPUs, making it vastly applicable in practical scenarios. We subjected our method to rigorous testing on the SynDD2 dataset, a complex benchmark for distracted driving behaviors, where it demonstrated commendable performance-achieving 57.5% accuracy in event classification and 51% in event detection. These outcomes underscore the substantial promise of DeepLocalization in accurately identifying diverse driver behaviors and their temporal occurrences, all within the bounds of limited computational resources.


title: Concept Induction: Analyzing Unstructured Text with High-Level Concepts Using LLooM

abstract: Data analysts have long sought to turn unstructured text data into meaningful concepts. Though common, topic modeling and clustering focus on lower-level keywords and require significant interpretative work. We introduce concept induction, a computational process that instead produces high-level concepts, defined by explicit inclusion criteria, from unstructured text. For a dataset of toxic online comments, where a state-of-the-art BERTopic model outputs "women, power, female," concept induction produces high-level concepts such as "Criticism of traditional gender roles" and "Dismissal of women's concerns." We present LLooM, a concept induction algorithm that leverages large language models to iteratively synthesize sampled text and propose human-interpretable concepts of increasing generality. We then instantiate LLooM in a mixed-initiative text analysis tool, enabling analysts to shift their attention from interpreting topics to engaging in theory-driven analysis. Through technical evaluations and four analysis scenarios ranging from literature review to content moderation, we find that LLooM's concepts improve upon the prior art of topic models in terms of quality and data coverage. In expert case studies, LLooM helped researchers to uncover new insights even from familiar datasets, for example by suggesting a previously unnoticed concept of attacks on out-party stances in a political social media dataset.


title: Alleviating Catastrophic Forgetting in Facial Expression Recognition with Emotion-Centered Models

abstract: Facial expression recognition is a pivotal component in machine learning, facilitating various applications. However, convolutional neural networks (CNNs) are often plagued by catastrophic forgetting, impeding their adaptability. The proposed method, emotion-centered generative replay (ECgr), tackles this challenge by integrating synthetic images from generative adversarial networks. Moreover, ECgr incorporates a quality assurance algorithm to ensure the fidelity of generated images. This dual approach enables CNNs to retain past knowledge while learning new tasks, enhancing their performance in emotion recognition. The experimental results on four diverse facial expression datasets demonstrate that incorporating images generated by our pseudo-rehearsal method enhances training on the targeted dataset and the source dataset while making the CNN retain previously learned knowledge.


title: Design And Flight Testing Of LQRi Attitude Control For Quadcopter UAV

abstract: This paper presents the design, implementation, and flight test results of linear quadratic integral regulator (LQRi) based attitude control for a quadcopter UAV. We present the derivation of the mathematical model for the kinematics and dynamics of the UAV, along with the linearized state space representation of the system about hover conditions. LQR and LQRi controllers are then designed to stabilize the UAV in hover conditions and to track desired attitude commands. The controllers are then implemented onboard the Pixhawk flight controller and flight test results are discussed. Finally, the code related to this paper has been published open-source for replication and further research


title: Tree-Based Nonlinear Reduced Modeling

abstract: This paper is concerned with model order reduction of parametric Partial Differential Equations (PDEs) using tree-based library approximations. Classical approaches are formulated for PDEs on Hilbert spaces and involve one single linear space to approximate the set of PDE solutions. Here, we develop reduced models relying on a collection of linear or nonlinear approximation spaces called a library, and which can also be formulated on general metric spaces. To build the spaces of the library, we rely on greedy algorithms involving different splitting strategies which lead to a hierarchical tree-based representation. We illustrate through numerical examples that the proposed strategies have a much wider range of applicability in terms of the parametric PDEs that can successfully be addressed. While the classical approach is very efficient for elliptic problems with strong coercivity, we show that the tree-based library approaches can deal with diffusion problems with weak coercivity, convection-diffusion problems, and with transport-dominated PDEs posed on general metric spaces such as the $L^2$-Wasserstein space.


title: On the problem of optimal fluid transport in capillaries

abstract: In this note, we revisit the problem of the pressure-driven transport of a meniscus through a narrow cylindrical capillary or pore. This generic process finds many applications in science and technology. As it is known that Direct Numerical Simulations of moving contact line problems are highly demanding in terms of computational costs, simplified models in the form of ordinary differential equations offer an interesting alternative to perform a mathematical optimization of the flow. Blake and De Coninck studied the pressure-driven transport of a meniscus and identified two major competing mechanisms. While a hydrophilic surface is favorable to enhance the spontaneous imbibition into the pore, the friction is known to be significantly reduced on a hydrophobic surface. Blake and De Coninck showed that, depending on the applied pressure difference, there exists an optimal wettability that minimizes the time required to move the meniscus over a certain distance. We revisit this problem and derive analytical solutions in the limiting cases of negligible inertia and negligible contact line friction.


title: Polynomials of complete spatial graphs and Jones polynomial of related links

abstract: Let $K_n$ be a complete graph with $n$ vertices. An embedding of $K_n$ in $S^3$ is called a spatial $K_n$-graph. Knots in a spatial $K_n$-graph corresponding to simple cycles of $K_n$ are said to be constituent knots. We consider the case $n=4$. The boundary of an oriented band surface with zero Seifert form, constructed for a spatial $K_4$, is a four-component associated link. There are obtained relations between normalized Yamada and Jaeger polynomials of spatial graphs and Jones polynomials of constituent knots and the associated link.


title: A higher-dimensional version of F\'ary's theorem

abstract: We prove a generalization of Istvan F\'ary's celebrated theorem to higher dimension.


title: Ring Structure in the Complex Plane: A Fingerprint of non-Hermitian Mobility Edge

abstract: By Avila's global theory, we analytically reveal that the non-Hermitian mobility edge will take on a ring structure in the complex plane, which we name as "mobility ring". The universality of mobility ring has been checked and supported by the Hermitian limit, $PT$-symmetry protection and without $PT$-symmetry cases. Further, we study the evolution of mobility ring versus quasiperiodic strength, and find that in the non-Hermitian system, there will appear multiple mobility ring structures. With cross-reference to the multiple mobility edges in Hermitian case, we give the expression of the maximum number of mobility rings. Finally, by comparing the results of Avila's global theorem and self-duality method, we show that self-duality relation has its own limitations in calculating the critical point in non-Hermitian systems. As we know, the general non-Hermitian system has a complex spectrum, which determines that the non-Hermitian mobility edge can but exhibit a ring structure in the complex plane.


title: Physics-integrated generative modeling using attentive planar normalizing flow based variational autoencoder

abstract: Physics-integrated generative modeling is a class of hybrid or grey-box modeling in which we augment the the data-driven model with the physics knowledge governing the data distribution. The use of physics knowledge allows the generative model to produce output in a controlled way, so that the output, by construction, complies with the physical laws. It imparts improved generalization ability to extrapolate beyond the training distribution as well as improved interpretability because the model is partly grounded in firm domain knowledge. In this work, we aim to improve the fidelity of reconstruction and robustness to noise in the physics integrated generative model. To this end, we use variational-autoencoder as a generative model. To improve the reconstruction results of the decoder, we propose to learn the latent posterior distribution of both the physics as well as the trainable data-driven components using planar normalizng flow. Normalizng flow based posterior distribution harnesses the inherent dynamical structure of the data distribution, hence the learned model gets closer to the true underlying data distribution. To improve the robustness of generative model against noise injected in the model, we propose a modification in the encoder part of the normalizing flow based VAE. We designed the encoder to incorporate scaled dot product attention based contextual information in the noisy latent vector which will mitigate the adverse effect of noise in the latent vector and make the model more robust. We empirically evaluated our models on human locomotion dataset [33] and the results validate the efficacy of our proposed models in terms of improvement in reconstruction quality as well as robustness against noise injected in the model.


title: How Population Diversity Influences the Efficiency of Crossover

abstract: Our theoretical understanding of crossover is limited by our ability to analyze how population diversity evolves. In this study, we provide one of the first rigorous analyses of population diversity and optimization time in a setting where large diversity and large population sizes are required to speed up progress. We give a formal and general criterion which amount of diversity is necessary and sufficient to speed up the $(\mu+1)$ Genetic Algorithm on LeadingOnes. We show that the naturally evolving diversity falls short of giving a substantial speed-up for any $\mu=O(\sqrt{n}/\log^2 n)$. On the other hand, we show that even for $\mu=2$, if we simply break ties in favor of diversity then this increases diversity so much that optimization is accelerated by a constant factor.


title: Upward L\"owenheim-Skolem-Tarski Numbers for Abstract Logics

abstract: Galeotti, Khomskii and V\"a\"an\"aanen recently introduced the notion of the upward L\"owenheim-Skolem-Tarski number for a logic, strengthening the classical notion of a Hanf number. A cardinal $\kappa$ is the \emph{upward L\"owenheim-Skolem-Tarski number} (ULST) of a logic $\mathcal L$ if it is the least cardinal with the property that whenever $M$ is a model of size at least $\kappa$ satisfying a sentence $\varphi$ in $\mathcal L$, then there are arbitrarily large models satisfying $\varphi$ and having $M$ as a substructure. The substructure requirement is what differentiates the ULST number from the Hanf number and gives the notion large cardinal strength. While it is a theorem of ZFC that every logic has a Hanf number, Galeotti, Khomskii and V\"a\"an\"anen showed that the existence of the ULST number for second-order logic implies the existence of a partially extendible cardinal. We answer positively their conjecture that the ULST number for second-order logic is the least extendible cardinal. We define the strong ULST number by strengthening the substructure requirement to elementary substructure. We investigate the ULST and strong ULST numbers for several classical strong logics: infinitary logics, the equicardinality logic, logic with the well-foundedness quantifier, second-order logic, and sort logics. We show that the ULST and the strong ULST numbers are characterized in some cases by classical large cardinals and in some cases by natural new large cardinal notions that they give rise to. We show that for some logics the notions of the ULST number, strong ULST number and least strong compactness cardinal coincide, while for others, it is consistent that they can be separated. Finally, we introduce a natural large cardinal notion characterizing strong compactness cardinals for the equicardinality logic.


title: Efficient Identification of Broad Absorption Line Quasars using Dimensionality Reduction and Machine Learning

abstract: Broad Absorption Line Quasars (BALQSOs) displaying distinct blue-shifted broad absorption lines. These serve as invaluable probes for unraveling the intricate structure and evolution of quasars, shedding light on the profound influence exerted by supermassive black holes on galaxy formation. The proliferation of large-scale spectroscopic surveys such as LAMOST, SDSS, and DESI has exponentially expanded the repository of quasar spectra at our disposal. In this study, we present an innovative approach to streamline the identification of BALQSOs, leveraging the power of dimensionality reduction and machine learning algorithms. Our dataset is curated from the SDSS DR16, amalgamating quasar spectra with classification labels sourced from the DR16Q quasar catalog. We employ a diverse array of dimensionality reduction techniques, including Principal Component Analysis (PCA), t-Distributed Stochastic Neighbor Embedding (t-SNE), Locally Linear Embedding (LLE), and Isometric Mapping (ISOMAP), to distill the essence of the original spectral data. The resultant low-dimensional representations serve as inputs for a suite of machine learning classifiers, including XGBoost and Random Forest models. Through experimentation, we unveil PCA as the most effective dimensionality reduction methodology, adeptly navigating the intricate balance between dimensionality reduction and preservation of vital spectral information. Notably, the synergistic fusion of PCA with the XGBoost classifier emerges as the pinnacle of efficacy in the BALQSO classification endeavor, boasting impressive accuracy rates of 97.60% by 10-cross validation and 96.92% on the outer test sample. This study not only introduces a novel machine learning-based paradigm for quasar classification but also offers invaluable insights transferrable to a myriad of spectral classification challenges pervasive in the realm of astronomy.


title: Emergent Anti-Ferroelectric Ordering and the Coupling of Liquid Crystalline and Polar Order

abstract: Polar liquid crystals possess three dimensional orientational order coupled with unidirectional electric polarity, yielding fluid ferroelectrics. Such polar phases are generated by rod-like molecules with large electric dipole moments. 2,5-Disubstituted 1,3-dioxane is commonly employed as a polar motif in said systems, and here we show this to suffer from thermal instability as a consequence of equatorial-trans to axial-trans isomerism at elevated temperatures. We utilise isosteric building blocks as potential replacements for the 1,3- dioxane unit, and in doing so we obtain new examples of fluid ferroelectric systems. For binary mixtures of certain composition, we observe the emergence of a new fluid antiferroelectric phase - a finding not observed for either of the parent molecules. Our study also reveals a critical tipping point for the emergence of polar order in otherwise apolar systems. These results hint at the possibility for uncovering new highly ordered polar LC phases and delineate distinct transition mechanisms in orientational and polar ordering.


title: Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences

abstract: Due to the cumbersome nature of human evaluation and limitations of code-based evaluation, Large Language Models (LLMs) are increasingly being used to assist humans in evaluating LLM outputs. Yet LLM-generated evaluators simply inherit all the problems of the LLMs they evaluate, requiring further human validation. We present a mixed-initiative approach to ``validate the validators'' -- aligning LLM-generated evaluation functions (be it prompts or code) with human requirements. Our interface, EvalGen, provides automated assistance to users in generating evaluation criteria and implementing assertions. While generating candidate implementations (Python functions, LLM grader prompts), EvalGen asks humans to grade a subset of LLM outputs; this feedback is used to select implementations that better align with user grades. A qualitative study finds overall support for EvalGen but underscores the subjectivity and iterative process of alignment. In particular, we identify a phenomenon we dub \emph{criteria drift}: users need criteria to grade outputs, but grading outputs helps users define criteria. What is more, some criteria appears \emph{dependent} on the specific LLM outputs observed (rather than independent criteria that can be defined \emph{a priori}), raising serious questions for approaches that assume the independence of evaluation from observation of model outputs. We present our interface and implementation details, a comparison of our algorithm with a baseline approach, and implications for the design of future LLM evaluation assistants.


title: FedEval-LLM: Federated Evaluation of Large Language Models on Downstream Tasks with Collective Wisdom

abstract: Federated Learning (FL) has emerged as a promising solution for collaborative training of large language models (LLMs). However, the integration of LLMs into FL introduces new challenges, particularly concerning the evaluation of LLMs. Traditional evaluation methods that rely on labeled test sets and similarity-based metrics cover only a subset of the acceptable answers, thereby failing to accurately reflect the performance of LLMs on generative tasks. Meanwhile, although automatic evaluation methods that leverage advanced LLMs present potential, they face critical risks of data leakage due to the need to transmit data to external servers and suboptimal performance on downstream tasks due to the lack of domain knowledge. To address these issues, we propose a Federated Evaluation framework of Large Language Models, named FedEval-LLM, that provides reliable performance measurements of LLMs on downstream tasks without the reliance on labeled test sets and external tools, thus ensuring strong privacy-preserving capability. FedEval-LLM leverages a consortium of personalized LLMs from participants as referees to provide domain knowledge and collective evaluation capability, thus aligning to the respective downstream tasks and mitigating uncertainties and biases associated with a single referee. Experimental results demonstrate a significant improvement in the evaluation capability of personalized evaluation models on downstream tasks. When applied to FL, these evaluation models exhibit strong agreement with human preference and RougeL-score on meticulously curated test sets. FedEval-LLM effectively overcomes the limitations of traditional metrics and the reliance on external services, making it a promising framework for the evaluation of LLMs within collaborative training scenarios.


title: Advancing the Robustness of Large Language Models through Self-Denoised Smoothing

abstract: Although large language models (LLMs) have achieved significant success, their vulnerability to adversarial perturbations, including recent jailbreak attacks, has raised considerable concerns. However, the increasing size of these models and their limited access make improving their robustness a challenging task. Among various defense strategies, randomized smoothing has shown great potential for LLMs, as it does not require full access to the model's parameters or fine-tuning via adversarial training. However, randomized smoothing involves adding noise to the input before model prediction, and the final model's robustness largely depends on the model's performance on these noise corrupted data. Its effectiveness is often limited by the model's sub-optimal performance on noisy data. To address this issue, we propose to leverage the multitasking nature of LLMs to first denoise the noisy inputs and then to make predictions based on these denoised versions. We call this procedure self-denoised smoothing. Unlike previous denoised smoothing techniques in computer vision, which require training a separate model to enhance the robustness of LLMs, our method offers significantly better efficiency and flexibility. Our experimental results indicate that our method surpasses existing methods in both empirical and certified robustness in defending against adversarial attacks for both downstream tasks and human alignments (i.e., jailbreak attacks). Our code is publicly available at https://github.com/UCSB-NLP-Chang/SelfDenoise


title: Spin-Valve-Like Magnetoresistance and Anomalous Hall Effect in Magnetic Weyl Metal Mn$_2$PdSn

abstract: Realization of noncentrosymmetric magnetic Weyl metals is expected to exhibit anomalous transport properties stemming from the interplay of unusual bulk electronic topology and magnetism. Here, we present spin-valve-like magnetoresistance at room temperature in ferrimagneticWeyl metal Mn$_2$PdSn that crystallizes in the inverse Heusler structure. Anomalous magnetoresistance display dominant asymmetric component attributed to domain wall electron scattering, indicative of spin-valve-like behavior. Ab initio calculations confirm the topologically non-trivial nature of the band structure, with three pairs of Weyl nodes proximate to the Fermi level, providing deeper insights into the observed intrinsic Berry curvature mediated substantial anomalous Hall conductivity. Our results underscore the inverse Heusler compounds as promising platform to realize magnetic Weyl metals/semimetals and leverage emergent transport properties for electronic functionalities.


title: A New Computational Method for Energetic Particle Acceleration and Transport with its Feedback

abstract: We have developed a new computational method to explore astrophysical and heliophysical phenomena, especially those considerably influenced by non-thermal energetic particles. This novel approach considers the backreaction from these energetic particles by incorporating the non-thermal fluid pressure into Magnetohydrodynamics (MHD) equations. The pressure of the non-thermal fluid is evaluated from the energetic particle distribution evolved through Parker's transport equation, which is solved using stochastic differential equations. We implement this method in the HOW-MHD code (Seo \& Ryu 2023), which achieves 5th-order accuracy. We find that without spatial diffusion, the method accurately reproduces the Riemann solution in the hydrodynamic shock tube test when including the non-thermal pressure. Solving Parker's transport equation allows the determination of pressure terms for both relativistic and non-relativistic non-thermal fluids with adiabatic indices $\gamma_{\rm{NT}}=4/3$ and $\gamma_{\rm{NT}}=5/3$, respectively. The method also successfully replicates the Magnetohydrodynamic shock tube test with non-thermal pressure, successfully resolving the discontinuities within a few cells. Introducing spatial diffusion of non-thermal particles leads to marginal changes in the shock but smooths the contact discontinuity. Importantly, this method successfully simulates the energy spectrum of the non-thermal particles accelerated through shock, which includes feedback from the non-thermal population. These results demonstrate that this method is very powerful for studying particle acceleration when a significant portion of the plasma energy is taken by energetic particles.

categories: astro-ph.HE astro-ph.GA astro-ph.SR physics.plasm-ph


title: Stability of Klartag's improved Lichnerowicz inequality

abstract: In a recent work, Klartag gave an improved version of Lichnerowicz' spectral gap bound for uniformly log-concave measures, which improves on the classical estimate by taking into account the covariance matrix. We analyze the equality cases in Klartag's bound, showing that it can be further improved whenever the measure has no Gaussian factor. Additionally, we give a quantitative improvement for log-concave measures with finite Fisher information.