title: Weighted Fourier inequalities and application of restriction theorems on rank one Riemannian symmetric spaces of noncompact type

abstract: This article explores weighted $(L^p, L^q)$ inequalities for the Fourier transform in rank one Riemannian symmetric spaces of noncompact type. We establish both necessary and sufficient conditions for these inequalities to hold. To prove the weighted Fourier inequalities, we apply restriction theorems on symmetric spaces and utilize Calder{\'o}n's estimate for sublinear operators. While establishing the necessary conditions, we demonstrate that Harish-Chandra's elementary spherical functions play a crucial role in this setting. Furthermore, we apply our findings to derive Fourier inequalities with polynomial and exponential weights.


title: Mode-Coupling-Driven Frequency Stabilization in Semiconductor Lasers with Bragg Grating Waveguide

abstract: Precisely stabilizing laser frequency is crucial for advancing laser technology and unlocking the full potential of various quantum technologies. Here, we propose a compact device for stabilizing frequency of a semiconductor laser through mode coupling effects, which provides enhanced sensitivity. Our proposed architecture features a main ridge waveguide with a Bragg grating, flanked by two curved ridge waveguides. This configuration exhibits an optical phenomenon characterized by a transmission crossing at the wavelength of the Bragg grating. Using particle swarm optimization strategy and employing efficient figures of merit, we achieve a high transmission crossing. The observed asymmetric transmission crossing not only holds the promise for an efficient and compact on-chip laser frequency stabilizer, but also fosters the development of novel sensing platforms with heightened sensitivity.


title: Recursive algorithm for generating high-temperature expansions for spin systems and the chiral non-linear susceptibility

abstract: We show that the high-temperature expansion of the free energy and arbitrary connected correlation functions of quantum spin systems can be recursively obtained from the exact renormalization group flow equation for the generating functional of connected spin correlation functions derived by Krieg and Kopietz [Phys. Rev. B 99, 060403(R) (2019)]. Our recursive algorithm can be explicitly written down in closed form including all combinatorial factors. We use our method to estimate critical temperatures of Heisenberg magnets from low-order truncations of the inverse spin susceptibility in the static limit. We also calculate the connected correlation function involving three different spin components (chiral non-linear susceptibility) of quantum Heisenberg magnets up to second order in the exchange couplings.


title: Improving the long-term stability of new-generation perovskite-based TCO using binary and ternary oxides capping layers

abstract: We report the impact of capping layers on vanadate based transparent conductive oxides (TCOs) to prolong the thermal stability with a minimal loss of resistivity during heat treatment in ambient environment. In the present study, various protecting layers (amorphous Al2O3, LaAlO3 (LAO), TiO2 grown in base pressure and TiO2 deposited under oxygen partial pressure) are grown in-situ on polycrystalline perovskite SrVO3 (SVO) thin films using Pulsed Laser Deposition (PLD). The results show that amorphous LaAlO3 is the most promising protection layer among the oxide layers, to preserve both electrical and optical properties of perovskite SVO films from natural as well as artificial aging. Our present approach for a capping layer on SVO may address the long-term stability issues of correlated TCOs and would open an opportunity for the future oxide electronics applications.


title: Global-in-time energy stability analysis for the exponential time differencing Runge-Kutta scheme for the phase field crystal equation

abstract: The global-in-time energy estimate is derived for the second-order accurate exponential time differencing Runge-Kutta (ETDRK2) numerical scheme to the phase field crystal (PFC) equation, a sixth-order parabolic equation modeling crystal evolution. To recover the value of stabilization constant, some local-in-time convergence analysis has been reported, and the energy stability becomes available over a fixed final time. In this work, we develop a global-in-time energy estimate for the ETDRK2 numerical scheme to the PFC equation by showing the energy dissipation property for any final time. An a priori assumption at the previous time step, combined with a single-step $H^2$ estimate of the numerical solution, is the key point in the analysis. Such an $H^2$ estimate recovers the maximum norm bound of the numerical solution at the next time step, and then the value of the stabilization parameter can be theoretically justified. This justification ensures the energy dissipation at the next time step, so that the mathematical induction can be effectively applied, by then the global-in-time energy estimate is accomplished. This paper represents the first effort to theoretically establish a global-in-time energy stability analysis for a second-order stabilized numerical scheme in terms of the original free energy functional. The presented methodology is expected to be available for many other Runge-Kutta numerical schemes to the gradient flow equations.


title: Quantum enhancements and entropic constraints to Boundary Time Crystals as sensors of AC fields

abstract: We investigate the use of a boundary time crystals (BTCs) as sensors of AC fields. Boundary time crystals are non-equilibrium phases of matter in contact to an environment, for which a macroscopic fraction of the many-body system breaks the time translation symmetry. We find an enhanced sensitivity of the BTC when its spins are resonant with the applied AC field, as quantified by the quantum Fisher information (QFI). The QFI dynamics in this regime is shown to be captured by a relatively simple ansatz consisting of an initial power-law growth and late-time exponential decay. We study the scaling of the ansatz parameters with resources (encoding time and number of spins) and identify a moderate quantum enhancement in the sensor performance through comparison with classical QFI bounds. Investigating the precise source of this performance, we find that despite of its long coherence time and multipartite correlations (advantageous properties for quantum metrology), the entropic cost of the BTC (which grows indefinitely in the thermodynamic limit) hinders an optimal decoding of the AC field information. This result has implications for future candidates of quantum sensors in open system and we hope it will encourage future study into the role of entropy in quantum metrology.


title: Relativistic and wide-angle corrections to galaxy power spectra

abstract: Galaxy surveys contain information on the largest scales via wide-angle and relativistic contributions. By combining two different galaxy populations, we can suppress the strong cosmic variance on ultra-large scales and thus enhance the detectability of the signals. The relativistic Doppler and Sachs-Wolfe effects are of a similar magnitude to the leading wide-angle corrections, so that it is important to treat them together, especially since they can partially cancel. The power spectra depend on the choice of line of sight for each galaxy pair and we present results for a general line of sight. Then we estimate the detection significance of the auto- and cross-power spectra for a variety of cases. We use two futuristic galaxy samples based on a `beyond-DESI' survey and a SKA Phase 2 survey, covering 15,000\,deg$^2$ up to $z=1$. We find a detection significance for the total relativistic wide-angle effects that ranges from $\sim 5\sigma$ to $>15\sigma$, depending on the line-of-sight configuration.


title: Asymptotic limit of the compressible Navier-Stokes system on domains with rough boundaries

abstract: In this paper, we study the asymptotic behavior of solutions to the compressible Navier-Stokes system considered on a sequence of spatial domains, whose boundaries exhibit fast oscillations with amplitude and characteristic wave length proportional to a small parameter. Imposing the full-slip boundary conditions we show that in the asymptotic limit the fluid sticks completely to the boundary, provided the oscillations are non-degenerate, meaning not oriented in a single direction.


title: Structural, magnetic and x-ray absorption spectroscopy studies of new Cr-based low, medium and high-entropy spinel oxides

abstract: The emergence of high-entropy oxides has spurred significant research interest in recent times. These compounds exhibit exotic functional properties that often transcend simple linear combinations of their constituent elements. Herein, we present a new series of Cr-based low, medium, and high entropy spinel oxides with composition NiCr2O4, [Ni0.5Mn0.5]Cr2O4, [Ni0.33Mn0.33Co0.33]Cr2O4, [Ni0.25Mn0.25Co0.25Cu0.25]Cr2O4, [Ni0.2Mn0.2Co0.2Cu0.2Zn0.2]Cr2O4, and [Ni0.2Mg0.2Co0.2Cu0.2Zn0.2]Cr2O4. We conducted detailed structural (X-ray and Neutron diffraction), microstructural, Raman spectroscopy, magnetic, and X-ray absorption spectroscopy measurements on these materials. Our study reveals that the incorporation of multiple cations at the A-site of the structure (AB2O4) significantly modulates the magnetic properties. These compounds exhibit transitions from complex ferrimagnetic ([Ni0.2Mn0.2Co0.2Cu0.2Zn0.2]Cr2O4) to antiferromagnetic ([Ni0.2Mg0.2Co0.2Cu0.2Zn0.2]Cr2O4) states, with remarkable coercivity variations, demonstrating the ability to tailor magnetic responses through compositional design.


title: Measurement of the branching fractions of $\bar{B}\to D^{(*)} K^- K^{(*)0}_{(S)}$ and $\bar{B}\to D^{(*)}D_s^{-}$ decays at Belle II

abstract: We present measurements of the branching fractions of eight $\overline B{}^0\to D^{(*)+} K^- K^{(*)0}_{(S)}$, $B^{-}\to D^{(*)0} K^- K^{(*)0}_{(S)}$ decay channels. The results are based on data from SuperKEKB electron-positron collisions at the $\Upsilon(4S)$ resonance collected with the Belle II detector, corresponding to an integrated luminosity of $362~\text{fb}^{-1}$. The event yields are extracted from fits to the distributions of the difference between expected and observed $B$ meson energy, and are efficiency-corrected as a function of $m(K^-K^{(*)0}_{(S)})$ and $m(D^{(*)}K^{(*)0}_{(S)})$ in order to avoid dependence on the decay model. These results include the first observation of $\overline B{}^0\to D^+K^-K_S^0$, $B^-\to D^{*0}K^-K_S^0$, and $\overline B{}^0\to D^{*+}K^-K_S^0$ decays and a significant improvement in the precision of the other channels compared to previous measurements. The helicity-angle distributions and the invariant mass distributions of the $K^- K^{(*)0}_{(S)}$ systems are compatible with quasi-two-body decays via a resonant transition with spin-parity $J^P=1^-$ for the $K^-K_S^0$ systems and $J^P= 1^+$ for the $K^-K^{*0}$ systems. We also present measurements of the branching fractions of four $\overline B{}^0\to D^{(*)+} D_s^-$, $B^{-}\to D^{(*)0} D_s^- $ decay channels with a precision compatible to the current world averages.


title: Three super-Earths and a possible water world from TESS and ESPRESSO

abstract: Since 2018, the ESPRESSO spectrograph at the VLT has been hunting for planets in the Southern skies via the RV method. One of its goals is to follow up candidate planets from transit surveys such as the TESS mission, particularly small planets. We analyzed photometry from TESS and ground-based facilities, high-resolution imaging, and RVs from ESPRESSO, HARPS, and HIRES, to confirm and characterize three new planets: TOI-260 b, transiting a late K-dwarf, and TOI-286 b and c, orbiting an early K-dwarf. We also update parameters for the known super-Earth TOI-134 b , hosted by an M-dwarf. TOI-260 b has a $13.475853^{+0.000013}_{-0.000011}$ d period, $4.23 \pm1.60 \mathrm{M_\oplus}$ mass and $1.71\pm0.08\mathrm{R_\oplus}$ radius. For TOI-286 b we find a $4.5117244^{+0.0000031}_{-0.0000027}$ d period, $4.53\pm0.78\mathrm{M_\oplus}$ mass and $1.42\pm0.10\mathrm{R_\oplus}$ radius; for TOI-286 c, a $39.361826^{+0.000070}_{-0.000081}$ d period, $3.72\pm2.22\mathrm{M_\oplus}$ mass and $1.88\pm 0.12\mathrm{R_\oplus}$ radius. For TOI-134 b we obtain a $1.40152604^{+0.00000074}_{-0.00000082}$ d period, $4.07\pm0.45\mathrm{M_\oplus}$ mass, and $1.63\pm0.14\mathrm{R_\oplus}$ radius. Circular models are preferred for all, although for TOI-260 b the eccentricity is not well-constrained. We compute bulk densities and place the planets in the context of composition models. TOI-260 b lies within the radius valley, and is most likely a rocky planet. However, the uncertainty on the eccentricity and thus on the mass renders its composition hard to determine. TOI-286 b and c span the radius valley, with TOI-286 b lying below it and having a likely rocky composition, while TOI-286 c is within the valley, close to the upper border, and probably has a significant water fraction. With our updated parameters for TOI-134 b, we obtain a lower density than previous findings, giving a rocky or Earth-like composition.


title: Multi-Prompting Decoder Helps Better Language Understanding

abstract: Recent Pre-trained Language Models (PLMs) usually only provide users with the inference APIs, namely the emerging Model-as-a-Service (MaaS) setting. To adapt MaaS PLMs to downstream tasks without accessing their parameters and gradients, some existing methods focus on the output-side adaptation of PLMs, viewing the PLM as an encoder and then optimizing a task-specific decoder for decoding the output hidden states and class scores of the PLM. Despite the effectiveness of these methods, they only use a single prompt to query PLMs for decoding, leading to a heavy reliance on the quality of the adopted prompt. In this paper, we propose a simple yet effective Multi-Prompting Decoder (MPD) framework for MaaS adaptation. The core idea is to query PLMs with multiple different prompts for each sample, thereby obtaining multiple output hidden states and class scores for subsequent decoding. Such multi-prompting decoding paradigm can simultaneously mitigate reliance on the quality of a single prompt, alleviate the issue of data scarcity under the few-shot setting, and provide richer knowledge extracted from PLMs. Specifically, we propose two decoding strategies: multi-prompting decoding with optimal transport for hidden states and calibrated decoding for class scores. Extensive experiments demonstrate that our method achieves new state-of-the-art results on multiple natural language understanding datasets under the few-shot setting.


title: Optimal sensing policy with interference-model uncertainty

abstract: Assume that an interferer behaves according to a parametric model but one does not know the value of the model parameters. Sensing enables to improve the model knowledge and therefore perform a better link adaptation. However, we consider a half-duplex scenario where, at each time slot, the communication system should decide between sensing and communication. We thus propose to investigate the optimal policy to maximize the expected sum rate given a finite-time communication. % the following question therefore arises: At a given time slot, should one sense or communicate? We first show that this problem can be modelled in the Markov decision process (MDP) framework. We then demonstrate that the optimal open-loop and closed-loop policies can be found significantly faster than the standard backward-induction algorithm.


title: Applications and resource estimates for open system simulation on a quantum computer

abstract: We study applications of a fully controllable open system quantum simulator. A universal quantum computer can realize such a simulator, and some classical methods can also approximate it. We introduce two concrete computational problems, such that finding their solution would have direct scientific or industrial utility. The scientific utility is exemplified by a computation of nonequilibrium behavior of Ca$_3$Co$_2$O$_6$, which has been studied in the costly MagLab experiments. Specifically, an order of \$2M per material can be saved if an affordable quantum computer simulation is used to screen the materials before sending them to MagLab. For industrial utility, we develop a methodology that allows researchers of various backgrounds to estimate the economic value of an emerging technology consistently. We then apply our approach to the applications of materials with a Metal-Insulator Transition. These materials have not been used commercially yet, but many potential applications, including alternative transistors, neuromorphic computing, and smart windows, amount in total to \$20M for the entire material search performed on a quantum computer. We provide zeroth-order resource estimates for both algorithms on superconducting qubit hardware, finding that simulating long-lifetime nonequilibrium effects presents a new challenge for quantum simulators. Finally, we introduce planted solution problems and their obfuscated versions to test the capabilities of the future quantum device. The intended use of those problems is to match the size of application benchmarks so that solving one guarantees the ability to solve the other.


title: PowerInfer-2: Fast Large Language Model Inference on a Smartphone

abstract: This paper introduces PowerInfer-2, a framework designed for high-speed inference of Large Language Models (LLMs) on smartphones, particularly effective for models whose sizes exceed the device's memory capacity. The key insight of PowerInfer-2 is to utilize the heterogeneous computation, memory, and I/O resources in smartphones by decomposing traditional matrix computations into fine-grained neuron cluster computations. Specifically, PowerInfer-2 features a polymorphic neuron engine that adapts computational strategies for various stages of LLM inference. Additionally, it introduces segmented neuron caching and fine-grained neuron-cluster-level pipelining, which effectively minimize and conceal the overhead caused by I/O operations. The implementation and evaluation of PowerInfer-2 demonstrate its capability to support a wide array of LLM models on two smartphones, achieving up to a 29.2x speed increase compared with state-of-the-art frameworks. Notably, PowerInfer-2 is the first system to serve the TurboSparse-Mixtral-47B model with a generation rate of 11.68 tokens per second on a smartphone. For models that fit entirely within the memory, PowerInfer-2 can achieve approximately a 40% reduction in memory usage while maintaining inference speeds comparable to llama.cpp and MLC-LLM. For more details, including a demonstration video, please visit the project site at www.powerinfer.ai/v2.


title: Schwarz preconditioner with $H_k$-GenEO coarse space for the indefinite Helmholtz problem

abstract: GenEO (`Generalised Eigenvalue problems on the Overlap') is a method from the family of spectral coarse spaces that can efficiently rely on local eigensolves in order to build a robust parallel domain decomposition preconditioner for elliptic PDEs. When used as a preconditioner in a conjugate gradient, this method is extremely efficient in the positive-definite case, yielding an iteration count completely independent of the number of subdomains and heterogeneity. In a previous work this theory was extended to the cased of convection--diffusion--reaction problems, which may be non-self-adjoint and indefinite, and whose discretisations are solved with preconditioned GMRES. The GenEO coarse space was then defined here using a generalised eigenvalue problem based on a self-adjoint and positive definite subproblem. The resulting method, called $\Delta$-GenEO becomes robust with respect to the variation of the coefficient of the diffusion term in the operator and depends only very mildly on variations of the other coefficients. However, the iteration number estimates get worse as the non-self-adjointness and indefiniteness of the operator increases, which is often the case for the high frequency Helmholtz problems. In this work, we will improve on this aspect by introducing a new version, called $H_k$-GenEO, which uses a generalised eigenvalue problem based directly on the indefinite operator which will lead to a robust method with respect to the increase in the wave-number. We provide theoretical estimates showing the dependence of the size of the coarse space on the wave-number.


title: An ODMA-Based Unsourced Random Access Scheme with a Multiple Antenna Receiver

abstract: We investigate the unsourced random access scheme assuming that the base station is equipped with multiple antennas, and propose a high-performing solution utilizing on-off-division multiple access. We assume that each user spreads its pilot sequence and polar codeword to the pilot and data parts of the transmission frame, respectively, based on a transmission pattern. The iterative receiver operation consists of pilot and pattern detection followed by channel vector and symbol estimation, polar decoding, and successive interference cancellation. Numerical findings demonstrate that the proposed scheme has superior performance compared to the state-of-the-art in various antenna settings.


title: Holographic complex potential of a quarkonium from deep learning

abstract: Utilizing an emergent metric developed from deep learning techniques, we determine the complex potential associated with static quarkonium. This study explores the disintegration process of quarkonium by analyzing the real component of this potential, which is crucial for understanding its stability in various conditions. We show that the dissociation length, the critical distance at which a quark and antiquark pair disintegrate, decreases as the temperature increases. Furthermore, our assessment of the imaginary component of the potential indicates an increase in the magnitude of the imaginary potential for quarkonium as temperatures rise. This enhancement contributes to the quarkonium's suppression within the quark-gluon plasma, mirroring the anticipated outcomes from QCD. Our findings not only confirm the theoretical predictions but also demonstrate the efficacy of deep learning methods in advancing our understanding of high-energy particle physics.


title: A Twisted Adiabatic Limit Approach to Vanishing Theorems for Complex Line Bundles

abstract: Given an $n$-dimensional compact complex Hermitian manifold $X$, a $C^\infty$ complex line bundle $L$ equipped with a connection $D$ whose $(0,\,1)$-component $D''$ squares to zero and a real-valued function $\eta$ on $X$, we prove that the $D''$-cohomology group of $L$ of any bidegree $(p,\,q)$ such that either $(p>q \hspace{1ex}\mbox{and}\hspace{1ex} p+q\geq n+1)$ or $(p<q \hspace{1ex}\mbox{and}\hspace{1ex} p+q\leq n-1)$ vanishes when two extra hypotheses are made. The first hypothesis requires a certain real-valued, not necessarily closed, $(1,\,1)$-form depending on $p,\,q$, on the curvature of $D$ and on a $(1,\,1)$-form induced by $\eta$ to be positive definite. The second hypothesis requires the norm of $\partial\eta$ to be small relative to $|\eta|$. This theorem, for which we also give a number of variants, is proved by generalising our very recent twisted adiabatic limit construction for complex structures to connections on complex line bundles. This twisting of $D$ induces first-order differential operators acting on the $L$-valued forms, for which we obtain commutation relations involving their formal adjoints, and two twisted Laplacians for which we obtain a comparison formula reminiscent of the classical Bochner-Kodaira-Nakano identity. The main features of our results are that $X$ need not be K\"ahler, $L$ need not be holomorphic and the types of $C^\infty$ functions that $X$ supports play a key role in our hypotheses, thus capturing some of their links with the geometry of manifolds.


title: VS-PINN: A Fast and efficient training of physics-informed neural networks using variable-scaling methods for solving PDEs with stiff behavior

abstract: Physics-informed neural networks (PINNs) have recently emerged as a promising way to compute the solutions of partial differential equations (PDEs) using deep neural networks. However, despite their significant success in various fields, it remains unclear in many aspects how to effectively train PINNs if the solutions of PDEs exhibit stiff behaviors or high frequencies. In this paper, we propose a new method for training PINNs using variable-scaling techniques. This method is simple and it can be applied to a wide range of problems including PDEs with rapidly-varying solutions. Throughout various numerical experiments, we will demonstrate the effectiveness of the proposed method for these problems and confirm that it can significantly improve the training efficiency and performance of PINNs. Furthermore, based on the analysis of the neural tangent kernel (NTK), we will provide theoretical evidence for this phenomenon and show that our methods can indeed improve the performance of PINNs.


title: Identifying Bottlenecks of NISQ-friendly HHL algorithms

abstract: Quantum computing promises enabling solving large problem instances, e.g. large linear equation systems with HHL algorithm, once the hardware stack matures. For the foreseeable future quantum computing will remain in the so-called NISQ era, in which the algorithms need to account for the flaws of the hardware such as noise. In this work, we perform an empirical study to test scaling properties and directly related noise resilience of the the most resources-intense component of the HHL algorithm, namely QPE and its NISQ-adaptation Iterative QPE. We explore the effectiveness of noise mitigation techniques for these algorithms and investigate whether we can keep the gate number low by enforcing sparsity constraints on the input or using circuit optimization techniques provided by Qiskit package. Our results indicate that currently available noise mitigation techniques, such as Qiskit readout and Mthree readout packages, are insufficient for enabling results recovery even in the small instances tested here. Moreover, our results indicate that the scaling of these algorithms with increase in precision seems to be the most substantial obstacle. These insights allowed us to deduce an approximate bottleneck for algorithms that consider a similar time evolution as QPE. Such observations provide evidence of weaknesses of such algorithms on NISQ devices and help us formulate meaningful future research directions.


title: Ladder mice

abstract: Assume ZF + AD + $V=L(\mathbb{R})$. We prove some "mouse set" theorems, for definability over $J_\alpha(\mathbb{R})$ where $[\alpha,\alpha]$ is a projective-like gap (of $L(\mathbb{R})$) and $\alpha$ is either a successor ordinal or has countable cofinality, but $\alpha\neq\beta+1$ where $\beta$ ends a strong gap. For such ordinals $\alpha$ and integers $n\geq 1$, we show that there is a mouse $M$ with $\mathbb{R}\cap M=\mathrm{OD}_{\alpha n}$. The proof involves an analysis of ladder mice and their generalizations to $J_\alpha(\mathbb{R})$. This analysis is related to earlier work of Rudominer, Woodin and Steel on ladder mice. However, it also yields a new proof of the mouse set theorem even at the least point where ladder mice arise -- one which avoids the stationary tower. The analysis also yields a corresponding "anti-correctness" result on a cone, generalizing facts familiar in the projective hierarchy; for example, that $(\Pi^1_3)^V\upharpoonright M_1$ truth is $(\Sigma^1_3)^{M_1}$-definable and $(\Sigma^1_3)^{M_1}$ truth is $(\Pi^1_3)^V\upharpoonright M_1$-definable. We also define and study versions of ladder mice on a cone at the end of weak gap, and at the successor of the end of a strong gap, and an anti-correctness result on a cone there.


title: Geometric sparsification in recurrent neural networks

abstract: A common technique for ameliorating the computational costs of running large neural models is sparsification, or the removal of neural connections during training. Sparse models are capable of maintaining the high accuracy of state of the art models, while functioning at the cost of more parsimonious models. The structures which underlie sparse architectures are, however, poorly understood and not consistent between differently trained models and sparsification schemes. In this paper, we propose a new technique for sparsification of recurrent neural nets (RNNs), called moduli regularization, in combination with magnitude pruning. Moduli regularization leverages the dynamical system induced by the recurrent structure to induce a geometric relationship between neurons in the hidden state of the RNN. By making our regularizing term explicitly geometric, we provide the first, to our knowledge, a priori description of the desired sparse architecture of our neural net. We verify the effectiveness of our scheme for navigation and natural language processing RNNs. Navigation is a structurally geometric task, for which there are known moduli spaces, and we show that regularization can be used to reach 90% sparsity while maintaining model performance only when coefficients are chosen in accordance with a suitable moduli space. Natural language processing, however, has no known moduli space in which computations are performed. Nevertheless, we show that moduli regularization induces more stable recurrent neural nets with a variety of moduli regularizers, and achieves high fidelity models at 98% sparsity.


title: The first-order structural phase transition at low-temperature in GaPt$_{5}$P and its rapid enhancement with pressure

abstract: Single crystals of XPt$_{5}$P (X = Al, Ga, and In) were grown from a Pt-P solution at high temperatures, and ambient-pressure measurements of temperature-dependent magnetization, resistivity, and X-ray diffraction were made. Also, the ambient-pressure Hall resistivity and temperature-dependent resistance under pressure were measured on GaPt$_{5}$P. All three compounds have tetragonal $P4/mmm$ crystal structure at room-temperature with metallic transport and weak diamagnetism over the $2-300$~K temperature range. Surprisingly, at ambient pressure, both the transport and magnetization measurements on GaPt$_{5}$P show a step-like feature in $70-90$~K region suggesting a possible structural phase transition, and no such features were observed in (Al/In)Pt$_{5}$P. Both the hysteretic nature and sharpness of the feature suggest the first-order transition, and single-crystal X-ray diffraction measurements provided further details of the structural transition with a crystal symmetry likely different than $P4/mmm$ below transition. The transition is characterized by anisotropic changes in the lattice parameters, a volume collapse, and satellite peaks at two distinct wave-vectors. Density functional theory calculations present phonon softening as a possible driving mechanism. Additionally, the structural transition temperature increases rapidly with increasing pressure, reaching room temperature by $\sim 2.2$~GPa, highlighting the high degree of pressure sensitivity and fragile nature of GaPt$_{5}$P room-temperature structure. Although the volume collapse and extreme pressure sensitivity suggest chemical pressure should drive a similar structural change in AlPt$_{5}$P, with smaller unit cell dimensions and volume, its structure is found to be $P4/mmm$ as well. Overall, GaPt$_{5}$P stands out as a sole member of the 1-5-1 family of compounds with a temperature-driven structural change.


title: Modeling inclusive electron-nucleus scattering with Bayesian artificial neural networks

abstract: We introduce a Bayesian protocol based on artificial neural networks that is suitable for modeling inclusive electron-nucleus scattering on a variety of nuclear targets with quantified uncertainties. Unlike previous applications in the field, which directly parameterize the cross sections, our approach employs artificial neural networks to represent the longitudinal and transverse response functions. In contrast to cross sections, which depend on the incoming energy, scattering angle, and energy transfer, the response functions are determined solely by the energy and momentum transfer to the system, allowing the angular component to be treated analytically. We assess the accuracy and predictive power of our framework against the extensive data in the quasielastic inclusive electron-scattering database. Additionally, we present novel extractions of the longitudinal and transverse response functions and compare them with previous experimental analysis and nuclear ab-initio calculations.


title: Sample Rate Independent Recurrent Neural Networks for Audio Effects Processing

abstract: In recent years, machine learning approaches to modelling guitar amplifiers and effects pedals have been widely investigated and have become standard practice in some consumer products. In particular, recurrent neural networks (RNNs) are a popular choice for modelling non-linear devices such as vacuum tube amplifiers and distortion circuitry. One limitation of such models is that they are trained on audio at a specific sample rate and therefore give unreliable results when operating at another rate. Here, we investigate several methods of modifying RNN structures to make them approximately sample rate independent, with a focus on oversampling. In the case of integer oversampling, we demonstrate that a previously proposed delay-based approach provides high fidelity sample rate conversion whilst additionally reducing aliasing. For non-integer sample rate adjustment, we propose two novel methods and show that one of these, based on cubic Lagrange interpolation of a delay-line, provides a significant improvement over existing methods. To our knowledge, this work provides the first in-depth study into this problem.


title: Exact formulae for ranks of partitions

abstract: In 2009, Bringmann arXiv:0708.0691 [math.NT] used the circle method to prove an asymptotic formula for the Fourier coefficients of rank generating functions. In this paper, we prove that Bringmann's formula, when summing up to infinity and in the case of prime modulus, gives a Rademacher-type exact formula involving sums of vector-valued Kloosterman sums. As a corollary, in an upcoming paper, we will provide a new proof of Dyson's conjectures by showing that the certain Kloosterman sums vanish.


title: Zero-Shot Audio Captioning Using Soft and Hard Prompts

abstract: In traditional audio captioning methods, a model is usually trained in a fully supervised manner using a human-annotated dataset containing audio-text pairs and then evaluated on the test sets from the same dataset. Such methods have two limitations. First, these methods are often data-hungry and require time-consuming and expensive human annotations to obtain audio-text pairs. Second, these models often suffer from performance degradation in cross-domain scenarios, i.e., when the input audio comes from a different domain than the training set, which, however, has received little attention. We propose an effective audio captioning method based on the contrastive language-audio pre-training (CLAP) model to address these issues. Our proposed method requires only textual data for training, enabling the model to generate text from the textual feature in the cross-modal semantic space.In the inference stage, the model generates the descriptive text for the given audio from the audio feature by leveraging the audio-text alignment from CLAP.We devise two strategies to mitigate the discrepancy between text and audio embeddings: a mixed-augmentation-based soft prompt and a retrieval-based acoustic-aware hard prompt. These approaches are designed to enhance the generalization performance of our proposed model, facilitating the model to generate captions more robustly and accurately. Extensive experiments on AudioCaps and Clotho benchmarks show the effectiveness of our proposed method, which outperforms other zero-shot audio captioning approaches for in-domain scenarios and outperforms the compared methods for cross-domain scenarios, underscoring the generalization ability of our method.


title: Exploring the discrepancy between Planck PR3 and ACT DR4

abstract: We explore the scales and the extent of disagreement between $Planck$ PR3 and Atacama Cosmology Telescope (ACT) DR4 data. $Planck$ and ACT data have substantial overlap in the temperature anisotropy data between scales corresponding to multipoles $\ell\simeq 600-2500$ with complementing coverage of larger angular scales by $Planck$ and smaller angular scales by ACT. Since the same cosmology should govern the anisotropy spectrum at all scales, we probe this disagreement in the primordial power spectrum. We use a parametric form of power law primordial spectrum that allows changes in the spectral tilt. We also reconstruct the primordial spectrum with a non-parametric method from both $Planck$ and ACT temperature data. We find the disagreement exists within scales 0.08 - 0.16 ${\rm Mpc}^{-1}$ where ACT temperature data prefers a scale invariant/blue spectrum. At scales larger and smaller than this window, ACT data strongly prefers a red tilt, which is consistent with $Planck$. This change in the spectral tilt can be identified in the ACT data at 2$\sigma$ C.L. without using $Planck$ data, indicating that the tension is driven by different preferences for tilts within the ACT data. The addition of $Planck$ data up to intermediate scales ($\ell\le650$) increases this significance to 3$\sigma$. Given the large overlap between $Planck$ and ACT within 0.08 - 0.16 ${\rm Mpc}^{-1}$ and considering the internal consistency between different $Planck$ temperature and polarization spectra, the scope of new physics as a solution to the tension remains limited. Our results -- a strong preference for an intermediate transition in spectral tilt and the variation of this preference in different data combinations -- indicate that systematic effects can be misperceived as new physics emerging from different non-standard cosmological processes.


title: Learning-based cognitive architecture for enhancing coordination in human groups

abstract: As interactions with autonomous agents-ranging from robots in physical settings to avatars in virtual and augmented realities-become more prevalent, developing advanced cognitive architectures is critical for enhancing the dynamics of human-avatar groups. This paper presents a reinforcement-learning-based cognitive architecture, trained via a sim-to-real approach, designed to improve synchronization in periodic motor tasks, crucial for applications in group rehabilitation and sports training. Extensive numerical validation consistently demonstrates improvements in synchronization. Theoretical derivations and numerical investigations are complemented by preliminary experiments with real participants, showing that our avatars can integrate seamlessly into human groups, often being indistinguishable from humans.


title: Large dynamical magnetic effective charges and anti-magnetoelectricity from spin and orbital origin in multiferroic BiCoO$_3$

abstract: Using first-principles calculations, we explore the magnetoelectric properties of the room-temperature multiferroic crystal BiCoO$_3$. We use both applied magnetic field and finite-difference techniques to show that BiCoO$_3$ is anti-magnetoelectric at the linear level. The calculation of the dynamical effective charges reveals that the total magnetoelectric response is zero due to the compensating non-zero magnetoelectric response of each magnetic sublattice. This calculation also highlights that the the orbital contribution to the response is remarkably larger than the spin one and that each sublattice has a rather large total magnetoelectric response of 85 ps/m. Furthermore, we provide an intuitive recipe to visualize the dynamical magnetic effective charge, allowing to examine its multipolar nature which we confirm by means of ab initio calculations. Given the large value of the local response, we investigate the ferromagnetic phase as well, which gives a giant magnetoelectric response of about 1000 ps/m and coming mainly from the spin contribution this time. Finally, we discuss the possible reasons for such a large magnetoelectric response in BiCoO3 and propose possible strategies to unveil this potentially large response.


title: Performance Test Methodology for Atmosphere-Breathing Electric Propulsion Intakes in an Atomic Oxygen Facility

abstract: The testing of atmosphere-breathing electric propulsion intakes is an important step in the development of functional propulsion systems which provide sustained drag compensation in very low Earth orbits. To make satellite operations more sustainable, it is necessary to develop new materials which withstand erosion, long-lasting propulsion systems to overcome drag, and tools that allow for ground-based testing. Among the tools to enable these innovations is the Rarefied Orbital Aerodynamics Research facility at the University of Manchester. Here, a description of the facility is provided together with two different methodologies for testing sub-scaled intake designs for atmosphere-breathing electric propulsion systems. The first methodology is based on measurements of the pressure difference between the two extremities of the intake, while the second uses a gas sensor to measure the collection efficiency of the intake. Direct Simulation Monte Carlo models have been used to assess the viability of the proposed testing methodologies. The results of this analysis indicate that either methodology or a combination of both can provide suitable measurements to assess the performance of future intake designs.


title: Human Gaze and Head Rotation during Navigation, Exploration and Object Manipulation in Shared Environments with Robots

abstract: The human gaze is an important cue to signal intention, attention, distraction, and the regions of interest in the immediate surroundings. Gaze tracking can transform how robots perceive, understand, and react to people, enabling new modes of robot control, interaction, and collaboration. In this paper, we use gaze tracking data from a rich dataset of human motion (TH\"OR-MAGNI) to investigate the coordination between gaze direction and head rotation of humans engaged in various indoor activities involving navigation, interaction with objects, and collaboration with a mobile robot. In particular, we study the spread and central bias of fixations in diverse activities and examine the correlation between gaze direction and head rotation. We introduce various human motion metrics to enhance the understanding of gaze behavior in dynamic interactions. Finally, we apply semantic object labeling to decompose the gaze distribution into activity-relevant regions.


title: Quantum Geometric Tensor and Critical Metrology in the Anisotropic Dicke Model

abstract: We investigate the quantum phase transition in the anisotropic Dicke model through an examination of the quantum geometric tensor of the ground state. In this analysis, two distinct classical limits exhibit their unique anisotropic characteristics. The classical spin limit demonstrates a preference for the rotating-wave coupling, whereas the classical oscillator limit exhibits symmetry in the coupling strength of the bias. The anisotropic features of the classical spin limit persist at finite scales. Furthermore, we observe that the interplay among the anisotropic ratio, spin length, and frequency ratio can collectively enhance the critical behaviors. This critical enhancement without trade-off between these factors provides a flexible method for quantum precision measurement.


title: Unveiling the Safety of GPT-4o: An Empirical Study using Jailbreak Attacks

abstract: The recent release of GPT-4o has garnered widespread attention due to its powerful general capabilities. While its impressive performance is widely acknowledged, its safety aspects have not been sufficiently explored. Given the potential societal impact of risky content generated by advanced generative AI such as GPT-4o, it is crucial to rigorously evaluate its safety. In response to this question, this paper for the first time conducts a rigorous evaluation of GPT-4o against jailbreak attacks. Specifically, this paper adopts a series of multi-modal and uni-modal jailbreak attacks on 4 commonly used benchmarks encompassing three modalities (\ie, text, speech, and image), which involves the optimization of over 4,000 initial text queries and the analysis and statistical evaluation of nearly 8,000+ response on GPT-4o. Our extensive experiments reveal several novel observations: (1) In contrast to the previous version (such as GPT-4V), GPT-4o has enhanced safety in the context of text modality jailbreak; (2) The newly introduced audio modality opens up new attack vectors for jailbreak attacks on GPT-4o; (3) Existing black-box multimodal jailbreak attack methods are largely ineffective against GPT-4o and GPT-4V. These findings provide critical insights into the safety implications of GPT-4o and underscore the need for robust alignment guardrails in large models. Our code is available at \url{https://github.com/NY1024/Jailbreak_GPT4o}.


title: Evolution of the autoresonant plasma wave excitation in two-dimensional particle-in-cell simulations

abstract: The generation of an autoresonantly phase-locked high amplitude plasma waves to the chirped beat frequency of two driving lasers is studied in two dimensions using particle-in-cell simulations. The two-dimensional plasma and laser parameters correspond to those that optimized the plasma wave amplitude in one-dimensional simulations. Near the start of autoresonant locking, the two-dimensional simulations appear similar to one-dimensional particle-in-cell results [Luo et al., Phys. Rev. Res. 6, 013338 (2024)] with plasma wave amplitudes above the Rosenbluth-Liu limit. Later, just below wave-breaking, the two-dimensional simulation exhibits a Weibel-like instability and eventually laser beam filamentation. These limit the coherence of the plasma oscillation after the peak plasma wave field is obtained. In spite of the reduction of spatial coherence of the accelerating density structure, the acceleration of self-injected electrons in the case studied remains at $70\%$ to $80\%$ of that observed in one dimension. Other effects such as plasma wave bowing are discussed.


title: Symmetries of F-cohomological field theories and F-topological recursion

abstract: We define F-topological recursion (F-TR) as a non-symmetric version of topological recursion, which associates a vector potential to some initial data. We describe the symmetries of the initial data for F-TR and show that, at the level of the vector potential, they include the F-Givental (non-linear) symmetries studied by Arsie, Buryak, Lorenzoni, and Rossi within the framework of F-manifolds. Additionally, we propose a spectral curve formulation of F-topological recursion. This allows us to extend the correspondence between semisimple cohomological field theories (CohFTs) and topological recursion, as established by Dunin-Barkowski, Orantin, Shadrin, and Spitz, to the F-world. In the absence of a full reconstruction theorem \`a la Teleman for F-CohFTs, this demonstrates that F-TR holds for the ancestor vector potential of a given F-CohFT if and only if it holds for some F-CohFT in its F-Givental orbit. We turn this into a useful statement by showing that the correlation functions of F-topological field theories (F-CohFTs of cohomological degree 0) are governed by F-TR. We apply these results to the extended 2-spin F-CohFT. Furthermore, we exhibit a large set of linear symmetries of F-CohFTs, which do not commute with the F-Givental action.


title: NeuroMoCo: A Neuromorphic Momentum Contrast Learning Method for Spiking Neural Networks

abstract: Recently, brain-inspired spiking neural networks (SNNs) have attracted great research attention owing to their inherent bio-interpretability, event-triggered properties and powerful perception of spatiotemporal information, which is beneficial to handling event-based neuromorphic datasets. In contrast to conventional static image datasets, event-based neuromorphic datasets present heightened complexity in feature extraction due to their distinctive time series and sparsity characteristics, which influences their classification accuracy. To overcome this challenge, a novel approach termed Neuromorphic Momentum Contrast Learning (NeuroMoCo) for SNNs is introduced in this paper by extending the benefits of self-supervised pre-training to SNNs to effectively stimulate their potential. This is the first time that self-supervised learning (SSL) based on momentum contrastive learning is realized in SNNs. In addition, we devise a novel loss function named MixInfoNCE tailored to their temporal characteristics to further increase the classification accuracy of neuromorphic datasets, which is verified through rigorous ablation experiments. Finally, experiments on DVS-CIFAR10, DVS128Gesture and N-Caltech101 have shown that NeuroMoCo of this paper establishes new state-of-the-art (SOTA) benchmarks: 83.6% (Spikformer-2-256), 98.62% (Spikformer-2-256), and 84.4% (SEW-ResNet-18), respectively.


title: Unified Fourier bases for GSP on stochastic block model graphs

abstract: We consider a recently proposed approach to graph signal processing based on graphons. We show how the graphon-based approach to GSP applies to graphs sampled from a stochastic block model. We obtain a basis for the graphon Fourier transform on such samples directly from the link probability matrix and the block sizes of the model. This formulation allows us to bound the sensitivity of the Fourier transform to small changes in block sizes. We then focus on the case where the probability matrix corresponds to a (weighted) Cayley graph. If block sizes are equal, a nice Fourier basis can be derived from the underlying group. We explore how, in the case where block sizes are not equal, some or all nice properties of the group basis can be maintained. We complement the theoretical results with simulations.


title: Building Continuous Quantum-Classical Bayesian Neural Networks for a Classical Clinical Dataset

abstract: In this work, we are introducing a Quantum-Classical Bayesian Neural Network (QCBNN) that is capable to perform uncertainty-aware classification of classical medical dataset. This model is a symbiosis of a classical Convolutional NN that performs ultra-sound image processing and a quantum circuit that generates its stochastic weights, within a Bayesian learning framework. To test the utility of this idea for the possible future deployment in the medical sector we track multiple behavioral metrics that capture both predictive performance as well as model's uncertainty. It is our ambition to create a hybrid model that is capable to classify samples in a more uncertainty aware fashion, which will advance the trustworthiness of these models and thus bring us step closer to utilizing them in the industry. We test multiple setups for quantum circuit for this task, and our best architectures display bigger uncertainty gap between correctly and incorrectly identified samples than its classical benchmark at an expense of a slight drop in predictive performance. The innovation of this paper is two-fold: (1) combining of different approaches that allow the stochastic weights from the quantum circuit to be continues thus allowing the model to classify application-driven dataset; (2) studying architectural features of quantum circuit that make-or-break these models, which pave the way into further investigation of more informed architectural designs.


title: Topological structures, dark matter and gravitational waves in $E_6$

abstract: We discuss the appearance of topological structures from the spontaneous breaking of $E_6$ to the Standard Model via its maximal subgroup $SO(10) \times U(1)_\psi$. They include dumbbells, metastable strings, as well as domain walls bounded by necklaces. We provide a novel scenario for producing metastable strings based on the symmetry breaking $U(1)_\psi \longrightarrow Z_8 \longrightarrow Z_4$. The metastable string arises from the merger of $Z_8$ strings that bound a domain wall. An unbroken gauge $Z_2$ symmetry from $SO(10)$ breaking yields viable stable dark matter candidates as well as topologically stable strings. We discuss the gravitational wave emission from two varieties of cosmic strings, namely the superheavy metastable ones and the intermediate scale topologically stable cosmic strings.


title: Is Value Functions Estimation with Classification Plug-and-play for Offline Reinforcement Learning?

abstract: In deep Reinforcement Learning (RL), value functions are typically approximated using deep neural networks and trained via mean squared error regression objectives to fit the true value functions. Recent research has proposed an alternative approach, utilizing the cross-entropy classification objective, which has demonstrated improved performance and scalability of RL algorithms. However, existing study have not extensively benchmarked the effects of this replacement across various domains, as the primary objective was to demonstrate the efficacy of the concept across a broad spectrum of tasks, without delving into in-depth analysis. Our work seeks to empirically investigate the impact of such a replacement in an offline RL setup and analyze the effects of different aspects on performance. Through large-scale experiments conducted across a diverse range of tasks using different algorithms, we aim to gain deeper insights into the implications of this approach. Our results reveal that incorporating this change can lead to superior performance over state-of-the-art solutions for some algorithms in certain tasks, while maintaining comparable performance levels in other tasks, however for other algorithms this modification might lead to the dramatic performance drop. This findings are crucial for further application of classification approach in research and practical tasks.


title: Unsupervised Improved MVDR Beamforming for Sound Enhancement

abstract: Neural networks have recently become the dominant approach to sound separation. Their good performance relies on large datasets of isolated recordings. For speech and music, isolated single channel data are readily available; however the same does not hold in the multi-channel case, and with most other sound classes. Multi-channel methods have the potential to outperform single channel approaches as they can exploit both spatial and spectral features, but the lack of training data remains a challenge. We propose unsupervised improved minimum variation distortionless response (UIMVDR), which enables multi-channel separation to leverage in-the-wild single-channel data through unsupervised training and beamforming. Results show that UIMVDR generalizes well and improves separation performance compared to supervised models, particularly in cases with limited supervised data. By using data available online, it also reduces the effort required to gather data for multi-channel approaches.


title: Universality in the mechanics of soft Kirigami

abstract: Recently, simple scaling laws concerning the mechanical response and mechanical transition of Kirigami have been revealed through agreement between theory and experiment for kirigami made of paper [M. Isobe and K. Okumura, Sci. Rep. 2016]. Here, we provide experimental data obtained from kirigami made of soft elastic sheets to demonstrate good agreement with previous theories, although a number of assumptions in the theory are violated and the elastic modulus is three orders of magnitude smaller in the present case. This remarkable universality in the mechanics of Kirigami, which could be useful for applications, is reported with physical insights based on previous theories.


title: Memory Complexity of Entropy Estimation

abstract: We observe an infinite sequence of independent identically distributed random variables $X_1,X_2,\ldots$ drawn from an unknown distribution $p$ over $[n]$, and our goal is to estimate the entropy $H(p)=-\mathbb{E}[\log p(X)]$ within an $\varepsilon$-additive error. To that end, at each time point we are allowed to update a finite-state machine with $S$ states, using a possibly randomized but time-invariant rule, where each state of the machine is assigned an entropy estimate. Our goal is to characterize the minimax memory complexity $S^*$ of this problem, which is the minimal number of states for which the estimation task is feasible with probability at least $1-\delta$ asymptotically, uniformly in $p$. Specifically, we show that there exist universal constants $C_1$ and $C_2$ such that $ S^* \leq C_1\cdot\frac{n (\log n)^4}{\varepsilon^2\delta}$ for $\varepsilon$ not too small, and $S^* \geq C_2 \cdot \max \{n, \frac{\log n}{\varepsilon}\}$ for $\varepsilon$ not too large. The upper bound is proved using approximate counting to estimate the logarithm of $p$, and a finite memory bias estimation machine to estimate the expectation operation. The lower bound is proved via a reduction of entropy estimation to uniformity testing. We also apply these results to derive bounds on the memory complexity of mutual information estimation.


title: ProAct: Progressive Training for Hybrid Clipped Activation Function to Enhance Resilience of DNNs

abstract: Deep Neural Networks (DNNs) are extensively employed in safety-critical applications where ensuring hardware reliability is a primary concern. To enhance the reliability of DNNs against hardware faults, activation restriction techniques significantly mitigate the fault effects at the DNN structure level, irrespective of accelerator architectures. State-of-the-art methods offer either neuron-wise or layer-wise clipping activation functions. They attempt to determine optimal clipping thresholds using heuristic and learning-based approaches. Layer-wise clipped activation functions cannot preserve DNNs resilience at high bit error rates. On the other hand, neuron-wise clipping activation functions introduce considerable memory overhead due to the addition of parameters, which increases their vulnerability to faults. Moreover, the heuristic-based optimization approach demands numerous fault injections during the search process, resulting in time-consuming threshold identification. On the other hand, learning-based techniques that train thresholds for entire layers concurrently often yield sub-optimal results. In this work, first, we demonstrate that it is not essential to incorporate neuron-wise activation functions throughout all layers in DNNs. Then, we propose a hybrid clipped activation function that integrates neuron-wise and layer-wise methods that apply neuron-wise clipping only in the last layer of DNNs. Additionally, to attain optimal thresholds in the clipping activation function, we introduce ProAct, a progressive training methodology. This approach iteratively trains the thresholds on a layer-by-layer basis, aiming to obtain optimal threshold values in each layer separately.


title: Topological transition in cyanobacteria: from motion to structure

abstract: Many active systems are capable of forming intriguing patterns at scales significantly larger than the size of their individual constituents. We recently introduced a model for gliding filamentous cyanobacteria, which form a reticulate pattern as an early-stage biofilm. Our observations reveal that the filaments' bodies follow the track of the head, and are subject to curvature fluctuations, defining a new class of active matter: active spaghetti. By identifying the dominant aspects of the filament's dynamics, our model achieves great computational efficiency, without coarse-graining past the scale of an individual filament. Here, we explore large-scale collective effects and rich dynamics of cyanobacteria colonies, while still retaining information about the individual constituents' dynamics and their interactions. We characterize the system's topological transition from an isotropic distribution to a state of large-scale reticulate patterns by quantifying both dynamical and structural observables. Although it is not a periodic structure, in the steady state the reticulate pattern possesses a well-defined length scale determined by the filaments' Peclet number, which controls the relative importance of activity and curvature fluctuations.


title: Inference of the Mass Composition of Cosmic Rays with energies from $\mathbf{10^{18.5}}$ to $\mathbf{10^{20}}$ eV using the Pierre Auger Observatory and Deep Learning

abstract: We present measurements of the atmospheric depth of the shower maximum $X_\mathrm{max}$, inferred for the first time on an event-by-event level using the Surface Detector of the Pierre Auger Observatory. Using deep learning, we were able to extend measurements of the $X_\mathrm{max}$ distributions up to energies of 100 EeV ($10^{20}$ eV), not yet revealed by current measurements, providing new insights into the mass composition of cosmic rays at extreme energies. Gaining a 10-fold increase in statistics compared to the Fluorescence Detector data, we find evidence that the rate of change of the average $X_\mathrm{max}$ with the logarithm of energy features three breaks at $6.5\pm0.6~(\mathrm{stat})\pm1~(\mathrm{sys})$ EeV, $11\pm 2~(\mathrm{stat})\pm1~(\mathrm{sys})$ EeV, and $31\pm5~(\mathrm{stat})\pm3~(\mathrm{sys})$ EeV, in the vicinity to the three prominent features (ankle, instep, suppression) of the cosmic-ray flux. The energy evolution of the mean and standard deviation of the measured $X_\mathrm{max}$ distributions indicates that the mass composition becomes increasingly heavier and purer, thus being incompatible with a large fraction of light nuclei between 50 EeV and 100 EeV.


title: Tx-LLM: A Large Language Model for Therapeutics

abstract: Developing therapeutics is a lengthy and expensive process that requires the satisfaction of many different criteria, and AI models capable of expediting the process would be invaluable. However, the majority of current AI approaches address only a narrowly defined set of tasks, often circumscribed within a particular domain. To bridge this gap, we introduce Tx-LLM, a generalist large language model (LLM) fine-tuned from PaLM-2 which encodes knowledge about diverse therapeutic modalities. Tx-LLM is trained using a collection of 709 datasets that target 66 tasks spanning various stages of the drug discovery pipeline. Using a single set of weights, Tx-LLM simultaneously processes a wide variety of chemical or biological entities(small molecules, proteins, nucleic acids, cell lines, diseases) interleaved with free-text, allowing it to predict a broad range of associated properties, achieving competitive with state-of-the-art (SOTA) performance on 43 out of 66 tasks and exceeding SOTA on 22. Among these, Tx-LLM is particularly powerful and exceeds best-in-class performance on average for tasks combining molecular SMILES representations with text such as cell line names or disease names, likely due to context learned during pretraining. We observe evidence of positive transfer between tasks with diverse drug types (e.g.,tasks involving small molecules and tasks involving proteins), and we study the impact of model size, domain finetuning, and prompting strategies on performance. We believe Tx-LLM represents an important step towards LLMs encoding biochemical knowledge and could have a future role as an end-to-end tool across the drug discovery development pipeline.


title: On the structure and diameter of graph associahedra of graphs with a set of true twins

abstract: Given a graph $G$, the graph associahedron $\mathcal{A}(G)$ is a polytope whose 1-skeleton is the rotation graph of $G$, that is, the 1-skeleton of $\mathcal{A}(G)$ is the graph $\mathcal{R}(G)$ whose vertices are the search trees on $G$ and whose edges correspond to an application of a local operation on the search trees, called rotation. The rotation distance between two search trees on $G$ is the minimum number of rotations needed to transform one of the trees into the other. A challenging question is what is the maximum rotation distance between search trees on a graph, i.e. what is the combinatorial diameter of the corresponding graph associahedron. In this paper we study the relation between the structure of $\mathcal{R}(G)$ and $\mathcal{R}(G-S)$ for a particular choice of $S\subseteq E(G)$. More specifically, we show that if $W$ is a set of true twins in $G$ and $S$ is the set of edges in $G$ with both endpoints in $W$, then $\mathcal{R}(G-S)$ is a quotient graph of $\mathcal{R}(G)$. We also give a lower bound for $\text{diam} (\mathcal{R}(G-S))$ in terms of $\text{diam}(\mathcal{R}(G))$. As a consequence, we obtain a new lower bound for the diameter of the graph associahedra of balanced complete bipartite graphs that allow us to compute the exact value of $\text{diam}(\mathcal{R}(K_{2,q}))$ for $q\in\{3,4,5,6,7,8\}$.


title: Should my Blockchain Learn to Drive? A Study of Hyperledger Fabric

abstract: Similar to other transaction processing frameworks, blockchain systems need to be dynamically reconfigured to adapt to varying workloads and changes in network conditions. However, achieving optimal reconfiguration is particularly challenging due to the complexity of the blockchain stack, which has diverse configurable parameters. This paper explores the concept of self-driving blockchains, which have the potential to predict workload changes and reconfigure themselves for optimal performance without human intervention. We compare and contrast our discussions with existing research on databases and highlight aspects unique to blockchains. We identify specific parameters and components in Hyperledger Fabric, a popular permissioned blockchain system, that are suitable for autonomous adaptation and offer potential solutions for the challenges involved. Further, we implement three demonstrative locally autonomous systems, each targeting a different layer of the blockchain stack, and conduct experiments to understand the feasibility of our findings. Our experiments indicate up to 11% improvement in success throughput and a 30% decrease in latency, making this a significant step towards implementing a fully autonomous blockchain system in the future.


title: Measurement of the Depth of Maximum of Air-Shower Profiles with energies between $\mathbf{10^{18.5}}$ and $\mathbf{10^{20}}$ eV using the Surface Detector of the Pierre Auger Observatory and Deep Learning

abstract: We report an investigation of the mass composition of cosmic rays with energies from 3 to 100 EeV (1 EeV=$10^{18}$ eV) using the distributions of the depth of shower maximum $X_\mathrm{max}$. The analysis relies on ${\sim}50,000$ events recorded by the Surface Detector of the Pierre Auger Observatory and a deep-learning-based reconstruction algorithm. Above energies of 5 EeV, the data set offers a 10-fold increase in statistics with respect to fluorescence measurements at the Observatory. After cross-calibration using the Fluorescence Detector, this enables the first measurement of the evolution of the mean and the standard deviation of the $X_\mathrm{max}$ distributions up to 100 EeV. Our findings are threefold: (1.) The evolution of the mean logarithmic mass towards a heavier composition with increasing energy can be confirmed and is extended to 100 EeV. (2.) The evolution of the fluctuations of $X_\mathrm{max}$ towards a heavier and purer composition with increasing energy can be confirmed with high statistics. We report a rather heavy composition and small fluctuations in $X_\mathrm{max}$ at the highest energies. (3.) We find indications for a characteristic structure beyond a constant change in the mean logarithmic mass, featuring three breaks that are observed in proximity to the ankle, instep, and suppression features in the energy spectrum.


title: Vehicle Vectors and Traffic Patterns from Planet Imagery

abstract: We explore methods to detect automobiles in Planet imagery and build a large scale vector field for moving objects. Planet operates two distinct constellations: high-resolution SkySat satellites as well as medium-resolution SuperDove satellites. We show that both static and moving cars can be identified reliably in high-resolution SkySat imagery. We are able to estimate the speed and heading of moving vehicles by leveraging the inter-band displacement (or "rainbow" effect) of moving objects. Identifying cars and trucks in medium-resolution SuperDove imagery is far more difficult, though a similar rainbow effect is observed in these satellites and enables moving vehicles to be detected and vectorized. The frequent revisit of Planet satellites enables the categorization of automobile and truck activity patterns over broad areas of interest and lengthy timeframes.


title: Optimal Preprocessing for Answering On-Line Product Queries

abstract: We examine the amount of preprocessing needed for answering certain on-line queries as fast as possible. We start with the following basic problem. Suppose we are given a semigroup $(S,\circ )$. Let $s_1 ,\ldots, s_n$ be elements of $S$. We want to answer on-line queries of the form, ``What is the product $s_i \circ s_{i+1} \circ \cdots \circ s_{j-1} \circ s_j$?'' for any given $1\le i\le j\le n$. We show that a preprocessing of $\Theta(n \lambda (k,n))$ time and space is both necessary and sufficient to answer each such query in at most $k$ steps, for any fixed $k$. The function $\lambda (k,\cdot)$ is the inverse of a certain function at the $\lfloor {k/2}\rfloor$-th level of the primitive recursive hierarchy. In case linear preprocessing is desired, we show that one can answer each such query in $O( \alpha (n))$ steps and that this is best possible. The function $\alpha (n)$ is the inverse Ackermann function. We also consider the following extended problem. Let $T$ be a tree with an element of $S$ associated with each of its vertices. We want to answer on-line queries of the form, ``What is the product of the elements associated with the vertices along the path from $u$ to $v$?'' for any pair of vertices $u$ and $v$ in $T$. We derive results that are similar to the above, for the preprocessing needed for answering such queries. All our sequential preprocessing algorithms can be parallelized efficiently to give optimal parallel algorithms which run in $O(\log n)$ time on a CREW PRAM. These parallel algorithms are optimal in both running time and total number of operations. Our algorithms, especially for the semigroup of the real numbers with the minimum or maximum operations, have various applications in certain graph algorithms, in the utilization of communication networks and in Database retrieval.


title: Jordan degree type for codimension three Gorenstein algebras of small Sperner number

abstract: The Jordan type $P_{A,\ell}$ of a linear form $\ell$ acting on a graded Artinian algebra $A$ over a field $\sf k$ is the partition describing the Jordan block decomposition of the multiplication map $m_\ell$, which is nilpotent. The Jordan degree type $\mathcal S_{A,\ell}$ is a finer invariant, describing also the initial degrees of the simple submodules of $A$ in a decomposition of $A$ as ${\sf k}[\ell]$-modules. The set of Jordan types of $A$ or Jordan degree types (JDT) of $A$ as $\ell$ varies, is an invariant of the algebra. This invariant has been studied for codimension two graded algebras. We here extend the previous results to certain codimension three graded Artinian Gorenstein (AG) algebras - those of small Sperner number. Given a Gorenstein sequence $T$ - one possible for the Hilbert function of a codimension three AG algebra - the irreducible variety $\mathrm{Gor}(T)$ parametrizes all Gorenstein algebras of Hilbert function $T$. We here completely determine the JDT possible for all pairs $(A,\ell), A\in \mathrm{Gor}(T)$, for Gorenstein sequences $T$ of the form $T=(1,3,s^k,3,1)$ for Sperner number $s=3,4,5$ and arbitrary multiplicity $k$. For $s=6$ we delimit the prospective JDT, without verifying that each occurs.


title: Feasibility of accelerating incompressible computational fluid dynamics simulations with fault-tolerant quantum computers

abstract: Across industries, traditional design and engineering workflows are being upgraded to simulation-driven processes. Many workflows include computational fluid dynamics (CFD). Simulations of turbulent flow are notorious for high compute costs and reliance on approximate methods that compromise accuracy. Improvements in the speed and accuracy of CFD calculations would potentially reduce design workflow costs by reducing computational costs and eliminating the need for experimental testing. This study explores the feasibility of using fault-tolerant quantum computers to improve the speed and accuracy of CFD simulations in the incompressible or weakly compressible regime. For the example of simulation-driven ship design, we consider simulations for calculating the drag force in steady-state flows, and provide analysis on economic utility and classical hardness. As a waypoint toward assessing the feasibility of our chosen quantum approach, we estimate the quantum resources required for the simpler case of drag force on a sphere. We estimate the product of logical qubits $\times$ $T$ gates to range from $10^{22}$ to $10^{28}$. These high initial estimates suggest that future quantum computers are unlikely to provide utility for incompressible CFD applications unless significant algorithmic advancements or alternative quantum approaches are developed. Encouraged by applications in quantum chemistry that have realized orders-of-magnitude improvements as they matured, we identify the most promising next steps for quantum resource reduction as we work to scale up our estimates from spheres to utility-scale problems with more complex geometry.


title: Navigating Unknowns: Deep Learning Robustness for Gravitational Wave Signal Reconstruction

abstract: We present a rapid and reliable deep learning-based method for gravitational wave signal reconstruction from elusive, generic binary black hole mergers in LIGO data. We demonstrate that our model, \texttt{AWaRe}, effectively recovers gravitational waves with parameters it has not encountered during training. This includes features like higher black hole masses, additional harmonics, eccentricity, and varied waveform systematics, which introduce complex modulations in the waveform's amplitudes and phases. The accurate reconstructions of these unseen signal characteristics demonstrates \texttt{AWaRe}'s ability to handle complex features in the waveforms. By directly incorporating waveform reconstruction uncertainty estimation into the \texttt{AWaRe} framework, we show that for real gravitational wave events, the uncertainties in \texttt{AWaRe}'s reconstructions align closely with those achieved by benchmark algorithms like BayesWave and coherent WaveBurst. The robustness of our model to real gravitational wave events and its ability to extrapolate to unseen data open new avenues for investigations in various aspects of gravitational wave astrophysics and data analysis, including tests of General Relativity and the enhancement of current gravitational wave search methodologies.


title: n Distinguishable Particles on the Real Line interacting via Two Body Delta Potentials

abstract: This paper studies a system of $n \in \mathbb{N}: \, n \geq 2$ non-relativistic, spinless quantum particles moving on the real line and interacting via a two-body delta potential. The Hamiltonian of such a system is proved to be affiliated to the resolvent algebra of the case, $\mathcal{R}\left( \mathbb{R}^{2n},\sigma \right)$; it is further shown the existence of a $\text{C}^{\ast}-$dynamical system and of a subalgebra $\pi_S\left( \mathfrak{S}_0 \right)^{-1} \subset \mathcal{R}\left( \mathbb{R}^{2n},\sigma \right)$, stable under time evolution, where $\pi_S$ is the Schr{\"o}dinger representation of the algebra.


title: Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching

abstract: Large language models (LLMs) often struggle to provide up-to-date information due to their one-time training and the constantly evolving nature of the world. To keep LLMs current, existing approaches typically involve continued pre-training on new documents. However, they frequently face difficulties in extracting stored knowledge. Motivated by the remarkable success of the Feynman Technique in efficient human learning, we introduce Self-Tuning, a learning framework aimed at improving an LLM's ability to effectively acquire new knowledge from raw documents through self-teaching. Specifically, we develop a Self-Teaching strategy that augments the documents with a set of knowledge-intensive tasks created in a self-supervised manner, focusing on three crucial aspects: memorization, comprehension, and self-reflection. In addition, we introduce three Wiki-Newpages-2023-QA datasets to facilitate an in-depth analysis of an LLM's knowledge acquisition ability concerning memorization, extraction, and reasoning. Extensive experimental results on Llama2 family models reveal that Self-Tuning consistently exhibits superior performance across all knowledge acquisition tasks and excels in preserving previous knowledge.


title: Leveraging Hyperscanning EEG and VR Omnidirectional Treadmill to Explore Inter-Brain Synchrony in Collaborative Spatial Navigation

abstract: Navigating through a physical environment to reach a desired location involves a complex interplay of cognitive, sensory, and motor functions. When navigating with others, experiencing a degree of behavioral and cognitive synchronization is both natural and ubiquitous. This synchronization facilitates a harmonious effort toward achieving a common goal, reflecting how individuals instinctively align their actions and thoughts in collaborative settings. Collaborative spatial tasks, which are crucial in daily and professional settings, require coordinated navigation and problem-solving skills. This study explores the neural mechanisms underlying such tasks by using hyperscanning electroencephalography (EEG) technology to examine brain dynamics in dyadic route planning within a virtual reality setting. By analyzing intra- and inter-brain couplings across delta, theta, alpha, beta, and gamma EEG bands using both functional and effective connectivity measures, we identified significant neural synchronization patterns associated with collaborative task performance in both leaders and followers. Functional intra-brain connectivity analyses revealed distinct neural engagement across EEG frequency bands, with increased delta couplings observed in both leaders and followers. Theta connectivity was particularly enhanced in followers, whereas the alpha band exhibited divergent patterns that indicate role-specific neural strategies. Inter-brain analysis revealed increased delta causality between interacting members but decreased theta and gamma couplings from followers to leaders. Additionally, inter-brain analysis indicated decreased couplings in faster-performing dyads, especially in theta bands. These insights enhance our understanding of the neural mechanisms driving collaborative spatial navigation and demonstrate the effectiveness of hyperscanning in studying complex brain-to-brain interactions.


title: Exploring the generation and annihilation of three dimensional nulls through MHD simulations in initially chaotic magnetic field devoid of nulls

abstract: Three-dimensional (3D) magnetic nulls are abundant in the solar atmosphere, as been firmly established through contemporary observations. They are established to be important magnetic structures in, for example, jets and circular ribbon flares. While simulations and extrapolations support this, the mechanisms behind 3D null generation remain an open question. Recent magnetohydrodynamics (MHD) simulations propose that magnetic reconnection is responsible for both generating and annihilating 3D nulls, a novel concept. However, these simulations began with initial magnetic fields already supporting pre-existing nulls, raising the question of whether magnetic reconnection can create nulls in fields initially devoid of them. Previously, this question was briefly explored in a simulation with an initial chaotic magnetic field. However, the study failed to precisely identify locations, topological degrees, and natures (spiral or radial) of nulls, and it approximated magnetic reconnection without fully tracking field line in time. In this paper these findings are revisited in light of recent advancements and tools used to locate and trace nulls, along with the tracing of field lines, through which the concept of generation/annihilation of 3D nulls from chaotic fields is established in a precise manner.


title: A Parameter-efficient Language Extension Framework for Multilingual ASR

abstract: Covering all languages with a multilingual speech recognition model (MASR) is very difficult. Performing language extension on top of an existing MASR is a desirable choice. In this study, the MASR continual learning problem is probabilistically decomposed into language identity prediction (LP) and cross-lingual adaptation (XLA) sub-problems. Based on this, we propose an architecture-based framework for language extension that can fundamentally solve catastrophic forgetting, debudded as PELE. PELE is designed to be parameter-efficient, incrementally incorporating an add-on module to adapt to a new language. Specifically, different parameter-efficient fine-tuning (PEFT) modules and their variants are explored as potential candidates to perform XLA. Experiments are carried out on 5 new languages with a wide range of low-resourced data sizes. The best-performing PEFT candidate can achieve satisfactory performance across all languages and demonstrates superiority in three of five languages over the continual joint learning setting. Notably, PEFT methods focusing on weight parameters or input features are revealed to be limited in performance, showing significantly inferior extension capabilities compared to inserting a lightweight module in between layers such as an Adapter.


title: Theory of phonon sidebands in the absorption spectra of moir\'e exciton-polaritons

abstract: Excitons in twisted bilayers of transition metal dichalcogenides have strongly modified dispersion relations due to the formation of periodic moir\'e potentials. The strong coupling to a light field in an optical cavity leads to the appearance of moir\'e polaritons. In this paper, we derive a theoretical model for the linear absorption spectrum of the coupled moir\'e polariton-phonon system based on the time-convolutionless (TCL) approach. Results obtained by numerically solving the TCL equation are compared to those obtained in the Markovian limit and from a perturbative treatment of non-Markovian corrections. A key quantity for the interpretation of the findings is the generalized phonon spectral density. We discuss the phonon impact on the spectrum for realistic moir\'e exciton dispersions by varying twist angle and temperature. Key features introduced by the coupling to phonons are broadenings and energy shifts of the upper and lower polariton peak and the appearance of phonon sidebands between them. We analyze these features with respect to the role of Markovian and non-Markovian effects and find that they strongly depend on the twist angle. We can distinguish between the regimes of large, small, and intermediate twist angles. In the latter phonon effects are particularly pronounced due to dominating phonon transitions into regions which are characterized by van Hove singularities in the density of states.


title: MedExQA: Medical Question Answering Benchmark with Multiple Explanations

abstract: This paper introduces MedExQA, a novel benchmark in medical question-answering, to evaluate large language models' (LLMs) understanding of medical knowledge through explanations. By constructing datasets across five distinct medical specialties that are underrepresented in current datasets and further incorporating multiple explanations for each question-answer pair, we address a major gap in current medical QA benchmarks which is the absence of comprehensive assessments of LLMs' ability to generate nuanced medical explanations. Our work highlights the importance of explainability in medical LLMs, proposes an effective methodology for evaluating models beyond classification accuracy, and sheds light on one specific domain, speech language pathology, where current LLMs including GPT4 lack good understanding. Our results show generation evaluation with multiple explanations aligns better with human assessment, highlighting an opportunity for a more robust automated comprehension assessment for LLMs. To diversify open-source medical LLMs (currently mostly based on Llama2), this work also proposes a new medical model, MedPhi-2, based on Phi-2 (2.7B). The model outperformed medical LLMs based on Llama2-70B in generating explanations, showing its effectiveness in the resource-constrained medical domain. We will share our benchmark datasets and the trained model.


title: An automatic analysis of ultrasound vocalisations for the prediction of interaction context in captive Egyptian fruit bats

abstract: Prior work in computational bioacoustics has mostly focused on the detection of animal presence in a particular habitat. However, animal sounds contain much richer information than mere presence; among others, they encapsulate the interactions of those animals with other members of their species. Studying these interactions is almost impossible in a naturalistic setting, as the ground truth is often lacking. The use of animals in captivity instead offers a viable alternative pathway. However, most prior works follow a traditional, statistics-based approach to analysing interactions. In the present work, we go beyond this standard framework by attempting to predict the underlying context in interactions between captive \emph{Rousettus Aegyptiacus} using deep neural networks. We reach an unweighted average recall of over 30\% -- more than thrice the chance level -- and show error patterns that differ from our statistical analysis. This work thus represents an important step towards the automatic analysis of states in animals from sound.


title: On the coefficients in the Jones-Wenzl idempotent

abstract: By studying a categorification of the antisymmetriser quasi-idempotent in the Hecke algebra, we derive a closed formula for the Jones-Wenzl idempotent in the Temperley-Lieb algebra. In particular, we show that when the idempotent is expressed in terms of the monomial basis, the coefficients are the graded ranks of certain indecomposable Soergel modules. Equivalently, the coefficients can be expressed as a ratio of certain Kazhdan-Lusztig polynomials. Similar results are obtained for generalised Jones-Wenzl idempotents in other types.


title: Cell seeding dynamics in a porous scaffold material designed for meniscus tissue regeneration

abstract: We study the dynamics of a seeding experiment where a fibrous scaffold material is colonized by two types of cell populations. The specific application that we have in mind is related to the idea of meniscus tissue regeneration. In order to support the development of a promising replacement material, we discuss certain rate equations for the densities of human mesenchymal stem cells and chondrocytes and for the production of collagen-containing extracellular matrix. For qualitative studies, we start with a system of ordinary differential equations and refine then the model to include spatial effects of the underlying nonwoven scaffold structure. Numerical experiments as well as a complete set of parameters for future benchmarking are provided.


title: Feasibility of accelerating homogeneous catalyst discovery with fault-tolerant quantum computers

abstract: The industrial manufacturing of chemicals consumes a significant amount of energy and raw materials. In principle, the development of new catalysts could greatly improve the efficiency of chemical production. However, the discovery of viable catalysts can be exceedingly challenging because it is difficult to know the efficacy of a candidate without experimentally synthesizing and characterizing it. This study explores the feasibility of using fault-tolerant quantum computers to accelerate the discovery of homogeneous catalysts for nitrogen fixation, an industrially important chemical process. It introduces a set of ground-state energy estimation problems representative of calculations needed for the discovery of homogeneous catalysts and analyzes them on three dimensions: economic utility, classical hardness, and quantum resource requirements. For the highest utility problem considered, two steps of a catalytic cycle for the generation of cyanate anion from dinitrogen, the economic utility of running these computations is estimated to be $200,000, and the required runtime for double-factorized phase estimation on a fault-tolerant superconducting device is estimated under conservative assumptions to be 139,000 QPU-hours. The computational cost of an equivalent DMRG calculation is estimated to be about 400,000 CPU-hours. These results suggest that, with continued development, it will be feasible for fault-tolerant quantum computers to accelerate the discovery of homogeneous catalysts.


title: Propagation in rough waveguides: Forward and inverse problems

abstract: We discuss here the direct and inverse problems for wave propagation in a waveguide with rough internal surface and arbitrary mean shape. The high degree of multiple scattering inside the waveguide poses significant challenges both for the forward computation and for the recovery of the surface profile, and raises important questions about scattering cross-sections. This paper falls into two parts corresponding to these issues. We first apply Left-Right (L-R) operator splitting to calculate the scattered fields in 2- and 3-dimensional waveguides. Using this we illustrate the scattered fields and the effect of surface roughness. In the second part we formulate an algorithm for surface recovery from field measurements along the waveguide axis, which generalises recent work on surfaces in 2 dimensions. This method utilizes forward scattering assumptions in effect by formulating an integral equation in the unknown surface field, treated as a function of the surface. Although discussed in the context of waveguides, the formulae are given in a form applicable to a variety of geometries, with coefficients which will depend on and be determined by each specific application.


title: System- and Sample-agnostic Isotropic 3D Microscopy by Weakly Physics-informed, Domain-shift-resistant Axial Deblurring

abstract: Three-dimensional (3D) subcellular imaging is essential for biomedical research, but the diffraction limit of optical microscopy compromises axial resolution, hindering accurate 3D structural analysis. This challenge is particularly pronounced in label-free imaging of thick, heterogeneous tissues, where assumptions about data distribution (e.g. sparsity, label-specific distribution, and lateral-axial similarity) and system priors (e.g. independent and identically distributed (i.i.d.) noise and linear shift-invariant (LSI) point-spread functions (PSFs)) are often invalid. Here, we introduce SSAI-3D, a weakly physics-informed, domain-shift-resistant framework for robust isotropic 3D imaging. SSAI-3D enables robust axial deblurring by generating a PSF-flexible, noise-resilient, sample-informed training dataset and sparsely fine-tuning a large pre-trained blind deblurring network. SSAI-3D was applied to label-free nonlinear imaging of living organoids, freshly excised human endometrium tissue, and mouse whisker pads, and further validated in publicly available ground-truth-paired experimental datasets of 3D heterogeneous biological tissues with unknown blurring and noise across different microscopy systems.


title: The Lattice Problem for Models of $\mathsf{PA}$

abstract: The lattice problem for models of Peano Arithmetic ($\mathsf{PA}$) is to determine which lattices can be represented as lattices of elementary submodels of a model of $\mathsf{PA}$, or, in greater generality, for a given model $\mathcal{M}$, which lattices can be represented as interstructure lattices of elementary submodels $\mathcal{K}$ of an elementary extension $\mathcal{N}$ such that $\mathcal{M} \preccurlyeq \mathcal{K} \preccurlyeq \mathcal{N}$. The problem has been studied for the last 60 years and the results and their proofs show an interesting interplay between the model theory of PA, Ramsey style combinatorics, lattice representation theory, and some results in elementary number theory. We present a survey of the most important results together with a detailed analysis of some special cases to explain and motivate a technique of CPP-representations developed by James Schmerl for constructing elementary extensions with prescribed interstructure lattices. The last section is devoted to a discussion of lesser-known results about lattices of elementary submodels of countable recursively saturated models of PA.


title: Audio-based Step-count Estimation for Running -- Windowing and Neural Network Baselines

abstract: In recent decades, running has become an increasingly popular pastime activity due to its accessibility, ease of practice, and anticipated health benefits. However, the risk of running-related injuries is substantial for runners of different experience levels. Several common forms of injuries result from overuse -- extending beyond the recommended running time and intensity. Recently, audio-based tracking has emerged as yet another modality for monitoring running behaviour and performance, with previous studies largely concentrating on predicting runner fatigue. In this work, we investigate audio-based step count estimation during outdoor running, achieving a mean absolute error of 1.098 in window-based step-count differences and a Pearson correlation coefficient of 0.479 when predicting the number of steps in a 5-second window of audio. Our work thus showcases the feasibility of audio-based monitoring for estimating important physiological variables and lays the foundations for further utilising audio sensors for a more thorough characterisation of runner behaviour.


title: Optimisation of federated learning settings under statistical heterogeneity variations

abstract: Federated Learning (FL) enables local devices to collaboratively learn a shared predictive model by only periodically sharing model parameters with a central aggregator. However, FL can be disadvantaged by statistical heterogeneity produced by the diversity in each local devices data distribution, which creates different levels of Independent and Identically Distributed (IID) data. Furthermore, this can be more complex when optimising different combinations of FL parameters and choosing optimal aggregation. In this paper, we present an empirical analysis of different FL training parameters and aggregators over various levels of statistical heterogeneity on three datasets. We propose a systematic data partition strategy to simulate different levels of statistical heterogeneity and a metric to measure the level of IID. Additionally, we empirically identify the best FL model and key parameters for datasets of different characteristics. On the basis of these, we present recommended guidelines for FL parameters and aggregators to optimise model performance under different levels of IID and with different datasets


title: Predicting Heart Activity from Speech using Data-driven and Knowledge-based features

abstract: Accurately predicting heart activity and other biological signals is crucial for diagnosis and monitoring. Given that speech is an outcome of multiple physiological systems, a significant body of work studied the acoustic correlates of heart activity. Recently, self-supervised models have excelled in speech-related tasks compared to traditional acoustic methods. However, the robustness of data-driven representations in predicting heart activity remained unexplored. In this study, we demonstrate that self-supervised speech models outperform acoustic features in predicting heart activity parameters. We also emphasize the impact of individual variability on model generalizability. These findings underscore the value of data-driven representations in such tasks and the need for more speech-based physiological data to mitigate speaker-related challenges.


title: A Guide to Stochastic Optimisation for Large-Scale Inverse Problems

abstract: Stochastic optimisation algorithms are the de facto standard for machine learning with large amounts of data. Handling only a subset of available data in each optimisation step dramatically reduces the per-iteration computational costs, while still ensuring significant progress towards the solution. Driven by the need to solve large-scale optimisation problems as efficiently as possible, the last decade has witnessed an explosion of research in this area. Leveraging the parallels between machine learning and inverse problems has allowed harnessing the power of this research wave for solving inverse problems. In this survey, we provide a comprehensive account of the state-of-the-art in stochastic optimisation from the viewpoint of inverse problems. We present algorithms with diverse modalities of problem randomisation and discuss the roles of variance reduction, acceleration, higher-order methods, and other algorithmic modifications, and compare theoretical results with practical behaviour. We focus on the potential and the challenges for stochastic optimisation that are unique to inverse imaging problems and are not commonly encountered in machine learning. We conclude the survey with illustrative examples from imaging problems to examine the advantages and disadvantages that this new generation of algorithms bring to the field of inverse problems.