title: Connection between Sub-surface Layers and Surface Magnetic Activity over Multiple Solar Cycles

abstract: We investigate spatio-temporal evolution of high-degree acoustic mode frequencies of the Sun and the surface magnetic activity, over the course of multiple solar cycles, to improve our understanding of the connection between the solar interior and atmosphere. We focus on high-degree modes due to their ability to characterize conditions in the shear layer just below the solar surface. Using the full-disk Doppler observations made by the Global Oscillation Network Group (GONG), mode frequencies covering the period from July 2001 to December 2021 are computed through the local helioseismic technique of ring diagrams. Considering 10.7 cm radio flux measurements, the sunspot number, and the local magnetic activity index as solar activity proxies, we note strong correlation between the frequency shifts and each activity index. We further investigate the hemispheric asymmetry in frequency shifts and magnetic activity and find that both the activity and frequencies in the descending phase of cycle 23 were dominant in the southern hemisphere, while in cycle 24 these quantities fluctuated between northern and southern hemispheres. Analyzing the frequency shifts at different latitudes with the progression of solar cycles, we observe that the shifts at mid-latitudes are dominant in the southern hemisphere during the maximum period of solar activity in cycle 24 but the values overlap as the cycle advances towards the minimum activity period. The frequency shifts at the beginning of cycle 25 are found to be dominant in the southern hemisphere following magnetic activity. The analysis presents additional evidence that the variability in oscillation frequencies are caused by both strong and weak magnetic fields.


title: Path Planning for Continuum Rods Using Bernstein Surfaces

abstract: This paper presents a method for optimal motion planning of continuum robots by employing Bernstein surfaces to approximate the system's dynamics and impose complex constraints, including collision avoidance. The main contribution is the approximation of infinite-dimensional continuous problems into their discrete counterparts, facilitating their solution using standard optimization solvers. This discretization leverages the unique properties of Bernstein surface, providing a framework that extends previous works which focused on ODEs approximated by Bernstein polynomials. Numerical validations are conducted through several numerical scenarios. The presented methodology offers a promising direction for solving complex optimal control problems in the realm of soft robotics.


title: PowMix: A Versatile Regularizer for Multimodal Sentiment Analysis

abstract: Multimodal sentiment analysis (MSA) leverages heterogeneous data sources to interpret the complex nature of human sentiments. Despite significant progress in multimodal architecture design, the field lacks comprehensive regularization methods. This paper introduces PowMix, a versatile embedding space regularizer that builds upon the strengths of unimodal mixing-based regularization approaches and introduces novel algorithmic components that are specifically tailored to multimodal tasks. PowMix is integrated before the fusion stage of multimodal architectures and facilitates intra-modal mixing, such as mixing text with text, to act as a regularizer. PowMix consists of five components: 1) a varying number of generated mixed examples, 2) mixing factor reweighting, 3) anisotropic mixing, 4) dynamic mixing, and 5) cross-modal label mixing. Extensive experimentation across benchmark MSA datasets and a broad spectrum of diverse architectural designs demonstrate the efficacy of PowMix, as evidenced by consistent performance improvements over baselines and existing mixing methods. An in-depth ablation study highlights the critical contribution of each PowMix component and how they synergistically enhance performance. Furthermore, algorithmic analysis demonstrates how PowMix behaves in different scenarios, particularly comparing early versus late fusion architectures. Notably, PowMix enhances overall performance without sacrificing model robustness or magnifying text dominance. It also retains its strong performance in situations of limited data. Our findings position PowMix as a promising versatile regularization strategy for MSA. Code will be made available.


title: Nondefectivity of invariant secant varieties

abstract: We show that a large class of secant varieties is nondefective. In particular, we positively resolve most cases of the Baur-Draisma-de Graaf conjecture on Grassmannian secants in large dimensions. Our result improves the known bounds on nondefectivity for various other secant varieties, including Chow varieties, Segre-Veronese varieties and Gaussian moment varieties. We also give bounds for identifiability and the generic ranks.


title: Optical Feedback Loop in Paraxial Fluids of Light: A Gate to new phenomena in analogue physical simulations

abstract: Easily accessible through tabletop experiments based on laser propagation inside nonlinear optical media, Paraxial Fluids of Light are emerging as promising platforms for the simulation and exploration of quantum-like phenomena. In particular, the analogy builds on a formal equivalence between the governing model for a Bose-Einstein Condensate under the mean-field approximation and the model of laser propagation under the paraxial approximation. Yet, the fact that the role of time is played by the propagation distance in the optical analogue system may impose strong bounds on the range of accessible phenomena due to the limited length of the nonlinear medium. In this manuscript, we present a novel experimental approach to solve this limitation in the form of an optical feedback loop, which consists of the reconstruction of the optical states at the end of the system followed by their subsequent re-injection exploiting wavefront shaping techniques. The results enclosed demonstrate the potential of this approach to access unprecedented dynamics, paving for the observation of novel phenomena in these systems.


title: pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction

abstract: We introduce pixelSplat, a feed-forward model that learns to reconstruct 3D radiance fields parameterized by 3D Gaussian primitives from pairs of images. Our model features real-time and memory-efficient rendering for scalable training as well as fast 3D reconstruction at inference time. To overcome local minima inherent to sparse and locally supported representations, we predict a dense probability distribution over 3D and sample Gaussian means from that probability distribution. We make this sampling operation differentiable via a reparameterization trick, allowing us to back-propagate gradients through the Gaussian splatting representation. We benchmark our method on wide-baseline novel view synthesis on the real-world RealEstate10k and ACID datasets, where we outperform state-of-the-art light field transformers and accelerate rendering by 2.5 orders of magnitude while reconstructing an interpretable and editable 3D radiance field.


title: Smart Connected Farms and Networked Farmers to Tackle Climate Challenges Impacting Agricultural Production

abstract: To meet the grand challenges of agricultural production including climate change impacts on crop production, a tight integration of social science, technology and agriculture experts including farmers are needed. There are rapid advances in information and communication technology, precision agriculture and data analytics, which are creating a fertile field for the creation of smart connected farms (SCF) and networked farmers. A network and coordinated farmer network provides unique advantages to farmers to enhance farm production and profitability, while tackling adverse climate events. The aim of this article is to provide a comprehensive overview of the state of the art in SCF including the advances in engineering, computer sciences, data sciences, social sciences and economics including data privacy, sharing and technology adoption.


title: Value Explicit Pretraining for Learning Transferable Representations

abstract: We propose Value Explicit Pretraining (VEP), a method that learns generalizable representations for transfer reinforcement learning. VEP enables learning of new tasks that share similar objectives as previously learned tasks, by learning an encoder for objective-conditioned representations, irrespective of appearance changes and environment dynamics. To pre-train the encoder from a sequence of observations, we use a self-supervised contrastive loss that results in learning temporally smooth representations. VEP learns to relate states across different tasks based on the Bellman return estimate that is reflective of task progress. Experiments using a realistic navigation simulator and Atari benchmark show that the pretrained encoder produced by our method outperforms current SoTA pretraining methods on the ability to generalize to unseen tasks. VEP achieves up to a 2 times improvement in rewards on Atari and visual navigation, and up to a 3 times improvement in sample efficiency. For videos of policy performance visit our https://sites.google.com/view/value-explicit-pretraining/


title: Scalable Geometric Fracture Assembly via Co-creation Space among Assemblers

abstract: Geometric fracture assembly presents a challenging practical task in archaeology and 3D computer vision. Previous methods have focused solely on assembling fragments based on semantic information, which has limited the quantity of objects that can be effectively assembled. Therefore, there is a need to develop a scalable framework for geometric fracture assembly without relying on semantic information. To improve the effectiveness of assembling geometric fractures without semantic information, we propose a co-creation space comprising several assemblers capable of gradually and unambiguously assembling fractures. Additionally, we introduce a novel loss function, i.e., the geometric-based collision loss, to address collision issues during the fracture assembly process and enhance the results. Our framework exhibits better performance on both PartNet and Breaking Bad datasets compared to existing state-of-the-art frameworks. Extensive experiments and quantitative comparisons demonstrate the effectiveness of our proposed framework, which features linear computational complexity, enhanced abstraction, and improved generalization. Our code is publicly available at https://github.com/Ruiyuan-Zhang/CCS.


title: Engineering an Exact Pseudo-Boolean Model Counter

abstract: Model counting, a fundamental task in computer science, involves determining the number of satisfying assignments to a Boolean formula, typically represented in conjunctive normal form (CNF). While model counting for CNF formulas has received extensive attention with a broad range of applications, the study of model counting for Pseudo-Boolean (PB) formulas has been relatively overlooked. Pseudo-Boolean formulas, being more succinct than propositional Boolean formulas, offer greater flexibility in representing real-world problems. Consequently, there is a crucial need to investigate efficient techniques for model counting for PB formulas. In this work, we propose the first exact Pseudo-Boolean model counter, PBCount, that relies on knowledge compilation approach via algebraic decision diagrams. Our extensive empirical evaluation shows that PBCount can compute counts for 1513 instances while the current state-of-the-art approach could only handle 1013 instances. Our work opens up several avenues for future work in the context of model counting for PB formulas, such as the development of preprocessing techniques and exploration of approaches other than knowledge compilation.


title: Scalable Near-Field Localization Based on Partitioned Large-Scale Antenna Array

abstract: This paper studies a passive localization system, where an extremely large-scale antenna array (ELAA) is deployed at the base station (BS) to locate a user equipment (UE) residing in its near-field (Fresnel) region. We propose a novel algorithm, named array partitioning-based location estimation (APLE), for scalable near-field localization. The APLE algorithm is developed based on the basic assumption that, by partitioning the ELAA into multiple subarrays, the UE can be approximated as in the far-field region of each subarray. We establish a Bayeian inference framework based on the geometric constraints between the UE location and the angles of arrivals (AoAs) at different subarrays. Then, the APLE algorithm is designed based on the message-passing principle for the localization of the UE. APLE exhibits linear computational complexity with the number of BS antennas, leading to a significant reduction in complexity compared to existing methods. We further propose an enhanced APLE (E-APLE) algorithm that refines the location estimate obtained from APLE by following the maximum likelihood principle. The E-APLE algorithm achieves superior localization accuracy compared to APLE while maintaining a linear complexity with the number of BS antennas. Numerical results demonstrate that the proposed APLE and E-APLE algorithms outperform the existing baselines in terms of localization accuracy.


title: LatestEval: Addressing Data Contamination in Language Model Evaluation through Dynamic and Time-Sensitive Test Construction

abstract: Data contamination in evaluation is getting increasingly prevalent with the emergence of language models pre-trained on super large, automatically crawled corpora. This problem leads to significant challenges in the accurate assessment of model capabilities and generalisations. In this paper, we propose LatestEval, an automatic method that leverages the most recent texts to create uncontaminated reading comprehension evaluations. LatestEval avoids data contamination by only using texts published within a recent time window, ensuring no overlap with the training corpora of pre-trained language models. We develop the LatestEval automated pipeline to 1) gather the latest texts; 2) identify key information, and 3) construct questions targeting the information while removing the existing answers from the context. This encourages models to infer the answers themselves based on the remaining context, rather than just copy-paste. Our experiments demonstrate that language models exhibit negligible memorisation behaviours on LatestEval as opposed to previous benchmarks, suggesting a significantly reduced risk of data contamination and leading to a more robust evaluation. Data and code are publicly available at: https://github.com/liyucheng09/LatestEval.


title: Constraints on cosmological coupling from the accretion history of supermassive black holes

abstract: Coupling of black hole mass to the cosmic expansion has been suggested as a possible path to understanding the dark energy content of the Universe. We test this hypothesis by comparing the supermassive black hole (SMBH) mass density at $z=0$ to the total mass accreted in AGN since $z=6$, to constrain how much of the SMBH mass density can arise from cosmologically-coupled growth, as opposed to growth by accretion. Using an estimate of the local SMBH mass density of $\approx 1.0\times10^{6}\,$M$_{\odot}\,$Mpc$^{-1}$, a radiative accretion efficiency, $\eta$: $0.05<\eta<0.3$, and the observed AGN luminosity density at $z\approx 4$, we constrain the value of the coupling constant between the scale size of the Universe and the black hole mass, $k$, to lie in the range $0<k\stackrel{<}{_{\sim}}2$, below the value of $k=3$ needed for black holes to be the source term for dark energy. Initial estimates of the gravitational wave background using pulsar timing arrays, however, favor a higher SMBH mass density at $z=0$. We show that if we adopt such a mass density at $z=0$ of $\approx 7.4\times 10^{6}\,$M$_{\odot}\,$Mpc$^{-1}$, this makes $k=3$ viable even for low radiative efficiencies, and may exclude non-zero cosmological coupling. We conclude that, although current estimates of the SMBH mass density based on the black hole mass -- bulge mass relation probably exclude $k=3$, the possibility remains open that, if the GWB is due to SMBH mergers, $k>2$ is preferred.


title: On the Effectiveness of Retrieval, Alignment, and Replay in Manipulation

abstract: Imitation learning with visual observations is notoriously inefficient when addressed with end-to-end behavioural cloning methods. In this paper, we explore an alternative paradigm which decomposes reasoning into three phases. First, a retrieval phase, which informs the robot what it can do with an object. Second, an alignment phase, which informs the robot where to interact with the object. And third, a replay phase, which informs the robot how to interact with the object. Through a series of real-world experiments on everyday tasks, such as grasping, pouring, and inserting objects, we show that this decomposition brings unprecedented learning efficiency, and effective inter- and intra-class generalisation. Videos are available at https://www.robot-learning.uk/retrieval-alignment-replay.


title: The mod 2 cohomology rings of the alternating subgroups of the Coxeter groups of Type B

abstract: We show that the direct sum of the cohomology groups of the alternating subgroups of the family of Coxeter groups of Type B exhibits an almost-Hopf ring structure. We apply techniques developed by Giusti and Sinha to fully compute a presentation of this structure for mod 2 coefficient.


title: SMC-NCA: Semantic-guided Multi-level Contrast for Semi-supervised Temporal Action Segmentation

abstract: Semi-supervised temporal action segmentation aims to perform frame-wise classification in long untrimmed videos, where only a fraction of videos in the training set have labels. Recent studies have shown the potential of contrastive learning in unsupervised representation learning using unlabelled data. However, learning the representation of each frame by unsupervised contrastive learning for action segmentation remains an open and challenging problem. In this paper, we propose a novel Semantic-guided Multi-level Contrast scheme with a Neighbourhood-Consistency-Aware unit (SMC-NCA) to extract strong frame-wise representations for semi-supervised action segmentation. Specifically, for representation learning, SMC is firstly used to explore intra- and inter-information variations in a unified and contrastive way, based on dynamic clustering process of the original input, encoded semantic and temporal features. Then, the NCA module, which is responsible for enforcing spatial consistency between neighbourhoods centered at different frames to alleviate over-segmentation issues, works alongside SMC for semi-supervised learning. Our SMC outperforms the other state-of-the-art methods on three benchmarks, offering improvements of up to 17.8% and 12.6% in terms of edit distance and accuracy, respectively. Additionally, the NCA unit results in significant better segmentation performance against the others in the presence of only 5% labelled videos. We also demonstrate the effectiveness of the proposed method on our Parkinson's Disease Mouse Behaviour (PDMB) dataset. The code and datasets will be made publicly available.


title: An ergodic theorem with weights and applications to random measures, RW homogenization and IPS hydrodynamics on point processes

abstract: We prove a multidimensional ergodic theorem with weighted averages for the action of the group $\mathbb{Z}^d$ on a probability space. At level $n$ weights are of the form $n^{-d} \psi(j/n)$, $ j\in \mathbb{Z}^d$, for real functions $\psi$ decaying suitably fast. We discuss applications to random measures and to quenched stochastic homogenization of random walks (RWs) on simple point processes with long-range random jump rates, allowing to remove the technical Assumption (A9) from \cite[Theorem~4.4]{Fhom1}. This last result concerns also some semigroup and resolvent convergence particularly relevant for the derivation of the quenched hydrodynamic limit of interacting particle systems (IPSs) via homogenization and duality. As a consequence we show that also the quenched hydrodynamic limit of the symmetric simple exclusion process on point processes stated in \cite[Theorem~4.1]{F_SEP} remains valid when removing the above mentioned Assumption (A9).


title: Holographic complexity: braneworld gravity versus the Lloyd bound

abstract: We explore the complexity equals volume proposal for planar black holes in anti-de Sitter (AdS) spacetime in 2+1 dimensions, with an end of the world (ETW) brane behind the horizon. We allow for the possibility of intrinsic gravitational dynamics in the form of Jackiw-Teitelboim (JT) gravity to be localized on the brane. We compute the asymptotic rate of change of volume complexity analytically and obtain the full time dependence using numerical techniques. We find that the inclusion of JT gravity on the brane leads to interesting effects on time dependence of holographic complexity. We identify the region in parameter space (the brane location and the JT coupling) for which the rate of change of complexity violates the Lloyd bound. In an equivalent description of the model in terms of an asymptotically AdS wormhole, we connect the violation of the Lloyd bound to the violation of a suitable energy condition in the bulk that we introduce. We also compare the Lloyd bound constraints to previously derived constraints on the bulk parameters in this model that are based on bounds on entanglement growth in the dual CFT state.


title: Work and efficiency fluctuations in a quantum Otto cycle with idle levels

abstract: We study the performance of a quantum Otto heat engine with two spins coupled by a Heisenberg interaction, taking into account not only the mean values of work and efficiency but also their fluctuations. We first show that, for this system, the output work and its fluctuations are directly related to the magnetization and magnetic susceptibility of the system at equilibrium with either heat bath. We analyze the regions where the work extraction can be done with low relative fluctuation for a given range of temperatures, while still achieving an efficiency higher than that of a single spin system heat engine. In particular, we find that, due to the presence of `idle' levels, an increase in the inter-spin coupling can either increase or decrease fluctuations, depending on the other parameters. In all cases, however, we find that the relative fluctuations in work or efficiency remain large, implying that this microscopic engine is not very reliable as a source of work.


title: The He abundance in NGC 1850 A and B: are we observing the early stage of formation of multiple populations in a stellar cluster?

abstract: We present the result of a sample of B-stars in the Large Magellanic Cloud young double stellar cluster NGC 1850 A and NGC 1850 B, observed with the integral-field spectrograph at the Very Large Telescope, the Multi Unit Spectroscopic Explorer. We compare the observed equivalent widths (EWs) of four He lines (4922 $\mathring{\mathrm A}$, 5015 $\mathring{\mathrm A}$, 6678 $\mathring{\mathrm A}$, and 7065 $\mathring{\mathrm A}$) with the ones determined from synthetic spectra computed with different He mass fraction (Y=0.25, 0.27, 0.30 and 0.35) with the code SYNSPEC, that takes into account the non-LTE effect. From this comparison, we determined the He mass fraction of the B stars, finding a not homogeneous distribution. The stars can be divided in three groups, He-weak (Y $\lt$ 0.24) and the He-normal (0.24 $\leqslant$ Y $\leqslant$ 0.26) belonging to the MS of NGC 1850 A, and the He-rich stars (0.33 $\leqslant$ Y $\leqslant$ 0.38) situated in the MS associated to NGC 1850 B. We have analyzed the stellar rotation as possible responsible of the anomalous features of the He lines in the He-rich stars. We provide a simple analysis of the differences between the observed EWs and the ones obtained from the theoretical models with different rotation velocity (V$\sin{i}$ = 0 and 250 Km/s). The resolution of the MUSE spectra do not allow to get a conclusive result, however our analysis support the He-enhanced hypothesis.


title: Anti-de Sitter $\to$ de Sitter transition driven by Casimir forces and mitigating tensions in cosmological parameters

abstract: Over the last few years, low- and high-redshift observations set off tensions in the measurement of the present-day expansion rate $H_0$ and in the determination of the amplitude of the matter clustering in the late Universe (parameterized by $S_8$). It was recently noted that both these tensions can be resolved if the cosmological constant parametrizing the dark energy content switches its sign at a critical redshift $z_c \sim 2$. However, the anti-de Sitter (AdS) swampland conjecture suggests that the postulated switch in sign of the cosmological constant at zero temperature seems unlikely because the AdS vacua are an infinite distance appart from de Sitter (dS) vacua in moduli space. We provide an explanation for the required AdS $\to$ dS crossover transition in the vacuum energy using the Casimir forces of fields inhabiting the bulk. We then use entropy arguments to claim that any AdS $\to$ dS transition between metastable vacua must be accompanied by a reduction of the species scale where gravity becomes strong. We provide a few examples supporting this AdS $\to$ dS uplift conjecture.


title: Dynamical approximation and sensor placement for filtering problems

abstract: We consider the inverse problem of reconstructing an unknown function $u$ from a finite set of measurements, under the assumption that $u$ is the trajectory of a transport-dominated problem with unknown input parameters. We propose an algorithm based on the Parameterized Background Data-Weak method (PBDW) where dynamical sensor placement is combined with approximation spaces that evolve in time. We prove that the method ensures an accurate reconstruction at all times and allows to incorporate relevant physical properties in the reconstructed solutions by suitably evolving the dynamical approximation space. As an application of this strategy we consider Hamiltonian systems modeling wave-type phenomena, where preservation of the geometric structure of the flow plays a crucial role in the accuracy and stability of the reconstructed trajectory.


title: How to apply tree decomposition ideas in large networks?

abstract: Graph decompositions are the natural generalisation of tree decompositions where the decomposition tree is replaced by a genuine graph. Recently they found theoretical applications in the theory of sparsity, topological graph theory, structural graph theory and geometric group theory. We demonstrate applicability of graph decompositions on large networks by implementing an efficient algorithm and testing it on road networks.


title: Transformed Primal-Dual Methods with Variable-Preconditioners

abstract: This paper introduces a novel Transformed Primal-Dual with variable-metric/preconditioner (TPDv) algorithm, designed to efficiently solve affine constrained optimization problems common in nonlinear partial differential equations (PDEs). Diverging from traditional methods, TPDv iteratively updates time-evolving preconditioning operators, enhancing adaptability. The algorithm is derived and analyzed, demonstrating global linear convergence rates under mild assumptions. Numerical experiments on challenging nonlinear PDEs, including the Darcy-Forchheimer model and a nonlinear electromagnetic problem, showcase the algorithm's superiority over existing methods in terms of iteration numbers and computational efficiency. The paper concludes with a comprehensive convergence analysis.


title: Every theory is eventually of presheaf type

abstract: We give a detailed and self-contained introduction to the theory of $\lambda $-toposes and prove the following: 1) A $\lambda $-separable $\lambda $-topos (one whose defining site has a certain smallness property) has enough $\lambda $-points. 2) Given a $\kappa $-site, its classifying $\lambda $-topos is of presheaf type (assuming $\kappa \vartriangleleft \lambda =\lambda ^{<\lambda }$).


title: Modeling non-linear Effects with Neural Networks in Relational Event Models

abstract: Dynamic networks offer an insight of how relational systems evolve. However, modeling these networks efficiently remains a challenge, primarily due to computational constraints, especially as the number of observed events grows. This paper addresses this issue by introducing the Deep Relational Event Additive Model (DREAM) as a solution to the computational challenges presented by modeling non-linear effects in Relational Event Models (REMs). DREAM relies on Neural Additive Models to model non-linear effects, allowing each effect to be captured by an independent neural network. By strategically trading computational complexity for improved memory management and leveraging the computational capabilities of Graphic Processor Units (GPUs), DREAM efficiently captures complex non-linear relationships within data. This approach demonstrates the capability of DREAM in modeling dynamic networks and scaling to larger networks. Comparisons with traditional REM approaches showcase DREAM superior computational efficiency. The model potential is further demonstrated by an examination of the patent citation network, which contains nearly 8 million nodes and 100 million events.


title: Localization and Discrete Beamforming with a Large Reconfigurable Intelligent Surface

abstract: In millimeter-wave (mmWave) cellular systems, reconfigurable intelligent surfaces (RISs) are foreseeably deployed with a large number of reflecting elements to achieve high beamforming gains. The large-sized RIS will make radio links fall in the near-field localization regime with spatial non-stationarity issues. Moreover, the discrete phase restriction on the RIS reflection coefficient incurs exponential complexity for discrete beamforming. It remains an open problem to find the optimal RIS reflection coefficient design in polynomial time. To address these issues, we propose a scalable partitioned-far-field protocol that considers both the near-filed non-stationarity and discrete beamforming. The protocol approximates near-field signal propagation using a partitioned-far-field representation to inherit the sparsity from the sophisticated far-field and facilitate the near-field localization scheme. To improve the theoretical localization performance, we propose a fast passive beamforming (FPB) algorithm that optimally solves the discrete RIS beamforming problem, reducing the search complexity from exponential order to linear order. Furthermore, by exploiting the partitioned structure of RIS, we introduce a two-stage coarse-to-fine localization algorithm that leverages both the time delay and angle information. Numerical results demonstrate that centimeter-level localization precision is achieved under medium and high signal-to-noise ratios (SNR), revealing that RISs can provide support for low-cost and high-precision localization in future cellular systems.


title: CLIP-DINOiser: Teaching CLIP a few DINO tricks for open-vocabulary semantic segmentation

abstract: The popular CLIP model displays impressive zero-shot capabilities thanks to its seamless interaction with arbitrary text prompts. However, its lack of spatial awareness makes it unsuitable for dense computer vision tasks, e.g., semantic segmentation, without an additional fine-tuning step that often uses annotations and can potentially suppress its original open-vocabulary properties. Meanwhile, self-supervised representation methods have demonstrated good localization properties without human-made annotations nor explicit supervision. In this work, we take the best of both worlds and propose an open-vocabulary semantic segmentation method, which does not require any annotations. We propose to locally improve dense MaskCLIP features, which are computed with a simple modification of CLIP's last pooling layer, by integrating localization priors extracted from self-supervised features. By doing so, we greatly improve the performance of MaskCLIP and produce smooth outputs. Moreover, we show that the used self-supervised feature properties can directly be learnt from CLIP features. Our method CLIP-DINOiser needs only a single forward pass of CLIP and two light convolutional layers at inference, no extra supervision nor extra memory and reaches state-of-the-art results on challenging and fine-grained benchmarks such as COCO, Pascal Context, Cityscapes and ADE20k. The code to reproduce our results is available at https://github.com/wysoczanska/clip_dinoiser.


title: Exact Tunneling Solutions in Multi-Field Potentials

abstract: The tunneling potential formalism makes it easy to construct exact solutions to the vacuum decay problem in potentials with multiple fields. While some exact solutions for single-field decays were known, we present the first nontrivial analytic examples with two and three scalar fields, and show how the method can be generalized to include gravitational corrections. Our results illuminate some analytic properties of the tunneling potential functions and can have a number of uses, among others: to serve as simple approximations to realistic potentials; to learn about parametric dependencies of decay rates; to check conjectures on vacuum decay; as benchmarks for multi-field numerical codes; or to study holographic interpretations of vacuum decay.


title: Improved multifidelity Monte Carlo estimators based on normalizing flows and dimensionality reduction techniques

abstract: We study the problem of multifidelity uncertainty propagation for computationally expensive models. In particular, we consider the general setting where the high-fidelity and low-fidelity models have a dissimilar parameterization both in terms of number of random inputs and their probability distributions, which can be either known in closed form or provided through samples. We derive novel multifidelity Monte Carlo estimators which rely on a shared subspace between the high-fidelity and low-fidelity models where the parameters follow the same probability distribution, i.e., a standard Gaussian. We build the shared space employing normalizing flows to map different probability distributions into a common one, together with linear and nonlinear dimensionality reduction techniques, active subspaces and autoencoders, respectively, which capture the subspaces where the models vary the most. We then compose the existing low-fidelity model with these transformations and construct modified models with an increased correlation with the high-fidelity model, which therefore yield multifidelity Monte Carlo estimators with reduced variance. A series of numerical experiments illustrate the properties and advantages of our approaches.


title: Auditable Algorithms for Approximate Model Counting

abstract: Model counting, or counting the satisfying assignments of a Boolean formula, is a fundamental problem with diverse applications. Given #P-hardness of the problem, developing algorithms for approximate counting is an important research area. Building on the practical success of SAT-solvers, the focus has recently shifted from theory to practical implementations of approximate counting algorithms. This has brought to focus new challenges, such as the design of auditable approximate counters that not only provide an approximation of the model count, but also a certificate that a verifier with limited computational power can use to check if the count is indeed within the promised bounds of approximation. Towards generating certificates, we start by examining the best-known deterministic approximate counting algorithm that uses polynomially many calls to a $\Sigma_2^P$ oracle. We show that this can be audited via a $\Sigma_2^P$ oracle with the query constructed over $n^2 \log^2 n$ variables, where the original formula has $n$ variables. Since $n$ is often large, we ask if the count of variables in the certificate can be reduced -- a crucial question for potential implementation. We show that this is indeed possible with a tradeoff in the counting algorithm's complexity. Specifically, we develop new deterministic approximate counting algorithms that invoke a $\Sigma_3^P$ oracle, but can be certified using a $\Sigma_2^P$ oracle using certificates on far fewer variables: our final algorithm uses only $n \log n$ variables. Our study demonstrates that one can simplify auditing significantly if we allow the counting algorithm to access a slightly more powerful oracle. This shows for the first time how audit complexity can be traded for complexity of approximate counting.


title: On a conjecture on Hodge loci of linear combinations of linear subvarieties

abstract: For each $k \geq 5$ we give a counterexample to a conjecture of Movasati on the dimension of certain Hodge loci of cubic hypersurfaces in $\mathbf{P}^{2k+1}$ containing two $k$-planes intersecting in dimension $k-3$. We give similar examples for Hodge loci of cubic hypersurfaces in $\mathbf{P}^{2k+1}$ containing two $k$-planes intersecting in dimension $k-2$ and for quartic hypersurfaces in $\mathbf{P}^{2k+1}$ containing two $k$-planes intersecting in dimension $k-2$. Moreover, we present new evidence for Movasati's conjecture for the values of $k$ for which our type of counterexamples cannot exist, i.e., for $k=3,4$.


title: SpokesBiz -- an Open Corpus of Conversational Polish

abstract: This paper announces the early release of SpokesBiz, a freely available corpus of conversational Polish developed within the CLARIN-BIZ project and comprising over 650 hours of recordings. The transcribed recordings have been diarized and manually annotated for punctuation and casing. We outline the general structure and content of the corpus, showcasing selected applications in linguistic research, evaluation and improvement of automatic speech recognition (ASR) systems


title: Modeling the extracellular matrix in cell migration and morphogenesis: A guide for the curious biologist

abstract: The extracellular matrix (ECM) is a highly complex structure through which biochemical and mechanical signals are transmitted. In processes of cell migration, the ECM also acts as a scaffold, providing structural support to cells as well as points of potential attachment. Although the ECM is a well-studied structure, its role in many biological processes remains difficult to investigate comprehensively due to its complexity and structural variation within an organism. In tandem with experiments, mathematical models are helpful in refining and testing hypotheses, generating predictions, and exploring conditions outside the scope of experiments. Such models can be combined and calibrated with in vivo and in vitro data to identify critical cell-ECM interactions that drive developmental and homeostatic processes, or the progression of diseases. In this review, we focus on mathematical and computational models of the ECM in processes such as cell migration including cancer metastasis, and in tissue structure and morphogenesis. By highlighting the predictive power of these models, we aim to help bridge the gap between experimental and computational approaches to studying the ECM and to provide guidance on selecting an appropriate model framework to complement corresponding experimental studies.


title: On the Kodaira-Spencer's problem on almost Hermitian $4$-manifolds

abstract: In 1954, Hirzebruch reported a problem posed by Kodaira and Spencer: on compact almost complex manifolds, is the dimension $h^{p,q}_{\bar \partial}$ of the kernel of the Dolbeault Laplacian independent of the choice of almost Hermitian metric? In this paper, we review recent progresses on the original problem and we introduce a similar one: on compact almost complex manifolds, find a generalization of Bott-Chern and Aeppli numbers which is metric-independent. We find a solution to our problem valid on almost K\"ahler $4$-manifolds.


title: Dynamics of a millimeter size drop exposed to MHz-frequency surface acoustic wave in the underlying solid substrate

abstract: We present an experimental, theoretical, and computational study of the spreading of a millimetric silicon oil drop under the excitation of a surface acoustic wave (SAW), traveling in the underlying solid substrate. Our theoretical model, formulated within the long wave approach, dynamically captures the interplay between fluid dynamics and acoustic driving forces, emphasizing Eckart streaming as the dominant mechanism over Schlichting and Rayleigh streaming due to drop thickness. Following an initial deformation phase to accommodate acoustic stress, the drop accelerates to a sustained translation at nearly constant speed, leaving behind a thin wetting layer. This speed is sustained by the quasi-steady shape of the drop's main body, influenced by SAW attenuation. Notably, SAW attenuation becomes significant once the wave reaches the main body of the drop, with weaker effects observed under the air and the micron-thick liquid trail left behind the drop. The translating drop's speed is found to be dependent on the drop size, as well as on the SAW intensity. The drop's steady shape and speed are further informed by analytical consideration of a simplified traveling wave type model, that clarifies contributions from different physical effects. The theoretical results show qualitative and sometimes even quantitative agreement with the experiments, particularly regarding drop height and traveling speed.


title: Easy quantum groups

abstract: A closed subgroup $G\subset_uU_N^+$ is called easy when its associated Tannakian category $C_{kl}=Hom(u^{\otimes k},u^{\otimes l})$ appears from a category of partitions, $C=span(D)$ with $D=(D_{kl})\subset P$, via the standard implementation of partitions as linear maps. The examples abound, and the main known subgroups $G\subset U_N^+$ are either easy, or not far from being easy. We discuss here the basic theory, examples and known classification results for the easy quantum groups $G\subset U_N^+$, as well as various generalizations of the formalism, known as super-easiness theories, and the unification problem for them.


title: Chasing Fairness in Graphs: A GNN Architecture Perspective

abstract: There has been significant progress in improving the performance of graph neural networks (GNNs) through enhancements in graph data, model architecture design, and training strategies. For fairness in graphs, recent studies achieve fair representations and predictions through either graph data pre-processing (e.g., node feature masking, and topology rewiring) or fair training strategies (e.g., regularization, adversarial debiasing, and fair contrastive learning). How to achieve fairness in graphs from the model architecture perspective is less explored. More importantly, GNNs exhibit worse fairness performance compared to multilayer perception since their model architecture (i.e., neighbor aggregation) amplifies biases. To this end, we aim to achieve fairness via a new GNN architecture. We propose \textsf{F}air \textsf{M}essage \textsf{P}assing (FMP) designed within a unified optimization framework for GNNs. Notably, FMP \textit{explicitly} renders sensitive attribute usage in \textit{forward propagation} for node classification task using cross-entropy loss without data pre-processing. In FMP, the aggregation is first adopted to utilize neighbors' information and then the bias mitigation step explicitly pushes demographic group node presentation centers together. In this way, FMP scheme can aggregate useful information from neighbors and mitigate bias to achieve better fairness and prediction tradeoff performance. Experiments on node classification tasks demonstrate that the proposed FMP outperforms several baselines in terms of fairness and accuracy on three real-world datasets. The code is available in {\url{https://github.com/zhimengj0326/FMP}}.


title: Hilton-Milnor's theorem in $\infty$-topoi

abstract: In this note we show that the classical theorem of Hilton-Milnor on finite wedges of suspension spaces remains valid in any $\infty$-topos. Our result relies on a version of James' splitting and uses only basic constructions native to any model of $\infty$-categories.


title: Vinberg's T-Algebras. From Exceptional Periodicity to Black Hole Entropy

abstract: We introduce the so-called Magic Star (MS) projection within the root lattice of finite-dimensional exceptional Lie algebras, and relate it to rank-3 simple and semi-simple Jordan algebras. By relying on the Bott periodicity of reality and conjugacy properties of spinor representations, we present the so-called Exceptional Periodicity (EP) algebras, which are finite-dimensional algebras, violating the Jacobi identity, and providing analternative with respect to Kac-Moody infinite-dimensional Lie algebras. Remarkably, also EP algebras can be characterized in terms of a MS projection, exploiting special Vinberg T-algebras, a class of generalized Hermitian matrix algebras introduced by Vinberg in the '60s within his theory of homogeneous convex cones. As physical applications, we highlight the role of the invariant norm of special Vinberg T-algebras in Maxwell-Einstein-scalar theories in 5 space-time dimensions, in which the Bekenstein-Hawking entropy of extremal black strings can be expressed in terms of the cubic polynomial norm of the T-algebras.


title: Frequency-resolved Purcell effect for the dissipative generation of steady-state entanglement

abstract: We report a driven-dissipative mechanism to generate stationary entangled $W$ states among strongly-interacting quantum emitters placed within a cavity. Driving the ensemble into the highest energy state -- whether coherently or incoherently -- enables a subsequent cavity-enhanced decay into an entangled steady state consisting of a single de-excitation shared coherently among all emitters, i.e., a $W$ state, well known for its robustness against qubit loss. The non-harmonic energy structure of the interacting ensemble allows this transition to be resonantly selected by the cavity, while quenching subsequent off-resonant decays. Evidence of this purely dissipative mechanism should be observable in state-of-the-art cavity QED systems in the solid-state, enabling new prospects for the scalable stabilization of quantum states in dissipative quantum platforms.


title: Fluorescent Fe K line emission of gamma Cas stars I. Do gamma Cas stars host propelling neutron stars?

abstract: Gamma~Cas stars are early-type Be stars that exhibit an unusually hard and bright thermal X-ray emission. One of the proposed scenarios to explain these properties postulates the existence of a neutron star companion in the propeller stage, during which the magnetosphere of a rapidly rotating neutron star repels infalling material. To test this model, we examined the fluorescent Fe K$\alpha$ emission line at $\sim 6.4$\,keV in the X-ray spectra of $\gamma$~Cas stars, which offers a powerful diagnostic of both the primary source of hard X-rays and the reprocessing material. We computed synthetic line profiles of the fluorescent Fe K$\alpha$ emission line in the framework of the propelling neutron star scenario. Two reservoirs of material contribute to the fluorescence in this case: the Be circumstellar decretion disk and a shell of cool material that surrounds the shell of X-ray-emitting plasma around the putative propelling neutron star. We analysed the synthetic line profiles and expected equivalent widths of the lines for three well-studied $\gamma$~Cas stars. The predicted line strengths fall short of the observed values by at least an order of magnitude. Pushing the model parameters to reproduce the observed line strengths led to column densities towards the primary X-ray source that exceed the observationally determined values by typically a factor of 20, and would further imply a higher X-ray luminosity than observed. The strengths of the observed Fe K$\alpha$ fluorescent emission lines in $\gamma$~Cas stars are inconsistent with the expected properties of a propeller scenario as proposed in the literature.


title: Thermal rectification with topological edge states

abstract: Thermal rectification devices can be important for various thermal management applications. For oscillator chains, thermal rectification was observed when masses are distributed non-uniformly. Leaning on the importance of topological materials, we consider here a simple vibrational topological system, the binary isotope superlattice (BISL). We show that the BISL can be mapped exactly onto the Su-Schrieffer-Heeger (SSH) model, which has different topological phases, including topological edge sates. For the case, where there is a single topological edge state, we show that the BISL exhibits thermal rectification in the presence of a small nonlinear term. Thermal transport is computed using temperature reservoirs connected to both extremities. These results have implications for other classes of topological phonon systems.


title: Perturbed cone theorems for proper harmonic maps

abstract: Inspired by the halfspace theorem for minimal surfaces in $\mathbb{R}^3$ of Hoffman-Meeks, the halfspace theorem of Rodriguez-Rosenberg, and the cone theorem of Omori, we derive new non-existence results for proper harmonic maps into perturbed cones in $\mathbb{R}^n$, horospheres in $\mathbb{H}^n$ and also into perturbed Riemannian cones. The technical tool in use is an extension of the foliated maximum principle appearing in Assimos-Jost to the non-compact setting.


title: Tracing baryon and electric charge transport in isobar collisions

abstract: It is of fundamental interest to understand the carrier of conserved quantum charges within protons and nuclei at high energy. Preliminary data from isobar collisions at RHIC reveal a scaled net-baryon to net-electric charge ratio ($B/\Delta Q \times \Delta Z/A$) at mid-rapidity between 1.2 and 2, consistent with string junction model predictions. Here, we compute the initial stage scaled net-baryon to net-electric charge ratio for isobar collisions. Our model incorporates a realization of the string junction model and models the nuclear structure. Our predictions identify the baseline expectations for such measurement and quantify the impact of the nuclear structure.


title: An Algebraic Roadmap of Particle Theories, Part I: General construction

abstract: It is a curious fact that our most well-studied BSM theories can inform us about the Standard Model itself. Just over a decade ago, [1], Baez and Huerta explained how the Standard Model's gauge group can be seen to coincide with the intersection of Georgi and Glashow's SU(5), and Pati and Salam's $SU(4)\times SU(2)\times SU(2)$, inside Spin(10). More recently, [2], [3], it was shown how (up to a factor of B-L) the Spin(10) model, the Pati-Salam model, the Left-Right Symmetric model, the Standard Model pre-Higgs mechanism, and the Standard Model post-Higgs mechanism are interlinked via a sequence of division algebraic reflections. Between these three papers, [1], [2], [3], are six theories that have been studied extensively by particle physicists. In this article, we demonstrate how the full set of six familiar particle models may be laid out in one connected algebraic particle roadmap. The inclusion of a quaternionic reflection within the network further differentiates $W^{\pm}$ bosons from the $Z^0$ boson in comparison to the Standard Model. It may introduce subtle new considerations for the phenomenology of electroweak symmetry breaking.


title: A Statistical Study of Soft X-ray Flares on Solar-type Stars

abstract: The statistical characteristic of stellar flares at optical bands has received an extensive study, but it remains to be studied at soft X-ray bands, in particular for solar-type stars. Here, we present a statistical study of soft X-ray flares on solar-type stars, which can help understand multi-wavelength behaviors of stellar flares. We mainly use Chandra Source Catalog Release 2.0, which includes a number of flaring stars with denoted variability, and Gaia Data Release 3, which includes necessary information for classifying stars. We also develop a set of methods for identifying and classifying stellar soft X-ray flares and estimating their properties. A detailed statistical investigation for 129 flare samples on 103 nearby solar-type stars as selected yields the following main results. (1) The flare energy emitted at the soft X-ray band in our sample ranges from $\sim 10^{33}$ to $\sim 10^{37} \ \mathrm{erg}$, and the majority of them are superflares with the most energetic one having energy of $6.0_{-4.7}^{+3.2} \times 10^{37} \ \mathrm{erg}$. (2) The flare duration is related to its energy as formulated by $T_\mathrm{duration,SXR} \propto E_\mathrm{flare,SXR}^{\ 0.201 \pm 0.024}$, which is different from those derived at optical and NIR bands, indicating distinct radiation mechanisms at different bands. (3) The frequency distribution of stellar flares as a function of energy is formulated as $\mathrm{d} N_\mathrm{flare} / \mathrm{d} E_\mathrm{flare,SXR} \propto E_\mathrm{flare,SXR}^{\ -1.77}$, which is similar to the results found at other bands and on other types of stars, indicating that the energy emitted at the soft X-ray band could be a constant fraction of the full-band bolometric energy.


title: Mixture of Cluster-conditional LoRA Experts for Vision-language Instruction Tuning

abstract: Instruction tuning of Large Vision-language Models (LVLMs) has revolutionized the development of versatile models with zero-shot generalization across a wide range of downstream vision-language tasks. However, the diversity of training tasks of different sources and formats would lead to inevitable task conflicts, where different tasks conflict for the same set of model parameters, resulting in sub-optimal instructionfollowing abilities. To address that, we propose the Mixture of Clusterconditional LoRA Experts (MoCLE), a novel Mixture of Experts (MoE) architecture designed to activate the task-customized model parameters based on the instruction clusters. A separate universal expert is further incorporated to improve generalization capabilities of MoCLE for novel instructions. Extensive experiments on 11 zero-shot tasks demonstrate the effectiveness of MoCLE.


title: The stellar mass function of quiescent galaxies in 2 < z < 2.5 protoclusters

abstract: We present an analysis of the galaxy stellar mass function (SMF) of 14 known protoclusters between $2.0 < z < 2.5$ in the COSMOS field, down to a mass limit of $10^{9.5}$ M$_{\odot}$. We use existing photometric redshifts with a statistical background subtraction, and consider star-forming and quiescent galaxies identified from $(NUV - r)$ and $(r - J)$ colours separately. Our fiducial sample includes galaxies within 1 Mpc of the cluster centres. The shape of the protocluster SMF of star-forming galaxies is indistinguishable from that of the general field at this redshift. Quiescent galaxies, however, show a flatter SMF than in the field, with an upturn at low mass, though this is only significant at $\sim 2\sigma$. There is no strong evidence for a dominant population of quiescent galaxies at any mass, with a fraction of $< 15\%$ at $1\sigma$ confidence for galaxies with log$M_{\ast}/M_{\odot} < 10.5$. We compare our results with a sample of galaxies groups at $1 < z < 1.5$, and demonstrate that a significant amount of environmental quenching must take place between these epochs, increasing the relative abundance of high-mass ($\rm M > 10^{10.5} M_{\odot}$) quiescent galaxies by a factor of $\gtrsim$ 2. However, we find that at lower masses ($\rm M < 10^{10.5} M_{\odot}$), no additional environmental quenching is required.


title: Blockchain-Based Identity Authentication Oriented to Multi-Cluster UAV Networking

abstract: Unmanned Aerial Vehicle (UAV) networking is increasingly used in field environments such as power inspection, agricultural plant protection, and emergency rescue. To guarantee UAV networking security, UAV identity authentication attracts wide attention, especially in the field environment without perfect infrastructure. Some blockchain-based UAV identity authentication solutions are proposed to establish decentralized and trusted authentication systems without relying on infrastructure. However, these solutions do not support disconnected UAV reconnection or even disband a cluster directly after its head UAV disconnection, which compromises cluster robustness and task result integrity. In this paper, we propose a blockchain-based identity authentication solution oriented to multi-cluster UAV networking with a UAV disconnection mechanism and a task result backup mechanism. Specifically, we build a blockchain maintained by head UAVs of all clusters, managing identity information to guarantee the security of decentralized identity management. The UAV disconnection mechanism permits a verified distributed UAV reconnection to ensure the robustness of the UAV cluster, and on this basis, the task result backup mechanism ensures the integrity of the task results stored in a cluster even any UAV disconnection. Finally, extensive experimental results prove the superiority of our solutions in terms of robustness, integrity, delay, and energy consumption.


title: Discontinuity in RG Flows Across Dimensions: Entanglement, Anomaly Coefficients and Geometry

abstract: We study the entanglement entropy associated with a holographic RG flow from $\textrm{AdS}_7$ to $\textrm{AdS}_{4} \times \mathbb{H}_3$, where $\mathbb{H}_3$ is a $3$-dimensional hyperbolic manifold with curvature $\kappa$. The dual six-dimensional RG flow is disconnected from Lorentz-invariant flows. In this context we address various notions of central charges and identify a monotonic candidate $c$-function that captures IR aspects of the flow. The UV behavior of the holographic entanglement entropy and, in particular its universal term, display an interesting dependence on the curvature, $\kappa$. We then contrast our holographic results with existing field theory computations in six dimensions and find a series of new corrections in curvature to the universal term in the entanglement entropy.


title: Visual AI and Linguistic Intelligence Through Steerability and Composability

abstract: This study explores the capabilities of multimodal large language models (LLMs) in handling challenging multistep tasks that integrate language and vision, focusing on model steerability, composability, and the application of long-term memory and context understanding. The problem addressed is the LLM's ability (Nov 2023 GPT-4 Vision Preview) to manage tasks that require synthesizing visual and textual information, especially where stepwise instructions and sequential logic are paramount. The research presents a series of 14 creatively and constructively diverse tasks, ranging from AI Lego Designing to AI Satellite Image Analysis, designed to test the limits of current LLMs in contexts that previously proved difficult without extensive memory and contextual understanding. Key findings from evaluating 800 guided dialogs include notable disparities in task completion difficulty. For instance, 'Image to Ingredient AI Bartender' (Low difficulty) contrasted sharply with 'AI Game Self-Player' (High difficulty), highlighting the LLM's varying proficiency in processing complex visual data and generating coherent instructions. Tasks such as 'AI Genetic Programmer' and 'AI Negotiator' showed high completion difficulty, emphasizing challenges in maintaining context over multiple steps. The results underscore the importance of developing LLMs that combine long-term memory and contextual awareness to mimic human-like thought processes in complex problem-solving scenarios.


title: Interference Effects in $\mathbf{gg \to H \to Z \gamma}$ Beyond Leading Order

abstract: The ATLAS and CMS collaborations at the LHC have recently announced evidence for the rare Higgs boson decay into a $Z$ boson and a photon. We analyze the interference between the process $gg\! \to \! H \! \to \! Z \gamma$ induced by loops of heavy particles, which is by far the dominant contribution to the signal, and the continuum $gg \to Z \gamma$ QCD background process mediated by light quark loops. This interference modifies the event yield, the resonance line-shape and the apparent mass of the Higgs boson. We calculate the radiative corrections to this interference beyond the leading-order approximation in perturbative QCD and find that, while differing numerically from the corresponding effects on the more studied $gg \! \to \! \gamma \gamma$ signal, they are generally rather small. As such, they do not impact significantly the interpretation of the present measurements of the $H \to Z \gamma$ decay mode.


title: Input Compression with Positional Consistency for Efficient Training and Inference of Transformer Neural Networks

abstract: Transformers have rapidly increased in popularity in recent years, achieving state-of-the-art performance in processing text, images, audio and video. However, Transformers present large computational requirements for both training and inference, and are prone to overfitting during training. To address these challenges, we present Input Compression with Positional Consistency (ICPC), a new data augmentation method that, unlike prior augmentation techniques, simultaneously improves both generalization and training efficiency. ICPC applies varying levels of compression to each training sample in each epoch. This leads to smaller input sequences being processed by the Transformer, and hence faster training, while also alleviating overfitting by presenting each input with different compression levels. We introduce a consistency-aware position selection method in ICPC that enables accurate processing of compressed inputs without any changes to the underlying Transformer architecture. We detail compression-based augmentation methods for four different modalities -- insignificant word pruning for text, resolution modulation for images, spatio-temporal resolution modulation for videos, and spectogram size modulation for audio. ICPC also enables efficient variable-effort inference, where samples are first inferred at high compression levels, and progressively re-evaluated with lower compression for more challenging inputs. On 9 diverse tasks spanning 4 different modalities, ICPC improves accuracy by up to 1%, while also accelerating training and inference by up to 2.9X and 2.6X, respectively. Code is available at https://github.com/amrnag/ICPC.


title: Quantum Equation of Motion with Orbital Optimization for Computing Molecular Properties in Near-Term Quantum Computing

abstract: Determining the properties of molecules and materials is one of the premier applications of quantum computing. A major question in the field is how to use imperfect near-term quantum computers to solve problems of practical value. Inspired by the recently developed variants of the quantum counterpart of the equation-of-motion (qEOM) approach and the orbital-optimized variational quantum eigensolver (oo-VQE), we present a quantum algorithm (oo-VQE-qEOM) for the calculation of molecular properties by computing expectation values on a quantum computer. We perform noise-free quantum simulations of BeH$_2$ in the series of STO-3G/6-31G/6-31G* basis sets and of H$_4$ and H$_2$O in 6-31G using an active space of four electrons and four spatial orbitals (8 qubits) to evaluate excitation energies, electronic absorption, and, for twisted H$_4$, circular dichroism spectra. We demonstrate that the proposed algorithm can reproduce the results of conventional classical CASSCF calculations for these molecular systems.


title: Minimal massive supergravity and new theories of massive gravity

abstract: We present an action for minimal massive gravity (MMG) in three dimensions in terms of a dreibein and an independent spin connection. Furthermore, the construction provides an action principle for an infinite family of so-called third-way consistent generalizations of the three-dimensional Einstein field equations, including exotic massive gravity and new higher-order generalizations. It allows to systematically construct the matter couplings for these models, including the couplings to fermions, depending on the spin connection. In particular, we construct different supersymmetric extensions of MMG, and derive their second order fermionic field equations. This establishes a new class of three-dimensional supergravity theories and we discuss their limit to topological massive supergravity. Finally, we identify the landscape of (A)dS vacua of the supersymmetric models. We analyze the spectrum and the unitarity properties of these vacua. We recover the known AdS vacua of MMG which are bulk and boundary unitary.


title: On Combinatorial Network Flows Algorithms and Circuit Augmentation for Pseudoflows

abstract: There is a wealth of combinatorial algorithms for classical min-cost flow problems and their simpler variants like max flow or shortest path problems. It is well-known that many of these algorithms are related to the Simplex method and the more general circuit augmentation schemes: prime examples are the network Simplex method, a refinement of the primal Simplex method, and min-mean cycle canceling, which corresponds to a steepest-descent circuit augmentation scheme. We are interested in a deeper understanding of the relationship between circuit augmentation and combinatorial network flows algorithms. To this end, we generalize from the consideration of primal or dual flows to so-called pseudoflows, which adhere to arc capacities but allow for a violation of flow balance. We introduce `pseudoflow polyhedra,' in which slack variables are used to quantify this violation, and characterize their circuits. This enables the study of combinatorial network flows algorithms in view of the walks that they trace in these polyhedra, and in view of the pivot rules for the steps. In doing so, we provide an `umbrella,' a general framework, that captures several algorithms. We show that the Successive Shortest Path Algorithm for min-cost flow problems, the Shortest Augmenting Path Algorithm for max flow problems, and the Preflow-Push algorithm for max flow problems lead to (non-edge) circuit walks in these polyhedra. The former two are replicated by circuit augmentation schemes for simple pivot rules. Further, we show that the Hungarian Method leads to an edge walk and is replicated, equivalently, as a circuit augmentation scheme or a primal Simplex run for a simple pivot rule.


title: JWST Reveals a Surprisingly High Fraction of Galaxies Being Spiral-like at $0.5\leq z\leq4$

abstract: Spiral arms are one of the most important features used to classify the morphology of local galaxies. The cosmic epoch when spiral arms first appeared contains essential clues to the evolution of disk galaxies. In this letter, we used James Webb Space Telescope (JWST) images from the Cosmic Evolution Early Release Science Survey to visually identify spiral galaxies with redshift $0.5\leq z\leq4$ and stellar mass $\geq10^{10}\; M_\odot$. Out of 873 galaxies, 216 were found to have a spiral structure. The spiral galaxies in our sample have higher star formation rates (SFRs) and larger sizes than non-spiral galaxies. We found the observed spiral fraction decreases from 48% at $z\sim0.75$ to 8% at $z\sim2.75$. These fractions are higher than the fractions observed with the Hubble Space Telescope (HST). We even detect possible spiral-like features at redshifts $z>3$. We artificially redshifted low redshift galaxies to high redshifts and re-inspected them to evaluate observational effects. By varying the input spiral fraction of the redshifted sample, we found that the input fraction of $\sim35$% matches the observed fraction at $z=2-3$ the best. We are able to rule out spiral fractions being $<20$% (2$\sigma$) and $<10$% (3$\sigma$) for real galaxies at $z\sim3$. This fraction is surprisingly high and implies that the formation of spiral arms, as well as disks, was earlier in the universe.


title: Jordan meets Freudenthal. A Black Hole Exceptional Story

abstract: Within the extremal black hole attractors arising in ungauged $\mathcal{N}\geqslant 2$-extended Maxwell Einstein supergravity theories in $3+1$ space-time dimensions, we provide an overview of the stratification of the electric-magnetic charge representation space into "large" orbits and related "moduli spaces", under the action of the (continuous limit of the) non-compact $U$-duality Lie group. While each "large" orbit of the $U$-duality supports a class of attractors, the corresponding "moduli space" is the proper subspace of the scalar manifold spanned by those scalar fields on which the Attractor Mechanism is inactive. We present the case study concerning $\mathcal{N}=2$ supergravity theories with symmetric vector multiplets' scalar manifold, which in all cases (with the exception of the minimally coupled models) have the electric-magnetic charge representation of $U$-duality fitting into a reduced Freudenthal triple system over a cubic (simple or semi-simple) Jordan algebra.


title: vTrain: A Simulation Framework for Evaluating Cost-effective and Compute-optimal Large Language Model Training

abstract: As large language models (LLMs) become widespread in various application domains, a critical challenge the AI community is facing is how to train these large AI models in a cost-effective manner. Existing LLM training plans typically employ a heuristic based parallel training strategy which is based on empirical observations rather than grounded upon a thorough examination of the search space of LLM parallelization. Such limitation renders existing systems to leave significant performance left on the table, wasting millions of dollars worth of training cost. This paper presents our profiling-driven simulator called vTrain, providing AI practitioners a fast yet accurate software framework to determine an efficient and cost-effective LLM training system configuration. We demonstrate vTrain's practicality through several case studies, e.g., effectively evaluating optimal training parallelization strategies that balances training time and its associated training cost, efficient multi-tenant GPU cluster schedulers targeting multiple LLM training jobs, and determining a compute-optimal LLM model architecture given a fixed compute budget.


title: Recursive Camera Painting: A Method for Real-Time Painterly Renderings of 3D Scenes

abstract: In this work, we present the recursive camera-painting approach to obtain painterly smudging in real-time rendering applications. We have implemented recursive camera painting as both a GPU-based ray-tracing and in a Virtual Reality game environment. Using this approach, we can obtain dynamic 3D Paintings in real-time. In a camera painting, each pixel has a separate associated camera whose parameters are computed from a corresponding image of the same size. In recursive camera painting, we use the rendered images to compute new camera parameters. When we apply this process a few times, it creates painterly images that can be viewed as real-time 3D dynamic paintings. These visual results are not surprising since multi-view techniques help to obtain painterly effects.


title: The hybrid cosmology in the scalar-tensor representation of $f(\mathcal{G},T)$ gravity

abstract: In this work, the $f(\mathcal{G},T)$ theory of gravity is recast in terms of the $\phi$ and $\psi$ fields within the scalar-tensor formulation, where $\mathcal{G}$ is the Gauss-Bonnet term and $T$ denotes the trace of the energy-momentum tensor. The general aspects of the introduced reformulation are discussed and the reconstruction of the cosmological scenarios is presented, focusing on the so-called hybrid evolution. As a result, the scalar-tensor $f(\mathcal{G},T)$ theory is successfully reconstructed for the early and late time approximations with the corresponding potentials. The procedure of recovering the $f(\mathcal{G},T)$ theory in the original formulation is performed for the late time evolution and a specific quadratic potential. The scalar-tensor formulation introduced herein not only facilitates the description of various cosmic phases but also serves as a viable alternative portrayal of the $f(\mathcal{G},T)$ gravity which can be viewed as an extension of the well-established scalar Einstein-Gauss-Bonnet gravity.


title: Celestial Gluon Amplitudes from the Outside In

abstract: We show that, given a two-dimensional realization of the celestial OPE in self-dual Yang-Mills, we can find a scalar source around which scattering amplitudes replicate correlation functions computed from the 2D 'gluon' operators in a limit where a dynamic massless scalar decouples. We derive conditions on the two-dimensional three-point correlation function so that such a source exists and give two particular examples of this construction, one in which gluons are constructed from vertex operators in the semiclassical limit of Liouville theory and another in which the soft gluons arise from generalized free fields. Finally, we identify a bulk dual to the level of the boundary Kac-Moody algebra and discuss moving beyond the decoupling limit.


title: Global sections of equivariant line bundles on the $p$-adic upper half plane

abstract: Let $F$ be a finite extension of $\mathbb{Q}_p$, let $\Omega_F$ be Drinfeld's upper half-plane over $F$ and let $G^0$ the subgroup of $GL_2(F)$ consisting of elements whose determinant has norm $1$. Let $\mathscr{L}$ be a torsion $G^0$-equivariant line bundle with connection on $\Omega_F$. We show that the strong dual of $\mathscr{L}(\Omega_F)$ is an admissible locally $F$-analytic representation of $G^0$ of topological length at most $2$. It is topologically irreducible if and only if the underlying connection on $\mathscr{L}$ is non-trivial. We give an explicit formula for the length of the strong dual of the space of globally-defined rigid analytic functions on a $G^0$-equivariant finite \'etale rigid analytic covering of $\Omega_F$ with abelian Galois group as an admissible locally $F$-analytic representation of $G^0$.


title: A change-point random partition model for large spatio-temporal datasets

abstract: Spatio-temporal areal data can be seen as a collection of time series which are spatially correlated, according to a specific neighboring structure. Motivated by a dataset on mobile phone usage in the Metropolitan area of Milan, Italy, we propose a semi-parametric hierarchical Bayesian model allowing for time-varying as well as spatial model-based clustering. To accommodate for changing patterns over work hours and weekdays/weekends, we incorporate a temporal change-point component that allows the specification of different hierarchical structures across time points. The model features a random partition prior that incorporates the desired spatial features and encourages co-clustering based on areal proximity. We explore properties of the model by way of extensive simulation studies from which we collect valuable information. Finally, we discuss the application to the motivating data, where the main goal is to spatially cluster population patterns of mobile phone usage.


title: Gauged permutation invariant matrix quantum mechanics: Path Integrals

abstract: We give a path integral construction of the quantum mechanical partition function for gauged finite groups. Our construction gives the quantization of a system of $d$, $N\times N$ matrices invariant under the adjoint action of the symmetric group $S_N$. The approach is general to any discrete group. For a system of harmonic oscillators, i.e. for the non-interacting case, the partition function is given by the Molien-Weyl formula times the zero-point energy contribution. We further generalise the result to a system of non-square and complex matrices transforming under arbitrary representations of the gauge group.


title: Gauged permutation invariant matrix quantum mechanics: Partition functions

abstract: The Hilbert spaces of matrix quantum mechanical systems with $N \times N$ matrix degrees of freedom $ X $ have been analysed recently in terms of $S_N$ symmetric group elements $U$ acting as $X \rightarrow U X U^T $. Solvable models have been constructed uncovering partition algebras as hidden symmetries of these systems. The solvable models include an 11-dimensional space of matrix harmonic oscillators, the simplest of which is the standard matrix harmonic oscillator with $U(N)$ symmetry. The permutation symmetry is realised as gauge symmetry in a path integral formulation in a companion paper. With the simplest matrix oscillator Hamiltonian subject to gauge permutation symmetry, we use the known result for the micro-canonical partition function to derive the canonical partition function. It is expressed as a sum over partitions of $N$ of products of factors which depend on elementary number-theoretic properties of the partitions, notably the least common multiples and greatest common divisors of pairs of parts appearing in the partition. This formula is recovered using the Molien-Weyl formula, which we review for convenience. The Molien-Weyl formula is then used to generalise the formula for the canonical partition function to the 11-parameter permutation invariant matrix harmonic oscillator.


title: Virtual Reality-Assisted Physiotherapy for Visuospatial Neglect Rehabilitation: A Proof-of-Concept Study

abstract: This study explores a VR-based intervention for Visuospatial neglect (VSN), a post-stroke condition. It aims to develop a VR task utilizing interactive visual-audio cues to improve sensory-motor training and assess its impact on VSN patients' engagement and performance. Collaboratively designed with physiotherapists, the VR task uses directional and auditory stimuli to alert and direct patients, tested over 12 sessions with two individuals. Results show a consistent decrease in task completion variability and positive patient feedback, highlighting the VR task's potential for enhancing engagement and suggesting its feasibility in rehabilitation. The study underlines the significance of collaborative design in healthcare technology and advocates for further research with a larger sample size to confirm the benefits of VR in VSN treatment, as well as its applicability to other multimodal disorders.


title: New Classes of the Greedy-Applicable Arm Feature Distributions in the Sparse Linear Bandit Problem

abstract: We consider the sparse contextual bandit problem where arm feature affects reward through the inner product of sparse parameters. Recent studies have developed sparsity-agnostic algorithms based on the greedy arm selection policy. However, the analysis of these algorithms requires strong assumptions on the arm feature distribution to ensure that the greedily selected samples are sufficiently diverse; One of the most common assumptions, relaxed symmetry, imposes approximate origin-symmetry on the distribution, which cannot allow distributions that has origin-asymmetric support. In this paper, we show that the greedy algorithm is applicable to a wider range of the arm feature distributions from two aspects. Firstly, we show that a mixture distribution that has a greedy-applicable component is also greedy-applicable. Second, we propose new distribution classes, related to Gaussian mixture, discrete, and radial distribution, for which the sample diversity is guaranteed. The proposed classes can describe distributions with origin-asymmetric support and, in conjunction with the first claim, provide theoretical guarantees of the greedy policy for a very wide range of the arm feature distributions.


title: Introducing the concept of the Widom line in the QCD phase diagram

abstract: Critical phenomena emerging from the critical end point of a first-order transition are ubiquitous in nature. Here we bring the concept of a supercritical crossover, the Widom line, initially developed in the context of fluids, into the interacting matter described by quantum chromodynamics (QCD). We show that the existence of the putative critical end point between hadron gas and quark-gluon plasma in the temperature versus chemical potential of the QCD phase diagram implies the existence of a Widom line emerging from it in the supercritical region. We survey the thermodynamic anomalies already identified in simplified theoretical models of QCD exhibiting a critical end point, to show that they can be interpreted in terms of a Widom line. Then we suggest possible directions where the Widom line concept could provide new light on the QCD phase diagram.


title: Inferring geometrical dynamics of cell nucleus translocation

abstract: The ability of eukaryotic cells to squeeze through constrictions is limited by the stiffness of their large and rigid nucleus. However, migrating cells are often able to overcome this limitation and pass through constrictions much smaller than their nucleus, a mechanism that is not yet understood. This is what we address here through a data-driven approach using microfluidic devices where cells migrate through controlled narrow spaces of sizes comparable to the ones encountered in physiological situations. Stochastic Force Inference is applied to experimental nuclear trajectories and nuclear shape descriptors, resulting in equations that effectively describe this phenomenon of nuclear translocation. By employing a model where the channel geometry is an explicit parameter and by training it over experimental data with different sizes of constrictions, we ensure that the resulting equations are predictive to other geometries. Altogether, the approach developed here paves the way for a mechanistic and quantitative description of dynamical cell complexity during its motility.


title: On Alternating-Time Temporal Logic, Hyperproperties, and Strategy Sharing

abstract: Alternating-time temporal logic (ATL$^*$) is a well-established framework for formal reasoning about multi-agent systems. However, while ATL$^*$ can reason about the strategic ability of agents (e.g., some coalition $A$ can ensure that a goal is reached eventually), we cannot compare multiple strategic interactions, nor can we require multiple agents to follow the same strategy. For example, we cannot state that coalition $A$ can reach a goal sooner (or more often) than some other coalition $A'$. In this paper, we propose HyperATLS$^*_S$, an extension of ATL$^*$ in which we can (1) compare the outcome of multiple strategic interactions w.r.t. a hyperproperty, i.e., a property that refers to multiple paths at the same time, and (2) enforce that some agents share the same strategy. We show that HyperATL$^*_S$ is a rich specification language that captures important AI-related properties that were out of reach of existing logics. We prove that model checking of HyperATL$^*_S$ on concurrent game structures is decidable. We implement our model-checking algorithm in a tool we call HyMASMC and evaluate it on a range of benchmarks.


title: Towards Automatic Support of Software Model Evolution with Large Language~Models

abstract: Modeling structure and behavior of software systems plays a crucial role, in various areas of software engineering. As with other software engineering artifacts, software models are subject to evolution. Supporting modelers in evolving models by model completion facilities and providing high-level edit operations such as frequently occurring editing patterns is still an open problem. Recently, large language models (i.e., generative neural networks) have garnered significant attention in various research areas, including software engineering. In this paper, we explore the potential of large language models in supporting the evolution of software models in software engineering. We propose an approach that utilizes large language models for model completion and discovering editing patterns in model histories of software systems. Through controlled experiments using simulated model repositories, we conduct an evaluation of the potential of large language models for these two tasks. We have found that large language models are indeed a promising technology for supporting software model evolution, and that it is worth investigating further in the area of software model evolution.


title: PNG-UNITsims: Halo clustering response to primordial non-Gaussianities as a function of mass

abstract: We present the largest full N-body simulation to date with local primordial non-Gaussianities (L-PNG), the \textsc{PNG-UNITsim}. It tracks the evolution of $4096^3$ particles within a periodic box with $L_{\rm box} = 1 \; h^{-1}\,{\rm Gpc}$, leading to a mass resolution of $m_{p} = 1.24\times 10^{9}\; h^{-1}\,M_\odot$. This is enough to resolve galaxies targeted by stage-IV spectroscopic surveys. The \textsc{PNG-UNIT} has \textit{Fixed} initial conditions whose phases are also \textit{Matched} to the pre-existing \textsc{UNIT} simulation. These two features in the simulations reduce our uncertainty significantly so we use 100 \textsc{FastPM} mocks to estimate this reduction. The amplitude of the non-Gaussianities used to set the initial conditions of this new simulation is $f_{\rm NL}^{\rm local} = 100$. In this first study, we use mass selected dark matter haloes from the \textsc{PNG-UNIT} simulation to constrain the local PNG parameters. PNG induce a scale dependent bias, parameterised through \bp or $p$, which might depend on the type of cosmological tracer. Those cases when $p=1$ are referred to as the {\it universality relation}. We measure $p$ as a function of the halo mass. Haloes with masses between $1\times 10^{12}$ and $2\times 10^{13} \, h^{-1} M_\odot$ are well described by the {\it universality relation}. For haloes with masses between $2\times 10^{10}$ and $1\times 10^{12} \, h^{-1} M_\odot$ we find that $p<1$ at $3\sigma$. Combining all the mass bins, we find $p$ consistent with a value of $0.955\pm0.013$, which is $3\sigma$ away from \textit{universality}, as low mass haloes are more numerous. We also study the effect of using priors on $p$ when constraining $f_{\rm NL}$. Using the values we obtain for $b_\phi$ as priors, we forecast that a DESI-like (stage-IV) survey will be able to constrain $f_{\rm NL}$ better than if the universality relation is assumed.


title: On partial rigidity of $\mathcal{S}$-adic subshifts

abstract: We develop combinatorial tools to study partial rigidity within the class of minimal $\mathcal{S}$-adic subshifts. By leveraging the combinatorial data of well-chosen Kakutani-Rokhlin partitions, we establish a necessary and sufficient condition for partial rigidity. Additionally, we provide an explicit expression to compute the partial rigidity rate and an associated partial rigidity sequence. As applications, we compute the partial rigidity rate for a variety of constant length substitution subshifts, such as the Thue-Morse subshift, where we determine a partial rigidity rate of 2/3. We also exhibit non-rigid substitution subshifts with partial rigidity rates arbitrarily close to 1 and as a consequence, using products of the aforementioned substitutions, we obtain that any number in $[0, 1]$ is the partial rigidity rate of a system.


title: Central Limit Theorems for Smooth Optimal Transport Maps

abstract: One of the central objects in the theory of optimal transport is the Brenier map: the unique monotone transformation which pushes forward an absolutely continuous probability law onto any other given law. A line of recent work has analyzed $L^2$ convergence rates of plugin estimators of Brenier maps, which are defined as the Brenier map between density estimators of the underlying distributions. In this work, we show that such estimators satisfy a pointwise central limit theorem when the underlying laws are supported on the flat torus of dimension $d \geq 3$. We also derive a negative result, showing that these estimators do not converge weakly in $L^2$ when the dimension is sufficiently large. Our proofs hinge upon a quantitative linearization of the Monge-Amp\`ere equation, which may be of independent interest. This result allows us to reduce our problem to that of deriving limit laws for the solution of a uniformly elliptic partial differential equation with a stochastic right-hand side, subject to periodic boundary conditions.


title: Hubble tension as a window on the gravitation of the dark matter sector: Exploration of a family of models

abstract: A family of simple and minimal extensions of the standard cosmological $\Lambda$CDM model in which dark matter experiences an additional long-range scalar interaction is demonstrated to alleviate the long lasting Hubble-tension while letting primordial nucleosynthesis predictions unaffected and passing by construction all current local tests of general relativity. This article describes their theoretical formulation and their implications for dark matter. Then, it investigates their cosmological signatures, both at the background and perturbation levels. A detailed comparison to astrophysical data is performed to discuss their ability to fit existing data. A thorough discussion of the complementarity of the low- and high-redshift data and on their constraining power highlights how these models improve the predictions of the $\Lambda$CDM model whatever the combination of datasets used and why they can potentially resolve the Hubble tension. Being fully predictive in any environment, they pave the way to a better understanding of gravity in the dark matter sector.


title: A strongly degenerate migration-consumption model in domains of arbitrary dimension

abstract: In a smoothly bounded convex domain $\Omega\subset R^n$ with $n\ge 1$, a no-flux initial-boundary value problem for \[ \left\{ \begin{array}{l} u_t=\Delta \big(u\phi(v)\big), v_t=\Delta v-uv, \end{array} \right. \] is considered under the assumption that near the origin, the function $\phi$ suitably generalizes the prototype given by \[ \phi(\xi)=\xi^\alpha, \qquad \xi\in [0,\xi_0]. \] By means of separate approaches, it is shown that in both cases $\alpha\in (0,1)$ and $\alpha\in [1,2]$ some global weak solutions exist which, inter alia, satisfy $C(T):= {\rm esssup} {}_{t\in (0,T)} \int_\Omega u(\cdot,t)\ln u(\cdot,t) < \infty$ for all $T>0$, with $\sup_{T>0} C(T)<\infty$ if $\alpha\in [1,2]$.


title: Towards the super Yang-Mills spectrum at large $N_c$

abstract: We examine one-flavour $SU(N_c)$ gauge theories, where $N_c$ denotes the number of colors, with one fermion in the antisymmetric representation as a candidate to approximate $\mathcal{N}=1$ super Yang Mills due to their equivalence in the large-$N_c$ limit. Summarising results on spectral evaluations of $N_c=3$, we will report on the progress of dynamical calculations for $N_c>3$. We discuss cut-off effects and challenges in configuration generation.


title: Future-proofing geotechnics workflows: accelerating problem-solving with large language models

abstract: The integration of Large Language Models (LLMs) like ChatGPT into the workflows of geotechnical engineering has a high potential to transform how the discipline approaches problem-solving and decision-making. This paper delves into the innovative application of LLMs in geotechnical engineering, as explored in a hands-on workshop held in Tokyo, Japan. The event brought together a diverse group of 20 participants, including students, researchers, and professionals from academia, industry, and government sectors, to investigate practical uses of LLMs in addressing specific geotechnical challenges. The workshop facilitated the creation of solutions for four different practical geotechnical problems as illustrative examples, culminating in the development of an academic paper. The paper discusses the potential of LLMs to transform geotechnical engineering practices, highlighting their proficiency in handling a range of tasks from basic data analysis to complex, multimodal problem-solving. It also addresses the challenges in implementing LLMs, particularly in achieving high precision and accuracy in specialized tasks, and underscores the need for expert oversight. The findings demonstrate LLMs' effectiveness in enhancing efficiency, data processing, and decision-making in geotechnical engineering, suggesting a paradigm shift towards more integrated, data-driven approaches in this field. This study not only showcases the potential of LLMs in a specific engineering domain, but also sets a precedent for their broader application in interdisciplinary research and practice, where the synergy of human expertise and artificial intelligence redefines the boundaries of problem-solving.


title: Towards Accelerating Particle-Resolved Direct Numerical Simulation with Neural Operators

abstract: We present our ongoing work aimed at accelerating a particle-resolved direct numerical simulation model designed to study aerosol-cloud-turbulence interactions. The dynamical model consists of two main components - a set of fluid dynamics equations for air velocity, temperature, and humidity, coupled with a set of equations for particle (i.e., cloud droplet) tracing. Rather than attempting to replace the original numerical solution method in its entirety with a machine learning (ML) method, we consider developing a hybrid approach. We exploit the potential of neural operator learning to yield fast and accurate surrogate models and, in this study, develop such surrogates for the velocity and vorticity fields. We discuss results from numerical experiments designed to assess the performance of ML architectures under consideration as well as their suitability for capturing the behavior of relevant dynamical systems.


title: Gravitational waves from supercooled phase transitions: dimensional transmutation meets dimensional reduction

abstract: Models with radiative symmetry breaking typically feature strongly supercooled first-order phase transitions, which result in an observable stochastic gravitational wave background. In this work, we analyse the role of higher order thermal corrections for these transitions, applying high-temperature dimensional reduction to a theory with dimensional transmutation. In particular, we study to what extent high-temperature effective field theories (3D EFT) can be used. We find that despite significant supercooling down from the critical temperature, the high-temperature expansion for the bubble nucleation rate can be applied using the 3D EFT framework, and we point out challenges in the EFT description. We compare our findings to previous studies, and find that the next-to-leading order corrections obtained in this work have a significant effect on the predictions for GW observables, motivating a further exploration of higher order thermal effects.


title: Translating Natural Language Queries to SQL Using the T5 Model

abstract: This paper presents the development process of a natural language to SQL model using the T5 model as the basis. The models, developed in August 2022 for an online transaction processing system and a data warehouse, have a 73\% and 84\% exact match accuracy respectively. These models, in conjunction with other work completed in the research project, were implemented for several companies and used successfully on a daily basis. The approach used in the model development could be implemented in a similar fashion for other database environments and with a more powerful pre-trained language model.


title: On real-time multi-stage speech enhancement systems

abstract: Recently, multi-stage systems have stood out among deep learning-based speech enhancement methods. However, these systems are always high in complexity, requiring millions of parameters and powerful computational resources, which limits their application for real-time processing in low-power devices. Besides, the contribution of various influencing factors to the success of multi-stage systems remains unclear, which presents challenges to reduce the size of these systems. In this paper, we extensively investigate a lightweight two-stage network with only 560k total parameters. It consists of a Mel-scale magnitude masking model in the first stage and a complex spectrum mapping model in the second stage. We first provide a consolidated view of the roles of gain power factor, post-filter, and training labels for the Mel-scale masking model. Then, we explore several training schemes for the two-stage network and provide some insights into the superiority of the two-stage network. We show that the proposed two-stage network trained by an optimal scheme achieves a performance similar to a four times larger open source model DeepFilterNet2.


title: Prompting Hard or Hardly Prompting: Prompt Inversion for Text-to-Image Diffusion Models

abstract: The quality of the prompts provided to text-to-image diffusion models determines how faithful the generated content is to the user's intent, often requiring `prompt engineering'. To harness visual concepts from target images without prompt engineering, current approaches largely rely on embedding inversion by optimizing and then mapping them to pseudo-tokens. However, working with such high-dimensional vector representations is challenging because they lack semantics and interpretability, and only allow simple vector operations when using them. Instead, this work focuses on inverting the diffusion model to obtain interpretable language prompts directly. The challenge of doing this lies in the fact that the resulting optimization problem is fundamentally discrete and the space of prompts is exponentially large; this makes using standard optimization techniques, such as stochastic gradient descent, difficult. To this end, we utilize a delayed projection scheme to optimize for prompts representative of the vocabulary space in the model. Further, we leverage the findings that different timesteps of the diffusion process cater to different levels of detail in an image. The later, noisy, timesteps of the forward diffusion process correspond to the semantic information, and therefore, prompt inversion in this range provides tokens representative of the image semantics. We show that our approach can identify semantically interpretable and meaningful prompts for a target image which can be used to synthesize diverse images with similar content. We further illustrate the application of the optimized prompts in evolutionary image generation and concept removal.