title: Moduli of sheaves on fourfolds as derived Lagrangian intersections

abstract: We show that any $(-2)$-shifted symplectic derived scheme $\textbf{X}$ (of finite type over an algebraically closed field of characteristic zero) is locally equivalent to the derived intersection of two Lagrangian morphisms to a $(-1)$-shifted symplectic derived scheme which is the $(-1)$-shifted cotangent stack of a smooth classical scheme. This leads to the possibility of the following viewpoint that is, at least to us, new: any $n$-shifted symplectic derived scheme can be obtained, locally, by repeated derived Lagrangian intersections in a smooth classical scheme. We also give a separate proof of our main result in the case where the local Darboux atlas cdga for $\textbf{X}$ has an even number of generators in degree $(-1)$; in this case we strengthen the result by showing that $\textbf{X}$ is in fact locally equivalent to the derived critical locus of a shifted function, which we've been told is a folklore result in the field. We indicate the implications of this for derived moduli stacks of sheaves on Calabi-Yau fourfolds by spelling out the case when the fourfold is $\mathbb{C}^4$.


title: Emergence of interfacial magnetism in strongly-correlated nickelate-titanate superlattices

abstract: Strongly-correlated transition-metal oxides are widely known for their various exotic phenomena. This is exemplified by rare-earth nickelates such as LaNiO$_{3}$, which possess intimate interconnections between their electronic, spin, and lattice degrees of freedom. Their properties can be further enhanced by pairing them in hybrid heterostructures, which can lead to hidden phases and emergent phenomena. An important example is the LaNiO$_{3}$/LaTiO$_{3}$ superlattice, where an interlayer electron transfer has been observed from LaTiO$_{3}$ into LaNiO$_{3}$ and is predicted to result in a high-spin state. However, macroscopic emergence of magnetic order has so far not been observed. Here, by using muon spin rotation, x-ray absorption, and resonant inelastic x-ray scattering, we present direct evidence of an emergent antiferromagnetic order with high magnon energy and exchange interactions at the LaNiO$_{3}$/LaTiO$_{3}$ interface. As the magnetism is purely interfacial, a single LaNiO$_{3}$/LaTiO$_{3}$ interface can essentially behave as an atomically thin quasi-two-dimensional antiferromagnet, potentially allowing its technological utilisation in advanced spintronic devices. Furthermore, its strong quasi-two-dimensional magnetic correlations and orbitally-polarized planar ligand holes make its electronic and magnetic configurations resemble the precursor states of superconducting cuprates and nickelates, but with an S $\rightarrow$ 1 spin state instead.


title: Can Transformers Capture Spatial Relations between Objects?

abstract: Spatial relationships between objects represent key scene information for humans to understand and interact with the world. To study the capability of current computer vision systems to recognize physically grounded spatial relations, we start by proposing precise relation definitions that permit consistently annotating a benchmark dataset. Despite the apparent simplicity of this task relative to others in the recognition literature, we observe that existing approaches perform poorly on this benchmark. We propose new approaches exploiting the long-range attention capabilities of transformers for this task, and evaluating key design principles. We identify a simple "RelatiViT" architecture and demonstrate that it outperforms all current approaches. To our knowledge, this is the first method to convincingly outperform naive baselines on spatial relation prediction in in-the-wild settings. The code and datasets are available in \url{https://sites.google.com/view/spatial-relation}.


title: Covariance and symmetry algebras

abstract: In general relativity as well as gauge theories, non-trivial symmetries can appear at boundaries. In the presence of radiation some of the symmetries are not Hamiltonian vector fields, hence the definition of charges for the symmetries becomes delicate. It can lead to the problem of field-dependent 2-cocycles in the charge algebra, as opposed to the central extensions allowed in standard classical mechanics. We show that if the Wald-Zoupas prescription is implemented, its covariance requirement guarantees that the algebra of Noether currents is free of field-dependent 2-cocycles, and its stationarity requirement further removes central extensions. Therefore the charge algebra admits at most a time-independent field-dependent 2-cocycle, whose existence depends on the boundary conditions. We report on new results for asymptotic symmetries at future null infinity that can be derived with this approach.


title: On Locally Conformal Spin(7) Structure

abstract: This article reveals a significant connection in geometry: when the Lee form $\theta$ is normal to an almost Hermitian manifold $N$, it implies that $N$ possesses a nearly K\"ahler structure. Investigating locally conformally Spin(7) manifolds with 2-vector fields, our study provides a concise yet rigorous proof of this relationship.


title: Silicon Photonic Microresonator-Based High-Resolution Line-by-Line Pulse Shaping

abstract: Optical pulse shaping stands as a formidable technique in ultrafast optics, radio-frequency photonics, and quantum communications. While existing systems rely on bulk optics or integrated platforms with planar waveguide sections for spatial dispersion, they face limitations in achieving finer (few- or sub-GHz) spectrum control. These methods either demand considerable space or suffer from pronounced phase errors and optical losses when assembled to achieve fine resolution. Addressing these challenges, we present a foundry-fabricated six-channel silicon photonic shaper using microresonator filter banks with inline phase control and high spectral resolution. Leveraging existing comb-based spectroscopic techniques, we devise a novel system to mitigate thermal crosstalk and enable the versatile use of our on-chip shaper. Our results demonstrate the shaper's ability to phase-compensate six comb lines at tunable channel spacings of 3, 4, and 5 GHz. Specifically, at a 3 GHz channel spacing, we showcase the generation of arbitrary waveforms in the time domain. This scalable design and control scheme holds promise in meeting future demands for high-precision spectral shaping capabilities.


title: Remarks on "Successive Convexification: A Superlinearly Convergent Algorithm for Non-convex Optimal Control Problems"

abstract: The purpose of this note is to highlight and address inaccuracies in the convergence guarantees of SCvx, a nonconvex trajectory optimization algorithm proposed by Mao et al. (arXiv:1804.06539), and make connections to relevant prior work. Specifically, we identify errors in the convergence proof within Mao et al. (arXiv:1804.06539) and reestablish the proof of convergence by employing a new method under stricter assumptions.


title: MIGHTEE-HI: HI galaxy properties in the large scale structure environment at z~0.37 from a stacking experiment

abstract: We present the first measurement of HI mass of star-forming galaxies in different large scale structure environments from a blind survey at $z\sim 0.37$. In particular, we carry out a spectral line stacking analysis considering $2875$ spectra of colour-selected star-forming galaxies undetected in HI at $0.23 < z < 0.49$ in the COSMOS field, extracted from the MIGHTEE-HI Early Science datacubes, acquired with the MeerKAT radio telescope. We stack galaxies belonging to different subsamples depending on three different definitions of large scale structure environment: local galaxy overdensity, position inside the host dark matter halo (central, satellite, or isolated), and cosmic web type (field, filament, or knot). We first stack the full star-forming galaxy sample and find a robust HI detection yielding an average galaxy HI mass of $M_{\rm HI}=(8.12\pm 0.75)\times 10^9\, {\rm M}_\odot$ at $\sim 11.8\sigma$. Next, we investigate the different subsamples finding a negligible difference in $M_{\rm HI}$ as a function of the galaxy overdensity. We report an HI excess compared to the full sample in satellite galaxies ($M_{\rm HI}=(11.31\pm1.22)\times 10^9$, at $\sim 10.2 \sigma$) and in filaments ($M_{\rm HI}=(11.62\pm 0.90)\times 10^9$. Conversely, we report non-detections for the central and knot galaxies subsamples, which appear to be HI-deficient. We find the same qualitative results also when stacking in units of HI fraction ($f_{\rm HI}$). We conclude that the HI amount in star-forming galaxies at the studied redshifts correlates with the large scale structure environment.


title: On the moduli space of simple sheaves on singular K3 surfaces

abstract: Mukai proved that the moduli space of simple sheaves on a smooth projective K3 surface is symplectic, and in \cite{FM2} we gave two constructions allowing one to construct new locally closed Lagrangian/isotropic subspaces of the moduli from old ones. In this paper, we extend both Mukai's result and our construction to reduced projective K3 surfaces; for the former we need to restrict our attention to perfect sheaves. There are two key points where we cannot get a straightforward generalization. In each, we need to prove that a certain differential form on the moduli space of simple, perfect sheaves vanishes, and we introduce a smoothability condition to complete the proof.


title: The Probability to Hit Every Bin with a Linear Number of Balls

abstract: Assume that $2n$ balls are thrown independently and uniformly at random into $n$ bins. We consider the unlikely event $E$ that every bin receives at least one ball, showing that $\Pr[E] = \Theta(b^n)$ where $b \approx 0.836$. Note that, due to correlations, $b$ is not simply the probability that any single bin receives at least one ball. More generally, we consider the event that throwing $\alpha n$ balls into $n$ bins results in at least $d$ balls in each bin.


title: Happy Ending: An Empty Hexagon in Every Set of 30 Points

abstract: Satisfiability solving has been used to tackle a range of long-standing open math problems in recent years. We add another success by solving a geometry problem that originated a century ago. In the 1930s, Esther Klein's exploration of unavoidable shapes in planar point sets in general position showed that every set of five points includes four points in convex position. For a long time, it was open if an empty hexagon, i.e., six points in convex position without a point inside, can be avoided. In 2006, Gerken and Nicol\'as independently proved that the answer is no. We establish the exact bound: Every 30-point set in the plane in general position contains an empty hexagon. Our key contributions include an effective, compact encoding and a search-space partitioning strategy enabling linear-time speedups even when using thousands of cores.


title: Prospect of high-temperature superconductivity in layered metal borocarbides

abstract: Delithiation of the known layered LiBC compound was predicted to induce conventional superconductivity at liquid nitrogen temperatures but extensive experimental work over the past two decades has detected no signs of the expected superconducting transition. Using a combination of first-principles stability analysis and anisotropic Migdal-Eliashberg formalism, we have investigated possible Li$_x$BC morphologies and established what particular transformations of the planar honeycomb BC layers are detrimental to the material's superconductivity. We propose that Li$_x$BC reintercalation with select alkali and alkaline earth metals could lead to synthesis of otherwise inaccessible metastable Li$_x$M$_y$BC superconductors with critical temperatures ($T_{c}$) up to 73 K. The large-scale exploration of metal borocarbides has revealed that NaBC and Li$_{1/2}$Na$_y$BC layered phases are likely true ground states at low temperatures. The findings indicate that this compositional space may host overlooked synthesizable compounds with potential to break the $T_{c}$ record for conventional superconductivity in ambient-pressure materials.


title: Numerical challenges for energy conservation in N-body simulations of collapsing self-interacting dark matter haloes

abstract: Dark matter (DM) haloes can be subject to gravothermal collapse if DM is not collisionless but has strong self-interactions. When the scattering can efficiently transfer heat from the centre to the outskirts, the central region of the halo collapses and reaches densities much higher than those for collisionless DM. This phenomenon is potentially observable in studies of strong lensing. Current theoretical efforts are motivated by observations of surprisingly dense substructures. A comparison with them requires accurate predictions. One method to obtain such predictions is to use N-body simulations. The collapsed haloes are extreme systems that pose severe challenges to state-of-the-art codes used to model self-interacting dark matter (SIDM). We investigate the root of such problems with a focus on energy non-conservation. We run N-body simulations with and without DM self-interactions of an isolated DM-only halo and change numerical parameters relevant to the accuracy of the simulation. We find that not only the numerical scheme for the DM self-interactions can lead to energy non-conservation but also the modelling of gravitational interaction and the time integration are problematic. The issues we found are: (a) particles changing their time step in a non-time-reversible manner; (b) the asymmetry in the tree-based gravitational force evaluation; (c) SIDM velocity kicks break the symplectic nature and time symmetry. Tuning the parameters of the simulation to achieve a high accuracy allows for conserving energy not only at early stages of the evolution but also at late ones. However, the cost of the simulations becomes prohibitively large. Some problems making the simulations of the gravothermal collapse phase inaccurate, can be overcome by choosing appropriate numerical schemes. However, others remain challenging. Our findings motivate further work on addressing these challenges.


title: A Universal Roadmap For Searching Repulsive Casimir Forces Between Magneto-Electric Materials

abstract: The Casimir effect, arising from vacuum quantum fluctuations, plays a fundamental role in the development of modern quantum electrodynamics. In parallel, the field of condensed matter has flourished through the discovery of various materials exhibiting broken symmetries, often connected to topology and characterized by magneto-electric coupling. Here, we calculate the Casimir forces between materials with time-reversal symmetry and/or parity symmetry breaking. Remarkably, we obtain a universal phase diagram governing the sign of symmetry-breaking-induced Casimir forces, contributing to a comprehensive understanding on the sign of Casimir force for linear optical materials. The discovered phase diagram serves as a roadmap for searching repulsive Casimir forces, a subject bearing both theoretical interest and practical significance.


title: Transchromatic phenomena in the equivariant slice spectral sequence

abstract: In this paper, we prove a transchromatic phenomenon for Hill--Hopkins--Ravenel and Lubin--Tate theories. This establishes a direct relationship between the equivariant slice spectral sequences of height-$h$ and height-$(h/2)$ theories. As applications of this transchromatic phenomenon, we prove periodicity and vanishing line results for these theories.


title: Dialect prejudice predicts AI decisions about people's character, employability, and criminality

abstract: Hundreds of millions of people now interact with language models, with uses ranging from serving as a writing aid to informing hiring decisions. Yet these language models are known to perpetuate systematic racial prejudices, making their judgments biased in problematic ways about groups like African Americans. While prior research has focused on overt racism in language models, social scientists have argued that racism with a more subtle character has developed over time. It is unknown whether this covert racism manifests in language models. Here, we demonstrate that language models embody covert racism in the form of dialect prejudice: we extend research showing that Americans hold raciolinguistic stereotypes about speakers of African American English and find that language models have the same prejudice, exhibiting covert stereotypes that are more negative than any human stereotypes about African Americans ever experimentally recorded, although closest to the ones from before the civil rights movement. By contrast, the language models' overt stereotypes about African Americans are much more positive. We demonstrate that dialect prejudice has the potential for harmful consequences by asking language models to make hypothetical decisions about people, based only on how they speak. Language models are more likely to suggest that speakers of African American English be assigned less prestigious jobs, be convicted of crimes, and be sentenced to death. Finally, we show that existing methods for alleviating racial bias in language models such as human feedback training do not mitigate the dialect prejudice, but can exacerbate the discrepancy between covert and overt stereotypes, by teaching language models to superficially conceal the racism that they maintain on a deeper level. Our findings have far-reaching implications for the fair and safe employment of language technology.


title: Neural Acceleration of Incomplete Cholesky Preconditioners

abstract: The solution of a sparse system of linear equations is ubiquitous in scientific applications. Iterative methods, such as the Preconditioned Conjugate Gradient method (PCG), are normally chosen over direct methods due to memory and computational complexity constraints. However, the efficiency of these methods depends on the preconditioner utilized. The development of the preconditioner normally requires some insight into the sparse linear system and the desired trade-off of generating the preconditioner and the reduction in the number of iterations. Incomplete factorization methods tend to be black box methods to generate these preconditioners but may fail for a number of reasons. These reasons include numerical issues that require searching for adequate scaling, shifting, and fill-in while utilizing a difficult to parallelize algorithm. With a move towards heterogeneous computing, many sparse applications find GPUs that are optimized for dense tensor applications like training neural networks being underutilized. In this work, we demonstrate that a simple artificial neural network trained either at compile time or in parallel to the running application on a GPU can provide an incomplete sparse Cholesky factorization that can be used as a preconditioner. This generated preconditioner is as good or better in terms of reduction of iterations than the one found using multiple preconditioning techniques such as scaling and shifting. Moreover, the generated method also works and never fails to produce a preconditioner that does not reduce the iteration count.


title: On the properties and implications of collapse-driven MHD turbulence

abstract: We numerically investigate the driving of MHD turbulence by gravitational contraction using simulations of an initially spherical, magnetically supercritical cloud core with initially transonic and trans-Alfv\'enic turbulence. We perform a Helmholtz decomposition of the velocity field, and investigate the evolution of its solenoidal and compressible parts, as well as of the velocity component along the gravitational acceleration vector, a proxy for the infall component of the velocity field. We find that: 1) In spite of being supercritical, the core first contracts to a sheet perpendicular to the mean field, and the sheet itself collapses. 2) The solenoidal component of the turbulence remains at roughly its initial level throughout the simulation, while the compressible component increases continuously. This implies that turbulence does {\it not} dissipate towards the center of the core. 3) The distribution of simulation cells in the $B$-$\rho$ plane occupies a wide triangular region at low densities, bounded below by the expected trend for fast MHD waves ($B \propto \rho$, applicable for high local Alfv\'enic Mach number $\Ma$) and above by the trend expected for slow waves ($B \sim$ constant, applicable for low local $\Ma$). At high densities, the distribution follows a single trend $B \propto \rho^{\gamef}$, with $1/2 < \gamef < 2/3$, as expected for gravitational compression. 4) The measured mass-to-magnetic flux ratio $\lambda$ increases with radius $r$, due to the different scalings of the mass and magnetic flux with $r$. At a fixed radius, $\lambda$ increases with time due to the accretion of material along field lines. 5) The solenoidal energy fraction is much smaller than the total turbulent component, indicating that the collapse drives the turbulence mainly compressibly, even in directions orthogonal to that of the collapse.


title: AtP*: An efficient and scalable method for localizing LLM behaviour to components

abstract: Activation Patching is a method of directly computing causal attributions of behavior to model components. However, applying it exhaustively requires a sweep with cost scaling linearly in the number of model components, which can be prohibitively expensive for SoTA Large Language Models (LLMs). We investigate Attribution Patching (AtP), a fast gradient-based approximation to Activation Patching and find two classes of failure modes of AtP which lead to significant false negatives. We propose a variant of AtP called AtP*, with two changes to address these failure modes while retaining scalability. We present the first systematic study of AtP and alternative methods for faster activation patching and show that AtP significantly outperforms all other investigated methods, with AtP* providing further significant improvement. Finally, we provide a method to bound the probability of remaining false negatives of AtP* estimates.


title: A time-stepping deep gradient flow method for option pricing in (rough) diffusion models

abstract: We develop a novel deep learning approach for pricing European options in diffusion models, that can efficiently handle high-dimensional problems resulting from Markovian approximations of rough volatility models. The option pricing partial differential equation is reformulated as an energy minimization problem, which is approximated in a time-stepping fashion by deep artificial neural networks. The proposed scheme respects the asymptotic behavior of option prices for large levels of moneyness, and adheres to a priori known bounds for option prices. The accuracy and efficiency of the proposed method is assessed in a series of numerical examples, with particular focus in the lifted Heston model.


title: The QCD theta-parameter in canonical quantization

abstract: The role of the QCD theta-parameter is investigated in pure Yang-Mills theory in the spacetime given by the four-dimensional Euclidean torus. While in this setting the introduction of possibly unphysical boundary conditions is avoided, it must be specified how the sum over the topological sectors is to be carried out. To connect with observables in real time, we perceive the partition function as the trace over the canonical density matrix. The system then corresponds to one of a finite temperature on a spatial three-torus. Carrying out the trace operation requires canonical quantization and gauge fixing. Fixing the gauge and demanding that the Hermiticity of the Hamiltonian is maintained leads to a restriction of the Hilbert space of physical wave functionals that generalizes the constraints derived from imposing Gauss' law. Consequently, we find that the states in the Hilbert space are properly normalizable under an inner product that integrates over each physical configuration represented by the gauge potential one time and one time only. The observables derived from the constrained Hilbert space do not violate charge-parity symmetry. We note that an exact hidden symmetry of the theory that is present for arbitrary values of theta in the Hamiltonian is effectively promoted to parity conservation in this constrained space. These results, derived on a torus in order to avoid the introduction of boundary conditions, also carry over to Minkowski spacetime when taking account of all possible gauge transformations.


title: Primal-Dual iLQR

abstract: We introduce a new algorithm for solving unconstrained discrete-time optimal control problems. Our method follows a direct multiple shooting approach, and consists of applying the SQP method together with an $\ell_2$ augmented Lagrangian primal-dual merit function. We use the LQR algorithm to efficiently solve the primal-dual Newton-KKT system. As our algorithm is a specialization of NPSQP, it inherits its generic properties, including global convergence, fast local convergence, and the lack of need for second order corrections or dimension expansions, improving on existing direct multiple shooting approaches such as acados, ALTRO, GNMS, FATROP, and FDDP. As our algorithm avoids sequential rollouts of the nonlinear dynamics, it can be combined with (S\"arkk\"a and Garc\'ia-Fern\'andez, 2023) to run in $O(\log(N))$ parallel time per iteration (where $N$ is the number of stages), as well as $O(1)$ parallel time per line search iteration. Therefore, this paper provides a practical, theoretically sound, and highly parallelizable (for example, with a GPU) method for solving nonlinear discrete-time optimal control problems.


title: Shrinkage estimators in zero-inflated Bell regression model with application

abstract: We propose Stein-type estimators for zero-inflated Bell regression models by incorporating information on model parameters. These estimators combine the advantages of unrestricted and restricted estimators. We derive the asymptotic distributional properties, including bias and mean squared error, for the proposed shrinkage estimators. Monte Carlo simulations demonstrate the superior performance of our shrinkage estimators across various scenarios. Furthermore, we apply the proposed estimators to analyze a real dataset, showcasing their practical utility.


title: Edge open packing: complexity, algorithmic aspects, and bounds

abstract: Given a graph $G$, two edges $e_{1},e_{2}\in E(G)$ are said to have a common edge $e$ if $e$ joins an endvertex of $e_{1}$ to an endvertex of $e_{2}$. A subset $B\subseteq E(G)$ is an edge open packing set in $G$ if no two edges of $B$ have a common edge in $G$, and the maximum cardinality of such a set in $G$ is called the edge open packing number, $\rho_{e}^{o}(G)$, of $G$. In this paper, we prove that the decision version of the edge open packing number is NP-complete even when restricted to graphs with universal vertices, Eulerian bipartite graphs, and planar graphs with maximum degree $4$, respectively. In contrast, we present a linear-time algorithm that computes the edge open packing number of a tree. We also resolve two problems posed in the seminal paper [Edge open packing sets in graphs, RAIRO-Oper.\ Res.\ 56 (2022) 3765--3776]. Notably, we characterize the graphs $G$ that attain the upper bound $\rho_e^o(G)\le |E(G)|/\delta(G)$, and provide lower and upper bounds for the edge-deleted subgraph of a graph and establish the corresponding realization result.


title: Machine learning that predicts well may not learn the correct physical descriptions of glassy systems

abstract: The complexity of glasses makes it challenging to explain their dynamics. Machine Learning (ML) has emerged as a promising pathway for understanding glassy dynamics by linking their structural features to rearrangement dynamics. Support Vector Machine (SVM) was one of the first methods used to detect such correlations. Specifically, a certain output of SVMs trained to predict dynamics from structure, the distance from the separating hyperplane, was interpreted as being linearly related to the activation energy for the rearrangement. By numerical analysis of toy models, we explore under which conditions it is possible to infer the energy barrier to rearrangements from the distance to the separating hyperplane. We observe that such successful inference is possible only under very restricted conditions. Typical tests, such as the apparent Arrhenius dependence of the probability of rearrangement on the inferred energy and the temperature, or high cross-validation accuracy do not guarantee success. We propose practical approaches for measuring the quality of the energy inference and for modifying the inferred model to improve the inference, which should be usable in the context of realistic datasets.


title: An Experimental Study of Low-Latency Video Streaming over 5G

abstract: Low-latency video streaming over 5G has become rapidly popular over the last few years due to its increased usage in hosting virtual events, online education, webinars, and all-hands meetings. Our work aims to address the absence of studies that reveal the real-world behavior of low-latency video streaming. To that end, we provide an experimental methodology and measurements, collected in a US metropolitan area over a commercial 5G network, that correlates application-level QoE and lower-layer metrics on the devices, such as RSRP, RSRQ, handover records, etc., under both static and mobility scenarios. We find that RAN-side information, which is readily available on every cellular device, has the potential to enhance throughput estimation modules of video streaming clients, ultimately making low-latency streaming more resilient against network perturbations and handover events.


title: The role of the likelihood for elastic scattering uncertainty quantification

abstract: Background: Analyses of elastic scattering with the optical model (OMP) are widely used in nuclear reactions. Purpose: Previous work compared a traditional frequentist approach and a Bayesian approach to quantify uncertainties in the OMP. In this study, we revisit this comparison and consider the role of the likelihood used in the analysis. Method: We compare the Levenberg-Marquardt algorithm for $\chi^{2}$ minimization with Markov Chain Monte Carlo sampling to obtain parameter posteriors. Following previous work, we consider how results are affected when $\chi^{2}$/N is used for the likelihood function, N being the number of data points, to account for possible correlations in the model and underestimation of the error in the data. Results: We analyze a simple linear model and then move to OMP analysis of elastic angular distributions using a) a 5-parameter model and b) a 6-parameter model. In the linear model, the frequentist and Bayesian approaches yield consistent optima and uncertainty estimates. The same is qualitatively true for the 5-parameter OMP analysis. For the 6-parameter OMP analysis, the parameter posterior is no longer well-approximated by a Gaussian and a covariance-based frequentist prediction becomes unreliable. In all cases, when the Bayesian approach uses $\chi^{2}$/N in the likelihood, uncertainties increase by $\sqrt{N}$. Conclusions: When the parameter posterior is near-Gaussian and the same likelihood is used, the frequentist and Bayesian approaches recover consistent parameter uncertainty estimates. If the parameter posterior has significant higher moments, the covariance-only frequentist approach becomes unreliable and the Bayesian approach should be used. Empirical coverage can serve as an important internal check for uncertainty estimation, providing red flags for uncertainty analyses.


title: The quark-mass dependence of the potential energy between static colour sources in the QCD vacuum with light and strange quarks

abstract: The low-lying energy spectrum of the static-colour-source-anti-source system in a vacuum containing light and strange quarks is computed using lattice QCD for a range of different light quark masses. The resulting levels are described using a simple model Hamiltonian and the parameters in this model are extrapolated to the physical light-quark masses. In this framework, the QCD string tension is found to be $\sqrt{\sigma}=445(3)_{\rm stat}(6)_{\rm sys}$ MeV.


title: Carbon-contaminated topological defects in hexagonal boron nitride for quantum photonics

abstract: Topological defects, such as Stone-Wales defects and grain boundaries, are common in 2D materials. In this study, we investigate the intricate interplay of topological defects and carbon contamination in hexagonal boron nitride revealing an intriguing class of color centers. We demonstrate that both carbon contamination and strain can stabilize Stone-Wales configurations and give rise to emitters with desirable optical properties in the visible spectral range. Inspired by these results, we further demonstrate that carbon atoms at grain boundaries can resolve energetic B-B and N-N bonds leading to highly favorable atomic structures that may facilitate the accumulation of carbon contamination at the boundaries. Similarly to contaminated Stone-Wales defects, carbon-doped grain boundaries can also give rise to color centers emitting in the visible spectral range with short radiative lifetime and high Debye-Waller factors. Our discoveries shed light on an exciting class of defects and pave the way toward the identification of color centers and single photon emitters in hBN.


title: Scalable Multispecies Ion Transport in a Grid Based Surface-Electrode Trap

abstract: We present a scalable method for the control of ion crystals in a grid-based surface electrode Paul trap and characterize it in the context of transport operations that sort and reorder multispecies crystals. By combining co-wiring of control electrodes at translationally symmetric locations in each grid site with the site-wise ability to exchange the voltages applied to two special electrodes gated by a binary input, site-dependent operations are achieved using only a fixed number of analog voltage signals and a single digital input per site. In two separate experimental systems containing nominally identical grid traps, one using $^{171}\mathrm{Yb}^{+}$-$^{138}\mathrm{Ba}^{+}$ crystals and the other $^{137}\mathrm{Ba}^{+}$-$^{88}\mathrm{Sr}^{+}$, we demonstrate this method by characterizing the conditional intra-site crystal reorder and the conditional exchange of ions between adjacent sites on the grid. Averaged across a multi-site region of interest, we measure sub-quanta motional excitation in the axial in-phase and out-of-phase modes of the crystals following these operations at exchange rates of 2.5 kHz. These conditional transport operations display all necessary components for sorting qubits, and could be extended to implement other conditional operations involving control fields such as gates, initialization, and measurement.


title: Investigating Ionization in the Intergalactic Medium

abstract: The Intergalactic Medium (IGM) contains $>$50% of the baryonic mass of the Universe, yet the mechanisms responsible for keeping the IGM ionized has not been fully explained. Hence, we investigate ion abundances from the largest blind QSO absorption catalog for clouds that show C IV, N V, and O VI simultaneously. The wavelength range of present UV spectrographs, however, make it possible to probe C IV and O VI over a small range of redshift ($z \approx 0.12 - 0.15$). As a result, we only have five IGM absorbing clouds, yet these provide a powerful and representative tool to probe the IGM ionization state. We found one cloud to be in collisional ionization equilibrium while three of five showed signs of being produced by non-equilibrium processes, specifically conductive interfaces and turbulent mixing layers. None of the models we explore here were able to reproduce the ionization state of the remaining system. Energetic processes, such as galactic feedback from star formation and AGN winds, would be excellent candidates that can cause such widespread ionization.


title: Mitigating Reversal Curse in Large Language Models via Semantic-aware Permutation Training

abstract: While large language models (LLMs) have achieved impressive performance across diverse tasks, recent studies showcase that causal LLMs suffer from the "reversal curse". It is a typical example that the model knows "A's father is B", but is unable to reason "B's child is A". This limitation poses a challenge to the advancement of artificial general intelligence (AGI), as it suggests a gap in the models' ability to comprehend and apply bidirectional reasoning. In this paper, we first conduct substantial evaluation and identify that the root cause of the reversal curse lies in the different word order between the training and inference stage, namely, the poor ability of causal language models to predict antecedent words within the training data. Accordingly, permutation on the training data is considered as a potential solution, since this can make the model predict antecedent words or tokens. However, previous permutation methods may disrupt complete phrases or entities, thereby posing challenges for the model to comprehend and learn from training data. To address this issue, we propose Semantic-aware Permutation Training (SPT), which addresses this issue by segmenting the training sentences into semantic units (i.e., entities or phrases) with an assistant language model and permuting these units before feeding into the model. Extensive experiments demonstrate that SPT effectively mitigates the reversal curse since the performance on reversed questions approximates that on the forward ones, and significantly advances the performance of existing works.


title: Large deformations in terms of stretch and rotation and local solution to the non-stationary problem

abstract: In this paper we consider and generalize a model, recently proposed and analytically investigated in its quasi-stationary approximation by the authors, for visco-elasticity with large deformations and conditional compatibility, where the independent variables are the stretch and the rotation tensors. The model takes the form of a system of integro-differential coupled equations. Here, its derivation is generalized to consider mixed boundary conditions, which may represent a wider range of physical applications then the case with Dirichlet boundary conditions considered in our previous contribution. This also introduces nontrivial technical difficulties in the theoretical framework, related to the definition and the regularity of the solutions of elliptic operators with mixed boundary conditions. As a novel contribution, we develop the analysis of the fully non-stationary version of the system where we consider inertia. In this context, we prove the existence of a local in time weak solution in three space dimensions, employing techniques from PDEs and convex analysis.


title: Faulhaber's formula, Bernoulli numbers and the equation $f(x)+x^k=f(x+1)$

abstract: In modern usage the Bernoulli numbers and polynomials follow Euler's approach and are defined using generating functions. We consider the functional equation $f(x)+x^k=f(x+1)$ and show that a solution can be derived from Faulhaber's formula for the sum of powers. We show how these solutions provide a characterization of Bernoulli numbers and related results.


title: Orbital analysis of stars in the nuclear stellar disc of the Milky Way

abstract: While orbital analysis studies were so far mainly focused on the Galactic halo, it is possible now to do these studies in the heavily obscured region close to the Galactic Centre. We aim to do a detailed orbital analysis of stars located in the nuclear stellar disc (NSD) of the Milky Way allowing us to trace the dynamical history of this structure. We integrated orbits of the observed stars in a non-axisymmetric potential. We used a Fourier transform to estimate the orbital frequencies. We compared two orbital classifications, one made by eye and the other with an algorithm, in order to identify the main orbital families. We also compared the Lyapunov and the frequency drift techniques to estimate the chaoticity of the orbits. We identified several orbital families as chaotic, $z$-tube, $x$-tube, banana, fish, saucer, pretzel, 5:4, and 5:6 orbits. As expected for stars located in a NSD, the large majority of orbits are identified as $z$-tubes (or as a sub-family of $z$-tubes). Since the latter are parented by $x_{2}$ orbits, this result supports the contribution of the bar (in which $x_{2}$ orbits are dominant in the inner region) in the formation of the NSD. Moreover, most of the chaotic orbits are found to be contaminants from the bar or bulge which would confirm the predicted contamination from the most recent NSD models. Based on a detailed orbital analysis, we were able to classify orbits into various families, most of which are parented by $x_{2}$-type orbits, which are dominant in the inner part of the bar.


title: Point Cloud Mamba: Point Cloud Learning via State Space Model

abstract: Recently, state space models have exhibited strong global modeling capabilities and linear computational complexity in contrast to transformers. This research focuses on applying such architecture in point cloud analysis. In particular, for the first time, we demonstrate that Mamba-based point cloud methods can outperform previous methods based on transformer or multi-layer perceptrons (MLPs). To enable Mamba to process 3-D point cloud data more effectively, we propose a novel Consistent Traverse Serialization method to convert point clouds into 1-D point sequences while ensuring that neighboring points in the sequence are also spatially adjacent. Consistent Traverse Serialization yields six variants by permuting the order of x, y, and z coordinates, and the synergistic use of these variants aids Mamba in comprehensively observing point cloud data. Furthermore, to assist Mamba in handling point sequences with different orders more effectively, we introduce point prompts to inform Mamba of the sequence's arrangement rules. Finally, we propose positional encoding based on spatial coordinate mapping to inject positional information into point cloud sequences better. Point Cloud Mamba surpasses the state-of-the-art (SOTA) point-based method PointNeXt and achieves new SOTA performance on the ScanObjectNN, ModelNet40, ShapeNetPart, and S3DIS datasets. It is worth mentioning that when using a more powerful local feature extraction module, our PCM achieves 82.6 mIoU on S3DIS, significantly surpassing the previous SOTA models, DeLA and PTv3, by 8.5 mIoU and 7.9 mIoU, respectively. Code and model are available at https://github.com/SkyworkAI/PointCloudMamba.


title: Optical modeling of systematic uncertainties in detector polarization angles for the Atacama Cosmology Telescope

abstract: We present an estimate of the Atacama Cosmology Telescope (ACT) detector polarization angle systematic uncertainty from optics perturbation analysis using polarization-sensitive ray tracing in CODE V optical design software. Uncertainties in polarization angle calibration in CMB measurements can limit constraints on cosmic birefringence and other cosmological measurements. Our framework estimates the angle calibration systematic uncertainties from possible displacements in lens positions and orientations, and anti-reflection coating (ARC) thicknesses and refractive indices. With millimeter displacements in lens positions and percent-level perturbations in ARC thicknesses and indices from design, we find the total systematic uncertainty for three ACT detector arrays operating between 90--220 GHz to be at the tenth of degree scale. Reduced lens position and orientation uncertainties from physical measurements could lead to a reduction in the systematic uncertainty estimated with the framework presented here. This optical modeling can inform polarization angle systematic uncertainties for current and future microwave polarimeters, such as the CCAT Observatory, Simons Observatory, and CMB-S4.


title: Optical-coherence-tomography-based deep-learning scatterer-density estimator using physically accurate noise model

abstract: We demonstrate a deep-learning-based scatterer density estimator (SDE) that processes local speckle patterns of optical coherence tomography (OCT) images and estimates the scatterer density behind each speckle pattern. The SDE is trained using large quantities of numerically simulated OCT images and their associated scatterer densities. The numerical simulation uses a noise model that incorporates the spatial properties of three types of noise, i.e., shot noise, relative-intensity noise, and non-optical noise. The SDE's performance was evaluated numerically and experimentally using two types of scattering phantom and in vitro tumor spheroids. The results confirmed that the SDE estimates scatterer densities accurately. The estimation accuracy improved significantly when compared with our previous deep-learning-based SDE, which was trained using numerical speckle patterns generated from a noise model that did not account for the spatial properties of noise.

categories: physics.bio-ph physics.ins-det physics.med-ph physics.optics


title: An Architecture for Unattended Containerized (Deep) Reinforcement Learning with Webots

abstract: As data science applications gain adoption across industries, the tooling landscape matures to facilitate the life cycle of such applications and provide solutions to the challenges involved to boost the productivity of the people involved. Reinforcement learning with agents in a 3D world could still face challenges: the knowledge required to use a simulation software as well as the utilization of a standalone simulation software in unattended training pipelines. In this paper we review tools and approaches to train reinforcement learning agents for robots in 3D worlds with respect to the robot Robotino and argue that the separation of the simulation environment for creators of virtual worlds and the model development environment for data scientists is not a well covered topic. Often both are the same and data scientists require knowledge of the simulation software to work directly with their APIs. Moreover, sometimes creators of virtual worlds and data scientists even work on the same files. We want to contribute to that topic by describing an approach where data scientists don't require knowledge about the simulation software. Our approach uses the standalone simulation software Webots, the Robot Operating System to communicate with simulated robots as well as the simulation software itself and container technology to separate the simulation from the model development environment. We put emphasize on the APIs the data scientists work with and the use of a standalone simulation software in unattended training pipelines. We show the parts that are specific to the Robotino and the robot task to learn.


title: Towards Fair and Firm Real-Time Scheduling in DNN Multi-Tenant Multi-Accelerator Systems via Reinforcement Learning

abstract: This paper addresses the critical challenge of managing Quality of Service (QoS) in cloud services, focusing on the nuances of individual tenant expectations and varying Service Level Indicators (SLIs). It introduces a novel approach utilizing Deep Reinforcement Learning for tenant-specific QoS management in multi-tenant, multi-accelerator cloud environments. The chosen SLI, deadline hit rate, allows clients to tailor QoS for each service request. A novel online scheduling algorithm for Deep Neural Networks in multi-accelerator systems is proposed, with a focus on guaranteeing tenant-wise, model-specific QoS levels while considering real-time constraints.


title: Single-channel and multi-channel electrospinning for the fabrication of PLA/PCL tissue engineering scaffolds: comparative study of the materials physicochemical and biological properties

abstract: Fabrication of tissue engineering scaffolds with tailored physicochemical and biological characteristics is a relevant task in biomedical engineering. The present work was focused at the evaluation of the effect of fabrication approach (single-channel or multi-channel electrospinning) on the properties of the fabricated poly(lactic acid)(PLA)/poly(epsilon-caprolactone)(PCL) scaffolds with various polymer mass ratios (1/0, 2/1, 1/1, 1/2, and 0/1). The scaffolds with same morphology (regardless of electrospinning variant) were fabricated and characterized using SEM, water contact angle measurement, FTIR, XRD, tensile testing and in vitro experiment with multipotent mesenchymal stem cells. It was demonstrated, that multi-channel electrospinning prevents intermolecular interactions between the polymer components of the scaffold, preserving their crystal structure, what affects the mechanical characteristics of the scaffold (particularly, leads to 2-fold difference in elongation). Better adhesion of multipotent mesenchymal stem cells on the surface of the scaffolds fabricated using multichannel electrospinning was demonstrated.


title: Adaptive Exponential Integrate-and-Fire Model with Fractal Extension

abstract: The description of neuronal activity has been of great importance in neuroscience. In this field, mathematical models are useful to describe the electrophysical behaviour of neurons. One successful model used for this purpose is the Adaptive Exponential Integrate-and-Fire (Adex), which is composed of two ordinary differential equations. Usually, this model is considered in his standard formulation, i.e., with integer order derivatives. In this work, we propose and study the fractal extension of Adex model, which in simple terms corresponds to replacing the integer derivative by non-integer. As non-integer operators, we choose the fractal derivatives. We explore the effects of equal and different orders of fractal derivatives in the firing patterns and mean frequency of the neuron described by the Adex model. Previous results suggest that fractal derivatives can provide a more realistic representation due to the fact that the standard operators are generalized. Our findings show that the fractal order influences the inter-spike intervals and changes the mean firing frequency. In addition, the firing patterns depend not only on the neuronal parameters but also on the order of respective fractal operators. As our main conclusion, the fractal order below the unit value increases the influence of the adaptation mechanism in the spike firing patterns.


title: Text mining in education

abstract: The explosive growth of online education environments is generating a massive volume of data, specially in text format from forums, chats, social networks, assessments, essays, among others. It produces exciting challenges on how to mine text data in order to find useful knowledge for educational stakeholders. Despite the increasing number of educational applications of text mining published recently, we have not found any paper surveying them. In this line, this work presents a systematic overview of the current status of the Educational Text Mining field. Our final goal is to answer three main research questions: Which are the text mining techniques most used in educational environments? Which are the most used educational resources? And which are the main applications or educational goals? Finally, we outline the conclusions and the more interesting future trends.


title: Blockchain Metrics and Indicators in Cryptocurrency Trading

abstract: The objective of this paper is the construction of new indicators that can be useful to operate in the cryptocurrency market. These indicators are based on public data obtained from the blockchain network, specifically from the nodes that make up Bitcoin mining. Therefore, our analysis is unique to that network. The results obtained with numerical simulations of algorithmic trading and prediction via statistical models and Machine Learning demonstrate the importance of variables such as the hash rate, the difficulty of mining or the cost per transaction when it comes to trade Bitcoin assets or predict the direction of price. Variables obtained from the blockchain network will be called here blockchain metrics. The corresponding indicators (inspired by the "Hash Ribbon") perform well in locating buy signals. From our results, we conclude that such blockchain indicators allow obtaining information with a statistical advantage in the highly volatile cryptocurrency market.


title: XProspeCT: CT Volume Generation from Paired X-Rays

abstract: Computed tomography (CT) is a beneficial imaging tool for diagnostic purposes. CT scans provide detailed information concerning the internal anatomic structures of a patient, but present higher radiation dose and costs compared to X-ray imaging. In this paper, we build on previous research to convert orthogonal X-ray images into simulated CT volumes by exploring larger datasets and various model structures. Significant model variations include UNet architectures, custom connections, activation functions, loss functions, optimizers, and a novel back projection approach.


title: Do Weibo platform experts perform better at predicting stock market?

abstract: Sentiment analysis can be used for stock market prediction. However, existing research has not studied the impact of a user's financial background on sentiment-based forecasting of the stock market using artificial neural networks. In this work, a novel combination of neural networks is used for the assessment of sentiment-based stock market prediction, based on the financial background of the population that generated the sentiment. The state-of-the-art language processing model Bidirectional Encoder Representations from Transformers (BERT) is used to classify the sentiment and a Long-Short Term Memory (LSTM) model is used for time-series based stock market prediction. For evaluation, the Weibo social networking platform is used as a sentiment data collection source. Weibo users (and their comments respectively) are divided into Authorized Financial Advisor (AFA) and Unauthorized Financial Advisor (UFA) groups according to their background information, as collected by Weibo. The Hong Kong Hang Seng index is used to extract historical stock market change data. The results indicate that stock market prediction learned from the AFA group users is 39.67% more precise than that learned from the UFA group users and shows the highest accuracy (87%) when compared to existing approaches.


title: Misconduct in Post-Selections and Deep Learning

abstract: This is a theoretical paper on "Deep Learning" misconduct in particular and Post-Selection in general. As far as the author knows, the first peer-reviewed papers on Deep Learning misconduct are [32], [37], [36]. Regardless of learning modes, e.g., supervised, reinforcement, adversarial, and evolutional, almost all machine learning methods (except for a few methods that train a sole system) are rooted in the same misconduct -- cheating and hiding -- (1) cheating in the absence of a test and (2) hiding bad-looking data. It was reasoned in [32], [37], [36] that authors must report at least the average error of all trained networks, good and bad, on the validation set (called general cross-validation in this paper). Better, report also five percentage positions of ranked errors. From the new analysis here, we can see that the hidden culprit is Post-Selection. This is also true for Post-Selection on hand-tuned or searched hyperparameters, because they are random, depending on random observation data. Does cross-validation on data splits rescue Post-Selections from the Misconducts (1) and (2)? The new result here says: No. Specifically, this paper reveals that using cross-validation for data splits is insufficient to exonerate Post-Selections in machine learning. In general, Post-Selections of statistical learners based on their errors on the validation set are statistically invalid.


title: Regional inflation analysis using social network data

abstract: Inflation is one of the most important macroeconomic indicators that have a great impact on the population of any country and region. Inflation is influenced by range of factors, one of which is inflation expectations. Many central banks take this factor into consideration while implementing monetary policy within the inflation targeting regime. Nowadays, a lot of people are active users of the Internet, especially social networks. There is a hypothesis that people search, read, and discuss mainly only those issues that are of particular interest to them. It is logical to assume that the dynamics of prices may also be in the focus of user discussions. So, such discussions could be regarded as an alternative source of more rapid information about inflation expectations. This study is based on unstructured data from Vkontakte social network to analyze upward and downward inflationary trends (on the example of the Omsk region). The sample of more than 8.5 million posts was collected between January 2010 and May 2022. The authors used BERT neural networks to solve the problem. These models demonstrated better results than the benchmarks (e.g., logistic regression, decision tree classifier, etc.). It makes possible to define pro-inflationary and disinflationary types of keywords in different contexts and get their visualization with SHAP method. This analysis provides additional operational information about inflationary processes at the regional level The proposed approach can be scaled for other regions. At the same time the limitation of the work is the time and power costs for the initial training of similar models for all regions of Russia.


title: Detecting Anomalous Events in Object-centric Business Processes via Graph Neural Networks

abstract: Detecting anomalies is important for identifying inefficiencies, errors, or fraud in business processes. Traditional process mining approaches focus on analyzing 'flattened', sequential, event logs based on a single case notion. However, many real-world process executions exhibit a graph-like structure, where events can be associated with multiple cases. Flattening event logs requires selecting a single case identifier which creates a gap with the real event data and artificially introduces anomalies in the event logs. Object-centric process mining avoids these limitations by allowing events to be related to different cases. This study proposes a novel framework for anomaly detection in business processes that exploits graph neural networks and the enhanced information offered by object-centric process mining. We first reconstruct and represent the process dependencies of the object-centric event logs as attributed graphs and then employ a graph convolutional autoencoder architecture to detect anomalous events. Our results show that our approach provides promising performance in detecting anomalies at the activity type and attributes level, although it struggles to detect anomalies in the temporal order of events.


title: A framework for understanding data science

abstract: The objective of this research is to provide a framework with which the data science community can understand, define, and develop data science as a field of inquiry. The framework is based on the classical reference framework (axiology, ontology, epistemology, methodology) used for 200 years to define knowledge discovery paradigms and disciplines in the humanities, sciences, algorithms, and now data science. I augmented it for automated problem-solving with (methods, technology, community). The resulting data science reference framework is used to define the data science knowledge discovery paradigm in terms of the philosophy of data science addressed in previous papers and the data science problem-solving paradigm, i.e., the data science method, and the data science problem-solving workflow, both addressed in this paper. The framework is a much called for unifying framework for data science as it contains the components required to define data science. For insights to better understand data science, this paper uses the framework to define the emerging, often enigmatic, data science problem-solving paradigm and workflow, and to compare them with their well-understood scientific counterparts, scientific problem-solving paradigm and workflow.


title: Combating Financial Crimes with Unsupervised Learning Techniques: Clustering and Dimensionality Reduction for Anti-Money Laundering

abstract: Anti-Money Laundering (AML) is a crucial task in ensuring the integrity of financial systems. One keychallenge in AML is identifying high-risk groups based on their behavior. Unsupervised learning, particularly clustering, is a promising solution for this task. However, the use of hundreds of features todescribe behavior results in a highdimensional dataset that negatively impacts clustering performance.In this paper, we investigate the effectiveness of combining clustering method agglomerative hierarchicalclustering with four dimensionality reduction techniques -Independent Component Analysis (ICA), andKernel Principal Component Analysis (KPCA), Singular Value Decomposition (SVD), Locality Preserving Projections (LPP)- to overcome the issue of high-dimensionality in AML data and improve clusteringresults. This study aims to provide insights into the most effective way of reducing the dimensionality ofAML data and enhance the accuracy of clustering-based AML systems. The experimental results demonstrate that KPCA outperforms other dimension reduction techniques when combined with agglomerativehierarchical clustering. This superiority is observed in the majority of situations, as confirmed by threedistinct validation indices.


title: Simulation of charged particles in Earth's magnetosphere: an approach to the Van Allen belts

abstract: Earth's magnetosphere, beyond protecting the ozone layer, is a natural phenomena which allows to study the interaction between charged particles from solar activity and electromagnetic fields. In this paper we studied trajectories of charged particles interacting with a constant dipole magnetic field as first approach of the Earth's magnetosphere using different initial conditions. As a result of this interaction there is a formation of well defined radiation regions by a confinement of charged particles around the lines of the magnetic field. These regions, called Van Allen radiation belts, are described by classical electrodynamics and appear naturally in the numerical modeling done in this work.


title: Mid-surface scaling invariance of some bending strain measures

abstract: The mid-surface scaling invariance of bending strain measures proposed in [Acharya (2000)] is discussed in light of the work of [arXiv:2010.14308].


title: Empirical and Experimental Insights into Data Mining Techniques for Crime Prediction: A Comprehensive Survey

abstract: This survey paper presents a comprehensive analysis of crime prediction methodologies, exploring the various techniques and technologies utilized in this area. The paper covers the statistical methods, machine learning algorithms, and deep learning techniques employed to analyze crime data, while also examining their effectiveness and limitations. We propose a methodological taxonomy that classifies crime prediction algorithms into specific techniques. This taxonomy is structured into four tiers, including methodology category, methodology sub-category, methodology techniques, and methodology sub-techniques. Empirical and experimental evaluations are provided to rank the different techniques. The empirical evaluation assesses the crime prediction techniques based on four criteria, while the experimental evaluation ranks the algorithms that employ the same sub-technique, the different sub-techniques that employ the same technique, the different techniques that employ the same methodology sub-category, the different methodology sub-categories within the same category, and the different methodology categories. The combination of methodological taxonomy, empirical evaluations, and experimental comparisons allows for a nuanced and comprehensive understanding of crime prediction algorithms, aiding researchers in making informed decisions. Finally, the paper provides a glimpse into the future of crime prediction techniques, highlighting potential advancements and opportunities for further research in this field


title: ChatDiet: Empowering Personalized Nutrition-Oriented Food Recommender Chatbots through an LLM-Augmented Framework

abstract: The profound impact of food on health necessitates advanced nutrition-oriented food recommendation services. Conventional methods often lack the crucial elements of personalization, explainability, and interactivity. While Large Language Models (LLMs) bring interpretability and explainability, their standalone use falls short of achieving true personalization. In this paper, we introduce ChatDiet, a novel LLM-powered framework designed specifically for personalized nutrition-oriented food recommendation chatbots. ChatDiet integrates personal and population models, complemented by an orchestrator, to seamlessly retrieve and process pertinent information. The personal model leverages causal discovery and inference techniques to assess personalized nutritional effects for a specific user, whereas the population model provides generalized information on food nutritional content. The orchestrator retrieves, synergizes and delivers the output of both models to the LLM, providing tailored food recommendations designed to support targeted health outcomes. The result is a dynamic delivery of personalized and explainable food recommendations, tailored to individual user preferences. Our evaluation of ChatDiet includes a compelling case study, where we establish a causal personal model to estimate individual nutrition effects. Our assessments, including a food recommendation test showcasing a 92\% effectiveness rate, coupled with illustrative dialogue examples, underscore ChatDiet's strengths in explainability, personalization, and interactivity.


title: Ploutos: Towards interpretable stock movement prediction with financial large language model

abstract: Recent advancements in large language models (LLMs) have opened new pathways for many domains. However, the full potential of LLMs in financial investments remains largely untapped. There are two main challenges for typical deep learning-based methods for quantitative finance. First, they struggle to fuse textual and numerical information flexibly for stock movement prediction. Second, traditional methods lack clarity and interpretability, which impedes their application in scenarios where the justification for predictions is essential. To solve the above challenges, we propose Ploutos, a novel financial LLM framework that consists of PloutosGen and PloutosGPT. The PloutosGen contains multiple primary experts that can analyze different modal data, such as text and numbers, and provide quantitative strategies from different perspectives. Then PloutosGPT combines their insights and predictions and generates interpretable rationales. To generate accurate and faithful rationales, the training strategy of PloutosGPT leverage rearview-mirror prompting mechanism to guide GPT-4 to generate rationales, and a dynamic token weighting mechanism to finetune LLM by increasing key tokens weight. Extensive experiments show our framework outperforms the state-of-the-art methods on both prediction accuracy and interpretability.


title: On the Roles of LLMs in Planning: Embedding LLMs into Planning Graphs

abstract: Plan synthesis aims to generate a course of actions or policies to transit given initial states to goal states, provided domain models that could be designed by experts or learnt from training data or interactions with the world. Intrigued by the claims of emergent planning capabilities in large language models (LLMs), works have been proposed to investigate the planning effectiveness of LLMs, without considering any utilization of off-the-shelf planning techniques in LLMs. In this paper, we aim to further study the insight of the planning capability of LLMs by investigating the roles of LLMs in off-the-shelf planning frameworks. To do this, we investigate the effectiveness of embedding LLMs into one of the well-known planning frameworks, graph-based planning, proposing a novel LLMs-based planning framework with LLMs embedded in two levels of planning graphs, i.e., mutual constraints generation level and constraints solving level. We empirically exhibit the effectiveness of our proposed framework in various planning domains.


title: Utilizing BERT for Information Retrieval: Survey, Applications, Resources, and Challenges

abstract: Recent years have witnessed a substantial increase in the use of deep learning to solve various natural language processing (NLP) problems. Early deep learning models were constrained by their sequential or unidirectional nature, such that they struggled to capture the contextual relationships across text inputs. The introduction of bidirectional encoder representations from transformers (BERT) leads to a robust encoder for the transformer model that can understand the broader context and deliver state-of-the-art performance across various NLP tasks. This has inspired researchers and practitioners to apply BERT to practical problems, such as information retrieval (IR). A survey that focuses on a comprehensive analysis of prevalent approaches that apply pretrained transformer encoders like BERT to IR can thus be useful for academia and the industry. In light of this, we revisit a variety of BERT-based methods in this survey, cover a wide range of techniques of IR, and group them into six high-level categories: (i) handling long documents, (ii) integrating semantic information, (iii) balancing effectiveness and efficiency, (iv) predicting the weights of terms, (v) query expansion, and (vi) document expansion. We also provide links to resources, including datasets and toolkits, for BERT-based IR systems. A key highlight of our survey is the comparison between BERT's encoder-based models and the latest generative Large Language Models (LLMs), such as ChatGPT, which rely on decoders. Despite the popularity of LLMs, we find that for specific tasks, finely tuned BERT encoders still outperform, and at a lower deployment cost. Finally, we summarize the comprehensive outcomes of the survey and suggest directions for future research in the area.


title: Applying News and Media Sentiment Analysis for Generating Forex Trading Signals

abstract: The objective of this research is to examine how sentiment analysis can be employed to generate trading signals for the Foreign Exchange (Forex) market. The author assessed sentiment in social media posts and news articles pertaining to the United States Dollar (USD) using a combination of methods: lexicon-based analysis and the Naive Bayes machine learning algorithm. The findings indicate that sentiment analysis proves valuable in forecasting market movements and devising trading signals. Notably, its effectiveness is consistent across different market conditions. The author concludes that by analyzing sentiment expressed in news and social media, traders can glean insights into prevailing market sentiments towards the USD and other pertinent countries, thereby aiding trading decision-making. This study underscores the importance of weaving sentiment analysis into trading strategies as a pivotal tool for predicting market dynamics.


title: Leveraging Contrastive Learning for Few-shot Geolocation of Social Posts

abstract: Social geolocation is an important problem of predicting the originating locations of social media posts. However, this task is challenging due to the need for a substantial volume of training data, alongside well-annotated labels. These issues are further exacerbated by new or less popular locations with insufficient labels, further leading to an imbalanced dataset. In this paper, we propose \textbf{ContrastGeo}, a \textbf{Contrast}ive learning enhanced framework for few-shot social \textbf{Geo}location. Specifically, a Tweet-Location Contrastive learning objective is introduced to align representations of tweets and locations within tweet-location pairs. To capture the correlations between tweets and locations, a Tweet-Location Matching objective is further adopted into the framework and refined via an online hard negative mining approach. We also develop three fusion strategies with various fusion encoders to better generate joint representations of tweets and locations. Comprehensive experiments on three social media datasets highlight ContrastGeo's superior performance over several state-of-the-art baselines in few-shot social geolocation.


title: Reusable MLOps: Reusable Deployment, Reusable Infrastructure and Hot-Swappable Machine Learning models and services

abstract: Although Machine Learning model building has become increasingly accessible due to a plethora of tools, libraries and algorithms being available freely, easy operationalization of these models is still a problem. It requires considerable expertise in data engineering, software development, cloud and DevOps. It also requires planning, agreement, and vision of how the model is going to be used by the business applications once it is in production, how it is going to be continuously trained on fresh incoming data, and how and when a newer model would replace an existing model. This leads to developers and data scientists working in silos and making suboptimal decisions. It also leads to wasted time and effort. We introduce the Acumos AI platform we developed and we demonstrate some unique novel capabilities that the Acumos model runner possesses, that can help solve the above problems. We introduce a new sustainable concept in the field of AI/ML operations - called Reusable MLOps - where we reuse the existing deployment and infrastructure to serve new models by hot-swapping them without tearing down the infrastructure or the microservice, thus achieving reusable deployment and operations for AI/ML models while still having continuously trained models in production.


title: PRECISE Framework: GPT-based Text For Improved Readability, Reliability, and Understandability of Radiology Reports For Patient-Centered Care

abstract: This study introduces and evaluates the PRECISE framework, utilizing OpenAI's GPT-4 to enhance patient engagement by providing clearer and more accessible chest X-ray reports at a sixth-grade reading level. The framework was tested on 500 reports, demonstrating significant improvements in readability, reliability, and understandability. Statistical analyses confirmed the effectiveness of the PRECISE approach, highlighting its potential to foster patient-centric care delivery in healthcare decision-making.


title: A note on identifying continuous gravitational wave emission signatures of magnetars in gamma-ray bursts

abstract: Continuous gravitational waves (GWs) of neutrons stars haven't been detected directly until now. One possible way to indirectly identify their signatures is via the correlation between magnetars and gamma-ray bursts (GRBs), since, under this magnetar scenario of GRBs, GW radiation can affect the evolution of GRB X-ray light curves. Nevertheless, relevant studies lack essential details of this GRB magnetar scenario. For instance, the authors tend to avoid answering the questions like why GRB X-ray light curves can record the information of gravitational wave emissions, what are the reliable criteria for selecting samples that can reveal GW information, and what are the limitations of this GRB-magnetar scenario. In this paper, we elucidate these issues in detail.


title: Structuring Concept Space with the Musical Circle of Fifths by Utilizing Music Grammar Based Activations

abstract: In this paper, we explore the intriguing similarities between the structure of a discrete neural network, such as a spiking network, and the composition of a piano piece. While both involve nodes or notes that are activated sequentially or in parallel, the latter benefits from the rich body of music theory to guide meaningful combinations. We propose a novel approach that leverages musical grammar to regulate activations in a spiking neural network, allowing for the representation of symbols as attractors. By applying rules for chord progressions from music theory, we demonstrate how certain activations naturally follow others, akin to the concept of attraction. Furthermore, we introduce the concept of modulating keys to navigate different basins of attraction within the network. Ultimately, we show that the map of concepts in our model is structured by the musical circle of fifths, highlighting the potential for leveraging music theory principles in deep learning algorithms.


title: $\textit{L+M-24}$: Building a Dataset for Language + Molecules @ ACL 2024

abstract: Language-molecule models have emerged as an exciting direction for molecular discovery and understanding. However, training these models is challenging due to the scarcity of molecule-language pair datasets. At this point, datasets have been released which are 1) small and scraped from existing databases, 2) large but noisy and constructed by performing entity linking on the scientific literature, and 3) built by converting property prediction datasets to natural language using templates. In this document, we detail the $\textit{L+M-24}$ dataset, which has been created for the Language + Molecules Workshop shared task at ACL 2024. In particular, $\textit{L+M-24}$ is designed to focus on three key benefits of natural language in molecule design: compositionality, functionality, and abstraction.


title: Theory and Computation of Substructure Characteristic Modes

abstract: The problem of substructure characteristic modes is reformulated using a scattering matrix-based formulation, generalizing subregion characteristic mode decomposition to arbitrary computational tools. It is shown that the scattering formulation is identical to the classical formulation based on the background Green's function for lossless systems. The scattering formulation, however, opens a variety of new subregion scenarios unavailable within previous formulations, including cases with lumped or wave ports or subregions in circuits. Thanks to its scattering nature, the formulation is solver-agnostic with the possibility to utilize an arbitrary full-wave method.


title: Ad Recommendation in a Collapsed and Entangled World

abstract: In this paper, we present an industry ad recommendation system, paying attention to the challenges and practices of learning appropriate representations. Our study begins by showcasing our approaches to preserving priors when encoding features of diverse types into embedding representations. Specifically, we address sequence features, numeric features, pre-trained embedding features, as well as sparse ID features. Moreover, we delve into two pivotal challenges associated with feature representation: the dimensional collapse of embeddings and the interest entanglement across various tasks or scenarios. Subsequently, we propose several practical approaches to effectively tackle these two challenges. We then explore several training techniques to facilitate model optimization, reduce bias, and enhance exploration. Furthermore, we introduce three analysis tools that enable us to comprehensively study feature correlation, dimensional collapse, and interest entanglement. This work builds upon the continuous efforts of Tencent's ads recommendation team in the last decade. It not only summarizes general design principles but also presents a series of off-the-shelf solutions and analysis tools. The reported performance is based on our online advertising platform, which handles hundreds of billions of requests daily, serving millions of ads to billions of users.


title: Getting Serious about Humor: Crafting Humor Datasets with Unfunny Large Language Models

abstract: Humor is a fundamental facet of human cognition and interaction. Yet, despite recent advances in natural language processing, humor detection remains a challenging task that is complicated by the scarcity of datasets that pair humorous texts with similar non-humorous counterparts. In our work, we investigate whether large language models (LLMs), can generate synthetic data for humor detection via editing texts. We benchmark LLMs on an existing human dataset and show that current LLMs display an impressive ability to 'unfun' jokes, as judged by humans and as measured on the downstream task of humor detection. We extend our approach to a code-mixed English-Hindi humor dataset, where we find that GPT-4's synthetic data is highly rated by bilingual annotators and provides challenging adversarial examples for humor classifiers.


title: Executing Natural Language-Described Algorithms with Large Language Models: An Investigation

abstract: Executing computer programs described in natural language has long been a pursuit of computer science. With the advent of enhanced natural language understanding capabilities exhibited by large language models (LLMs), the path toward this goal has been illuminated. In this paper, we seek to examine the capacity of present-day LLMs to comprehend and execute algorithms outlined in natural language. We established an algorithm test set sourced from Introduction to Algorithm, a well-known textbook that contains many representative widely-used algorithms. To systematically assess LLMs' code execution abilities, we selected 30 algorithms, generated 300 random-sampled instances in total, and evaluated whether popular LLMs can understand and execute these algorithms. Our findings reveal that LLMs, notably GPT-4, can effectively execute programs described in natural language, as long as no heavy numeric computation is involved. We believe our findings contribute to evaluating LLMs' code execution abilities and would encourage further investigation and application for the computation power of LLMs.


title: Enhancing Mean-Reverting Time Series Prediction with Gaussian Processes: Functional and Augmented Data Structures in Financial Forecasting

abstract: In this paper, we explore the application of Gaussian Processes (GPs) for predicting mean-reverting time series with an underlying structure, using relatively unexplored functional and augmented data structures. While many conventional forecasting methods concentrate on the short-term dynamics of time series data, GPs offer the potential to forecast not just the average prediction but the entire probability distribution over a future trajectory. This is particularly beneficial in financial contexts, where accurate predictions alone may not suffice if incorrect volatility assessments lead to capital losses. Moreover, in trade selection, GPs allow for the forecasting of multiple Sharpe ratios adjusted for transaction costs, aiding in decision-making. The functional data representation utilized in this study enables longer-term predictions by leveraging information from previous years, even as the forecast moves away from the current year's training data. Additionally, the augmented representation enriches the training set by incorporating multiple targets for future points in time, facilitating long-term predictions. Our implementation closely aligns with the methodology outlined in, which assessed effectiveness on commodity futures. However, our testing methodology differs. Instead of real data, we employ simulated data with similar characteristics. We construct a testing environment to evaluate both data representations and models under conditions of increasing noise, fat tails, and inappropriate kernels-conditions commonly encountered in practice. By simulating data, we can compare our forecast distribution over time against a full simulation of the actual distribution of our test set, thereby reducing the inherent uncertainty in testing time series models on real data. We enable feature prediction through augmentation and employ sub-sampling to ensure the feasibility of GPs.


title: Approximations in Besov Spaces and Jump Detection of Besov Functions with Bounded Variation

abstract: In this paper, we provide a proof that functions belonging to Besov spaces $B^{r}_{q,\infty}(\mathbb{R}^N,\mathbb{R}^d)$, $q\in [1,\infty)$, $r\in(0,1)$, satisfy the following formula under a certain condition: \begin{equation} \label{eq:main result in abstract} \lim_{{\epsilon}\to 0^+}\frac{1}{|\ln{\epsilon}|}\left[u_{\epsilon}\right]^q_{W^{r,q}(\mathbb{R}^N,\mathbb{R}^d)}=N\lim_{{\epsilon}\to 0^+}\int_{\mathbb{R}^N}\frac{1}{{\epsilon}^N}\int_{B_{\epsilon}(x)}\frac{|u(x)-u(y)|^q}{|x-y|^{rq}}dydx. \end{equation} Here, $\left[\cdot\right]_{W^{r,q}}$ represents the Gagliardo seminorm, and $u_{\epsilon}$ denotes the convolution of $u$ with a mollifier $\eta_{(\epsilon)}(x):=\frac{1}{\epsilon^N}\eta\left(\frac{x}{\epsilon}\right)$, $\eta\in W^{1,1}(\mathbb{R}^N),\int_{\mathbb{R}^N}\eta(z)dz=1$. Furthermore, we prove that every function $u$ in $BV(\mathbb{R}^N,\mathbb{R}^d)\cap B^{1/p}_{p,\infty}(\mathbb{R}^N,\mathbb{R}^d),p\in(1,\infty),$ satisfies \begin{multline} \lim_{\epsilon\to 0^+}\frac{1}{|\ln{\epsilon}|}\left[u_{\epsilon}\right]^q_{W^{1/q,q}(\mathbb{R}^N,\mathbb{R}^d)}=N\lim_{{\epsilon}\to 0^+}\int_{\mathbb{R}^N}\frac{1}{{\epsilon}^N}\int_{B_{\epsilon}(x)}\frac{|u(x)-u(y)|^q}{|x-y|}dydx =\left(\int_{S^{N-1}}|z_1|~d\mathcal{H}^{N-1}(z)\right)\int_{\mathcal{J}_u} \Big|u^+(x)-u^-(x)\Big|^q d\mathcal{H}^{N-1}(x), \end{multline} for every $1<q<p$. Here $u^+,u^-$ are the one-sided approximate limits of $u$ along the jump set $\mathcal{J}_u$.


title: Helen: Optimizing CTR Prediction Models with Frequency-wise Hessian Eigenvalue Regularization

abstract: Click-Through Rate (CTR) prediction holds paramount significance in online advertising and recommendation scenarios. Despite the proliferation of recent CTR prediction models, the improvements in performance have remained limited, as evidenced by open-source benchmark assessments. Current researchers tend to focus on developing new models for various datasets and settings, often neglecting a crucial question: What is the key challenge that truly makes CTR prediction so demanding? In this paper, we approach the problem of CTR prediction from an optimization perspective. We explore the typical data characteristics and optimization statistics of CTR prediction, revealing a strong positive correlation between the top hessian eigenvalue and feature frequency. This correlation implies that frequently occurring features tend to converge towards sharp local minima, ultimately leading to suboptimal performance. Motivated by the recent advancements in sharpness-aware minimization (SAM), which considers the geometric aspects of the loss landscape during optimization, we present a dedicated optimizer crafted for CTR prediction, named Helen. Helen incorporates frequency-wise Hessian eigenvalue regularization, achieved through adaptive perturbations based on normalized feature frequencies. Empirical results under the open-source benchmark framework underscore Helen's effectiveness. It successfully constrains the top eigenvalue of the Hessian matrix and demonstrates a clear advantage over widely used optimization algorithms when applied to seven popular models across three public benchmark datasets on BARS. Our code locates at github.com/NUS-HPC-AI-Lab/Helen.


title: An Empirical Study of Data Ability Boundary in LLMs' Math Reasoning

abstract: Large language models (LLMs) are displaying emergent abilities for math reasoning tasks,and there is a growing attention on enhancing the ability of open-source LLMs through supervised fine-tuning (SFT).In this paper, we aim to explore a general data strategy for supervised data to help optimize and expand math reasoning ability.Firstly, we determine the ability boundary of reasoning paths augmentation by identifying these paths' minimal optimal set.Secondly, we validate that different abilities of the model can be cumulatively enhanced by Mix of Minimal Optimal Sets of corresponding types of data, while our models MMOS achieve SOTA performance on series base models under much lower construction costs.Besides, we point out GSM-HARD is not really hard and today's LLMs no longer lack numerical robustness.Also, we provide an Auto Problem Generator for robustness testing and educational applications.Our code and data are publicly available at https://github.com/cyzhh/MMOS.


title: Brain-Inspired Two-Stage Approach: Enhancing Mathematical Reasoning by Imitating Human Thought Processes

abstract: Although large language models demonstrate emergent abilities in solving math word problems, there is a challenging task in complex multi-step mathematical reasoning tasks. To improve model performance on mathematical reasoning tasks, previous work has conducted supervised fine-tuning on open-source models by improving the quality and quantity of data. In this paper, we propose a novel approach, named Brain, to imitate human thought processes to enhance mathematical reasoning abilities, using the Frontal Lobe Model to generate plans, and then employing the Parietal Lobe Model to generate code and execute to obtain answers. First, we achieve SOTA performance in comparison with Code LLaMA 7B based models through this method. Secondly, we find that plans can be explicitly extracted from natural language, code, or formal language. Our code and data are publicly available at https://github.com/cyzhh/Brain.


title: Self-Retrieval: Building an Information Retrieval System with One Large Language Model

abstract: The rise of large language models (LLMs) has transformed the role of information retrieval (IR) systems in the way to humans accessing information. Due to the isolated architecture and the limited interaction, existing IR systems are unable to fully accommodate the shift from directly providing information to humans to indirectly serving large language models. In this paper, we propose Self-Retrieval, an end-to-end, LLM-driven information retrieval architecture that can fully internalize the required abilities of IR systems into a single LLM and deeply leverage the capabilities of LLMs during IR process. Specifically, Self-retrieval internalizes the corpus to retrieve into a LLM via a natural language indexing architecture. Then the entire retrieval process is redefined as a procedure of document generation and self-assessment, which can be end-to-end executed using a single large language model. Experimental results demonstrate that Self-Retrieval not only significantly outperforms previous retrieval approaches by a large margin, but also can significantly boost the performance of LLM-driven downstream applications like retrieval augumented generation.


title: Towards a Theoretical Understanding of Two-Stage Recommender Systems

abstract: Production-grade recommender systems rely heavily on a large-scale corpus used by online media services, including Netflix, Pinterest, and Amazon. These systems enrich recommendations by learning users' and items' embeddings projected in a low-dimensional space with two-stage models (two deep neural networks), which facilitate their embedding constructs to predict users' feedback associated with items. Despite its popularity for recommendations, its theoretical behaviors remain comprehensively unexplored. We study the asymptotic behaviors of the two-stage recommender that entail a strong convergence to the optimal recommender system. We establish certain theoretical properties and statistical assurance of the two-stage recommender. In addition to asymptotic behaviors, we demonstrate that the two-stage recommender system attains faster convergence by relying on the intrinsic dimensions of the input features. Finally, we show numerically that the two-stage recommender enables encapsulating the impacts of items' and users' attributes on ratings, resulting in better performance compared to existing methods conducted using synthetic and real-world data experiments.


title: LiMAML: Personalization of Deep Recommender Models via Meta Learning

abstract: In the realm of recommender systems, the ubiquitous adoption of deep neural networks has emerged as a dominant paradigm for modeling diverse business objectives. As user bases continue to expand, the necessity of personalization and frequent model updates have assumed paramount significance to ensure the delivery of relevant and refreshed experiences to a diverse array of members. In this work, we introduce an innovative meta-learning solution tailored to the personalization of models for individual members and other entities, coupled with the frequent updates based on the latest user interaction signals. Specifically, we leverage the Model-Agnostic Meta Learning (MAML) algorithm to adapt per-task sub-networks using recent user interaction data. Given the near infeasibility of productionizing original MAML-based models in online recommendation systems, we propose an efficient strategy to operationalize meta-learned sub-networks in production, which involves transforming them into fixed-sized vectors, termed meta embeddings, thereby enabling the seamless deployment of models with hundreds of billions of parameters for online serving. Through extensive experimentation on production data drawn from various applications at LinkedIn, we demonstrate that the proposed solution consistently outperforms the baseline models of those applications, including strong baselines such as using wide-and-deep ID based personalization approach. Our approach has enabled the deployment of a range of highly personalized AI models across diverse LinkedIn applications, leading to substantial improvements in business metrics as well as refreshed experience for our members.


title: Uncovering Customer Issues through Topological Natural Language Analysis

abstract: E-commerce companies deal with a high volume of customer service requests daily. While a simple annotation system is often used to summarize the topics of customer contacts, thoroughly exploring each specific issue can be challenging. This presents a critical concern, especially during an emerging outbreak where companies must quickly identify and address specific issues. To tackle this challenge, we propose a novel machine learning algorithm that leverages natural language techniques and topological data analysis to monitor emerging and trending customer issues. Our approach involves an end-to-end deep learning framework that simultaneously tags the primary question sentence of each customer's transcript and generates sentence embedding vectors. We then whiten the embedding vectors and use them to construct an undirected graph. From there, we define trending and emerging issues based on the topological properties of each transcript. We have validated our results through various methods and found that they are highly consistent with news sources.


title: A New Dynamic Distributed Planning Approach: Application to DPDP Problems

abstract: In this work, we proposed a new dynamic distributed planning approach that is able to take into account the changes that the agent introduces on his set of actions to be planned in order to take into account the changes that occur in his environment. Our approach fits into the context of distributed planning for distributed plans where each agent can produce its own plans. According to our approach the generation of the plans is based on the satisfaction of the constraints by the use of the genetic algorithms. Our approach is to generate, a new plan by each agent, whenever there is a change in its set of actions to plan. This in order to take into account the new actions introduced in its new plan. In this new plan, the agent takes, each time, as a new action set to plan all the old un-executed actions of the old plan and the new actions engendered by the changes and as a new initial state; the state in which the set of actions of the agent undergoes a change. In our work, we used a concrete case to illustrate and demonstrate the utility of our approach.


title: Enhanced User Interaction in Operating Systems through Machine Learning Language Models

abstract: With the large language model showing human-like logical reasoning and understanding ability, whether agents based on the large language model can simulate the interaction behavior of real users, so as to build a reliable virtual recommendation A/B test scene to help the application of recommendation research is an urgent, important and economic value problem. The combination of interaction design and machine learning can provide a more efficient and personalized user experience for products and services. This personalized service can meet the specific needs of users and improve user satisfaction and loyalty. Second, the interactive system can understand the user's views and needs for the product by providing a good user interface and interactive experience, and then use machine learning algorithms to improve and optimize the product. This iterative optimization process can continuously improve the quality and performance of the product to meet the changing needs of users. At the same time, designers need to consider how these algorithms and tools can be combined with interactive systems to provide a good user experience. This paper explores the potential applications of large language models, machine learning and interaction design for user interaction in recommendation systems and operating systems. By integrating these technologies, more intelligent and personalized services can be provided to meet user needs and promote continuous improvement and optimization of products. This is of great value for both recommendation research and user experience applications.