title: Energy, economy, and emissions: A non-linear state space approach to projections

abstract: We propose a non-linear state-space model to examine the relationship between CO$_2$ emissions, energy sources, and macroeconomic activity, using data from 1971 to 2019. CO$_2$ emissions are modeled as a weighted sum of fossil fuel use, with emission conversion factors that evolve over time to reflect technological changes. GDP is expressed as the outcome of linearly increasing energy efficiency and total energy consumption. The model is estimated using CO$_2$ data from the Global Carbon Budget, GDP statistics from the World Bank, and energy data from the International Energy Agency (IEA). Projections for CO$_2$ emissions and GDP from 2020 to 2100 from the model are based on energy scenarios from the Shared Socioeconomic Pathways (SSP) and the IEA's Net Zero roadmap. Emissions projections from the model are consistent with these scenarios but predict lower GDP growth. An alternative model version, assuming exponential energy efficiency improvement, produces GDP growth rates more in line with the benchmark projections. Our results imply that if internationally agreed net-zero objectives are to be fulfilled and economic growth is to follow SSP or IEA scenarios, then drastic changes in energy efficiency, not consistent with historical trends, are needed.


title: On the Thermal Transport Puzzles in $\alpha\mbox{-}\mathrm{RuCl}_3$

abstract: Thermal transport has been used to probe the nature of $\alpha\mbox{-}\mathrm{RuCl}_3$, an important candidate of Kitaev material. Two remarkable observations were made under applied magnetic fields at low temperatures, and have stimulated extensive discussions. One is a sizable thermal Hall effect, and the other is an apparent "oscillation" of the longitudinal thermal conductivity with the magnetic field. It has been proposed that the former is due to a bosonic Chern band. Meanwhile, the origin of the latter has largely remained obscure. This work aims to resolve this "oscillation" puzzle. By examining the thermal transport data as well as other measured properties of $\alpha\mbox{-}\mathrm{RuCl}_3$, we argue that the most plausible scenario is that of phonons scattering with spin degrees of freedom across multiple phases. We substantiate this picture into a phenomenological theory, which reproduces the "oscillation" behavior in a simple manner and makes predictions that can be examined by future experiments. Moreover, our phenomenological theory and the aforementioned proposal for the thermal Hall effect support each other. We hope this work can thus help settle the physical mechanism behind the thermal transport puzzles in $\alpha\mbox{-}\mathrm{RuCl}_3$.


title: Unimodular-like times, evolution and Brans-Dicke Gravity

abstract: In unimodular-like theories, the constants of nature are demoted from pre-given parameters to phase space variables. Their canonical duals provide physical time variables. We investigate how this interacts with an alternative approach to varying constants, where they are replaced by dynamical scalar fields. Specifically we investigate the Brans-Dicke theory of gravity and its interaction with clocks dual to the cosmological constant, the Planck mass, etc. We crucially distinguish between the different role of Newton's G in this process, leading to the possibility of local Lorentz invariance violation. A large number of possible theories emerge, for example where the Brans-Dicke coupling, omega, depends on unimodular-like times (in a generalization of scalar-tensor theories), or even become the dual variable to unimodular-like clocks ticking variations in other demoted constants, such as the cosmological constant. We scan the space of possible theories and select those most interesting regarding the joint variations of the Brans-Dicke omega and other parameters, (such as the cosmological constant); and also regarding their energy conservation violation properties. This ground work is meant to provide the formalism for further developments, namely regarding cosmology, black holes and the cosmological constant problem.


title: Planar stick indices of some knotted graphs

abstract: Two isomorphic graphs can have inequivalent spatial embeddings in 3-space. In this way, an isomorphism class of graphs contains many spatial graph types. A common way to measure the complexity of a spatial graph type is to count the minimum number of straight sticks needed for its construction in 3-space. In this paper, we give estimates of this quantity by enumerating stick diagrams in a plane. In particular, we compute the planar stick indices of knotted graphs with low crossing numbers. We also show that if a bouquet graph or a theta-curve has the property that its proper subgraphs are all trivial, then the planar stick index must be at least seven.


title: On the spectral gap of Cayley graphs

abstract: Let $\Gamma$ be a Cayley graph, or a Cayley sum graph, or a twisted Cayley graph, or a twisted Cayley sum graph, or a vertex-transitive graph. Suppose $\Gamma$ is undirected and non-bipartite. Let $\mu$ (resp. $\mu_2$) denote the smallest (resp. the second largest) eigenvalue of the normalized adjacency operator of $\Gamma$, and $d$ denote the degree of $\Gamma$. We show that $1+ \mu = \Omega((1-\mu_2)/d)$ holds.


title: Statistical Inference on Latent Space Models for Network Data

abstract: Latent space models are powerful statistical tools for modeling and understanding network data. While the importance of accounting for uncertainty in network analysis has been well recognized, the current literature predominantly focuses on point estimation and prediction, leaving the statistical inference of latent space models an open question. This work aims to fill this gap by providing a general framework to analyze the theoretical properties of the maximum likelihood estimators. In particular, we establish the uniform consistency and asymptotic distribution results for the latent space models under different edge types and link functions. Furthermore, the proposed framework enables us to generalize our results to the dependent-edge and sparse scenarios. Our theories are supported by simulation studies and have the potential to be applied in downstream inferences, such as link prediction and network testing problems.


title: A Markovian Gau\ss \, Inequality for Asymmetric Deviations from the Mode of Symmetric Unimodal Distributions

abstract: For a random variable with a unimodal distribution and finite second moment Gau\ss \, (1823) proved a sharp bound on the probability of the random variable to be outside a symmetric interval around its mode. An alternative proof for it is given based on Khintchine's representation of unimodal random variables. Analogously, a sharp inequality is proved for the slightly broader class of unimodal distributions with finite first absolute moment, which might be called a Markovian Gau\ss\ inequality. For symmetric unimodal distributions with finite second moment Semenikhin (2019) generalized Gau\ss's inequality to arbitrary intervals. For the class of symmetric unimodal distributions with finite first absolute moment we construct a Markovian version of it. Related inequalities of Volkov (1969) and Sellke and Sellke (1997) will be discussed as well.


title: DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection

abstract: Reconstruction-based approaches have achieved remarkable outcomes in anomaly detection. The exceptional image reconstruction capabilities of recently popular diffusion models have sparked research efforts to utilize them for enhanced reconstruction of anomalous images. Nonetheless, these methods might face challenges related to the preservation of image categories and pixel-wise structural integrity in the more practical multi-class setting. To solve the above problems, we propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection, which consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Firstly, The SG network is proposed for reconstructing anomalous regions while preserving the original image's semantic information. Secondly, we introduce Spatial-aware Feature Fusion (SFF) block to maximize reconstruction accuracy when dealing with extensively reconstructed areas. Thirdly, the input and reconstructed images are processed by a pre-trained feature extractor to generate anomaly maps based on features extracted at different scales. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach which surpasses the state-of-the-art methods, e.g., achieving 96.8/52.6 and 97.2/99.0 (AUROC/AP) for localization and detection respectively on multi-class MVTec-AD dataset. Code will be available at https://lewandofskee.github.io/projects/diad.


title: Information theory for data-driven model reduction in physics and biology

abstract: Model reduction is the construction of simple yet predictive descriptions of the dynamics of many-body systems in terms of a few relevant variables. A prerequisite to model reduction is the identification of these relevant variables, a task for which no general method exists. Here, we develop a systematic approach based on the information bottleneck to identify the relevant variables, defined as those most predictive of the future. We elucidate analytically the relation between these relevant variables and the eigenfunctions of the transfer operator describing the dynamics. Further, we show that in the limit of high compression, the relevant variables are directly determined by the slowest-decaying eigenfunctions. Our information-based approach indicates when to optimally stop increasing the complexity of the reduced model. Furthermore, it provides a firm foundation to construct interpretable deep learning tools that perform model reduction. We illustrate how these tools work in practice by considering uncurated videos of atmospheric flows from which our algorithms automatically extract the dominant slow collective variables, as well as experimental videos of cyanobacteria colonies in which we discover an emergent synchronization order parameter.

categories: cond-mat.stat-mech cs.IT cs.LG math.IT nlin.CD physics.bio-ph


title: Finer characterization of bounded languages described by GF(2)-grammars

abstract: GF(2)-grammars are a somewhat recently introduced grammar family that have some unusual algebraic properties and are closely connected to unambiguous grammars. In "Bounded languages described by GF(2)-grammars", Makarov proved a necessary condition for subsets of $a_1^* a_2^* \cdots a_k^*$ to be described by some GF(2)-grammar. By extending these methods further, we prove an even stronger upper bound for these languages. Moreover, we establish a lower bound that closely matches the proven upper bound. Also, we prove the exact characterization for the special case of linear GF(2)-grammars. Finally, by using the previous result, we show that the class of languages described by linear GF(2)-grammars is not closed under GF(2)-concatenation


title: Difference-Isomorphic Graph Families

abstract: Many well-studied problems in extremal combinatorics deal with the maximum possible size of a family of objects in which every pair of objects satisfies a given restriction. One problem of this type was recently raised by Alon, Gujgiczer, K\"orner, Milojevi\'c and Simonyi. They asked to determine the maximum size of a family $\mathcal{G}$ of graphs on $[n]$, such that for every two $G_1,G_2 \in \mathcal{G}$, the graphs $G_1 \setminus G_2$ and $G_2 \setminus G_1$ are isomorphic. We completely resolve this problem by showing that this maximum is exactly $2^{\frac{1}{2}\big(\binom{n}{2} - \lfloor \frac{n}{2}\rfloor\big)}$ and characterizing all the extremal constructions. We also prove an analogous result for $r$-uniform hypergraphs.


title: Diamonds in Klein geometry

abstract: Recently it was suggested that the Unruh effect might occur in metamaterials at accessible Unruh temperatures. In some cases, the class of metamaterials that may be useful for this observation has a Klein instead of a Minkowski signature. Thus, confirmation of this effect in those materials requires more careful analysis. In this paper, we use the path integral formulation of Quantum Field Theory to investigate the analogous to the Unruh effect in Kleinian geometry. We calculate the analogous of the Unruh temperature for a scalar theory, provided we restrict the action in a convenient subspace of the Kleinian spacetime. As a consequence, we obtain the diamond temperature for a static observer with a finite lifetime. The result suggest metamaterials as a possible system to observe diamond regions.


title: Scalar fields in Bonnor-Melvin Universe with potential: A study of dynamics of spin-0 particles-antiparticles

abstract: This research focus on the investigation of relativistic quantum dynamics of spin0 scalar particles/fields through the utilization of the Klein-Gordon (KG) equation within the framework of an electrovacuum space-time in the presence of an external scalar potential. Specifically, we focus on a cylindrical symmetric Bonnor-Melvin magnetic universe with a cosmological constant, where the magnetic field aligns along the symmetry axis direction. We derive the radial wave equation of the KG-equation by considering a Cornell-type scalar potential in the background of magnetic universe and successfully obtain an analytical eigenvalue solution for spin-0 quantum system. Notably, our findings reveal that both the energy spectrum and the corresponding radial wave function are significantly influenced by the presence of the cosmological constant, the topology parameter of the space-time geometry, which induces a deficit in the angular coordinates, and the potential parameters.


title: Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism

abstract: Recent advances in deep learning for sequential data have given rise to fast and powerful models that produce realistic videos of talking humans. The state of the art in talking face generation focuses mainly on lip-syncing, being conditioned on audio clips. However, having the ability to synthesize talking humans from text transcriptions rather than audio is particularly beneficial for many applications and is expected to receive more and more attention, following the recent breakthroughs in large language models. For that, most methods implement a cascaded 2-stage architecture of a text-to-speech module followed by an audio-driven talking face generator, but this ignores the highly complex interplay between audio and visual streams that occurs during speaking. In this paper, we propose the first, to the best of our knowledge, text-driven audiovisual speech synthesizer that uses Transformers and does not follow a cascaded approach. Our method, which we call NEUral Text to ARticulate Talk (NEUTART), is a talking face generator that uses a joint audiovisual feature space, as well as speech-informed 3D facial reconstructions and a lip-reading loss for visual supervision. The proposed model produces photorealistic talking face videos with human-like articulation and well-synced audiovisual streams. Our experiments on audiovisual datasets as well as in-the-wild videos reveal state-of-the-art generation quality both in terms of objective metrics and human evaluation.


title: AttenScribble: Attentive Similarity Learning for Scribble-Supervised Medical Image Segmentation

abstract: The success of deep networks in medical image segmentation relies heavily on massive labeled training data. However, acquiring dense annotations is a time-consuming process. Weakly-supervised methods normally employ less expensive forms of supervision, among which scribbles started to gain popularity lately thanks to its flexibility. However, due to lack of shape and boundary information, it is extremely challenging to train a deep network on scribbles that generalizes on unlabeled pixels. In this paper, we present a straightforward yet effective scribble supervised learning framework. Inspired by recent advances of transformer based segmentation, we create a pluggable spatial self-attention module which could be attached on top of any internal feature layers of arbitrary fully convolutional network (FCN) backbone. The module infuses global interaction while keeping the efficiency of convolutions. Descended from this module, we construct a similarity metric based on normalized and symmetrized attention. This attentive similarity leads to a novel regularization loss that imposes consistency between segmentation prediction and visual affinity. This attentive similarity loss optimizes the alignment of FCN encoders, attention mapping and model prediction. Ultimately, the proposed FCN+Attention architecture can be trained end-to-end guided by a combination of three learning objectives: partial segmentation loss, a customized masked conditional random fields and the proposed attentive similarity loss. Extensive experiments on public datasets (ACDC and CHAOS) showed that our framework not just out-performs existing state-of-the-art, but also delivers close performance to fully-supervised benchmark. Code will be available upon publication.


title: Effects of rainbow gravity on charge-free scalar Bosons in Bonnor-Melvin s universe with cosmological constant

abstract: In this paper, we explore the relativistic quantum motion of spin-zero scalar particles influenced by rainbow gravity's in the background of a magnetic solution. Our focus is on the Bonnor-Melvin magnetic space-time, a four-dimensional solution featuring a non-zero cosmological constant. To analyze this scenario, we solve the Klein-Gordon equation using two sets of rainbow functions: (i) $f(\chi)=\frac{1}{(1-\beta\,\chi)}$, $h(\chi)=1$ and (ii) $f(\chi)=\frac{1}{(1-\beta\,\chi)}=h(\chi)$, where $0 < \chi(=\frac{|E|}{E_p}) \leq 1$ with $E_p$ being Planck's energy. The resulting solutions provide the relativistic energy profiles of the scalar particles. Furthermore, we study the quantum oscillator fields through the Klein-Gordon oscillator within the same Bonnor-Melvin magnetic space-time background. Employing $f(\chi)=\frac{1}{(1-\beta\,\chi)}$, $h(\chi)=1$ as the rainbow function, we obtain the eigenvalue solutions for the quantum oscillator fields. Notably, we demonstrate that the relativistic energy profile of scalar particles and the oscillator fields are influenced by the topology of the geometry and the cosmological constant both are connected with the magnetic field strength. Additionally, we highlight the impact of the rainbow parameter on the energy profiles.


title: The built environment and induced transport CO2 emissions: A double machine learning approach to account for residential self-selection

abstract: Understanding why travel behavior differs between residents of urban centers and suburbs is key to sustainable urban planning. Especially in light of rapid urban growth, identifying housing locations that minimize travel demand and induced CO2 emissions is crucial to mitigate climate change. While the built environment plays an important role, the precise impact on travel behavior is obfuscated by residential self-selection. To address this issue, we propose a double machine learning approach to obtain unbiased, spatially-explicit estimates of the effect of the built environment on travel-related CO2 emissions for each neighborhood by controlling for residential self-selection. We examine how socio-demographics and travel-related attitudes moderate the effect and how it decomposes across the 5Ds of the built environment. Based on a case study for Berlin and the travel diaries of 32,000 residents, we find that the built environment causes household travel-related CO2 emissions to differ by a factor of almost two between central and suburban neighborhoods in Berlin. To highlight the practical importance for urban climate mitigation, we evaluate current plans for 64,000 new residential units in terms of total induced transport CO2 emissions. Our findings underscore the significance of spatially differentiated compact development to decarbonize the transport sector.


title: Operators on nonlinear metric measure spaces I: A New Laplacian comparison theorem on Finsler manifolds and a generalized Li-Yau approach to gradient estimates of Finslerian Schr\"odinger equation

abstract: This paper is the first in a series of paper where we describe the differential operators on general nonlinear metric measure spaces, namely, the Finsler spaces. We try to propose a general method for gradient estimates of the positive solutions to nonlinear parabolic (or elliptic) equations on both compact and noncompact forward complete Finsler manifolds. The key of this approach is to find a valid comparison theorem, and particularly, to find related suitable curvature conditions. Actually, we define some non-Riemannian tensors and a generalization of the weighted Ricci curvature, called the mixed weighted Ricci curvature. With the assistance of these concepts, we prove a new kind of Laplacian comparison theorem. As an illustration of such method, we apply it to Finslerian Schr\"odinger equation. The Schr\"odinger equation is a typical class of parabolic equations, and the gradient estimation of their positive solution is representative. In this paper, based on the new Laplacian comparison theorem, we give global and local Li-Yau type gradient estimates for positive solutions to the Finslerian Schr\"odinger equation with respect to two different mixed weighted Ricci curvature conditions.


title: Scalar Product for a Version of Minisuperspace Model with Grassmann Variables

abstract: Grassmann variables are used to formally transform a system with constraints into an unconstrained system. As a result, the Schr\"{o}dinger equation arises instead of the Wheeler-DeWitt one. The Schr\"{o}dinger equation describes a system's evolution, but a definition of the scalar product is needed to calculate the mean values of the operators. We suggest an explicit formula for the scalar product related to the Klein-Gordon scalar product. The calculation of the mean values is compared with an etalon method in which a redundant degree of freedom is excluded. Nevertheless, we note that a complete correspondence with the etalon picture is not found. Apparently, the picture with Grassmann variables requires a further understanding of the underlying Hilbert space.


title: Emergence of Scale-Free Networks in Social Interactions among Large Language Models

abstract: Scale-free networks are one of the most famous examples of emergent behavior and are ubiquitous in social systems, especially online social media in which users can follow each other. By analyzing the interactions of multiple generative agents using GPT3.5-turbo as a language model, we demonstrate their ability to not only mimic individual human linguistic behavior but also exhibit collective phenomena intrinsic to human societies, in particular the emergence of scale-free networks. We discovered that this process is disrupted by a skewed token prior distribution of GPT3.5-turbo, which can lead to networks with extreme centralization as a kind of alignment. We show how renaming agents removes these token priors and allows the model to generate a range of networks from random networks to more realistic scale-free networks.


title: Greybody Factor for a Non Accelerated Charged Modified Black Hole in anti-de Sitter Regime

abstract: This paper investigates the greybody factor for a non accelerated black hole with modified Maxwell electrodynamics in an anti-de Sitter regime. For this purpose, we compute the radial equation for a massless scalar field with the help of Klein-Gordon equation. We then formulate effective potential by transforming this equation into Schrodinger wave equation. We analyze the graphical behavior of effective potential for different values of mass, parameter characterizing the modified Maxwell theory, anti-de Sitter radius and electromagnetic charge parameters. The exact solutions are computed at two different horizons, i.e., event and cosmological horizons through the radial equation. Furthermore, we match the obtained solutions in an intermediate regime to enhance feasibility of the greybody factor over the entire domain and check its behavior graphically. It is found that the greybody factor has a direct relation with the radius, electromagnetic charge as well as angular momentum of the black hole and an inverse relation with the anti-de Sitter radius and modification parameter. We conclude that the modified Maxwell solution reduces the emission rate of the black hole.


title: Interplay of baryonic chiral partners in fluctuations of net-baryon number density

abstract: In this contribution, we use the parity doublet model to investigate the fluctuations of the net-baryon number density. We discuss the systematics of the susceptibilities and their ratios for nucleons of positive and negative parity, as well as their correlator. We demonstrate that the fluctuations of positive-parity nucleon do not reflect the fluctuations of the total net-baryon number at the chiral phase transition.


title: Search and Rescue on a Poset

abstract: A Search and Rescue game (SR game) is a new type of game on a graph that has quickly found applications in scheduling, object detection, and adaptive search. In this paper, we broaden the definition of SR games by putting them into the context of ordered sets and Bayesian networks, extending known solutions of these games and opening up the way to further applications.


title: Model selection for risk analysis of wastewater networks

abstract: In this paper, we test various models of wastewater infrastructure for risk analysis and compare their performance. While many representations are available, existing studies do not consider selection of the appropriate model for risk analysis. In this paper, we define two characteristics of wastewater models: the network granularity and the fidelity of the governing equations. We consider different combinations of these characteristics to determine 6 network representations that could be used as the foundation for risk analysis. We test the performance of each model as compared to predictions from the most detailed model, the full network with dynamic wave flow equations. We demonstrate the model selection for Seaside, Oregon. We conclude that the full network granularity is needed as compared to a coarse network representation. For the fidelity of the governing equations, connectivity analysis is reasonable if the primary goal is to determine the spatial distribution of hazard impact. To more accurately predict nodal performance measures, the dynamic wave equations are needed as they capture important physical phenomena.


title: How To Program Your Own Quantum Computer or QUBE: QUantum computing for BEginners

abstract: Do you think you need to know quantum physics to understand how a quantum computer works? Nope, no worries there. You don't need a deep dive into physics or mathematics, just a bit of familiarity with vectors and matrix multiplication. That's really it. A good handle on Python programming and a few numpy functions will do the trick, specifically reshape(), kron(), matmul(), swapaxes(), linalg.norm(), and random.choice(). In fact, an appendix shows that twelve lines of Python code suffice to define a complete simulator. The whole point of this article is to give you an informal, brief, hopefully digestible and educational description of how you can easily implement your own quantum computer simulator. It's not about `Yet Another Quantum Computer Simulator' (YAQCS?), which are a dime a dozen, but about how to build your own. And, honestly, there's probably no better way to learn how a quantum computer works!


title: Decoding Mean Field Games from Population and Environment Observations By Gaussian Processes

abstract: This paper presents a Gaussian Process (GP) framework, a non-parametric technique widely acknowledged for regression and classification tasks, to address inverse problems in mean field games (MFGs). By leveraging GPs, we aim to recover agents' strategic actions and the environment's configurations from partial and noisy observations of the population of agents and the setup of the environment. Our method is a probabilistic tool to infer the behaviors of agents in MFGs from data in scenarios where the comprehensive dataset is either inaccessible or contaminated by noises.


title: A note on restriction rules

abstract: We consider a certain class of infinitary rules of inference, called here restriction rules, using of which allows us to deduce complete theories of given models. The first instance of such rules was the $\omega$-rule introduced by Hilbert, and generalizations of the $\omega$-rule were first considered by Henkin. Later on Barwise showed that within countable languages, for any countable model $\mathfrak M$, first-order logic expanded by the corresponding $\mathfrak M$-rule deduces from the diagram of $\mathfrak M$ all formulas that are true in all models that include $\mathfrak M$, in particular, it deduces the (relativized) complete theory of $\mathfrak M$. We show that, if the aim is only deducing the complete theory of a given model, these countability assumptions can be omitted. Moreover, similar facts hold for infinitary and higher-order logics, even if these logics are highly incomplete. Finally, we show that Barwise's theorem in its stronger form, for vocabularies of arbitrary cardinality, holds for infinitary logics $\mathscr L_{\kappa,\lambda}$ whenever $\kappa$ is supercompact. The note also contains brief historical remarks.


title: An adversarial attack approach for eXplainable AI evaluation on deepfake detection models

abstract: With the rising concern on model interpretability, the application of eXplainable AI (XAI) tools on deepfake detection models has been a topic of interest recently. In image classification tasks, XAI tools highlight pixels influencing the decision given by a model. This helps in troubleshooting the model and determining areas that may require further tuning of parameters. With a wide range of tools available in the market, choosing the right tool for a model becomes necessary as each one may highlight different sets of pixels for a given image. There is a need to evaluate different tools and decide the best performing ones among them. Generic XAI evaluation methods like insertion or removal of salient pixels/segments are applicable for general image classification tasks but may produce less meaningful results when applied on deepfake detection models due to their functionality. In this paper, we perform experiments to show that generic removal/insertion XAI evaluation methods are not suitable for deepfake detection models. We also propose and implement an XAI evaluation approach specifically suited for deepfake detection models.


title: Coherent states of quantum spacetimes for black holes and de Sitter spacetime

abstract: We provide a group theory approach to coherent states describing quantum space-time and its properties. This provides a relativistic framework for the metric of a Riemmanian space with bosonic and fermionic coordinates, its continuum and discrete states, and a kind of {\it"quantum optics"} for the space-time. {\bf New} results of this paper are: (i) The space-time is described as a physical coherent state of the complete covering of the SL(2C) group, eg the Metaplectic group Mp(n). (ii) (The discrete structure arises from its two irreducible: $\textit{even}$ $(2n)$ and $\textit{odd}$ $(2n\;+\;1)\;$ representations, ($n = 1,\, 2, \,3\,...$ ), spanning the complete Hilbert space $\mathcal{H} = \mathcal{H}_{odd}\oplus \mathcal{H}_{even}$. Such a global or {\it complete} covering guarantees the CPT symmetry and unitarity. Large $n$ yields the classical and continuum manifold, as it must be. (iii) The coherent and squeezed states and Wigner functions of quantum-space-time for black holes and de Sitter, and (iv) for the quantum space-imaginary time (instantons), black holes in particular. They encompass the semiclassical space-time behaviour plus high quantum phase oscillations, and notably account for the classical-quantum gravity duality and trans-Planckian domain. The Planck scale consistently corresponds to the coherent state eigenvalue $\alpha = 0$ (and to the $n = 0$ level in the discrete representation). It is remarkable the power of coherent states in describing both continuum and discrete space-time. The quantum space-time description is {\it regular}, there is no any space-time singularity here, as it must be.


title: A Family of Iterated Maps on Natural Numbers

abstract: In this paper, we introduce and study the iterates of the following family of functions $\varphi_k$ defined on natural numbers which exhibits nice properties. $$\varphi_k(x)=\left\lbrace \begin{array}{ll} x+k, & \mbox{ if $x$ is prime;}\\ \mbox{largest prime divisor of $x$,} & \mbox{ if $x$ is composite;} \end{array} \right.$$ In particular, we study the periodic behaviour of the trajectories of these iterated functions. In some cases, we provide proofs of these properties and in some other cases we pose some open problems based on numerical evidences supported by heuristic arguments.


title: TMT-VIS: Taxonomy-aware Multi-dataset Joint Training for Video Instance Segmentation

abstract: Training on large-scale datasets can boost the performance of video instance segmentation while the annotated datasets for VIS are hard to scale up due to the high labor cost. What we possess are numerous isolated filed-specific datasets, thus, it is appealing to jointly train models across the aggregation of datasets to enhance data volume and diversity. However, due to the heterogeneity in category space, as mask precision increases with the data volume, simply utilizing multiple datasets will dilute the attention of models on different taxonomies. Thus, increasing the data scale and enriching taxonomy space while improving classification precision is important. In this work, we analyze that providing extra taxonomy information can help models concentrate on specific taxonomy, and propose our model named Taxonomy-aware Multi-dataset Joint Training for Video Instance Segmentation (TMT-VIS) to address this vital challenge. Specifically, we design a two-stage taxonomy aggregation module that first compiles taxonomy information from input videos and then aggregates these taxonomy priors into instance queries before the transformer decoder. We conduct extensive experimental evaluations on four popular and challenging benchmarks, including YouTube-VIS 2019, YouTube-VIS 2021, OVIS, and UVO. Our model shows significant improvement over the baseline solutions, and sets new state-of-the-art records on all benchmarks. These appealing and encouraging results demonstrate the effectiveness and generality of our approach. The code is available at https://github.com/rkzheng99/TMT-VIS .


title: New black hole mergers in the LIGO-Virgo O3 data from a gravitational wave search including higher-order harmonics

abstract: Nearly all of the previous gravitational wave (GW) searches in the LIGO-Virgo data included GW waveforms with only the dominant quadrupole mode, i.e., omitting higher-order harmonics which are predicted by general relativity. Based on the techniques developed in Wadekar et al. [1,2], we improve the IAS pipeline by ($i$) introducing higher harmonics in the GW templates, ($ii$) downweighting noise transients ('glitches') to improve the search sensitivity to high-mass and high-redshift binary black hole (BBH) mergers. We find 14 new BBH mergers with $0.53\leq p_{\rm astro}\leq 0.88$ on running our pipeline over the public LIGO-Virgo data from the O3 run (we use the detection threshold as $p_{\rm astro}>0.5$ following the approach of other pipelines). We also broadly recover the high-significance events from earlier catalogs, except some which were either vetoed or fell below our SNR threshold for trigger collection. A few notable properties of our new candidate events are as follows. At $>95$\% credibility, 4 candidates have total masses in the IMBH range (i.e., above 100 $M_\odot$), and 9 candidates have $z>0.5$. 9 candidates have median mass of the primary BH falling roughly within the pair instability mass gap, with the highest primary mass being $300_{+60}^{-120} M_\odot$. 5 candidates have median mass ratio $q < 0.5$. Under a prior uniform in effective spin $\chi_{\rm eff}$, 6 candidates have $\chi_{\rm eff} > 0$ at $>95\%$ credibility. We also find that including higher harmonics in our search raises the significance of a few previously reported marginal events (e.g., GW190711_030756). While our new candidate events have modest false alarm rates ($\gtrsim 1.6 $/yr), a population inference study including these can better inform the parameter space of BHs corresponding to the pair instability mass gap, high redshifts, positive effective spins and asymmetric mass ratios.

categories: gr-qc astro-ph.CO astro-ph.HE astro-ph.IM


title: Control Risk for Potential Misuse of Artificial Intelligence in Science

abstract: The expanding application of Artificial Intelligence (AI) in scientific fields presents unprecedented opportunities for discovery and innovation. However, this growth is not without risks. AI models in science, if misused, can amplify risks like creation of harmful substances, or circumvention of established regulations. In this study, we aim to raise awareness of the dangers of AI misuse in science, and call for responsible AI development and use in this domain. We first itemize the risks posed by AI in scientific contexts, then demonstrate the risks by highlighting real-world examples of misuse in chemical science. These instances underscore the need for effective risk management strategies. In response, we propose a system called SciGuard to control misuse risks for AI models in science. We also propose a red-teaming benchmark SciMT-Safety to assess the safety of different systems. Our proposed SciGuard shows the least harmful impact in the assessment without compromising performance in benign tests. Finally, we highlight the need for a multidisciplinary and collaborative effort to ensure the safe and ethical use of AI models in science. We hope that our study can spark productive discussions on using AI ethically in science among researchers, practitioners, policymakers, and the public, to maximize benefits and minimize the risks of misuse.


title: Examining the Effect of Implementation Factors on Deep Learning Reproducibility

abstract: Reproducing published deep learning papers to validate their conclusions can be difficult due to sources of irreproducibility. We investigate the impact that implementation factors have on the results and how they affect reproducibility of deep learning studies. Three deep learning experiments were ran five times each on 13 different hardware environments and four different software environments. The analysis of the 780 combined results showed that there was a greater than 6% accuracy range on the same deterministic examples introduced from hardware or software environment variations alone. To account for these implementation factors, researchers should run their experiments multiple times in different hardware and software environments to verify their conclusions are not affected.


title: Data-Driven Bifurcation Analysis via Learning of Homeomorphism

abstract: This work proposes a data-driven approach for bifurcation analysis in nonlinear systems when the governing differential equations are not available. Specifically, regularized regression with barrier terms is used to learn a homeomorphism that transforms the underlying system to a reference linear dynamics -- either an explicit reference model with desired qualitative behavior, or Koopman eigenfunctions that are identified from some system data under a reference parameter value. When such a homeomorphism fails to be constructed with low error, bifurcation phenomenon is detected. A case study is performed on a planar numerical example where a pitchfork bifurcation exists.


title: Gated Linear Attention Transformers with Hardware-Efficient Training

abstract: Transformers with linear attention allow for efficient parallel training but can simultaneously be formulated as an RNN with 2D (matrix-valued) hidden states, thus enjoying linear-time inference complexity. However, linear attention generally underperforms ordinary softmax attention. Moreover, current implementations of linear attention lack I/O-awareness and are thus slower than highly optimized implementations of softmax attention. This work describes a hardware-efficient algorithm for linear attention that trades off memory movement against parallelizability. The resulting implementation, dubbed FLASHLINEARATTENTION, is faster than FLASHATTENTION-2 (Dao, 2023) as a standalone layer even on short sequence lengths (e.g., 1K). We then generalize this algorithm to a more expressive variant of linear attention with data-dependent gates. When used as a replacement for the standard attention layer in Transformers, the resulting gated linear attention (GLA) Transformer is found to perform competitively against the LLaMA-architecture Transformer (Touvron et al., 2023) as well recent linear-time-inference baselines such as RetNet (Sun et al., 2023a) and Mamba (Gu & Dao, 2023) on moderate-scale language modeling experiments. GLA Transformer is especially effective at length generalization, enabling a model trained on 2K to generalize to sequences longer than 20K without significant perplexity degradations. For training speed, the GLA Transformer has higher throughput than a similarly-sized Mamba model.


title: Spherical higher order Fourier analysis over finite fields III: a spherical Gowers inverse theorem

abstract: This paper is the third part of the series "Spherical higher order Fourier analysis over finite fields", aiming to develop the higher order Fourier analysis method along spheres over finite fields, and to solve the geometric Ramsey conjecture in the finite field setting. In this paper, we prove an inverse theorem over finite field for spherical Gowers norms, i.e. a local Gowers norm supported on a sphere. We show that if the $(s+1)$-th spherical Gowers norm of a 1-bounded function $f\colon\mathbb{F}_{p}^{d}\to \mathbb{C}$ is at least $\epsilon$ and if $d$ is sufficiently large depending only on $s$, then $f$ correlates on the sphere with a $p$-periodic $s$-step nilsequence, where the bounds for the complexity and correlation depend only on $d$ and $\epsilon$. This result will be used in later parts of the series to prove the geometric Ramsey conjecture in the finite field setting.


title: A Geometry-based Stochastic Wireless Channel Model using Channel Images

abstract: Due to the high complexity of geometry-deterministic wireless channel modeling and the difficulty in its implementation, geometry-based stochastic channel modeling (GBSM) approaches have been used to evaluate wireless systems. This paper introduces a new method to model any GBSM by training a generative neural network using images formed by channel parameters. In this work, we obtain channel parameters from the ray-tracing simulation in a specific area and process them in the form of images to train any generative model. Through a case study, we confirm that the use of channel images completes the training of the generative model within 10 epochs. In addition, we show that the trained generative model based on channel images faithfully represents the distributions of the original data under the assigned conditions. Therefore, we argue that the proposed data-to-image methods will facilitate the modeling of GBSM using any generative neural network under general wireless conditions.


title: SurvBeNIM: The Beran-Based Neural Importance Model for Explaining the Survival Models

abstract: A new method called the Survival Beran-based Neural Importance Model (SurvBeNIM) is proposed. It aims to explain predictions of machine learning survival models, which are in the form of survival or cumulative hazard functions. The main idea behind SurvBeNIM is to extend the Beran estimator by incorporating the importance functions into its kernels and by implementing these importance functions as a set of neural networks which are jointly trained in an end-to-end manner. Two strategies of using and training the whole neural network implementing SurvBeNIM are proposed. The first one explains a single instance, and the neural network is trained for each explained instance. According to the second strategy, the neural network only learns once on all instances from the dataset and on all generated instances. Then the neural network is used to explain any instance in a dataset domain. Various numerical experiments compare the method with different existing explanation methods. A code implementing the proposed method is publicly available.


title: Harmonic Mobile Manipulation

abstract: Recent advancements in robotics have enabled robots to navigate complex scenes or manipulate diverse objects independently. However, robots are still impotent in many household tasks requiring coordinated behaviors such as opening doors. The factorization of navigation and manipulation, while effective for some tasks, fails in scenarios requiring coordinated actions. To address this challenge, we introduce, HarmonicMM, an end-to-end learning method that optimizes both navigation and manipulation, showing notable improvement over existing techniques in everyday tasks. This approach is validated in simulated and real-world environments and adapts to novel unseen settings without additional tuning. Our contributions include a new benchmark for mobile manipulation and the successful deployment in a real unseen apartment, demonstrating the potential for practical indoor robot deployment in daily life. More results are on our project site: https://rchalyang.github.io/HarmonicMM/


title: Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution

abstract: Text-based diffusion models have exhibited remarkable success in generation and editing, showing great promise for enhancing visual content with their generative prior. However, applying these models to video super-resolution remains challenging due to the high demands for output fidelity and temporal consistency, which is complicated by the inherent randomness in diffusion models. Our study introduces Upscale-A-Video, a text-guided latent diffusion framework for video upscaling. This framework ensures temporal coherence through two key mechanisms: locally, it integrates temporal layers into U-Net and VAE-Decoder, maintaining consistency within short sequences; globally, without training, a flow-guided recurrent latent propagation module is introduced to enhance overall video stability by propagating and fusing latent across the entire sequences. Thanks to the diffusion paradigm, our model also offers greater flexibility by allowing text prompts to guide texture creation and adjustable noise levels to balance restoration and generation, enabling a trade-off between fidelity and quality. Extensive experiments show that Upscale-A-Video surpasses existing methods in both synthetic and real-world benchmarks, as well as in AI-generated videos, showcasing impressive visual realism and temporal consistency.


title: Online Decision Making with History-Average Dependent Costs (Extended)

abstract: In many online sequential decision-making scenarios, a learner's choices affect not just their current costs but also the future ones. In this work, we look at one particular case of such a situation where the costs depend on the time average of past decisions over a history horizon. We first recast this problem with history dependent costs as a problem of decision making under stage-wise constraints. To tackle this, we then propose the novel Follow-The-Adaptively-Regularized-Leader (FTARL) algorithm. Our innovative algorithm incorporates adaptive regularizers that depend explicitly on past decisions, allowing us to enforce stage-wise constraints while simultaneously enabling us to establish tight regret bounds. We also discuss the implications of the length of history horizon on design of no-regret algorithms for our problem and present impossibility results when it is the full learning horizon.


title: CorresNeRF: Image Correspondence Priors for Neural Radiance Fields

abstract: Neural Radiance Fields (NeRFs) have achieved impressive results in novel view synthesis and surface reconstruction tasks. However, their performance suffers under challenging scenarios with sparse input views. We present CorresNeRF, a novel method that leverages image correspondence priors computed by off-the-shelf methods to supervise NeRF training. We design adaptive processes for augmentation and filtering to generate dense and high-quality correspondences. The correspondences are then used to regularize NeRF training via the correspondence pixel reprojection and depth loss terms. We evaluate our methods on novel view synthesis and surface reconstruction tasks with density-based and SDF-based NeRF models on different datasets. Our method outperforms previous methods in both photometric and geometric metrics. We show that this simple yet effective technique of using correspondence priors can be applied as a plug-and-play module across different NeRF variants. The project page is at https://yxlao.github.io/corres-nerf.


title: Gaze Detection and Analysis for Initiating Joint Activity in Industrial Human-Robot Collaboration

abstract: Collaborative robots (cobots) are widely used in industrial applications, yet extensive research is still needed to enhance human-robot collaborations and operator experience. A potential approach to improve the collaboration experience involves adapting cobot behavior based on natural cues from the operator. Inspired by the literature on human-human interactions, we conducted a wizard-of-oz study to examine whether a gaze towards the cobot can serve as a trigger for initiating joint activities in collaborative sessions. In this study, 37 participants engaged in an assembly task while their gaze behavior was analyzed. We employ a gaze-based attention recognition model to identify when the participants look at the cobot. Our results indicate that in most cases (84.88\%), the joint activity is preceded by a gaze towards the cobot. Furthermore, during the entire assembly cycle, the participants tend to look at the cobot around the time of the joint activity. To the best of our knowledge, this is the first study to analyze the natural gaze behavior of participants working on a joint activity with a robot during a collaborative assembly task.


title: AnyHome: Open-Vocabulary Generation of Structured and Textured 3D Homes

abstract: Inspired by cognitive theories, we introduce AnyHome, a framework that translates any text into well-structured and textured indoor scenes at a house-scale. By prompting Large Language Models (LLMs) with designed templates, our approach converts provided textual narratives into amodal structured representations. These representations guarantee consistent and realistic spatial layouts by directing the synthesis of a geometry mesh within defined constraints. A Score Distillation Sampling process is then employed to refine the geometry, followed by an egocentric inpainting process that adds lifelike textures to it. AnyHome stands out with its editability, customizability, diversity, and realism. The structured representations for scenes allow for extensive editing at varying levels of granularity. Capable of interpreting texts ranging from simple labels to detailed narratives, AnyHome generates detailed geometries and textures that outperform existing methods in both quantitative and qualitative measures.


title: Beyond Classification: Definition and Density-based Estimation of Calibration in Object Detection

abstract: Despite their impressive predictive performance in various computer vision tasks, deep neural networks (DNNs) tend to make overly confident predictions, which hinders their widespread use in safety-critical applications. While there have been recent attempts to calibrate DNNs, most of these efforts have primarily been focused on classification tasks, thus neglecting DNN-based object detectors. Although several recent works addressed calibration for object detection and proposed differentiable penalties, none of them are consistent estimators of established concepts in calibration. In this work, we tackle the challenge of defining and estimating calibration error specifically for this task. In particular, we adapt the definition of classification calibration error to handle the nuances associated with object detection, and predictions in structured output spaces more generally. Furthermore, we propose a consistent and differentiable estimator of the detection calibration error, utilizing kernel density estimation. Our experiments demonstrate the effectiveness of our estimator against competing train-time and post-hoc calibration methods, while maintaining similar detection performance.


title: Computational Copyright: Towards A Royalty Model for Music Generative AI

abstract: The advancement of generative AI has given rise to pressing copyright challenges, particularly in music industry. This paper focuses on the economic aspects of these challenges, emphasizing that the economic impact constitutes a central issue in the copyright arena. The complexity of the black-box generative AI technologies not only suggests but necessitates algorithmic solutions. However, such solutions have been largely missing, leading to regulatory challenges in this landscape. We aim to bridge the gap in current approaches by proposing potential royalty models for revenue sharing on AI music generation platforms. Our methodology involves a detailed analysis of existing royalty models in platforms like Spotify and YouTube, and adapting these to the unique context of AI-generated music. A significant challenge we address is the attribution of AI-generated music to influential copyrighted content in the training data. To this end, we present algorithmic solutions employing data attribution techniques. Our experimental results verify the effectiveness of these solutions. This research represents a pioneering effort in integrating technical advancements with economic and legal considerations in the field of generative AI, offering a computational copyright solution for the challenges posed by the opaque nature of AI technologies.


title: 4M: Massively Multimodal Masked Modeling

abstract: Current machine learning models for vision are often highly specialized and limited to a single modality and task. In contrast, recent large language models exhibit a wide range of capabilities, hinting at a possibility for similarly versatile models in computer vision. In this paper, we take a step in this direction and propose a multimodal training scheme called 4M. It consists of training a single unified Transformer encoder-decoder using a masked modeling objective across a wide range of input/output modalities - including text, images, geometric, and semantic modalities, as well as neural network feature maps. 4M achieves scalability by unifying the representation space of all modalities through mapping them into discrete tokens and performing multimodal masked modeling on a small randomized subset of tokens. 4M leads to models that exhibit several key capabilities: (1) they can perform a diverse set of vision tasks out of the box, (2) they excel when fine-tuned for unseen downstream tasks or new input modalities, and (3) they can function as a generative model that can be conditioned on arbitrary modalities, enabling a wide variety of expressive multimodal editing capabilities with remarkable flexibility. Through experimental analyses, we demonstrate the potential of 4M for training versatile and scalable foundation models for vision tasks, setting the stage for further exploration in multimodal learning for vision and other domains.


title: Dense X Retrieval: What Retrieval Granularity Should We Use?

abstract: Dense retrieval has become a prominent method to obtain relevant context or world knowledge in open-domain NLP tasks. When we use a learned dense retriever on a retrieval corpus at inference time, an often-overlooked design choice is the retrieval unit in which the corpus is indexed, e.g. document, passage, or sentence. We discover that the retrieval unit choice significantly impacts the performance of both retrieval and downstream tasks. Distinct from the typical approach of using passages or sentences, we introduce a novel retrieval unit, proposition, for dense retrieval. Propositions are defined as atomic expressions within text, each encapsulating a distinct factoid and presented in a concise, self-contained natural language format. We conduct an empirical comparison of different retrieval granularity. Our results reveal that proposition-based retrieval significantly outperforms traditional passage or sentence-based methods in dense retrieval. Moreover, retrieval by proposition also enhances the performance of downstream QA tasks, since the retrieved texts are more condensed with question-relevant information, reducing the need for lengthy input tokens and minimizing the inclusion of extraneous, irrelevant information.


title: Spherical higher order Fourier analysis over finite fields IV: an application to the Geometric Ramsey Conjecture

abstract: This paper is the fourth and the last part of the series "Spherical higher order Fourier analysis over finite fields", aiming to develop the higher order Fourier analysis method along spheres over finite fields, and to solve the Geometric Ramsey Conjecture in the finite field setting. In this paper, we proof a conjecture of Graham on the Remsey properties for spherical configurations in the finite field setting. To be more precise, we show that for any spherical configuration $X$ of $\mathbb{F}_{p}^{d}$ of complexity at most $C$ with $d$ being sufficiently large with respect to $C$ and $\vert X\vert$, and for some prime $p$ being sufficiently large with respect to $C$, $\vert X\vert$ and $\epsilon>0$, any set $E\subseteq \mathbb{F}_{p}^{d}$ with $\vert E\vert>\epsilon p^{d}$ contains at least $\gg_{C,\epsilon,\vert X\vert}p^{(k+1)d-(k+1)k/2}$ congruent copies of $X$, where $k$ is the dimension of $\text{span}_{\mathbb{F}_{p}}(X-X)$. The novelty of our approach is that we avoid the use of harmonic analysis, and replace it by the theory of spherical higher order Fourier analysis developed in previous parts of the series.


title: Spherical higher order Fourier analysis over finite fields II: additive combinatorics for shifted ideals

abstract: This paper is the second part of the series "Spherical higher order Fourier analysis over finite fields", aiming to develop the higher order Fourier analysis method along spheres over finite fields, and to solve the geometric Ramsey conjecture in the finite field setting. In this paper, we study additive combinatorial properties for shifted ideals, i.e. the structure of sets of the form $E\pm E$, where $E$ is a collection of shifted ideals of the polynomial ring $\mathbb{F}_{p}[x_{1},\dots,x_{d}]$ and we identify two ideals if their difference contains the zero polynomial. We show that under appropriate definitions, the set $E\pm E$ enjoys properties similar to the conventional setting where $E$ is a subset of an abelian group. In particular, among other results, we prove the Balog-Gowers-Szemer\'edi theorem, the Rusza's quasi triangle inequality and a weak form of the Pl\"unnecke-Rusza theorem in the setting of shifted ideals. We also show that for a special class of maps $\xi$ from $\mathbb{F}_{p}^{d}$ to the collection of all shifted ideals of $\mathbb{F}_{p}[x_{1},\dots,x_{d}]$, if the set $\xi(\mathbb{F}_{p}^{d})+\xi(\mathbb{F}_{p}^{d})$ has large additive energy, then $\xi$ is an almost linear Freiman homomorphism. This result is the crucial additive combinatorial input we need to prove the spherical Gowers inverse theorem in later parts of the series.


title: Spherical higher order Fourier analysis over finite fields I: equidistribution for nilsequences

abstract: This paper is the first part of the series "Spherical higher order Fourier analysis over finite fields", aiming to develop the higher order Fourier analysis method along spheres over finite fields, and to solve the geometric Ramsey conjecture in the finite field setting. In this paper, we prove a quantitative equidistribution theorem for polynomial sequences in a nilmanifold, where the average is taken along spheres instead of cubes. To be more precise, let $\Omega\subseteq\mathbb{F}_{p}^{d}$ be a sphere. We showed that if a polynomial sequence $(g(n)\Gamma)_{n\in\Omega}$ which is $p$-periodic along $\Omega$ is not equidistributed on a nilmanifold $G/\Gamma$, then there exists a nontrivial horizontal character $\eta$ of $G/\Gamma$ such that $\eta\circ g \mod \mathbb{Z}$ vanishes on $\Omega$. This result will serve as a fundamental tool in later parts of the series to proof the spherical Gowers inverse theorem and the geometric Ramsey conjecture.


title: Building Domain-Specific LLMs Faithful To The Islamic Worldview: Mirage or Technical Possibility?

abstract: Large Language Models (LLMs) have demonstrated remarkable performance across numerous natural language understanding use cases. However, this impressive performance comes with inherent limitations, such as the tendency to perpetuate stereotypical biases or fabricate non-existent facts. In the context of Islam and its representation, accurate and factual representation of its beliefs and teachings rooted in the Quran and Sunnah is key. This work focuses on the challenge of building domain-specific LLMs faithful to the Islamic worldview and proposes ways to build and evaluate such systems. Firstly, we define this open-ended goal as a technical problem and propose various solutions. Subsequently, we critically examine known challenges inherent to each approach and highlight evaluation methodologies that can be used to assess such systems. This work highlights the need for high-quality datasets, evaluations, and interdisciplinary work blending machine learning with Islamic scholarship.


title: Adaptive Human Trajectory Prediction via Latent Corridors

abstract: Human trajectory prediction is typically posed as a zero-shot generalization problem: a predictor is learnt on a dataset of human motion in training scenes, and then deployed on unseen test scenes. While this paradigm has yielded tremendous progress, it fundamentally assumes that trends in human behavior within the deployment scene are constant over time. As such, current prediction models are unable to adapt to scene-specific transient human behaviors, such as crowds temporarily gathering to see buskers, pedestrians hurrying through the rain and avoiding puddles, or a protest breaking out. We formalize the problem of scene-specific adaptive trajectory prediction and propose a new adaptation approach inspired by prompt tuning called latent corridors. By augmenting the input of any pre-trained human trajectory predictor with learnable image prompts, the predictor can improve in the deployment scene by inferring trends from extremely small amounts of new data (e.g., 2 humans observed for 30 seconds). With less than 0.1% additional model parameters, we see up to 23.9% ADE improvement in MOTSynth simulated data and 16.4% ADE in MOT and Wildtrack real pedestrian data. Qualitatively, we observe that latent corridors imbue predictors with an awareness of scene geometry and scene-specific human behaviors that non-adaptive predictors struggle to capture. The project website can be found at https://neerja.me/atp_latent_corridors/.


title: LightSim: Neural Lighting Simulation for Urban Scenes

abstract: Different outdoor illumination conditions drastically alter the appearance of urban scenes, and they can harm the performance of image-based robot perception systems if not seen during training. Camera simulation provides a cost-effective solution to create a large dataset of images captured under different lighting conditions. Towards this goal, we propose LightSim, a neural lighting camera simulation system that enables diverse, realistic, and controllable data generation. LightSim automatically builds lighting-aware digital twins at scale from collected raw sensor data and decomposes the scene into dynamic actors and static background with accurate geometry, appearance, and estimated scene lighting. These digital twins enable actor insertion, modification, removal, and rendering from a new viewpoint, all in a lighting-aware manner. LightSim then combines physically-based and learnable deferred rendering to perform realistic relighting of modified scenes, such as altering the sun location and modifying the shadows or changing the sun brightness, producing spatially- and temporally-consistent camera videos. Our experiments show that LightSim generates more realistic relighting results than prior work. Importantly, training perception models on data generated by LightSim can significantly improve their performance.


title: Sherpa3D: Boosting High-Fidelity Text-to-3D Generation via Coarse 3D Prior

abstract: Recently, 3D content creation from text prompts has demonstrated remarkable progress by utilizing 2D and 3D diffusion models. While 3D diffusion models ensure great multi-view consistency, their ability to generate high-quality and diverse 3D assets is hindered by the limited 3D data. In contrast, 2D diffusion models find a distillation approach that achieves excellent generalization and rich details without any 3D data. However, 2D lifting methods suffer from inherent view-agnostic ambiguity thereby leading to serious multi-face Janus issues, where text prompts fail to provide sufficient guidance to learn coherent 3D results. Instead of retraining a costly viewpoint-aware model, we study how to fully exploit easily accessible coarse 3D knowledge to enhance the prompts and guide 2D lifting optimization for refinement. In this paper, we propose Sherpa3D, a new text-to-3D framework that achieves high-fidelity, generalizability, and geometric consistency simultaneously. Specifically, we design a pair of guiding strategies derived from the coarse 3D prior generated by the 3D diffusion model: a structural guidance for geometric fidelity and a semantic guidance for 3D coherence. Employing the two types of guidance, the 2D diffusion model enriches the 3D content with diversified and high-quality results. Extensive experiments show the superiority of our Sherpa3D over the state-of-the-art text-to-3D methods in terms of quality and 3D consistency.


title: Schatten class Hankel operators on doubling Fock spaces and the Berger-Coburn phenomenon

abstract: Using the notion of integral distance to analytic functions, we give a characterization of Schatten class Hankel operators acting on doubling Fock spaces on the complex plane and use it to show that for $f\in L^{\infty}$, if $H_{f}$ is Hilbert-Schmidt, then so is $H_{\bar{f}}$. This property is known as the Berger-Coburn phenomenon. When $0<p\le 1$, we show that the Berger-Coburn phenomenon fails for a large class of doubling Fock spaces. Along the way, we illustrate our results for the canonical weights $|z|^m$ when $m>0$.


title: Learning Naturally Aggregated Appearance for Efficient 3D Editing

abstract: Neural radiance fields, which represent a 3D scene as a color field and a density field, have demonstrated great progress in novel view synthesis yet are unfavorable for editing due to the implicitness. In view of such a deficiency, we propose to replace the color field with an explicit 2D appearance aggregation, also called canonical image, with which users can easily customize their 3D editing via 2D image processing. To avoid the distortion effect and facilitate convenient editing, we complement the canonical image with a projection field that maps 3D points onto 2D pixels for texture lookup. This field is carefully initialized with a pseudo canonical camera model and optimized with offset regularity to ensure naturalness of the aggregated appearance. Extensive experimental results on three datasets suggest that our representation, dubbed AGAP, well supports various ways of 3D editing (e.g., stylization, interactive drawing, and content extraction) with no need of re-optimization for each case, demonstrating its generalizability and efficiency. Project page is available at https://felixcheng97.github.io/AGAP/.


title: Mean estimation in the add-remove model of differential privacy

abstract: Differential privacy is often studied under two different models of neighboring datasets: the add-remove model and the swap model. While the swap model is frequently used in the academic literature to simplify analysis, many practical applications rely on the more conservative add-remove model, where obtaining tight results can be difficult. Here, we study the problem of one-dimensional mean estimation under the add-remove model. We propose a new algorithm and show that it is min-max optimal, achieving the best possible constant in the leading term of the mean squared error for all $\epsilon$, and that this constant is the same as the optimal algorithm under the swap model. These results show that the add-remove and swap models give nearly identical errors for mean estimation, even though the add-remove model cannot treat the size of the dataset as public information. We also demonstrate empirically that our proposed algorithm yields at least a factor of two improvement in mean squared error over algorithms frequently used in practice. One of our main technical contributions is a new hour-glass mechanism, which might be of independent interest in other scenarios.


title: Convergence of Multi-Scale Reinforcement Q-Learning Algorithms for Mean Field Game and Control Problems

abstract: We establish the convergence of the unified two-timescale Reinforcement Learning (RL) algorithm presented in a previous work by Angiuli et al. This algorithm provides solutions to Mean Field Game (MFG) or Mean Field Control (MFC) problems depending on the ratio of two learning rates, one for the value function and the other for the mean field term. Our proof of convergence highlights the fact that in the case of MFC several mean field distributions need to be updated and for this reason we present two separate algorithms, one for MFG and one for MFC. We focus on a setting with finite state and action spaces, discrete time and infinite horizon. The proofs of convergence rely on a generalization of the two-timescale approach of Borkar. The accuracy of approximation to the true solutions depends on the smoothing of the policies. We provide a numerical example illustrating the convergence.


title: EdgeSAM: Prompt-In-the-Loop Distillation for On-Device Deployment of SAM

abstract: This paper presents EdgeSAM, an accelerated variant of the Segment Anything Model (SAM), optimized for efficient execution on edge devices with minimal compromise in performance. Our approach involves distilling the original ViT-based SAM image encoder into a purely CNN-based architecture, better suited for edge devices. We carefully benchmark various distillation strategies and demonstrate that task-agnostic encoder distillation fails to capture the full knowledge embodied in SAM. To overcome this bottleneck, we include both the prompt encoder and mask decoder in the distillation process, with box and point prompts in the loop, so that the distilled model can accurately capture the intricate dynamics between user input and mask generation. To mitigate dataset bias issues stemming from point prompt distillation, we incorporate a lightweight module within the encoder. EdgeSAM achieves a 40-fold speed increase compared to the original SAM, and it also outperforms MobileSAM, being 14 times as fast when deployed on edge devices while enhancing the mIoUs on COCO and LVIS by 2.3 and 3.2 respectively. It is also the first SAM variant that can run at over 30 FPS on an iPhone 14. Code and models are available at https://github.com/chongzhou96/EdgeSAM.


title: UpFusion: Novel View Diffusion from Unposed Sparse View Observations

abstract: We propose UpFusion, a system that can perform novel view synthesis and infer 3D representations for an object given a sparse set of reference images without corresponding pose information. Current sparse-view 3D inference methods typically rely on camera poses to geometrically aggregate information from input views, but are not robust in-the-wild when such information is unavailable/inaccurate. In contrast, UpFusion sidesteps this requirement by learning to implicitly leverage the available images as context in a conditional generative model for synthesizing novel views. We incorporate two complementary forms of conditioning into diffusion models for leveraging the input views: a) via inferring query-view aligned features using a scene-level transformer, b) via intermediate attentional layers that can directly observe the input image tokens. We show that this mechanism allows generating high-fidelity novel views while improving the synthesis quality given additional (unposed) images. We evaluate our approach on the Co3Dv2 and Google Scanned Objects datasets and demonstrate the benefits of our method over pose-reliant sparse-view methods as well as single-view methods that cannot leverage additional views. Finally, we also show that our learned model can generalize beyond the training categories and even allow reconstruction from self-captured images of generic objects in-the-wild.


title: Photorealistic Video Generation with Diffusion Models

abstract: We present W.A.L.T, a transformer-based approach for photorealistic video generation via diffusion modeling. Our approach has two key design decisions. First, we use a causal encoder to jointly compress images and videos within a unified latent space, enabling training and generation across modalities. Second, for memory and training efficiency, we use a window attention architecture tailored for joint spatial and spatiotemporal generative modeling. Taken together these design decisions enable us to achieve state-of-the-art performance on established video (UCF-101 and Kinetics-600) and image (ImageNet) generation benchmarks without using classifier free guidance. Finally, we also train a cascade of three models for the task of text-to-video generation consisting of a base latent video diffusion model, and two video super-resolution diffusion models to generate videos of $512 \times 896$ resolution at $8$ frames per second.


title: CAD: Photorealistic 3D Generation via Adversarial Distillation

abstract: The increased demand for 3D data in AR/VR, robotics and gaming applications, gave rise to powerful generative pipelines capable of synthesizing high-quality 3D objects. Most of these models rely on the Score Distillation Sampling (SDS) algorithm to optimize a 3D representation such that the rendered image maintains a high likelihood as evaluated by a pre-trained diffusion model. However, finding a correct mode in the high-dimensional distribution produced by the diffusion model is challenging and often leads to issues such as over-saturation, over-smoothing, and Janus-like artifacts. In this paper, we propose a novel learning paradigm for 3D synthesis that utilizes pre-trained diffusion models. Instead of focusing on mode-seeking, our method directly models the distribution discrepancy between multi-view renderings and diffusion priors in an adversarial manner, which unlocks the generation of high-fidelity and photorealistic 3D content, conditioned on a single image and prompt. Moreover, by harnessing the latent space of GANs and expressive diffusion model priors, our method facilitates a wide variety of 3D applications including single-view reconstruction, high diversity generation and continuous 3D interpolation in the open domain. The experiments demonstrate the superiority of our pipeline compared to previous works in terms of generation quality and diversity.


title: Accurate optimal quantum error correction thresholds from coherent information

abstract: Quantum error correcting (QEC) codes protect quantum information from decoherence, as long as error rates fall below critical error thresholds. In general, obtaining thresholds implies simulating the QEC procedure using, in general, sub-optimal decoding strategies. In a few cases and for sufficiently simple noise models, optimal decoding of QEC codes can be framed as a phase transition in disordered classical spin models. In both situations, accurate estimation of thresholds demands intensive computational resources. Here we use the coherent information of the mixed state of noisy QEC codes to accurately estimate the associated optimal QEC thresholds already from small-distance codes at moderate computational cost. We show the effectiveness and versatility of our method by applying it first to the topological surface and color code under bit-flip and depolarizing noise. We then extend the coherent information based methodology to phenomenological and quantum circuit level noise settings. For all examples considered we obtain highly accurate estimates of optimal error thresholds from small, low-distance instances of the codes, in close accordance with threshold values reported in the literature. Our findings establish the coherent information as a reliable competitive practical tool for the calculation of optimal thresholds of state-of-the-art QEC codes under realistic noise models.


title: Predicting Neural Stem Cell Differentiation Using Deep Learning Models

abstract: Neural stem cells have immense therapeutic potential for treating various neurological disorders. However, lengthy differentiation protocols hinder the translation of neural stem cells into clinical applications. In this study, we present a deep learning approach using convolutional neural networks (CNNs) to predict the fate of neural stem cell differentiation at an early stage. We trained a CNN model on a dataset of cellular images from neural stem cell cultures, and the model achieved impressive results with a 99.7% testing accuracy for the binary Resnet50 model and a 93.3% testing accuracy for the multiclass Resnet50 model in predicting neuron and glial cell differentiation. This demonstrates the feasibility of using CNNs for rapid, early differentiation outcome prediction from simple microscopy images, which could greatly accelerate neural stem cell research and therapies. Additionally, the model provides biological insights into morphological features associated with specific neural cell lineages.


title: Synchronization and movement control of an ensemble of mobile agents

abstract: This article suggests ways to implement sequential, parallel and in the form of a given configuration of the movement of an ensemble (swarm) of mobile agents using the effect of chaotic phase synchronization. The possibility of controlling the movement of the ensemble is shown and the stability conditions of the obtained structures are determined.


title: Optimizing Fault-Tolerant Quality-Guaranteed Sensor Deployments for UAV Localization in Critical Areas via Computational Geometry

abstract: The increasing spreading of small commercial Unmanned Aerial Vehicles (UAVs, aka drones) presents serious threats for critical areas such as airports, power plants, governmental and military facilities. In fact, such UAVs can easily disturb or jam radio communications, collide with other flying objects, perform espionage activity, and carry offensive payloads, e.g., weapons or explosives. A central problem when designing surveillance solutions for the localization of unauthorized UAVs in critical areas is to decide how many triangulating sensors to use, and where to deploy them to optimise both coverage and cost effectiveness. In this article, we compute deployments of triangulating sensors for UAV localization, optimizing a given blend of metrics, namely: coverage under multiple sensing quality levels, cost-effectiveness, fault-tolerance. We focus on large, complex 3D regions, which exhibit obstacles (e.g., buildings), varying terrain elevation, different coverage priorities, constraints on possible sensors placement. Our novel approach relies on computational geometry and statistical model checking, and enables the effective use of off-the-shelf AI-based black-box optimizers. Moreover, our method allows us to compute a closed-form, analytical representation of the region uncovered by a sensor deployment, which provides the means for rigorous, formal certification of the quality of the latter. We show the practical feasibility of our approach by computing optimal sensor deployments for UAV localization in two large, complex 3D critical regions, the Rome Leonardo Da Vinci International Airport (FCO) and the Vienna International Center (VIC), using NOMAD as our state-of-the-art underlying optimization engine. Results show that we can compute optimal sensor deployments within a few hours on a standard workstation and within minutes on a small parallel infrastructure.


title: Evaluating Self-supervised Speech Models on a Taiwanese Hokkien Corpus

abstract: Taiwanese Hokkien is declining in use and status due to a language shift towards Mandarin in Taiwan. This is partly why it is a low resource language in NLP and speech research today. To ensure that the state of the art in speech processing does not leave Taiwanese Hokkien behind, we contribute a 1.5-hour dataset of Taiwanese Hokkien to ML-SUPERB's hidden set. Evaluating ML-SUPERB's suite of self-supervised learning (SSL) speech representations on our dataset, we find that model size does not consistently determine performance. In fact, certain smaller models outperform larger ones. Furthermore, linguistic alignment between pretraining data and the target language plays a crucial role.


title: An Association Test Based on Kernel-Based Neural Networks for Complex Genetic Association Analysis

abstract: The advent of artificial intelligence, especially the progress of deep neural networks, is expected to revolutionize genetic research and offer unprecedented potential to decode the complex relationships between genetic variants and disease phenotypes, which could mark a significant step toward improving our understanding of the disease etiology. While deep neural networks hold great promise for genetic association analysis, limited research has been focused on developing neural-network-based tests to dissect complex genotype-phenotype associations. This complexity arises from the opaque nature of neural networks and the absence of defined limiting distributions. We have previously developed a kernel-based neural network model (KNN) that synergizes the strengths of linear mixed models with conventional neural networks. KNN adopts a computationally efficient minimum norm quadratic unbiased estimator (MINQUE) algorithm and uses KNN structure to capture the complex relationship between large-scale sequencing data and a disease phenotype of interest. In the KNN framework, we introduce a MINQUE-based test to assess the joint association of genetic variants with the phenotype, which considers non-linear and non-additive effects and follows a mixture of chi-square distributions. We also construct two additional tests to evaluate and interpret linear and non-linear/non-additive genetic effects, including interaction effects. Our simulations show that our method consistently controls the type I error rate under various conditions and achieves greater power than a commonly used sequence kernel association test (SKAT), especially when involving non-linear and interaction effects. When applied to real data from the UK Biobank, our approach identified genes associated with hippocampal volume, which can be further replicated and evaluated for their role in the pathogenesis of Alzheimer's disease.


title: Combating the effects of speed and delays in end-to-end self-driving

abstract: In the behavioral cloning approach to end-to-end driving, a dataset of expert driving is collected and the model learns to guess what the expert would do in different situations. Situations are summarized in observations and the outputs are low or mid-level commands (e.g. brake, throttle, and steering; or trajectories). The models learn to match observations at time T to actions recorded at T or as simultaneously as possible. However, when deploying the models to the real world (or to an asynchronous simulation), the action predicted based on observations at time T gets applied at T + $\Delta$ T. In a variety of cases, $\Delta$ T can be considerable and significantly influence performance. We first demonstrate that driving at two different speeds is effectively two different tasks. Delays partially cause this difference and linearly amplify it. Even without computational delays, actuator delays and slipping due to inertia result in the need to perform actions preemptively when driving fast. The function mapping observations to commands becomes different compared to slow driving. We experimentally show that models trained to drive fast cannot perform the seemingly easier task of driving slow and vice-versa. Good driving models may be judged to be poor due to testing them at "a safe low speed", a task they cannot perform. Secondly, we show how to counteract the effect of delays in end-to-end networks by changing the target labels. This is in contrast to the approaches attempting to minimize the delays, i.e. the cause, not the effect. To exemplify the problems and solutions in the real world, we use 1:10 scale minicars with limited computing power, using behavioral cloning for end-to-end driving. Some of the ideas discussed here may be transferable to the wider context of self-driving, to vehicles with more compute power and end-to-mid or modular approaches.


title: Generalized Finite Differences Method Applied to Finite Photonic Crystal

abstract: We propose a Generalized Finite-Differences in the Frequency Domain method for the computation of photonic band structures of finite photonic crystals. Our approach is to discretize some fundamental domain instead of a single unit cell, such that boundary conditions of interest can be introduced into the eigenvalue problem. The validity and effectiveness of the proposed method are shown for the case of a one-dimensional photonic crystal embedded in an optical cavity. The limit from finite to infinite photonic crystals is reviewed in view of the proposed method.


title: Spin and orbital dynamics of planets undergoing thermal atmospheric tides using a vectorial approach

abstract: Earth-mass planets are expected to have atmospheres and experience thermal tides raised by the host star. These tides transfer energy to the planet that can counter the dissipation from bodily tides. Indeed, even a relatively thin atmosphere can drive the rotation of these planets away from the synchronous state. Here we revisit the dynamical evolution of planets undergoing thermal atmospheric tides. We use a novel approach based on a vectorial formalism, which is frame independent and valid for any configuration of the system, including any eccentricity and obliquity values. We provide the secular equations of motion after averaging over the mean anomaly and the argument of the pericenter, which are suitable to model the long-term spin and orbital evolution of the planet.


title: LD Double Logic and Gamma-LD Existential Graphs

abstract: In this paper, the deductive system for double propositional logic DL and gamma DL existential graphs are presented. It rigorously proves the consistency of the DL and that the DL theorems correspond exactly to the valid existential graphs of gamma DL. When the language of DL is restricted to the language of classical propositional logic, the restriction associated with gamma DL coincides with the valid existential graphs of Charles Sanders Peirce's alpha system. It turns out that intuitionistic propositional logic theorems are DL theorems; furthermore, when the language of DL is restricted to the language of IL, the restriction associated with gamma DL coincides with the valid existential graphs of Arnold Oostra's intuitionistic alpha system. As a consequence, it is inferred that gamma LD has as particular cases, the alpha existential graphs of LC and LI. Finally, in DL, the Aristotelian definitions of truth and falsity are derived, with which the ability of DL to solve a version of the liar paradox, where LC and LI fail, is illustrated.


title: Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations

abstract: We introduce Llama Guard, an LLM-based input-output safeguard model geared towards Human-AI conversation use cases. Our model incorporates a safety risk taxonomy, a valuable tool for categorizing a specific set of safety risks found in LLM prompts (i.e., prompt classification). This taxonomy is also instrumental in classifying the responses generated by LLMs to these prompts, a process we refer to as response classification. For the purpose of both prompt and response classification, we have meticulously gathered a dataset of high quality. Llama Guard, a Llama2-7b model that is instruction-tuned on our collected dataset, albeit low in volume, demonstrates strong performance on existing benchmarks such as the OpenAI Moderation Evaluation dataset and ToxicChat, where its performance matches or exceeds that of currently available content moderation tools. Llama Guard functions as a language model, carrying out multi-class classification and generating binary decision scores. Furthermore, the instruction fine-tuning of Llama Guard allows for the customization of tasks and the adaptation of output formats. This feature enhances the model's capabilities, such as enabling the adjustment of taxonomy categories to align with specific use cases, and facilitating zero-shot or few-shot prompting with diverse taxonomies at the input. We are making Llama Guard model weights available and we encourage researchers to further develop and adapt them to meet the evolving needs of the community for AI safety.


title: Energy dissipation in astrophysical simulations: results of the Orszag-Tang test problem

abstract: The magnetic field through the magnetic reconnection process affects the dynamics and structure of astrophysical systems. Numerical simulations are the tools to study the evolution of these systems. However, the resolution, dimensions, resistivity, and turbulence of the system are some important parameters to take into account in the simulations. In this paper, we investigate the evolution of magnetic energy in astrophysical simulations by performing a standard test problem for MHD codes, Orszag-Tang. We estimate the numerical dissipation in the simulations using state-of-the-art numerical simulation code in astrophysics, PLUTO. The estimated numerical resistivity in 2D simulations corresponds to the Lundquist number $\approx 10^{4}$ in the resolution of $512\times512$ grid cells. It is also shown that the plasmoid unstable reconnection layer can be resolved with sufficient resolutions. Our analysis demonstrates that in non-relativistic magnetohydrodynamics simulations, magnetic and kinetic energies undergo conversion into internal energy, resulting in plasma heating.


title: Riptide: a proton-recoil track imaging detector for fast neutrons

abstract: Riptide is a detector concept aiming to track fast neutrons. It is based on neutron--proton elastic collisions inside a plastic scintillator, where the neutron momentum can be measured by imaging the scintillation light. More specifically, by stereoscopically imaging the recoil proton tracks, the proposed apparatus provides neutron spectrometry capability and enable the online analysis of the specific energy loss along the track. In principle, the spatial and topological event reconstruction enables particle discrimination, which is a crucial property for neutron detectors. In this contribution, we report the advances on the Riptide detector concept. In particular, we have developed a Geant4 optical simulation to demonstrate the possibility of reconstructing with sufficient precision the tracks and the vertices of neutron interactions inside a plastic scintillator. To realistically model the optics of the scintillation detector, mono-energetic protons were generated inside a $6\times6\times6$ cm$^3$ cubic BC-408 scintillator, and the produced optical photons were propagated and then recorded on a scoring plane corresponding to the surfaces of the cube. The photons were then transported through an optical system to a $2\times2$ cm$^2$ photo sensitive area with 1 Megapixel. Moreover, we have developed two different analysis procedures to reconstruct 3D tracks: one based on data fitting and one on Principal Component Analysis. The main results of this study will be presented with a particular focus on the role of the optical system and the attainable spatial and energy resolution.


title: Intelligent Virtual Assistants with LLM-based Process Automation

abstract: While intelligent virtual assistants like Siri, Alexa, and Google Assistant have become ubiquitous in modern life, they still face limitations in their ability to follow multi-step instructions and accomplish complex goals articulated in natural language. However, recent breakthroughs in large language models (LLMs) show promise for overcoming existing barriers by enhancing natural language processing and reasoning capabilities. Though promising, applying LLMs to create more advanced virtual assistants still faces challenges like ensuring robust performance and handling variability in real-world user commands. This paper proposes a novel LLM-based virtual assistant that can automatically perform multi-step operations within mobile apps based on high-level user requests. The system represents an advance in assistants by providing an end-to-end solution for parsing instructions, reasoning about goals, and executing actions. LLM-based Process Automation (LLMPA) has modules for decomposing instructions, generating descriptions, detecting interface elements, predicting next actions, and error checking. Experiments demonstrate the system completing complex mobile operation tasks in Alipay based on natural language instructions. This showcases how large language models can enable automated assistants to accomplish real-world tasks. The main contributions are the novel LLMPA architecture optimized for app process automation, the methodology for applying LLMs to mobile apps, and demonstrations of multi-step task completion in a real-world environment. Notably, this work represents the first real-world deployment and extensive evaluation of a large language model-based virtual assistant in a widely used mobile application with an enormous user base numbering in the hundreds of millions.


title: Constraining nucleon effective masses with flow and stopping observables from the S$\pi$RIT experiment

abstract: Properties of the nuclear equation of state (EoS) can be probed by measuring the dynamical properties of nucleus-nucleus collisions. In this study, we present the directed flow ($v_1$), elliptic flow ($v_2$) and stopping (VarXZ) measured in fixed target Sn + Sn collisions at 270 AMeV with the S$\pi$RIT Time Projection Chamber. We perform Bayesian analyses in which EoS parameters are varied simultaneously within the Improved Quantum Molecular Dynamics-Skyrme (ImQMD-Sky) transport code to obtain a multivariate correlated constraint. The varied parameters include symmetry energy, $S_0$, and slope of the symmetry energy, $L$, at saturation density, isoscalar effective mass, $m_{s}^*/m_{N}$, isovector effective mass, $m_{v}^{*}/m_{N}$ and the in-medium cross-section enhancement factor $\eta$. We find that the flow and VarXZ observables are sensitive to the splitting of proton and neutron effective masses and the in-medium cross-section. Comparisons of ImQMD-Sky predictions to the S$\pi$RIT data suggest a narrow range of preferred values for $m_{s}^*/m_{N}$, $m_{v}^{*}/m_{N}$ and $\eta$.


title: The Transformative Effects of AI on International Economics

abstract: As AI adoption accelerates, research on its economic impacts becomes a salient source to consider for stakeholders of AI policy. Such research is however still in its infancy, and one in need of review. This paper aims to accomplish just that and is structured around two main themes. Firstly, the path towards transformative AI, and secondly the wealth created by it. It is found that sectors most embedded into global value chains will drive economic impacts, hence special attention is paid to the international trade perspective. When it comes to the path towards transformative AI, research is heterogenous in its predictions, with some predicting rapid, unhindered adoption, and others taking a more conservative view based on potential bottlenecks and comparisons to past disruptive technologies. As for wealth creation, while some agreement is to be found in AI's growth boosting abilities, predictions on timelines are lacking. Consensus exists however around the dispersion of AI induced wealth, which is heavily biased towards developed countries due to phenomena such as anchoring and reduced bargaining power of developing countries. Finally, a shortcoming of economic growth models in failing to consider AI risk is discovered. Based on the review, a calculated, and slower adoption rate of AI technologies is recommended.


title: Perceptual Similarity guidance and text guidance optimization for Editing Real Images using Guided Diffusion Models

abstract: When using a diffusion model for image editing, there are times when the modified image can differ greatly from the source. To address this, we apply a dual-guidance approach to maintain high fidelity to the original in areas that are not altered. First, we employ text-guided optimization, using text embeddings to direct latent space and classifier-free guidance. Second, we use perceptual similarity guidance, optimizing latent vectors with posterior sampling via Tweedie formula during the reverse process. This method ensures the realistic rendering of both the edited elements and the preservation of the unedited parts of the original image.