title: Autocompletion of Chief Complaints in the Electronic Health Records using Large Language Models

abstract: The Chief Complaint (CC) is a crucial component of a patient's medical record as it describes the main reason or concern for seeking medical care. It provides critical information for healthcare providers to make informed decisions about patient care. However, documenting CCs can be time-consuming for healthcare providers, especially in busy emergency departments. To address this issue, an autocompletion tool that suggests accurate and well-formatted phrases or sentences for clinical notes can be a valuable resource for triage nurses. In this study, we utilized text generation techniques to develop machine learning models using CC data. In our proposed work, we train a Long Short-Term Memory (LSTM) model and fine-tune three different variants of Biomedical Generative Pretrained Transformers (BioGPT), namely microsoft/biogpt, microsoft/BioGPT-Large, and microsoft/BioGPT-Large-PubMedQA. Additionally, we tune a prompt by incorporating exemplar CC sentences, utilizing the OpenAI API of GPT-4. We evaluate the models' performance based on the perplexity score, modified BERTScore, and cosine similarity score. The results show that BioGPT-Large exhibits superior performance compared to the other models. It consistently achieves a remarkably low perplexity score of 1.65 when generating CC, whereas the baseline LSTM model achieves the best perplexity score of 170. Further, we evaluate and assess the proposed models' performance and the outcome of GPT-4.0. Our study demonstrates that utilizing LLMs such as BioGPT, leads to the development of an effective autocompletion tool for generating CC documentation in healthcare settings.


title: PANDORA: A Parallel Dendrogram Construction Algorithm for Single Linkage Clustering on GPU

abstract: This paper presents \pandora, a novel parallel algorithm for efficiently constructing dendrograms for single-linkage hierarchical clustering, including \hdbscan. Traditional dendrogram construction methods from a minimum spanning tree (MST), such as agglomerative or divisive techniques, often fail to efficiently parallelize, especially with skewed dendrograms common in real-world data. \pandora addresses these challenges through a unique recursive tree contraction method, which simplifies the tree for initial dendrogram construction and then progressively reconstructs the complete dendrogram. This process makes \pandora asymptotically work-optimal, independent of dendrogram skewness. All steps in \pandora are fully parallel and suitable for massively threaded accelerators such as GPUs. Our implementation is written in Kokkos, providing support for both CPUs and multi-vendor GPUs (e.g., Nvidia, AMD). The multithreaded version of \pandora is 2.2$\times$ faster than the current best-multithreaded implementation, while the GPU \pandora implementation achieved 6-20$\times$ on \amdgpu and 10-37$\times$ on \nvidiagpu speed-up over multithreaded \pandora. These advancements lead to up to a 6-fold speedup for \hdbscan on GPUs over the current best, which only offload MST construction to GPUs and perform multithreaded dendrogram construction.


title: 2D Li$^{\bf +}$ ionic hopping in Li$_{\bf 3}$InCl$_{\bf 6}$ as revealed by diffusion-induced nuclear spin relaxation

abstract: Ternary Li halides, such as Li$_3$MeX$_6$ with, e.g., Me = In, Sc, Y and X = Cl, Br, are in the center of attention for battery applications as these materials might serve as ionic electrolytes. To fulfill their function, such electrolytes must have an extraordinarily high ionic Li$^+$ conductivity. Layer-structured Li$_3$InCl$_6$ represents such a candidate; understanding the origin of the rapid Li$^+$ exchange processes needs, however, further investigation. Spatially restricted, that is, low-dimensional particle diffusion might offer an explanation for fast ion dynamics. It is, however, challenging to provide evidence for 2D diffusion at the atomic scale when dealing with polycrystalline powder samples. Here, we used purely diffusion-induced $^7$Li nuclear magnetic spin relaxation to detect anomalies that unambiguously show that 2D Li diffusion is chiefly responsible for the dynamic processes in a Li$_3$InCl$_6$ powder sample. The change of the spin-lattice relaxation rate $1/T_1$ as a function of inverse temperature $1/T$ passes through a rate peak that is strictly following asymmetric behavior. This feature is in excellent agreement with the model of P. M. Richards suggesting a logarithmic spectral density function $J$ to fully describe 2D diffusion. Hence, Li$_3$InCl$_6$ belongs to the very rare examples for which 2D Li$^+$ diffusion has been immaculately verified. We believe that such information help understand the dynamic features of ternary Li halides.


title: A Closer Look at AUROC and AUPRC under Class Imbalance

abstract: In machine learning (ML), a widespread adage is that the area under the precision-recall curve (AUPRC) is a superior metric for model comparison to the area under the receiver operating characteristic (AUROC) for binary classification tasks with class imbalance. This paper challenges this notion through novel mathematical analysis, illustrating that AUROC and AUPRC can be concisely related in probabilistic terms. We demonstrate that AUPRC, contrary to popular belief, is not superior in cases of class imbalance and might even be a harmful metric, given its inclination to unduly favor model improvements in subpopulations with more frequent positive labels. This bias can inadvertently heighten algorithmic disparities. Prompted by these insights, a thorough review of existing ML literature was conducted, utilizing large language models to analyze over 1.5 million papers from arXiv. Our investigation focused on the prevalence and substantiation of the purported AUPRC superiority. The results expose a significant deficit in empirical backing and a trend of misattributions that have fuelled the widespread acceptance of AUPRC's supposed advantages. Our findings represent a dual contribution: a significant technical advancement in understanding metric behaviors and a stark warning about unchecked assumptions in the ML community. All experiments are accessible at https://github.com/mmcdermott/AUC_is_all_you_need.


title: A first-principles thermodynamic model for the Ba$\unicode{x2013}$Zr$\unicode{x2013}$S system in equilibrium with sulfur vapour

abstract: The chalcogenide perovskite BaZrS$_3$ has strong visible light absorption and high chemical stability, is nontoxic, and is made from earth-abundant elements. As such, it is a promising candidate material for application in optoelectronic technologies. However the synthesis of BaZrS$_3$ thin-films for characterisation and device integration remains a challenge. Here we use density functional theory and lattice dynamics to calculate the vibrational properties of elemental, binary and ternary materials in the Ba-Zr-S system. This is used to build a thermodynamic model for the stability of BaZrS$_3$, BaS$_x$, and ZrS$_x$ in equilibrium with sulfur gas, across a range of temperatures and sulfur partial pressures. We highlight that reaction thermodynamics are highly sensitive to sulfur allotrope and the extent of allotrope mixing. We use our model to predict the synthesis conditions in which BaZrS$_3$ and the intermediate binary compounds can form. At a moderate temperature of 500 {\deg}C we find that BaS$_3$, associated with fast reaction kinetics, is stable at pressures above 3x10$^5$ Pa. We also find BaZrS$_3$ is stable against decomposition into sulfur-rich binaries up to at least 1x10$^7$ Pa. Our work provides insights into the chemistry of this promising material and suggests the experimental conditions required for the successful synthesis of BaZrS$_3$.


title: Fast reconstruction of programmable interferometers with intensity-only measurements

abstract: Programmable linear optical interferometers are promising for classical and quantum applications. Their integrated design makes it possible to create more scalable and stable devices. To use them in practice, one has to reconstruct the whole device model taking the manufacturing errors into account. The inability to address individual interferometer elements complicates the reconstruction problem. A naive approach is to train the model via some complex optimization procedure. A faster optimization-free algorithm has been recently proposed [Opt. Express 31, 16729 (2023)]. However, it requires the full transfer matrix tomography while a more practical setup measures only the fields intensities at the interferometer output. In this paper, we propose the modification of the fast algorithm, which uses additional set of interferometer configurations in order to reconstruct the model in the case of intensity-only measurements. We show that it performs slightly worse than the original fast algorithm but it is more practical and still does not require intensive numerical optimization.


title: Branches and bifurcations of ejection-collision orbits in the planar circular restricted three body problem

abstract: The goal of this paper it to prove existence theorems for one parameter families (branches) of ejection-collision orbits in the planar circular restricted three body problem (CRTBP), and to study some of their bifurcations. The orbits considered are ejected from one primary body and collide with the other (as opposed to more local ejections-collision orbits which involve only a single body). We consider branches which are (i) parameterized by the Jacobi integral (energy like quantity conserved by the CRTBP) and (ii) parameterized by the two body mass ratio when energy is fixed. The method of proof is constructive and computer assisted, hence can be applied in non perturbative settings and (potentially) to other conservative systems of differential equations. The main requirement is that the system should admit a change of coordinates which regularizes the singularities (collisions). In the planar CRTBP the necessary regularization is provided by the classical Levi-Civita transformation.


title: On the Structure and Generators of the $n$th-order Chromatic Algebra

abstract: This work investigates the intrinsic properties of the chromatic algebra, introduced by Fendley and Krushkal as a framework to study the chromatic polynomial. We prove that the dimension of the $n$th-order chromatic algebra is the $2n$th Riordan number, which exhibits exponential growth. We find a generating set of size $\binom{n}{2}$, and we provide a procedure to construct the basis from the generating set. We additionally provide proofs for fundamental facts about this algebra that appear to be missing from the literature. These include determining a representation of the chromatic algebra as noncrossing planar partitions and expanding the chromatic relations to include an edge case.


title: Precise characterization of a silicon carbide waveguide fiber interface

abstract: Emitters in high refractive index materials like 4H-SiC suffer from reduced detection of photons because of losses caused by total internal reflection. Thus, integration into efficient nanophotonic structures which couple the emission of photons to a well defined waveguide mode can significantly enhance the photon detection efficiency. In addition, interfacing this waveguide to a classical fiber network is of similar importance to detect the photons and perform experiments. Here, we show a waveguide fiber interface in SiC. By careful measurements we determine efficiencies exceeding 93 % for the transfer of photons from SiC nanobeams to fibers. We use this interface to create a bright single photon source based on waveguide integrated V2 defects in 4H-SiC and achieve an overall photon count rate of 181 kilo-counts per second. We observe and quantify the strain induced shift of the ground state spin states and demonstrate coherent control of the electron spin with a coherence time of T2=42.5 $\rm\mu$s.


title: Anomalous dispersion, superluminality and instabilities in two-flavour theories with local non-Hermitian mass mixing

abstract: Pseudo-Hermitian field theories possess a global continuous ``similarity'' symmetry, interconnecting the theories with the same physical particle content and an identical mass spectrum. In their regimes with real spectra, within this family of similarity transformations, there is a map from the non-Hermitian theory to its Hermitian similarity partner. We promote the similarity transformation to a local symmetry, which requires the introduction of a new vector similarity field as a connection in the similarity space of non-Hermitian theories. In the case of non-Hermitian two-flavour scalar or fermion mixing, and by virtue of a novel IR/UV mixing effect, the effect of inhomogeneous non-Hermiticity then reveals itself via anomalous dispersion, instabilities and superluminal group velocities at very high momenta, thus setting an upper bound on the particle momentum propagating through inhomogeneous backgrounds characterised by Lagrangians with non-Hermitian mass matrices. Such a non-Hermitian extension of the Standard Model of particle physics, encoded in a weak inhomogeneity of the non-Hermitian part of the fermion mass matrix, may nevertheless provide us with a low-energy particle spectrum consistent with experimentally observed properties.


title: Proximal observers for secure state estimation

abstract: This paper discusses a general framework for designing robust state estimators for a class of discrete-time nonlinear systems. We consider systems that may be impacted by impulsive (sparse but otherwise arbitrary) measurement noise sequences. We show that a family of state estimators, robust to this type of undesired signal, can be obtained by minimizing a class of nonsmooth convex functions at each time step. The resulting state observers are defined through proximal operators. We obtain a nonlinear implicit dynamical system in term of estimation error and prove, in the noise-free setting, that it vanishes asymptotically when the minimized loss function and the to-beobserved system enjoy appropriate properties. From a computational perspective, even though the proposed observers can be implemented via efficient numerical procedures, they do not admit closed-form expressions. The paper argues that by adopting appropriate relaxations, simple and fast analytic expressions can be derived.


title: Two loop five point integrals: light, heavy and large spin correlators

abstract: We evaluated all two loop conformal integrals appearing in five point correlation functions of protected operators of $\mathcal{N} = 4$ Super Yang-Mills in several kinematical regimes. Starting from the correlation function of the lightest operators of the theory, we were able to extract structure constants of up to two spinning operators for small and large values of polarizations and spin. We conjectured an universal all loop behaviour for the large spin small polarization structure constants and comment on the subtleties of analytically continuing it from finite to large spin. We also consider correlation functions of heavier operators that get factorized in the more fundamental object called decagon. We fixed this object at two loops in general kinematics and studied its physical properties under OPE and null limits.


title: Special values of $p$-adic $L$-functions and Iwasawa $\lambda$-invariants of Dirichlet characters

abstract: We study the Iwasawa $\lambda$-invariant of Dirichlet characters $\chi$ for odd primes $p$. From the behaviour of the $p$-adic $L$-function at $s=0$, $s=1$ and $s=1-p$, we derive easily computable novel criteria to distinguish between the cases $\lambda = 0$, $\lambda = 1$, $\lambda = 2$ and $\lambda \geq 3$. In particular, we look at the case where the $p$-adic $L$-function and the Iwasawa power series have a trivial (exceptional) zero. We give a condition for $\lambda_p(\chi) >1 $ using the $p$-adic valuation of the Bernoulli number $B_{p,\chi \omega^{-1}}$ or alternatively $L_p(1,\chi)$. We also provide a similar condition for $\lambda_p(\chi) > 2$. The formulas are used to obtain numerical data on $\lambda$-invariants, where either a prime or a Dirichlet character is fixed. The data is consistent with our earlier conjecture on the distribution of $\lambda$-invariants. Now the case of a trivial zero is included, for which the distribution of $\lambda$-values is shifted by $1$.


title: Performance of range-separated long-range SOPPA short-range density functional theory method for vertical excitation energies

abstract: In this paper benchmark results are presented on the calculation of vertical electronic excitation energies using a long-range second-order polarisation propagator approximation (SOPPA) description with a short-range density functional theory (srDFT) description based on the Perdew-Burke-Ernzerhof (PBE) functional. The excitation energies are investigated for 132 singlet states and 71 triplet states across 28 medium sized organic molecules. The results show that overall SOPPA-srPBE always performs better than PBE, and that SOPPA-srPBE performs better than SOPPA for singlet states, but slightly worse than SOPPA for triplet states when CC3 results are the reference values.


title: Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models

abstract: Understanding the internal representations of large language models (LLMs) can help explain models' behavior and verify their alignment with human values. Given the capabilities of LLMs in generating human-understandable text, we propose leveraging the model itself to explain its internal representations in natural language. We introduce a framework called Patchscopes and show how it can be used to answer a wide range of questions about an LLM's computation. We show that many prior interpretability methods based on projecting representations into the vocabulary space and intervening on the LLM computation can be viewed as instances of this framework. Moreover, several of their shortcomings such as failure in inspecting early layers or lack of expressivity can be mitigated by Patchscopes. Beyond unifying prior inspection techniques, Patchscopes also opens up new possibilities such as using a more capable model to explain the representations of a smaller model, and multihop reasoning error correction.


title: In situ coherent X-ray scattering reveals polycrystalline structure and discrete annealing events in strongly-coupled nanocrystal superlattices

abstract: Solution-phase bottom up self-assembly of nanocrystals into superstructures such as ordered superlattices is an attractive strategy to generate functional materials of increasing complexity, including very recent advances that incorporate strong interparticle electronic coupling. While the self-assembly kinetics in these systems have been elucidated and related to the product characteristics, the weak interparticle bonding interactions suggest the superstructures formed could continue to order within the solution long after the primary nucleation and growth have occurred, even though the mechanism of annealing remains to be elucidated. Here, we use a combination of Bragg coherent diffractive imaging and X-ray photon correlation spectroscopy to create real-space maps of supercrystalline order along with a real-time view of the strain fluctuations in aging strongly coupled nanocrystal superlattices while they remain suspended and immobilized in solution. By combining the results, we deduce that the self-assembled superstructures are polycrystalline, initially comprising multiple nucleation sites, and that shear avalanches at grain boundaries continue to increase crystallinity long after growth has substantially slowed. This multimodal approach should be generalizable to characterize a breadth of materials in situ in their native chemical environments, thus extending the reach of high-resolution coherent X-ray characterization to the benefit of a much wider range of physical systems.


title: Transformers are Multi-State RNNs

abstract: Transformers are considered conceptually different from the previous generation of state-of-the-art NLP models - recurrent neural networks (RNNs). In this work, we demonstrate that decoder-only transformers can in fact be conceptualized as unbounded multi-state RNNs - an RNN variant with unlimited hidden state size. We further show that transformers can be converted into $\textit{bounded}$ multi-state RNNs by fixing the size of their hidden state, effectively compressing their key-value cache. We introduce a novel, training-free compression policy - $\textbf{T}$oken $\textbf{O}$mission $\textbf{V}$ia $\textbf{A}$ttention (TOVA). Our experiments with four long range tasks and several LLMs show that TOVA outperforms several baseline compression policies. Particularly, our results are nearly on par with the full model, using in some cases only $\frac{1}{8}$ of the original cache size, which translates to 4.8X higher throughput. Our results shed light on the connection between transformers and RNNs, and help mitigate one of LLMs' most painful computational bottlenecks - the size of their key-value cache. We publicly release our code at https://github.com/schwartz-lab-NLP/TOVA


title: PALP: Prompt Aligned Personalization of Text-to-Image Models

abstract: Content creators often aim to create personalized images using personal subjects that go beyond the capabilities of conventional text-to-image models. Additionally, they may want the resulting image to encompass a specific location, style, ambiance, and more. Existing personalization methods may compromise personalization ability or the alignment to complex textual prompts. This trade-off can impede the fulfillment of user prompts and subject fidelity. We propose a new approach focusing on personalization methods for a \emph{single} prompt to address this issue. We term our approach prompt-aligned personalization. While this may seem restrictive, our method excels in improving text alignment, enabling the creation of images with complex and intricate prompts, which may pose a challenge for current techniques. In particular, our method keeps the personalized model aligned with a target prompt using an additional score distillation sampling term. We demonstrate the versatility of our method in multi- and single-shot settings and further show that it can compose multiple subjects or use inspiration from reference images, such as artworks. We compare our approach quantitatively and qualitatively with existing baselines and state-of-the-art techniques.


title: Accelerated Development of Multicomponent Alloys in Discrete Design Space Using Bayesian Multi-Objective Optimisation

abstract: Bayesian optimisation (BO) protocol based on Active Learning (AL) principles has garnered significant attention due to its ability to efficiently optimise black-box objective functions. This capability is a prerequisite for guiding autonomous and high-throughput materials design and discovery processes. However, its application in the materials science domain, particularly for novel alloy designs with targeted properties, remains limited. This limitation is due to the computational complexity and the lack of reliable and robust acquisition functions for multi-objective optimisation. In recent years, expected hypervolume-based geometrical acquisition functions have demonstrated superior performance and speed compared to other multi-objective optimisation algorithms, such as Thompson Sampling Efficient Multiobjective Optimisation (TSEMO), Pareto Efficient Global Optimisation (parEGO), etc. In this work, we introduce a sparse, axis-aligned subspace BO framework that utilises the q-expected hypervolume improvement (qEHVI) acquisition function. This efficient, parallel variant of the expected hypervolume-based method is employed for the multi-objective optimisation of physical properties in multi-component alloys. We demonstrate the impressive performance of the qEHVI acquisition function in finding the optimum Pareto front in both 1- and 2-objective optimisation problems. Furthermore, by conducting several computational and experimental campaigns in each iteration within the pool-based active learning protocol, we can further accelerate the discovery process. This approach is particularly advantageous for use in massively parallel high-throughput synthesis facilities and computer architectures.


title: Variation of the Hausdorff dimension and degenerations of Schottky groups

abstract: We show that the Hausdorff dimension of the limit set of a Schottky group varies continuously over the moduli space of Schottky groups defined over any complete valued field constructed by Poineau and Turchetti. To obtain this result, we first study the non-Archimedean case in a setting of Berkovich analytic spaces, where we make use of Poincar\'e series. We show that the latter can be extended meromorphically over the complex plane and admit a special value at zero which is a purely topological invariant. As an application, we prove results on the asymptotic behavior of the Hausdorff dimension of degenerating families of complex Schottky groups. For certain families, including Schottky reflection groups, we obtain an exact formula for the asymptotic logarithmic decay rate of the Hausdorff dimension. This generalizes a theorem of McMullen.


title: Atmospheric chemistry surrogate modeling with sparse identification of nonlinear dynamics

abstract: Modeling atmospheric chemistry is computationally expensive and limits the widespread use of atmospheric chemical transport models. This computational cost arises from solving high-dimensional systems of stiff differential equations. Previous work has demonstrated the promise of machine learning (ML) to accelerate air quality model simulations but has suffered from numerical instability during long-term simulations. This may be because previous ML-based efforts have relied on explicit Euler time integration -- which is known to be unstable for stiff systems -- and have used neural networks which are prone to overfitting. We hypothesize that the creation of parsimonious models combined with modern numerical integration techniques can overcome this limitation. Using a small-scale photochemical mechanism to explore the potential of these methods, we have created a machine-learned surrogate by (1) reducing dimensionality using singular value decomposition to create an interpretably-compressed low-dimensional latent space, and (2) using Sparse Identification of Nonlinear Dynamics (SINDy) to create a differential-equation-based representation of the underlying chemical dynamics in the compressed latent space with reduced numerical stiffness. The root mean square error of the ML model prediction for ozone concentration over nine days is 37.8% of the root mean concentration across all simulations in our testing dataset. The surrogate model is 11$\times$ faster with 12$\times$ fewer integration timesteps compared to the reference model and is numerically stable in all tested simulations. Overall, we find that SINDy can be used to create fast, stable, and accurate surrogates of a simple photochemical mechanism. In future work, we will explore the application of this method to more detailed mechanisms and their use in large-scale simulations.


title: Holey graphs: very large Betti numbers are testable

abstract: We show that the graph property of having a (very) large $k$-th Betti number $\beta_k$ for constant $k$ is testable with a constant number of queries in the dense graph model. More specifically, we consider a clique complex defined by an underlying graph and prove that for any $\varepsilon>0$, there exists $\delta(\varepsilon,k)>0$ such that testing whether $\beta_k \geq (1-\delta) d_k$ for $\delta \leq \delta(\varepsilon,k)$ reduces to tolerantly testing $(k+2)$-clique-freeness, which is known to be testable. This complements a result by Elek (2010) showing that Betti numbers are testable in the bounded-degree model. Our result combines the Euler characteristic, matroid theory and the graph removal lemma.


title: Lagrangian Relations and Quantum $L_\infty$ Algebras

abstract: Quantum $L_\infty$ algebras are higher loop generalizations of cyclic $L_\infty$ algebras. Motivated by the problem of defining morphisms between such algebras, we construct a linear category of $(-1)$-shifted symplectic vector spaces and distributional half-densities, originally proposed by \v{S}evera. Morphisms in this category can be given both by formal half-densities and Lagrangian relations; we prove that the composition of such morphisms recovers the construction of homotopy transfer of quantum $L_\infty$ algebras. Finally, using this category, we propose a new notion of a relation between quantum $L_\infty$ algebras.


title: The volume polynomial of lattice polygons

abstract: We prove that every indefinite quadratic form with non-negative integer coefficients is the volume polynomial of a pair of lattice polygons. This solves the discrete version of the Heine-Shephard problem for two bodies in the plane. As an application, we show how to construct a pair of planar tropical curves (or a pair of divisors on a toric surface) with given intersection number and self-intersection numbers.


title: Axis Tour: Word Tour Determines the Order of Axes in ICA-transformed Embeddings

abstract: Word embedding is one of the most important components in natural language processing, but interpreting high-dimensional embeddings remains a challenging problem. To address this problem, Independent Component Analysis (ICA) is identified as an effective solution. ICA-transformed word embeddings reveal interpretable semantic axes; however, the order of these axes are arbitrary. In this study, we focus on this property and propose a novel method, Axis Tour, which optimizes the order of the axes. Inspired by Word Tour, a one-dimensional word embedding method, we aim to improve the clarity of the word embedding space by maximizing the semantic continuity of the axes. Furthermore, we show through experiments on downstream tasks that Axis Tour yields better or comparable low-dimensional embeddings compared to both PCA and ICA.


title: Jupyter widgets and extensions for education and research in computational physics and chemistry

abstract: Python and Jupyter are becoming increasingly popular tools for computational physics and chemistry research and education. Interactive notebooks are a precious tool for creating graphical user interfaces and teaching materials, and Jupyter widgets constitute the core of their interactive functionality. Packages and libraries which offer a broad range of widgets for general purposes exist, but the lack of specialized widgets for computational physics, chemistry and materials science implies significant time investments for the development of effective Jupyter notebooks for research and education in these domains. Here, we present custom Jupyter widgets that we have developed to target the needs of these research and teaching communities. These widgets constitute high quality interactive graphical components and can be employed, for example, as tools to visualize and manipulate data, or to explore different visual representations of concepts, illuminating the relationships existing between them. In addition, we discuss the JupyterLab extensions that we developed to modify the JupyterLab interface for an enhanced user experience when working with various applications within the targeted scientific domains.


title: Computing NMHV Gravity Amplitudes at Infinity

abstract: In this note we show how the solutions to the scattering equations in the NMHV sector fully decompose into subsectors in the $z\to \infty$ limit of a Risager deformation. Each subsector is characterized by the punctures that coalesce in the limit. This naturally decomposes the $E(n-3,1)$ solutions into sets characterized by partitions of $n-3$ elements so that exactly one subset has more than one element. We present analytic expressions for the leading order of the solutions in an expansion around infinite $z$ for any $n$. We also give a simple algorithm for numerically computing arbitrarily high orders in the same expansion. As a consequence, one has the ability to compute Yang-Mills and gravity amplitudes purely from this expansion around infinity. Moreover, we present a new analytic computation of the residue at infinity of the $n=12$ NMHV tree-level gravity amplitude which agrees with the results of Conde and Rajabi. In fact, we present the analytic form of the leading order in $1/z$ of the Cachazo-Skinner-Mason/CHY formula for graviton amplitudes for each subsector and to all multiplicity. As a byproduct of the all-order algorithm, one has access to the numerical value of the residue at infinity for any $n$ and hence to the corrected CSW (or MHV) expansion for NMHV gravity amplitudes.


title: Phase Transition and Magneto-caloric Properties of Perovskites Pr$_{0.55}$Sr$_{0.45}$MnO$_{3}$: Modeling versus Experiments

abstract: Experimental data obtained with the perovskite compounds Pr$_{0.55}$Sr$_{0.45}$MnO$_{3}$ show that the magnetization decreases with increasing temperature $T$ and undergoes a very sharp phase transition to the paramagnetic phase. The sharp transition in a system with a strong disorder is very rare, if not non-existent, in the theory of phase transition in systems of short-range pairwise exchange interactions. To understand this remarkable property, we introduce a model including a multispin (cluster-like) interaction between Mn ions, in addition to the usual pairwise exchange terms between these ions and the Mn-Pr interactions. We carry out Monte Carlo (MC) simulations. Due to the doping, Mn$^{4+}$ with $S=3/2$ has the concentration of Pr$^{3+}$ ($S=1$) and Mn$^{3+}$ with $S=2$ has the Sr concentration. After attempts with different spin models and various Hamiltonians, we find that the many-state Ising spin model reproduces most of the experimental results. For the Hamiltonian, we find that pairwise interactions alone between ions cannot reproduce the sharp transition and the magnetization below $T_C$. We have to include a multispin interaction as said above. We fit the MC results with experimental data, and we estimate values of various exchange interactions in the system. These values are found to be in the range of those found in perovskite manganite compounts. We also study the applied-field effect on the magnetization in the temperature region below and above the transition temperature $T_C$. We calculate the magnetic entropy change $|\Delta S_m|$ and the Relative Cooling Power, for magnetic field from 1 to 3 Tesla. Our simulation results are in good agreement with experiments.


title: Gaussian Shadow Casting for Neural Characters

abstract: Neural character models can now reconstruct detailed geometry and texture from video, but they lack explicit shadows and shading, leading to artifacts when generating novel views and poses or during relighting. It is particularly difficult to include shadows as they are a global effect and the required casting of secondary rays is costly. We propose a new shadow model using a Gaussian density proxy that replaces sampling with a simple analytic formula. It supports dynamic motion and is tailored for shadow computation, thereby avoiding the affine projection approximation and sorting required by the closely related Gaussian splatting. Combined with a deferred neural rendering model, our Gaussian shadows enable Lambertian shading and shadow casting with minimal overhead. We demonstrate improved reconstructions, with better separation of albedo, shading, and shadows in challenging outdoor scenes with direct sun light and hard shadows. Our method is able to optimize the light direction without any input from the user. As a result, novel poses have fewer shadow artifacts and relighting in novel scenes is more realistic compared to the state-of-the-art methods, providing new ways to pose neural characters in novel environments, increasing their applicability.


title: Landscape of nuclear deformation softness with spherical quasi-particle random phase approximation

abstract: We investigate the stability and softness of nuclei against quadrupole, octupole, and hexadecapole deformation. By applying the spherical Skyrme-force Hartree-Fock Bardeen-Cooper-Schrieffer quasi-particle random phase approximation, we diagnose ground-state deformation when imaginary solutions are obtained, i.e., the spherical ground state {\em collapses}. We also calculate the multipole polarizability in spherical nuclei with no collapse, as a measure of softness. This numerically light and theoretically sound method is found able to capture deformation patterns across the nuclide chart. The connection between the intrinsic shape of nuclei and the dynamics of their low-lying collective states is established and the role of shell structure is discussed.


title: Extreme Compression of Large Language Models via Additive Quantization

abstract: The emergence of accurate open large language models (LLMs) has led to a race towards performant quantization techniques which can enable their execution on end-user devices. In this paper, we revisit the problem of ``extreme'' LLM compression -- defined as targeting extremely low bit counts, such as 2 to 3 bits per parameter -- from the point of view of classic methods in Multi-Codebook Quantization (MCQ). Our algorithm, called AQLM, generalizes the classic Additive Quantization (AQ) approach for information retrieval to advance the state-of-the-art in LLM compression, via two innovations: 1) learned additive quantization of weight matrices in input-adaptive fashion, and 2) joint optimization of codebook parameters across each transformer blocks. Broadly, AQLM is the first scheme that is Pareto optimal in terms of accuracy-vs-model-size when compressing to less than 3 bits per parameter, and significantly improves upon all known schemes in the extreme compression (2bit) regime. In addition, AQLM is practical: we provide fast GPU and CPU implementations of AQLM for token generation, which enable us to match or outperform optimized FP16 implementations for speed, while executing in a much smaller memory footprint.


title: Highly multimode visible squeezed light with programmable spectral correlations through broadband up-conversion

abstract: Multimode squeezed states of light have been proposed as a resource for achieving quantum advantage in computing and sensing. Recent experiments that demonstrate multimode Gaussian states to this end have most commonly opted for spatial or temporal modes, whereas a complete system based on frequency modes has yet to be realized. Instead, we show how to use the frequency modes simultaneously squeezed in a conventional, single-spatial-mode, optical parametric amplifier when pumped by ultrashort pulses. Specifically, we show how adiabatic frequency conversion can be used not only to convert the quantum state from infrared to visible wavelengths, but to concurrently manipulate the joint spectrum. This near unity-efficiency quantum frequency conversion, over a bandwidth >45 THz and, to our knowledge, the broadest to date, allows us to measure the state with an electron-multiplying CCD (EMCCD) camera-based spectrometer, at non-cryogenic temperatures. We demonstrate the squeezing of >400 frequency modes, with a mean of approximately 700 visible photons per shot. Our work shows how many-mode quantum states of light can be generated, manipulated, and measured with efficient use of hardware resources -- in our case, using one pulsed laser, two nonlinear crystals, and one camera. This ability to produce, with modest hardware resources, large multimode squeezed states with partial programmability motivates the use of frequency encoding for photonics-based quantum information processing.


title: Reconstruction for the Calder\'on problem with Lipschitz conductivities

abstract: We determine the conductivity of the interior of a body using electrical measurements on its surface. We assume only that the conductivity is bounded below by a positive constant and that the conductivity and surface are Lipschitz continuous. To determine the conductivity we first solve an associated integral equation locally, finding solutions in $H^1(B)$, where $B$ is a ball that properly contains the body. A key ingredient is to equip this Sobolev space with an equivalent norm which depends on two auxiliary parameters that can be chosen to yield a contraction.


title: TOFU: A Task of Fictitious Unlearning for LLMs

abstract: Large language models trained on massive corpora of data from the web can memorize and reproduce sensitive or private data raising both legal and ethical concerns. Unlearning, or tuning models to forget information present in their training data, provides us with a way to protect private data after training. Although several methods exist for such unlearning, it is unclear to what extent they result in models equivalent to those where the data to be forgotten was never learned in the first place. To address this challenge, we present TOFU, a Task of Fictitious Unlearning, as a benchmark aimed at helping deepen our understanding of unlearning. We offer a dataset of 200 diverse synthetic author profiles, each consisting of 20 question-answer pairs, and a subset of these profiles called the forget set that serves as the target for unlearning. We compile a suite of metrics that work together to provide a holistic picture of unlearning efficacy. Finally, we provide a set of baseline results from existing unlearning algorithms. Importantly, none of the baselines we consider show effective unlearning motivating continued efforts to develop approaches for unlearning that effectively tune models so that they truly behave as if they were never trained on the forget data at all.


title: Manipulating Feature Visualizations with Gradient Slingshots

abstract: Deep Neural Networks (DNNs) are capable of learning complex and versatile representations, however, the semantic nature of the learned concepts remains unknown. A common method used to explain the concepts learned by DNNs is Activation Maximization (AM), which generates a synthetic input signal that maximally activates a particular neuron in the network. In this paper, we investigate the vulnerability of this approach to adversarial model manipulations and introduce a novel method for manipulating feature visualization without altering the model architecture or significantly impacting the model's decision-making process. We evaluate the effectiveness of our method on several neural network models and demonstrate its capabilities to hide the functionality of specific neurons by masking the original explanations of neurons with chosen target explanations during model auditing. As a remedy, we propose a protective measure against such manipulations and provide quantitative evidence which substantiates our findings.


title: Theory of nonlinear sub-Doppler laser spectroscopy taking into account atomic-motion-induced density-dependent effects in a gas

abstract: We develop a field-nonlinear theory of sub-Doppler spectroscopy in a gas of two-level atoms, based on a self-consistent solution of the Maxwell-Bloch equations in the mean field and single-atom density matrix approximations. This makes it possible to correctly take into account the effects caused by the free motion of atoms in a gas, which lead to a nonlinear dependence of the spectroscopic signal on the atomic density even in the absent of a direct interatomic interaction (e.g., dipole-dipole interaction). Within the framework of this approach, analytical expressions for the light field were obtained for an arbitrary number of resonant waves and arbitrary optical thickness of a gas medium. Sub-Doppler spectroscopy in the transmission signal for two counterpropagating and co-propagating waves has been studied in detail. A previously unknown red shift of a narrow sub-Doppler resonance is predicted in a counterpropagating waves scheme, when the frequency of one wave is fixed and the frequency of the other wave is varied. The magnitude of this shift depends on the atomic density and can be more than an order of magnitude greater than the known shift from the interatomic dipole-dipole interaction (Lorentz-Lorenz shift). The found effects, caused by the free motion of atoms, require a significant revision of the existing picture of spectroscopic effects depending on the density of atoms in a gas. Apart of fundamental aspect, obtained results are important for precision laser spectroscopy and optical atomic clocks.


title: Interstellar Photovoltaics for Exploring Alien Solar Systems

abstract: Explore alien solar systems via local star power using interstellar photovoltaics, tailored for the particular target star for maximum power and low mass. We consider tailored organic thin-film photovoltaics. Key for sensing, sending more data back and powering A.I. to send back observational summaries and interesting events and observations. This plus other technology developments are necessary for exploring Alien Solar Systems in the not too distant future.

categories: physics.pop-ph astro-ph.GA astro-ph.IM astro-ph.SR


title: Improved Capacity Outer Bound for Private Quadratic Monomial Computation

abstract: In private computation, a user wishes to retrieve a function evaluation of messages stored on a set of databases without revealing the function's identity to the databases. Obead \emph{et al.} introduced a capacity outer bound for private nonlinear computation, dependent on the order of the candidate functions. Focusing on private \emph{quadratic monomial} computation, we propose three methods for ordering candidate functions: a graph edge-coloring method, a graph-distance method, and an entropy-based greedy method. We confirm, via an exhaustive search, that all three methods yield an optimal ordering for $f < 6$ messages. For $6 \leq f \leq 12$ messages, we numerically evaluate the performance of the proposed methods compared with a directed random search. For almost all scenarios considered, the entropy-based greedy method gives the smallest gap to the best-found ordering.


title: Dubbing for Everyone: Data-Efficient Visual Dubbing using Neural Rendering Priors

abstract: Visual dubbing is the process of generating lip motions of an actor in a video to synchronise with given audio. Recent advances have made progress towards this goal but have not been able to produce an approach suitable for mass adoption. Existing methods are split into either person-generic or person-specific models. Person-specific models produce results almost indistinguishable from reality but rely on long training times using large single-person datasets. Person-generic works have allowed for the visual dubbing of any video to any audio without further training, but these fail to capture the person-specific nuances and often suffer from visual artefacts. Our method, based on data-efficient neural rendering priors, overcomes the limitations of existing approaches. Our pipeline consists of learning a deferred neural rendering prior network and actor-specific adaptation using neural textures. This method allows for $\textbf{high-quality visual dubbing with just a few seconds of data}$, that enables video dubbing for any actor - from A-list celebrities to background actors. We show that we achieve state-of-the-art in terms of $\textbf{visual quality}$ and $\textbf{recognisability}$ both quantitatively, and qualitatively through two user studies. Our prior learning and adaptation method $\textbf{generalises to limited data}$ better and is more $\textbf{scalable}$ than existing person-specific models. Our experiments on real-world, limited data scenarios find that our model is preferred over all others. The project page may be found at https://dubbingforeveryone.github.io/


title: E$^{2}$GAN: Efficient Training of Efficient GANs for Image-to-Image Translation

abstract: One highly promising direction for enabling flexible real-time on-device image editing is utilizing data distillation by leveraging large-scale text-to-image diffusion models to generate paired datasets used for training generative adversarial networks (GANs). This approach notably alleviates the stringent requirements typically imposed by high-end commercial GPUs for performing image editing with diffusion models. However, unlike text-to-image diffusion models, each distilled GAN is specialized for a specific image editing task, necessitating costly training efforts to obtain models for various concepts. In this work, we introduce and address a novel research direction: can the process of distilling GANs from diffusion models be made significantly more efficient? To achieve this goal, we propose a series of innovative techniques. First, we construct a base GAN model with generalized features, adaptable to different concepts through fine-tuning, eliminating the need for training from scratch. Second, we identify crucial layers within the base GAN model and employ Low-Rank Adaptation (LoRA) with a simple yet effective rank search process, rather than fine-tuning the entire base model. Third, we investigate the minimal amount of data necessary for fine-tuning, further reducing the overall training time. Extensive experiments show that we can efficiently empower GANs with the ability to perform real-time high-quality image editing on mobile devices with remarkably reduced training and storage costs for each concept.


title: A SymTFT for Continuous Symmetries

abstract: Symmetry is a powerful tool for studying dynamics in QFT: it provides selection rules, constrains RG flows, and often simplifies analysis. Currently, our understanding is that the most general form of symmetry is described by categorical symmetries which can be realized via Symmetry TQFTs or ``SymTFTs." In this paper, we show how the framework of the SymTFT, which is understood for discrete symmetries (i.e. finite categorical symmetries), can be generalized to continuous symmetries. In addition to demonstrating how $U(1)$ global symmetries can be incorporated into the paradigm of the SymTFT, we apply our formalism to study cubic $U(1)$ anomalies in $4d$ QFTs, describe the $\mathbb{Q}/\mathbb{Z}$ non-invertible chiral symmetry in $4d$ theories, and conjecture the SymTFT for general continuous $G^{(0)}$ global symmetries.

categories: hep-th cond-mat.str-el hep-ph math-ph math.MP


title: Distilling Vision-Language Models on Millions of Videos

abstract: The recent advance in vision-language models is largely attributed to the abundance of image-text data. We aim to replicate this success for video-language models, but there simply is not enough human-curated video-text data available. We thus resort to fine-tuning a video-language model from a strong image-language baseline with synthesized instructional data. The resulting video model by video-instruction-tuning (VIIT) is then used to auto-label millions of videos to generate high-quality captions. We show the adapted video-language model performs well on a wide range of video-language benchmarks. For instance, it surpasses the best prior result on open-ended NExT-QA by 2.8%. Besides, our model generates detailed descriptions for previously unseen videos, which provide better textual supervision than existing methods. Experiments show that a video-language dual-encoder model contrastively trained on these auto-generated captions is 3.8% better than the strongest baseline that also leverages vision-language models. Our best model outperforms state-of-the-art methods on MSR-VTT zero-shot text-to-video retrieval by 6%. As a side product, we generate the largest video caption dataset to date.


title: The chiral phase transition and the axial anomaly

abstract: To date numerical simulations of lattice QCD have not found a chiral phase transition of first order which is expected to occur for sufficiently light pions. We show how the restoration of an exact global chiral symmetry can strongly decrease the breaking of the approximate, anomalous $U_A(1)$ symmetry. This is testable on the lattice through simulations for one through four flavors. In QCD a small breaking of the $U_A(1)$ symmetry in the chirally symmetric phase generates novel experimental signals.


title: A Note on Some Classes of Function Algebras

abstract: In this note, we establish some new results on some special types of function algebras and also give new proofs to some existing ones


title: Cache Blocking for Flux Reconstruction: Extension to Navier-Stokes Equations and Anti-aliasing

abstract: In this article, cache blocking is implemented for the Navier Stokes equations with anti-aliasing support on mixed grids in PyFR for CPUs. In particular, cache blocking is used as an alternative to kernel fusion to eliminate unnecessary data movements between kernels at the main memory level. Specifically, kernels that exchange data are grouped together, and these groups are then executed on small sub-regions of the domain that fit in per-core private data cache. Additionally, cache blocking is also used to efficiently implement a tensor product factorisation of the interpolation operators associated with anti-aliasing. By using cache blocking, the intermediate results between application of the sparse factors are stored in per-core private data cache, and a significant amount of data movement from main memory is avoided. In order to assess the performance gains a theoretical model is developed, and the implementation is benchmarked using a compressible 3D Taylor-Green vortex test case on both hexahedral and prismatic grids, with third- and forth-order solution polynomials. The expected performance gains based on the theoretical model range from 1.99 to 2.62, and the speedups obtained in practice range from 1.67 to 3.67 compared to PyFR v1.11.0.


title: The possibility of making \$138,000 from shredded banknote pieces using computer vision

abstract: Every country must dispose of old banknotes. At the Hong Kong Monetary Authority visitor center, visitors can buy a paperweight souvenir full of shredded banknotes. Even though the shredded banknotes are small, by using computer vision, it is possible to reconstruct the whole banknote like a jigsaw puzzle. Each paperweight souvenir costs \$100 HKD, and it is claimed to contain shredded banknotes equivalent to 138 complete \$1000 HKD banknotes. In theory, \$138,000 HKD can be recovered by using computer vision. This paper discusses the technique of collecting shredded banknote pieces and applying a computer vision program.


title: Synergy or Rivalry? Glimpses of Regional Modernization and Public Service Equalization: A Case Study from China

abstract: For most developing countries, increasing the equalization of basic public services is widely recognized as an effective channel to improve people's sense of contentment. However, for many emerging economies like China, the equalization level of basic public services may often be neglected in the trade-off between the speed and quality of development. Taking the Yangtze River Delta region of China as an example, this paper first adopts the coupling coordination degree model to explore current status of basic public services in this region, and then uses Moran's I index to study the overall equalization level of development there. Moreover, this paper uses the Theil index to analyze the main reasons for the spatial differences in the level of public services, followed by the AF method to accurately identify the exact weaknesses of the 40 counties of 10 cities with the weakest level of basic public service development. Based on this, this paper provides targeted optimization initiatives and continues to explore the factors affecting the growth of the level of public service equalization through the convergence model, verifying the convergence trend of the degree of public service equalization, and ultimately providing practical policy recommendations for promoting the equalization of basic public services.


title: A Distributed Neural Linear Thompson Sampling Framework to Achieve URLLC in Industrial IoT

abstract: Industrial Internet of Things (IIoT) networks will provide Ultra-Reliable Low-Latency Communication (URLLC) to support critical processes underlying the production chains. However, standard protocols for allocating wireless resources may not optimize the latency-reliability trade-off, especially for uplink communication. For example, centralized grant-based scheduling can ensure almost zero collisions, but introduces delays in the way resources are requested by the User Equipments (UEs) and granted by the gNB. In turn, distributed scheduling (e.g., based on random access), in which UEs autonomously choose the resources for transmission, may lead to potentially many collisions especially when the traffic increases. In this work we propose DIStributed combinatorial NEural linear Thompson Sampling (DISNETS), a novel scheduling framework that combines the best of the two worlds. By leveraging a feedback signal from the gNB and reinforcement learning, the UEs are trained to autonomously optimize their uplink transmissions by selecting the available resources to minimize the number of collisions, without additional message exchange to/from the gNB. DISNETS is a distributed, multi-agent adaptation of the Neural Linear Thompson Sampling (NLTS) algorithm, which has been further extended to admit multiple parallel actions. We demonstrate the superior performance of DISNETS in addressing URLLC in IIoT scenarios compared to other baselines.


title: Isospectral open cavities and gratings

abstract: Open cavities are often an essential component in the design of ultra-thin subwavelength metasurfaces and a typical requirement is that cavities have precise, often low frequency, resonances whilst simultaneously being physically compact. To aid this design challenge we develop a methodology to allow isospectral twinning of reference cavities with either smaller or larger ones, enforcing their spectra to coincide so that open resonators are identical in terms of their complex eigenfrequencies. For open systems the spectrum is not purely discrete and real, and we pay special attention to the accurate twinning of leaky modes associated with complex valued eigenfrequencies with an imaginary part orders of magnitude lower than the real part. We further consider twinning of 2D gratings, and model these with Floquet-Bloch conditions along one direction and perfectly matched layers in the other one; complex eigenfrequencies of special interest are located in the vicinity of the positive real line and further depend upon the Bloch wavenumber. The isospectral behaviour is illustrated, and quantified, throughout by numerical simulation using finite element analysis.


title: QuasiNet: a neural network with trainable product layers

abstract: Classical neural networks achieve only limited convergence in hard problems such as XOR or parity when the number of hidden neurons is small. With the motivation to improve the success rate of neural networks in these problems, we propose a new neural network model inspired by existing neural network models with so called product neurons and a learning rule derived from classical error backpropagation, which elegantly solves the problem of mutually exclusive situations. Unlike existing product neurons, which have weights that are preset and not adaptable, our product layers of neurons also do learn. We tested the model and compared its success rate to a classical multilayer perceptron in the aforementioned problems as well as in other hard problems such as the two spirals. Our results indicate that our model is clearly more successful than the classical MLP and has the potential to be used in many tasks and applications.


title: The inheritance tracial topological rank zero for centrally large subalgebra

abstract: Let $A$ be an infinite-dimensional unital simple C*-algebra such that A has $\mu$-$oz{\rm LLP}$ property for any $\mu\in(0,1)$. Let $B\subseteq A$ be a centrally large subalgebra of $A$ such that $B$ has tracial topological rank zero. Then $A$ has tracial topological rank zero.


title: Stockformer: A Price-Volume Factor Stock Selection Model Based on Wavelet Transform and Multi-Task Self-Attention Networks

abstract: As the Chinese stock market continues to evolve and its market structure grows increasingly complex, traditional quantitative trading methods are facing escalating challenges. Particularly, due to policy uncertainty and the frequent market fluctuations triggered by sudden economic events, existing models often struggle to accurately predict market dynamics. To address these challenges, this paper introduces Stockformer, a price-volume factor stock selection model that integrates wavelet transformation and a multitask self-attention network, aimed at enhancing responsiveness and predictive accuracy regarding market instabilities. Through discrete wavelet transform, Stockformer decomposes stock returns into high and low frequencies, meticulously capturing long-term market trends and short-term fluctuations, including abrupt events. Moreover, the model incorporates a Dual-Frequency Spatiotemporal Encoder and graph embedding techniques to effectively capture complex temporal and spatial relationships among stocks. Employing a multitask learning strategy, it simultaneously predicts stock returns and directional trends. Experimental results show that Stockformer outperforms existing advanced methods on multiple real stock market datasets. In strategy backtesting, Stockformer consistently demonstrates exceptional stability and reliability across market conditions-whether rising, falling, or fluctuating-particularly maintaining high performance during downturns or volatile periods, indicating a high adaptability to market fluctuations. To foster innovation and collaboration in the financial analysis sector, the Stockformer model's code has been open-sourced and is available on the GitHub repository: https://github.com/Eric991005/Multitask-Stockformer.


title: Prospects for the stout smearing as an equivalent approach to the Wilson flow

abstract: We present the equivalence between the Wilson flow and the stout smearing. The similarity between these two methods was first pointed out by L\"uscher's original paper on the Wilson flow. We first show the analytical equivalence of two methods, which indicates that the finite stout smearing parameter induces ${\cal O}(a^2)$ correction. We secondly show that they remain equivalent in numerical simulations within some numerical precision even with finite cutoffs and stout smearing parameters by directly comparing the expectation values of the action density and we shortly mention the use of the equivalence.


title: The Role of Direct Capital Cash Transfers Towards Poverty and Extreme Poverty Alleviation -- An Omega Risk Process

abstract: Trapping refers to the event when a household falls into the area of poverty. Households that live or fall into the area of poverty are said to be in a poverty trap, where a poverty trap is a state of poverty from which it is difficult to escape without external help. Similarly, extreme poverty is considered as the most severe type of poverty, in which households experience severe deprivation of basic human needs. In this article, we consider an Omega risk process with deterministic growth and a multiplicative jump (collapse) structure to model the capital of a household. It is assumed that, when a household's capital level is above a certain capital barrier level that determines a household's eligibility for a capital cash transfer programme, its capital grows exponentially. As soon as its capital falls below the capital barrier level, the capital dynamics incorporate external support in the form of direct transfers (capital cash transfers) provided by donors or governments. Otherwise, once trapped, the capital grows only due to the capital cash transfers. Under this model, we first derive closed-form expressions for the trapping probability and then do the same for the probability of extreme poverty, which only depends on the current value of the capital given by some extreme poverty rate function. Numerical examples illustrate the role of capital cash transfers on poverty and extreme poverty dynamics.


title: A Statistical Field Perspective on Capital Allocation and Accumulation: Individual dynamics

abstract: We have shown, in a series of articles, that a classical description of a large number of economic agents can be replaced by a statistical fields formalism. To better understand the accumulation and allocation of capital among different sectors, the present paper applies this statistical fields description to a large number of heterogeneous agents divided into two groups. The first group is composed of a large number of firms in different sectors that collectively own the entire physical capital. The second group, investors, holds the entire financial capital and allocates it between firms across sectors according to investment preferences, expected returns, and stock prices variations on financial markets. In return, firms pay dividends to their investors. Financial capital is thus a function of dividends and stock valuations, whereas physical capital is a function of the total capital allocated by the financial sector. Whereas our previous work focused on the background fields that describe potential long-term equilibria, here we compute the transition functions of individual agents and study their probabilistic dynamics in the background field, as a function of their initial state. We show that capital accumulation depends on various factors. The probability associated with each firm's trajectories is the result of several contradictory effects: the firm tends to shift towards sectors with the greatest long-term return, but must take into account the impact of its shift on its attractiveness for investors throughout its trajectory. Since this trajectory depends largely on the average capital of transition sectors, a firm's attractiveness during its relocation depends on the relative level of capital in those sectors. Thus, an under-capitalized firm reaching a high-capital sector will experience a loss of attractiveness, and subsequently, in investors. Moreover, the firm must also consider the effects of competition in the intermediate sectors. An under-capitalized firm will tend to be ousted out towards sectors with lower average capital, while an over-capitalized firm will tend to shift towards higher averagecapital sectors. For investors, capital allocation depends on their short and long-term returns. These returns are not independent: in the short-term, returns are composed of both the firm's dividends and the increase in its stock prices. In the long-term, returns are based on the firm's growth expectations, but also, indirectly, on expectations of higher stock prices. Investors' capital allocation directly depends on the volatility of stock prices and {\ldots}rms'dividends. Investors will tend to reallocate their capital to maximize their short and long-term returns. The higher their level of capital, the stronger the reallocation will be.


title: Redefining Recon: Bridging Gaps with UAVs, 360 degree Cameras, and Neural Radiance Fields

abstract: In the realm of digital situational awareness during disaster situations, accurate digital representations, like 3D models, play an indispensable role. To ensure the safety of rescue teams, robotic platforms are often deployed to generate these models. In this paper, we introduce an innovative approach that synergizes the capabilities of compact Unmaned Arial Vehicles (UAVs), smaller than 30 cm, equipped with 360 degree cameras and the advances of Neural Radiance Fields (NeRFs). A NeRF, a specialized neural network, can deduce a 3D representation of any scene using 2D images and then synthesize it from various angles upon request. This method is especially tailored for urban environments which have experienced significant destruction, where the structural integrity of buildings is compromised to the point of barring entry-commonly observed post-earthquakes and after severe fires. We have tested our approach through recent post-fire scenario, underlining the efficacy of NeRFs even in challenging outdoor environments characterized by water, snow, varying light conditions, and reflective surfaces.


title: DFU: scale-robust diffusion model for zero-shot super-resolution image generation

abstract: Diffusion generative models have achieved remarkable success in generating images with a fixed resolution. However, existing models have limited ability to generalize to different resolutions when training data at those resolutions are not available. Leveraging techniques from operator learning, we present a novel deep-learning architecture, Dual-FNO UNet (DFU), which approximates the score operator by combining both spatial and spectral information at multiple resolutions. Comparisons of DFU to baselines demonstrate its scalability: 1) simultaneously training on multiple resolutions improves FID over training at any single fixed resolution; 2) DFU generalizes beyond its training resolutions, allowing for coherent, high-fidelity generation at higher-resolutions with the same model, i.e. zero-shot super-resolution image-generation; 3) we propose a fine-tuning strategy to further enhance the zero-shot super-resolution image-generation capability of our model, leading to a FID of 11.3 at 1.66 times the maximum training resolution on FFHQ, which no other method can come close to achieving.


title: Minuet: Accelerating 3D Sparse Convolutions on GPUs

abstract: Sparse Convolution (SC) is widely used for processing 3D point clouds that are inherently sparse. Different from dense convolution, SC preserves the sparsity of the input point cloud by only allowing outputs to specific locations. To efficiently compute SC, prior SC engines first use hash tables to build a kernel map that stores the necessary General Matrix Multiplication (GEMM) operations to be executed (Map step), and then use a Gather-GEMM-Scatter process to execute these GEMM operations (GMaS step). In this work, we analyze the shortcomings of prior state-of-the-art SC engines, and propose Minuet, a novel memory-efficient SC engine tailored for modern GPUs. Minuet proposes to (i) replace the hash tables used in the Map step with a novel segmented sorting double-traversed binary search algorithm that highly utilizes the on-chip memory hierarchy of GPUs, (ii) use a lightweight scheme to autotune the tile size in the Gather and Scatter operations of the GMaS step, such that to adapt the execution to the particular characteristics of each SC layer, dataset, and GPU architecture, and (iii) employ a padding-efficient GEMM grouping approach that reduces both memory padding and kernel launching overheads. Our evaluations show that Minuet significantly outperforms prior SC engines by on average $1.74\times$ (up to $2.22\times$) for end-to-end point cloud network executions. Our novel segmented sorting double-traversed binary search algorithm achieves superior speedups by $15.8\times$ on average (up to $26.8\times$) over prior SC engines in the Map step. The source code of Minuet is publicly available at https://github.com/UofT-EcoSystem/Minuet.


title: AAMDM: Accelerated Auto-regressive Motion Diffusion Model

abstract: Interactive motion synthesis is essential in creating immersive experiences in entertainment applications, such as video games and virtual reality. However, generating animations that are both high-quality and contextually responsive remains a challenge. Traditional techniques in the game industry can produce high-fidelity animations but suffer from high computational costs and poor scalability. Trained neural network models alleviate the memory and speed issues, yet fall short on generating diverse motions. Diffusion models offer diverse motion synthesis with low memory usage, but require expensive reverse diffusion processes. This paper introduces the Accelerated Auto-regressive Motion Diffusion Model (AAMDM), a novel motion synthesis framework designed to achieve quality, diversity, and efficiency all together. AAMDM integrates Denoising Diffusion GANs as a fast Generation Module, and an Auto-regressive Diffusion Model as a Polishing Module. Furthermore, AAMDM operates in a lower-dimensional embedded space rather than the full-dimensional pose space, which reduces the training complexity as well as further improves the performance. We show that AAMDM outperforms existing methods in motion quality, diversity, and runtime efficiency, through comprehensive quantitative analyses and visual comparisons. We also demonstrate the effectiveness of each algorithmic component through ablation studies.


title: A Kannappan-sine subtraction law on semigroups

abstract: Let $S$ be a semigroup, $z_0$ a fixed element in $S$ and $\sigma:S \longrightarrow S$ an involutive automorphism. We determine the complex-valued solutions of Kannappan-sine subtraction law $f(x\sigma(y)z_0)=f(x)g(y)-f(y)g(x),\; x,y \in S$. As an application we solve the following variant of Kannappan-sine subtraction law viz. $f(x\sigma(y)z_0)=f(x)g(y)-f(y)g(x)+\lambda g(x\sigma(y)z_0) ,\; x,y \in S,$ where $\lambda \in \mathbb{C}^{*}$. The continuous solutions on topological semigroups are given and an example to illustrate the main results is also given.


title: Artificial Intelligence for Digital and Computational Pathology

abstract: Advances in digitizing tissue slides and the fast-paced progress in artificial intelligence, including deep learning, have boosted the field of computational pathology. This field holds tremendous potential to automate clinical diagnosis, predict patient prognosis and response to therapy, and discover new morphological biomarkers from tissue images. Some of these artificial intelligence-based systems are now getting approved to assist clinical diagnosis; however, technical barriers remain for their widespread clinical adoption and integration as a research tool. This Review consolidates recent methodological advances in computational pathology for predicting clinical end points in whole-slide images and highlights how these developments enable the automation of clinical practice and the discovery of new biomarkers. We then provide future perspectives as the field expands into a broader range of clinical and research tasks with increasingly diverse modalities of clinical data.


title: Image Classifier Based Generative Method for Planar Antenna Design

abstract: To extend the antenna design on printed circuit boards (PCBs) for more engineers of interest, we propose a simple method that models PCB antennas with a few basic components. By taking two separate steps to decide their geometric dimensions and positions, antenna prototypes can be facilitated with no experience required. Random sampling statistics relate to the quality of dimensions are used in selecting among dimension candidates. A novel image-based classifier using a convolutional neural network (CNN) is introduced to further determine the positions of these fixed-dimension components. Two examples from wearable products have been chosen to examine the entire workflow. Their final designs are realistic and their performance metrics are not inferior to the ones designed by experienced engineers.


title: D-STGCNT: A Dense Spatio-Temporal Graph Conv-GRU Network based on transformer for assessment of patient physical rehabilitation

abstract: This paper tackles the challenge of automatically assessing physical rehabilitation exercises for patients who perform the exercises without clinician supervision. The objective is to provide a quality score to ensure correct performance and achieve desired results. To achieve this goal, a new graph-based model, the Dense Spatio-Temporal Graph Conv-GRU Network with Transformer, is introduced. This model combines a modified version of STGCN and transformer architectures for efficient handling of spatio-temporal data. The key idea is to consider skeleton data respecting its non-linear structure as a graph and detecting joints playing the main role in each rehabilitation exercise. Dense connections and GRU mechanisms are used to rapidly process large 3D skeleton inputs and effectively model temporal dynamics. The transformer encoder's attention mechanism focuses on relevant parts of the input sequence, making it useful for evaluating rehabilitation exercises. The evaluation of our proposed approach on the KIMORE and UI-PRMD datasets highlighted its potential, surpassing state-of-the-art methods in terms of accuracy and computational time. This resulted in faster and more accurate learning and assessment of rehabilitation exercises. Additionally, our model provides valuable feedback through qualitative illustrations, effectively highlighting the significance of joints in specific exercises.


title: Towards Joint Sequence-Structure Generation of Nucleic Acid and Protein Complexes with SE(3)-Discrete Diffusion

abstract: Generative models of macromolecules carry abundant and impactful implications for industrial and biomedical efforts in protein engineering. However, existing methods are currently limited to modeling protein structures or sequences, independently or jointly, without regard to the interactions that commonly occur between proteins and other macromolecules. In this work, we introduce MMDiff, a generative model that jointly designs sequences and structures of nucleic acid and protein complexes, independently or in complex, using joint SE(3)-discrete diffusion noise. Such a model has important implications for emerging areas of macromolecular design including structure-based transcription factor design and design of noncoding RNA sequences. We demonstrate the utility of MMDiff through a rigorous new design benchmark for macromolecular complex generation that we introduce in this work. Our results demonstrate that MMDiff is able to successfully generate micro-RNA and single-stranded DNA molecules while being modestly capable of joint modeling DNA and RNA molecules in interaction with multi-chain protein complexes. Source code: https://github.com/Profluent-Internships/MMDiff.


title: Graph-Network-Based Predictive Modeling for Highly Cross-Linked Polymer Systems

abstract: In this study, a versatile methodology for initiating polymerization from monomers in highly cross-linked materials is investigated. As polymerization progresses, force-field parameters undergo continuous modification due to the formation of new chemical bonds. This dynamic process not only impacts the atoms directly involved in bonding, but also influences the neighboring atomic environment. Monitoring these complex changes in highly cross-linked structures poses a challenge. To address this issue, we introduce a graph-network-based algorithm that offers both rapid and accurate predictions. The algorithm merges polymer construction protocols with LAMMPS, a large-scale molecular dynamics simulation software. The adaptability of this code has been demonstrated by its successful application to various amorphous polymers, including porous polymer networks (PPNs), and epoxy-resins, while the algorithm has been employed for additional tasks, such as implementing pore-piercing deformations and calculating material properties.


title: Multi-Modal Optimization with k-Cluster Big Bang-Big Crunch Algorithm

abstract: Multi-modal optimization is often encountered in engineering problems, especially when different and alternative solutions are sought. Evolutionary algorithms can efficiently tackle multi-modal optimization thanks to their features such as the concept of population, exploration/exploitation, and being suitable for parallel computation. This paper introduces a multi-modal optimization version of the Big Bang-Big Crunch algorithm based on clustering, namely, k-BBBC. This algorithm guarantees a complete convergence of the entire population, retrieving on average the 99\% of local optima for a specific problem. Additionally, we introduce two post-processing methods to (i) identify the local optima in a set of retrieved solutions (i.e., a population), and (ii) quantify the number of correctly retrieved optima against the expected ones (i.e., success rate). Our results show that k-BBBC performs well even with problems having a large number of optima (tested on 379 optima) and high dimensionality (tested on 32 decision variables). When compared to other multi-modal optimization methods, it outperforms them in terms of accuracy (in both search and objective space) and success rate (number of correctly retrieved optima) -- especially when elitism is applied. Lastly, we validated our proposed post-processing methods by comparing their success rate to the actual one. Results suggest that these methods can be used to evaluate the performance of a multi-modal optimization algorithm by correctly identifying optima and providing an indication of success -- without the need to know where the optima are located in the search space.


title: Comparison of home detection algorithms using smartphone GPS data

abstract: Estimation of people's home locations using location-based services data from smartphones is a common task in human mobility assessment. However, commonly used home detection algorithms (HDAs) are often arbitrary and unexamined. In this study, we review existing HDAs and examine five HDAs using eight high-quality mobile phone geolocation datasets. These include four commonly used HDAs as well as an HDA proposed in this work. To make quantitative comparisons, we propose three novel metrics to assess the quality of detected home locations and test them on eight datasets across four U.S. cities. We find that all three metrics show a consistent rank of HDAs' performances, with the proposed HDA outperforming the others. We infer that the temporal and spatial continuity of the geolocation data points matters more than the overall size of the data for accurate home detection. We also find that HDAs with high (and similar) performance metrics tend to create results with better consistency and closer to common expectations. Further, the performance deteriorates with decreasing data quality of the devices, though the patterns of relative performance persist. Finally, we show how the differences in home detection can lead to substantial differences in subsequent inferences using two case studies - (i) hurricane evacuation estimation, and (ii) correlation of mobility patterns with socioeconomic status. Our work contributes to improving the transparency of large-scale human mobility assessment applications.


title: De novo Drug Design using Reinforcement Learning with Multiple GPT Agents

abstract: De novo drug design is a pivotal issue in pharmacology and a new area of focus in AI for science research. A central challenge in this field is to generate molecules with specific properties while also producing a wide range of diverse candidates. Although advanced technologies such as transformer models and reinforcement learning have been applied in drug design, their potential has not been fully realized. Therefore, we propose MolRL-MGPT, a reinforcement learning algorithm with multiple GPT agents for drug molecular generation. To promote molecular diversity, we encourage the agents to collaborate in searching for desirable molecules in diverse directions. Our algorithm has shown promising results on the GuacaMol benchmark and exhibits efficacy in designing inhibitors against SARS-CoV-2 protein targets. The codes are available at: https://github.com/HXYfighter/MolRL-MGPT.


title: A Stochastic Approach to Classification Error Estimates in Convolutional Neural Networks

abstract: This technical report presents research results achieved in the field of verification of trained Convolutional Neural Network (CNN) used for image classification in safety-critical applications. As running example, we use the obstacle detection function needed in future autonomous freight trains with Grade of Automation (GoA) 4. It is shown that systems like GoA 4 freight trains are indeed certifiable today with new standards like ANSI/UL 4600 and ISO 21448 used in addition to the long-existing standards EN 50128 and EN 50129. Moreover, we present a quantitative analysis of the system-level hazard rate to be expected from an obstacle detection function. It is shown that using sensor/perceptor fusion, the fused detection system can meet the tolerable hazard rate deemed to be acceptable for the safety integrity level to be applied (SIL-3). A mathematical analysis of CNN models is performed which results in the identification of classification clusters and equivalence classes partitioning the image input space of the CNN. These clusters and classes are used to introduce a novel statistical testing method for determining the residual error probability of a trained CNN and an associated upper confidence limit. We argue that this greybox approach to CNN verification, taking into account the CNN model's internal structure, is essential for justifying that the statistical tests have covered the trained CNN with its neurons and inter-layer mappings in a comprehensive way.


title: UDEEP: Edge-based Computer Vision for In-Situ Underwater Crayfish and Plastic Detection

abstract: Invasive signal crayfish have a detrimental impact on ecosystems. They spread the fungal-type crayfish plague disease (Aphanomyces astaci) that is lethal to the native white clawed crayfish, the only native crayfish species in Britain. Invasive signal crayfish extensively burrow, causing habitat destruction, erosion of river banks and adverse changes in water quality, while also competing with native species for resources and leading to declines in native populations. Moreover, pollution exacerbates the vulnerability of White-clawed crayfish, with their populations declining by over 90% in certain English counties, making them highly susceptible to extinction. To safeguard aquatic ecosystems, it is imperative to address the challenges posed by invasive species and discarded plastics in the United Kingdom's river ecosystem's. The UDEEP platform can play a crucial role in environmental monitoring by performing on-the-fly classification of Signal crayfish and plastic debris while leveraging the efficacy of AI, IoT devices and the power of edge computing (i.e., NJN). By providing accurate data on the presence, spread and abundance of these species, the UDEEP platform can contribute to monitoring efforts and aid in mitigating the spread of invasive species.


title: Geometrical properties of 3D crossed nanowire networks

abstract: Three-dimensional interconnected nanowire networks have recently attracted notable attention for the fabrication of new devices for energy harvesting/storage, sensing, catalysis, magnetic and spintronic applications and for the design of new hardware neuromorphic computing architectures. However, the complex branching of these nanowire networks makes it challenging to investigate these 3D nanostructured systems theoretically. Here, we present a theoretical description and simulations of the geometric properties of these 3D interconnected nanowire networks with selected characteristics. Our analysis reveals that the nanowire segment length between two crossing zones follows an exponential distribution. This suggests that shorter nanowire segments have a more pronounced influence on the nanowire network properties compared to their longer counterparts. Moreover, our observations reveal a homogeneous distribution in the smallest distance between the cores of two crossing nanowires. The results are highly reproducible and unaffected by changes in the nanowire network characteristics. Finally, densities of interconnected segments up to 10$^{13}$ cm$^{-2}$ can be achieved for 22-$\mu$m-thick nanowire networks with high packing factors. This has important implications for neuromorphic computing applications, suggesting that the realization of 10$^{14}$ interconnections, which corresponds to the approximate number of synaptic connections in the human brain, is achievable with a nanowire network of about 10 cm$^{2}$.


title: FRED: Towards a Full Rotation-Equivariance in Aerial Image Object Detection

abstract: Rotation-equivariance is an essential yet challenging property in oriented object detection. While general object detectors naturally leverage robustness to spatial shifts due to the translation-equivariance of the conventional CNNs, achieving rotation-equivariance remains an elusive goal. Current detectors deploy various alignment techniques to derive rotation-invariant features, but still rely on high capacity models and heavy data augmentation with all possible rotations. In this paper, we introduce a Fully Rotation-Equivariant Oriented Object Detector (FRED), whose entire process from the image to the bounding box prediction is strictly equivariant. Specifically, we decouple the invariant task (object classification) and the equivariant task (object localization) to achieve end-to-end equivariance. We represent the bounding box as a set of rotation-equivariant vectors to implement rotation-equivariant localization. Moreover, we utilized these rotation-equivariant vectors as offsets in the deformable convolution, thereby enhancing the existing advantages of spatial adaptation. Leveraging full rotation-equivariance, our FRED demonstrates higher robustness to image-level rotation compared to existing methods. Furthermore, we show that FRED is one step closer to non-axis aligned learning through our experiments. Compared to state-of-the-art methods, our proposed method delivers comparable performance on DOTA-v1.0 and outperforms by 1.5 mAP on DOTA-v1.5, all while significantly reducing the model parameters to 16%.


title: Future-proofing Education: A Prototype for Simulating Oral Examinations Using Large Language Models

abstract: This study explores the impact of Large Language Models (LLMs) in higher education, focusing on an automated oral examination simulation using a prototype. The design considerations of the prototype are described, and the system is evaluated with a select group of educators and students. Technical and pedagogical observations are discussed. The prototype proved to be effective in simulating oral exams, providing personalized feedback, and streamlining educators' workloads. The promising results of the prototype show the potential for LLMs in democratizing education, inclusion of diverse student populations, and improvement of teaching quality and efficiency.


title: Trustworthy human-centric based Automated Decision-Making Systems

abstract: Automated Decision-Making Systems (ADS) have become pervasive across various fields, activities, and occupations, to enhance performance. However, this widespread adoption introduces potential risks, including the misuse of ADS. Such misuse may manifest when ADS is employed in situations where it is unnecessary or when essential requirements, conditions, and terms are overlooked, leading to unintended consequences. This research paper presents a thorough examination of the implications, distinctions, and ethical considerations associated with digitalization, digital transformation, and the utilization of ADS in contemporary society and future contexts. Emphasis is placed on the imperative need for regulation, transparency, and ethical conduct in the deployment of ADS.


title: A debiasing technique for place-based algorithmic patrol management

abstract: In recent years, there has been a revolution in data-driven policing. With that has come scrutiny on how bias in historical data affects algorithmic decision making. In this exploratory work, we introduce a debiasing technique for place-based algorithmic patrol management systems. We show that the technique efficiently eliminates racially biased features while retaining high accuracy in the models. Finally, we provide a lengthy list of potential future research in the realm of fairness and data-driven policing which this work uncovered.


title: Grassroots Innovation Actors: Their Role and Positioning in Economic Ecosystems -- A Comparative Study Through Complex Network Analysis

abstract: This study offers an examination of grassroots innovation actors and their integration within larger economic ecosystems. Through a comparative analysis in Oaxaca, Mexico; La Plata, Argentina; and Araucania, Chile, this research sheds light on the vital role that grassroots innovation plays in broader economic ecosystems. Using Complex Network Analysis and the TE-SER model, the study unveils how these actors interact, collaborate, and influence major economic ecosystems in the context of complex social challenges. The findings highlight that actors from the grassroots innovation ecosystem make up a significant portion of the larger innovation-driven entrepreneurial economic ecosystem, accounting for between 20% and 30% in all three cases and are strategically positioned within the ecosystem's structural network. Additionally, this study emphasizes the potential for greater integration of grassroots innovation actors to leverage resources and foster socio-economic development. The research concludes by advocating for further studies in similar socio-economic contexts to enhance our understanding of integration dynamics and mutual benefits between grassroots innovation ecosystems and other larger economic systems.


title: Multimodal Gen-AI for Fundamental Investment Research

abstract: This report outlines a transformative initiative in the financial investment industry, where the conventional decision-making process, laden with labor-intensive tasks such as sifting through voluminous documents, is being reimagined. Leveraging language models, our experiments aim to automate information summarization and investment idea generation. We seek to evaluate the effectiveness of fine-tuning methods on a base model (Llama2) to achieve specific application-level goals, including providing insights into the impact of events on companies and sectors, understanding market condition relationships, generating investor-aligned investment ideas, and formatting results with stock recommendations and detailed explanations. Through state-of-the-art generative modeling techniques, the ultimate objective is to develop an AI agent prototype, liberating human investors from repetitive tasks and allowing a focus on high-level strategic thinking. The project encompasses a diverse corpus dataset, including research reports, investment memos, market news, and extensive time-series market data. We conducted three experiments applying unsupervised and supervised LoRA fine-tuning on the llama2_7b_hf_chat as the base model, as well as instruction fine-tuning on the GPT3.5 model. Statistical and human evaluations both show that the fine-tuned versions perform better in solving text modeling, summarization, reasoning, and finance domain questions, demonstrating a pivotal step towards enhancing decision-making processes in the financial domain. Code implementation for the project can be found on GitHub: https://github.com/Firenze11/finance_lm.


title: Simulation-Based Equations for Propagation Constant in Uniform or Periodic Transmission

abstract: In this work, simulation-based equations to calculate propagation constant in uniform or periodic structures (SES) are deduced and verified through simulations in various types of structures. The modeling of those structures are essentially based on field distributions from a driven-mode solver, and the field distributions are used as the input parameters of the FPPS. It allows the separation of forward and backward waves from a total wave inside such a uniform or periodic structure, and thus it can be used to calculate the propagation constants inside both uniform and periodic structures even with a strong reflection. In order to test the performance and function of the FPPS, it has been applied to a variety of typical structures, including uniform waveguides, lossfree closed structures, lossy closed structures, and open radiation structures, and compared with the results of eigenmode solvers, equivalent network methods, and spectral domain integral equation methods. The comparison shows the easy-to-use and adaptable nature of the FPPS. the FPPS. This FPPS could be also applied to open radiating structures, and even multi-dimensional periodic/uniform structures.


title: AdaMR: Adaptable Molecular Representation for Unified Pre-training Strategy

abstract: We propose Adjustable Molecular Representation (AdaMR), a new large-scale uniform pre-training strategy for small-molecule drugs, as a novel unified pre-training strategy. AdaMR utilizes a granularity-adjustable molecular encoding strategy, which is accomplished through a pre-training job termed molecular canonicalization, setting it apart from recent large-scale molecular models. This adaptability in granularity enriches the model's learning capability at multiple levels and improves its performance in multi-task scenarios. Specifically, the substructure-level molecular representation preserves information about specific atom groups or arrangements, influencing chemical properties and functionalities. This proves advantageous for tasks such as property prediction. Simultaneously, the atomic-level representation, combined with generative molecular canonicalization pre-training tasks, enhances validity, novelty, and uniqueness in generative tasks. All of these features work together to give AdaMR outstanding performance on a range of downstream tasks. We fine-tuned our proposed pre-trained model on six molecular property prediction tasks (MoleculeNet datasets) and two generative tasks (ZINC250K datasets), achieving state-of-the-art (SOTA) results on five out of eight tasks.


title: Enhancing Multimodal Understanding with CLIP-Based Image-to-Text Transformation

abstract: The process of transforming input images into corresponding textual explanations stands as a crucial and complex endeavor within the domains of computer vision and natural language processing. In this paper, we propose an innovative ensemble approach that harnesses the capabilities of Contrastive Language-Image Pretraining models.