title: A Unified Transformer-based Network for multimodal Emotion Recognition

abstract: The development of transformer-based models has resulted in significant advances in addressing various vision and NLP-based research challenges. However, the progress made in transformer-based methods has not been effectively applied to biosensing research. This paper presents a novel Unified Biosensor-Vision Multi-modal Transformer-based (UBVMT) method to classify emotions in an arousal-valence space by combining a 2D representation of an ECG/PPG signal with the face information. To achieve this goal, we first investigate and compare the unimodal emotion recognition performance of three image-based representations of the ECG/PPG signal. We then present our UBVMT network which is trained to perform emotion recognition by combining the 2D image-based representation of the ECG/PPG signal and the facial expression features. Our unified transformer model consists of homogeneous transformer blocks that take as an input the 2D representation of the ECG/PPG signal and the corresponding face frame for emotion representation learning with minimal modality-specific design. Our UBVMT model is trained by reconstructing masked patches of video frames and 2D images of ECG/PPG signals, and contrastive modeling to align face and ECG/PPG data. Extensive experiments on the MAHNOB-HCI and DEAP datasets show that our Unified UBVMT-based model produces comparable results to the state-of-the-art techniques.


title: Intergrated Segmentation and Detection Models for Dentex Challenge 2023

abstract: Dental panoramic x-rays are commonly used in dental diagnosing. With the development of deep learning, auto detection of diseases from dental panoramic x-rays can help dentists to diagnose diseases more efficiently.The Dentex Challenge 2023 is a competition for automatic detection of abnormal teeth along with their enumeration ids from dental panoramic x-rays. In this paper, we propose a method integrating segmentation and detection models to detect abnormal teeth as well as obtain their enumeration ids.Our codes are available at https://github.com/xyzlancehe/DentexSegAndDet.


title: Scaling regimes for wormlike chains confined to cylindrical surfaces under tension

abstract: We compute the free energy of confinement ${\cal{F}}$ for a wormlike chain (WLC), with persistence length $l_p$, that is confined to the surface of a cylinder of radius $R$ under an external tension $f$ using a mean field variational approach. For long chains, we analytically determine the behavior of the chain in a variety of regimes, which are demarcated by the interplay of $l_p$, the Odijk deflection length ($l_d=(R^2l_p)^{1/3}$), and the Pincus length ($l_f = {k_BT}/{f}$, with $k_BT$ being the thermal energy). The theory accurately reproduces the Odijk scaling for strongly confined chains at $f=0$, with ${\cal{F}}\sim Ll_p^{-1/3}R^{-2/3}$. For moderate values of $f$, the Odijk scaling is discernible only when ${l_p}\gg R$ for strongly confined chains. Confinement does not significantly alter the scaling of the mean extension for sufficiently high tension. The theory is used to estimate unwrapping forces for DNA from nucleosomes.


title: Explaining with Attribute-based and Relational Near Misses: An Interpretable Approach to Distinguishing Facial Expressions of Pain and Disgust

abstract: Explaining concepts by contrasting examples is an efficient and convenient way of giving insights into the reasons behind a classification decision. This is of particular interest in decision-critical domains, such as medical diagnostics. One particular challenging use case is to distinguish facial expressions of pain and other states, such as disgust, due to high similarity of manifestation. In this paper, we present an approach for generating contrastive explanations to explain facial expressions of pain and disgust shown in video sequences. We implement and compare two approaches for contrastive explanation generation. The first approach explains a specific pain instance in contrast to the most similar disgust instance(s) based on the occurrence of facial expressions (attributes). The second approach takes into account which temporal relations hold between intervals of facial expressions within a sequence (relations). The input to our explanation generation approach is the output of an interpretable rule-based classifier for pain and disgust.We utilize two different similarity metrics to determine near misses and far misses as contrasting instances. Our results show that near miss explanations are shorter than far miss explanations, independent from the applied similarity metric. The outcome of our evaluation indicates that pain and disgust can be distinguished with the help of temporal relations. We currently plan experiments to evaluate how the explanations help in teaching concepts and how they could be enhanced by further modalities and interaction.


title: P3LI5: Practical and Confidential Lawful Interception on the 5G Core

abstract: Lawful Interception (LI) is a legal obligation of Communication Service Providers (CSPs) to provide interception capabilities to Law Enforcement Agencies (LEAs) in order to gain insightful data from network communications for criminal proceedings, e.g., network identifiers for tracking suspects. With the privacy-enhancements of network identifiers in the 5th generation of mobile networks (5G), LEAs need to interact with CSPs for network identifier resolution. This raises new privacy issues, as untrusted CSPs are able to infer sensitive information about ongoing investigations, e.g., the identities of their subscribers under suspicion. In this work, we propose P3LI5, a novel system that enables LEAs to privately query CSPs for network identifier resolution leveraging on an information retrieval protocol, SparseWPIR, that is based on private information retrieval and its weakly private version. As such, P3LI5 can be adapted to various operational scenarios with different confidentiality or latency requirements, by selectively allowing a bounded information leakage for improved performance. We implement P3LI5 on the 5G LI infrastructure using well known open-source projects and demonstrate its scalability to large databases while retaining low latency. To the best of our knowledge, P3LI5 is the first proposal for addressing the privacy issues raised by the mandatory requirement for LI on the 5G core network.


title: Distributional Off-Policy Evaluation for Slate Recommendations

abstract: Recommendation strategies are typically evaluated by using previously logged data, employing off-policy evaluation methods to estimate their expected performance. However, for strategies that present users with slates of multiple items, the resulting combinatorial action space renders many of these methods impractical. Prior work has developed estimators that leverage the structure in slates to estimate the expected off-policy performance, but the estimation of the entire performance distribution remains elusive. Estimating the complete distribution allows for a more comprehensive evaluation of recommendation strategies, particularly along the axes of risk and fairness that employ metrics computable from the distribution. In this paper, we propose an estimator for the complete off-policy performance distribution for slates and establish conditions under which the estimator is unbiased and consistent. This builds upon prior work on off-policy evaluation for slates and off-policy distribution estimation in reinforcement learning. We validate the efficacy of our method empirically on synthetic data as well as on a slate recommendation simulator constructed from real-world data (MovieLens-20M). Our results show a significant reduction in estimation variance and improved sample efficiency over prior work across a range of slate structures.


title: Algebras and their Covariant representations in quantum gravity

abstract: We study a physically motivated representation of an algebra of operators in gravitational and non gravitational theories called the covariant representation of an algebra. This is a representation where the symmetries of the operator algebra are implemented unitarily on the Hilbert space. We emphasize the very close similarity of this representation to the crossed product of an algebra. In fact, as an example of (and sometimes identified with) a covariance algebra, the crossed product of an algebra is in one to one correspondence with the covariant representation of the algebra. This will in turn illuminate physically what the crossed product algebra is in the context of quantum gravity.


title: Continuation of fixed points and bifurcations from ODE to flow-kick disturbance models

abstract: Some ODE models treat ecological disturbance as a continuous process, even disturbances such as fire that occur almost instantaneously on the timescale of system recovery. Alternatively, flow-kick models resolve disturbances as discrete impulses that change an ODE system's state periodically in time. Here we compare the dynamics of continuously disturbed ODE models to those of flow-kick models with the same average disturbance rate. In the case that kicks are small and high-frequency, we find multiple similarities between continuous and analogous discrete disturbance models. First, we prove that flow-kick maps generate an analogous vector field in the limit as the period between kicks approaches zero. Second, we present conditions under which equilibria, saddle-node bifurcations, and transcritical bifurcations continue from ODE to flow-kick systems. On the other hand, we also provide numerical evidence that similarities between continuous and discrete disturbance models can break down as the period between kick grows. We illustrate implications of these differences for climate change in a nonspatial Klausmeier model of vegetation and precipitation dynamics. We conclude that although ODEs may suffice to model high-frequency disturbances, resolving lower-frequency disturbances in time may be essential to effectively predicting their effects.


title: A Bayesian Projection of the Total Fertility Rate of Puerto Rico: 2020-2050

abstract: The abrupt decline in the Total Fertility Rate (TFR) of Puerto Rico since 2000 makes the prospect of a sustained population decline a real possibility. From 2000 to 2021 the TFR declined from 2.1 to 0.9 children per woman, one of the lowest in the world. Population projections produced by the United States Census Bureau and the United Nations Population Division show that the island population may decline from 3.8 millions in 2000 to slightly above 2 million by 2050, a dramatic 47% population decline in 50 years. As dire as this prospect may be, this may be an optimistic scenario. Both projections have the TFR increasing to 1.5 by 2050, but a fertility projection conducted by us show that fertility can remain much closer to 1.0 until 2050. Bayesian Hierarchical Probabilistic Theory has been used by the United Nations to incorporate a way to measure the uncertainty and to estimate the projection parameters. However, the assumption that the fertility level in countries with low fertility will eventually increase to 2.1 has been widely criticized as unrealistic and not supported by evidence. We modified the assumptions used by the United Nations considering countries with TFR similar to Puerto Rico and find that by 2050 Puerto Rico may have a TFR of 1.1 bounded by a 95% credibility interval (0.56,1.77). This indicates that there may be a larger population decline than what current projections show.


title: Magnetostatic modes and criticality in uniaxial magnetic materials

abstract: We analyze modes in a dipole-dipole coupled quantum magnetic material, taking into consideration domain structure and other shape effects present in any real magnet. We find that the soft mode governing quantum criticality in a non-ellipsoidal sample is an inhomogeneous magnetostatic mode which negates dynamic, demagnetization-field effects. The demagnetization field is analyzed from a microscopic perspective. Furthermore, we find a magnetostatic mode originating from variations in the magnetization of the sample, caused by domain structure and quantum or thermal fluctuations, will be lower in energy than the soft mode governing quantum criticality in the bulk of the magnet. Experimental evidence for these theoretical results is provided by analysis of electronuclear modes in LiHoF$_4$, an archetypal dipolar quantum Ising material, in a microwave resonator.


title: Examining the possibility of chiral superconductivity in Sr$_2$RuO$_4$ and other compounds via applied supercurrent

abstract: One approach to probe the still controversial superconductivity in Sr$_2$RuO$_4$ is to apply external perturbations that break the underlying tetragonal crystalline symmetry. Chiral $p_x+ip_y$ and $d_{xz}+id_{yz}$ states respond to such perturbations in ways that may help to distinguish them from other superconducting pairings. However, past experimental efforts along this line, using uniaxial strains and magnetic fields parallel to the RuO$_2$ plane, have not been able to reach an unambiguous conclusion. In this study, we propose to further examine the possibility of chiral superconducting order in Sr$_2$RuO$_4$ using an alternative tetragonal-symmetry-breaking perturbation -- in-plane supercurrent. We study the superconducting phase diagram as a function of both temperature and the applied supercurrent. Supercurrent generically splits the transition of the two chiral order parameter components, and we show that the splitting can give rise to visible specific heat anomalies. Furthermore, supercurrent parallel and anti-parallel to the unidirectional propagation of the chiral edge modes impact the edge states in different manner. This difference manifests in the tunneling spectrum, thereby providing an additional means to probe the chirality even when the related spontaneous edge current is vanishingly small. Finally, we discuss the distinction of supercurrent responses in non-chiral time-reversal-symmetry-breaking superconducting states. Our proposal can be applied to other candidate chiral superconductors.


title: Symplectic Groups, Mapping Class Groups and the Stability of Bounded Cohomology

abstract: Mapping class groups satisfy cohomological stability. In this note we show how results by Bestvina and Fujiwara imply that the bounded cohomology does not stabilize, additionally we show that stabily polynomials in the Mumford-Morita-Miller classes are unbounded i.e. their norm tends to infinity as one increases the genus. While the bounded cohomology of the symplectic group does stabilize, we show that it does not stabilize via isometries in degree $2$. In order to establish this we calculate the norm of the signature class in $\mathrm{Sp}_{2h}(\mathbb{R})$ and estimate the norm of the integral signature class.


title: Hypergraph Structure Inference From Data Under Smoothness Prior

abstract: Hypergraphs are important for processing data with higher-order relationships involving more than two entities. In scenarios where explicit hypergraphs are not readily available, it is desirable to infer a meaningful hypergraph structure from the node features to capture the intrinsic relations within the data. However, existing methods either adopt simple pre-defined rules that fail to precisely capture the distribution of the potential hypergraph structure, or learn a mapping between hypergraph structures and node features but require a large amount of labelled data, i.e., pre-existing hypergraph structures, for training. Both restrict their applications in practical scenarios. To fill this gap, we propose a novel smoothness prior that enables us to design a method to infer the probability for each potential hyperedge without labelled data as supervision. The proposed prior indicates features of nodes in a hyperedge are highly correlated by the features of the hyperedge containing them. We use this prior to derive the relation between the hypergraph structure and the node features via probabilistic modelling. This allows us to develop an unsupervised inference method to estimate the probability for each potential hyperedge via solving an optimisation problem that has an analytical solution. Experiments on both synthetic and real-world data demonstrate that our method can learn meaningful hypergraph structures from data more efficiently than existing hypergraph structure inference methods.


title: Heralding entangled optical photons from a microwave quantum processor

abstract: Exploiting the strengths of different quantum hardware components may enhance the capabilities of emerging quantum processors. Here, we propose and analyze a quantum architecture that leverages the non-local connectivity of optics, along with the exquisite quantum control offered by superconducting microwave circuits, to produce entangled optical resource states. Contrary to previous proposals on optically distributing entanglement between superconducting microwave processors, we use squeezing between microwaves and optics to produce microwave-optical Bell pairs in a dual-rail encoding from a single microwave quantum processor. Moreover, the microwave quantum processor allows us to deterministically entangle microwave-optical Bell pairs into larger cluster states, from which entangled optical photons can be extracted through microwave measurements. Our scheme paves the way for small microwave quantum processors to create heralded entangled optical resource states for optical quantum computation, communication, and sensing using imperfect microwave-optics transducers. We expect that improved isolation of the superconducting processor from stray optical fields will allow the scheme to be demonstrated using currently available hardware.


title: Integrated Approach of Gearbox Fault Diagnosis

abstract: Gearbox fault diagnosis is one of the most important parts in any industrial systems. Failure of components inside gearbox can lead to a catastrophic failure, uneven breakdown, and financial losses in industrial organization. In that case intelligent maintenance of the gearbox comes into context. This paper presents an integrated gearbox fault diagnosis approach which can easily deploy in online condition monitoring. This work introduces a nonparametric data preprocessing technique i.e., calculus enhanced energy operator (CEEO) to preserve the characteristics frequencies in the noisy and inferred vibrational signal. A set of time domain and spectral domain features are calculated from the raw and CEEO vibration signal and inputted to the multiclass support vector machine (MCSVM) to diagnose the faults on the system. An effective comparison between raw signal and CEEO signal are presented to show the impact of CEEO in gearbox fault diagnosis. The obtained results of this work look very promising and can be implemented in any type of industrial system due to its nonparametric nature.


title: Leveraging Linear Independence of Component Classifiers: Optimizing Size and Prediction Accuracy for Online Ensembles

abstract: Ensembles, which employ a set of classifiers to enhance classification accuracy collectively, are crucial in the era of big data. However, although there is general agreement that the relation between ensemble size and its prediction accuracy, the exact nature of this relationship is still unknown. We introduce a novel perspective, rooted in the linear independence of classifier's votes, to analyze the interplay between ensemble size and prediction accuracy. This framework reveals a theoretical link, consequently proposing an ensemble size based on this relationship. Our study builds upon a geometric framework and develops a series of theorems. These theorems clarify the role of linear dependency in crafting ensembles. We present a method to determine the minimum ensemble size required to ensure a target probability of linearly independent votes among component classifiers. Incorporating real and synthetic datasets, our empirical results demonstrate a trend: increasing the number of classifiers enhances accuracy, as predicted by our theoretical insights. However, we also identify a point of diminishing returns, beyond which additional classifiers provide diminishing improvements in accuracy. Surprisingly, the calculated ideal ensemble size deviates from empirical results for certain datasets, emphasizing the influence of other factors. This study opens avenues for deeper investigations into the complex dynamics governing ensemble design and offers guidance for constructing efficient and effective ensembles in practical scenarios.


title: Quantum Field Theory, Worldline Theory, and Spin Magnitude Change in Orbital Evolution

abstract: A previous paper~\cite{Bern:2022kto} identified a puzzle stemming from the amplitudes-based approach to spinning bodies in general relativity: additional Wilson coefficients appear compared to current worldline approaches to conservative dynamics of generic astrophysical objects, including neutron stars. In this paper we clarify the nature of analogous Wilson coefficients in the simpler theory of electrodynamics. We analyze the original field-theory construction, identifying definite-spin states some of which have negative norms, and relating the additional Wilson coefficients in the classical theory to transitions between different quantum spin states. We produce a new version of the theory which also has additional Wilson coefficients, but no negative-norm states. We match, through $\mathcal O(\alpha^2)$ and $\mathcal O(S^2)$, the Compton amplitudes of these field theories with those of a modified worldline theory with extra degrees of freedom introduced by releasing the spin supplementary condition. We build an effective two-body Hamiltonian that matches the impulse and spin kick of the modified field theory and of the worldline theory, displaying additional Wilson coefficients compared to standard worldline approaches. The results are then compactly expressed in terms of an eikonal formula. Our key conclusion is that, contrary to standard approaches, while the magnitude of the spin tensor is still conserved, the magnitude of the spin vector can change under conserved Hamiltonian dynamics and this change is governed by the additional Wilson coefficients. For specific values of Wilson coefficients the results are equivalent to those from a definite spin obeying the spin supplementary condition, but for generic values they are physically inequivalent. These results warrant detailed studies of the corresponding issues in general relativity.


title: AI-Generated Content (AIGC) for Various Data Modalities: A Survey

abstract: AI-generated content (AIGC) methods aim to produce text, images, videos, 3D assets, and other media using AI algorithms. Due to its wide range of applications and the demonstrated potential of recent works, AIGC developments have been attracting lots of attention recently, and AIGC methods have been developed for various data modalities, such as image, video, text, 3D shape (as voxels, point clouds, meshes, and neural implicit fields), 3D scene, 3D human avatar (body and head), 3D motion, and audio -- each presenting different characteristics and challenges. Furthermore, there have also been many significant developments in cross-modality AIGC methods, where generative methods can receive conditioning input in one modality and produce outputs in another. Examples include going from various modalities to image, video, 3D shape, 3D scene, 3D avatar (body and head), 3D motion (skeleton and avatar), and audio modalities. In this paper, we provide a comprehensive review of AIGC methods across different data modalities, including both single-modality and cross-modality methods, highlighting the various challenges, representative works, and recent technical directions in each setting. We also survey the representative datasets throughout the modalities, and present comparative results for various modalities. Moreover, we also discuss the challenges and potential future research directions.


title: Data-Driven Robust Control Using Prediction Error Bounds Based on Perturbation Analysis

abstract: For linear systems, many data-driven control methods rely on the behavioral framework, using historical data of the system to predict the future trajectories. However, measurement noise introduces errors in predictions. When the noise is bounded, we propose a method for designing historical experiments that enable the computation of an upper bound on the prediction error. This approach allows us to formulate a minimax control problem where robust constraint satisfaction is enforced. We derive an upper bound on the suboptimality gap of the resulting control input sequence compared to optimal control utilizing accurate measurements. As demonstrated in numerical experiments, the solution derived by our method can achieve constraint satisfaction and a small suboptimality gap despite the measurement noise.


title: Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP

abstract: Mechanistic interpretability seeks to understand the neural mechanisms that enable specific behaviors in Large Language Models (LLMs) by leveraging causality-based methods. While these approaches have identified neural circuits that copy spans of text, capture factual knowledge, and more, they remain unusable for multimodal models since adapting these tools to the vision-language domain requires considerable architectural changes. In this work, we adapt a unimodal causal tracing tool to BLIP to enable the study of the neural mechanisms underlying image-conditioned text generation. We demonstrate our approach on a visual question answering dataset, highlighting the causal relevance of later layer representations for all tokens. Furthermore, we release our BLIP causal tracing tool as open source to enable further experimentation in vision-language mechanistic interpretability by the community. Our code is available at https://github.com/vedantpalit/Towards-Vision-Language-Mechanistic-Interpretability.


title: Min-max construction of two capillary embedded geodesics on Riemannian $2$-disks

abstract: In this paper, we prove the existence of two capillary embedded geodesics with a contact angle $\theta \in (0,\pi/2)$ on Riemannian $2$-disks with strictly convex boundary, where the absence of a simple closed geodesic loop based on a point of boundary is given. In particular, our condition contains the cases of Riemannian $2$-disks with strictly convex boundary, nonnegative Gaussian curvature and total geodesic curvature lower bound $\pi$ of the boundary. Moreover, by providing examples, we prove that our total geodesic curvature condition is sharp to admit a capillary embedded geodesic with a contact angle $\theta \in (0,\pi/2)$ under the nonnegative interior Gaussian curvature condition. We also prove the existence of Morse Index $1$ and $2$ capillary embedded geodesics for generic metric under the assumptions above.


title: Class-Imbalanced Graph Learning without Class Rebalancing

abstract: Class imbalance is prevalent in real-world node classification tasks and poses great challenges for graph learning models. Most existing studies are rooted in a class-rebalancing (CR) perspective and address class imbalance with class-wise reweighting or resampling. In this work, we approach the root cause of class-imbalance bias from an topological paradigm. Specifically, we theoretically reveal two fundamental phenomena in the graph topology that greatly exacerbate the predictive bias stemming from class imbalance. On this basis, we devise a lightweight topological augmentation framework BAT to mitigate the class-imbalance bias without class rebalancing. Being orthogonal to CR, BAT can function as an efficient plug-and-play module that can be seamlessly combined with and significantly boost existing CR techniques. Systematic experiments on real-world imbalanced graph learning tasks show that BAT can deliver up to 46.27% performance gain and up to 72.74% bias reduction over existing techniques. Code, examples, and documentations are available at https://github.com/ZhiningLiu1998/BAT.


title: Generative AI for Business Strategy: Using Foundation Models to Create Business Strategy Tools

abstract: Generative models (foundation models) such as LLMs (large language models) are having a large impact on multiple fields. In this work, we propose the use of such models for business decision making. In particular, we combine unstructured textual data sources (e.g., news data) with multiple foundation models (namely, GPT4, transformer-based Named Entity Recognition (NER) models and Entailment-based Zero-shot Classifiers (ZSC)) to derive IT (information technology) artifacts in the form of a (sequence of) signed business networks. We posit that such artifacts can inform business stakeholders about the state of the market and their own positioning as well as provide quantitative insights into improving their future outlook.


title: Combinatorial Identities for Vacillating Tableaux

abstract: Vacillating tableaux are sequences of integer partitions that satisfy specific conditions. The concept of vacillating tableaux stems from the representation theory of the partition algebra and the combinatorial theory of crossings and nestings of matchings and set partitions. In this paper, we further investigate the enumeration of vacillating tableaux and derive multiple combinatorial identities and integer sequences relating to the number of vacillating tableaux, simplified vacillating tableaux, and limiting vacillating tableaux.


title: TeV pion bumps in the gamma-ray spectra of flaring blazars

abstract: (Abridged) Very high-energy (VHE, $E>100$ GeV) observations of the blazar Mrk 501 with MAGIC in 2014 provided evidence for an unusual narrow spectral feature at about 3 TeV during an extreme X-ray flaring activity. The one-zone synchrotron-self Compton scenario, widely used in blazar broadband spectral modeling, fails to explain the narrow TeV component. Motivated by this rare observation, we propose an alternative model for the production of narrow features in the VHE spectra of flaring blazars. These spectral features may result from the decay of neutral pions ($\pi^0$ bumps) that are in turn produced via interactions of protons (of tens of TeV energy) with energetic photons, whose density increases during hard X-ray flares. We explored the conditions needed for the emergence of narrow $\pi^0$ bumps in VHE blazar spectra during X-ray flares reaching synchrotron energies $\sim 100$ keV using time-dependent radiative transfer calculations. We focused on high-synchrotron peaked (HSP) blazars, which comprise the majority of VHE-detected extragalactic sources. We find that synchrotron-dominated flares with peak energies $\gtrsim100$ keV can be ideal periods for the search of $\pi^0$ bumps in the VHE spectra of HSP blazars. The flaring region is optically thin to photopion production, its energy content is dominated by the relativistic proton population, and the inferred jet power is highly super-Eddington. Application of the model to the spectral energy distribution of Mrk 501 on MJD 56857.98 shows that the VHE spectrum of the flare is described well by the sum of a synchrotron self-Compton (SSC) component and a distinct $\pi^0$ bump centered at 3 TeV. Spectral fitting of simulated SSC+$\pi^0$ spectra for the Cherenkov Telescope Array (CTA) show that a $\pi^0$ bump could be detected at a 5$\sigma$ significance level with a 30-min exposure.


title: Semi-static Conditions in Low-latency C++ for High Frequency Trading: Better than Branch Prediction Hints

abstract: Conditional branches pose a challenge for code optimisation, particularly in low latency settings. For better performance, processors leverage dedicated hardware to predict the outcome of a branch and execute the following instructions speculatively, a powerful optimisation. Modern branch predictors employ sophisticated algorithms and heuristics that utilise historical data and patterns to make predictions, and often, are extremely effective at doing so. Consequently, programmers may inadvertently underestimate the cost of misprediction when benchmarking code with synthetic data that is either too short or too predictable. While eliminating branches may not always be feasible, C++20 introduced the [[likely]] and [[unlikely]] attributes that enable the compiler to perform spot optimisations on assembly code associated with likely execution paths. Can we do better than this? This work presents the development of a novel language construct, referred to as a semi-static condition, which enables programmers to dynamically modify the direction of a branch at run-time by modifying the assembly code within the underlying executable. Subsequently, we explore scenarios where the use of semi-static conditions outperforms traditional conditional branching, highlighting their potential applications in real-time machine learning and high-frequency trading. Throughout the development process, key considerations of performance, portability, syntax, and security were taken into account.


title: Empowering Cross-lingual Abilities of Instruction-tuned Large Language Models by Translation-following demonstrations

abstract: The language ability of Large Language Models (LLMs) is often unbalanced towards English because of the imbalance in the distribution of the pre-training data. This disparity is demanded in further fine-tuning and affecting the cross-lingual abilities of LLMs. In this paper, we propose to empower Instructiontuned LLMs (It-LLMs) in languages other than English by building semantic alignment between them. Hence, we propose CrossAlpaca, an It-LLM with cross-lingual instruction-following and Translation-following demonstrations to improve semantic alignment between languages. We validate our approach on the multilingual Question Answering (QA) benchmarks XQUAD and MLQA and adapted versions of MMLU and BBH. Our models, tested over six different languages, outperform the It-LLMs tuned on monolingual data. The final results show that instruction tuning on non-English data is not enough and that semantic alignment can be further improved by Translation-following demonstrations.


title: Defying Conventional Wisdom in Spectroscopy: Power Narrowing on IBM Quantum

abstract: Power broadening $-$ the broadening of the spectral line profile of a two-state quantum transition as the amplitude of the driving field increases $-$ is a well-known and thoroughly examined phenomenon in spectroscopy. It typically occurs in continuous-wave driving when the intensity of the radiation field increases beyond the saturation intensity of the transition. In pulsed-field excitation, linear power broadening occurs for a pulse of rectangular temporal shape. Pulses with smooth shapes are known to exhibit much less power broadening, e.g. logarithmic for a Gaussian pulse shape. It has been predicted, but never experimentally verified, that pulse shapes which vanish in time as $\sim |t|^{-\lambda}$ should exhibit the opposite effect $-$ power narrowing $-$ in which the post-pulse transition line width decreases as the amplitude of the driving pulse increases. In this work, power narrowing is demonstrated experimentally for a class of powers-of-Lorentzian pulse shapes on the IBM Quantum processor ibmq_manila. Reduction of the line width by a factor of over 10 is observed when increasing the pulse area from $\pi$ to $7\pi$, in a complete reversal of the power broadening paradigm. Moreover, thorough theoretical and experimental study is conducted on the truncation of the pulse wings which introduces a (small) power-broadened term which prevents power narrowing from reaching extreme values $-$ a hitherto unknown cut-off broadening effect for which an explicit analytical formula is derived. In the absence of other power broadening mechanisms, Lorentzian pulses truncated at sufficiently small values can achieve as narrow line profiles as desired.


title: Bayesian deep operator learning for homogenized to fine-scale maps for multiscale PDE

abstract: We present a new framework for computing fine-scale solutions of multiscale Partial Differential Equations (PDEs) using operator learning tools. Obtaining fine-scale solutions of multiscale PDEs can be challenging, but there are many inexpensive computational methods for obtaining coarse-scale solutions. Additionally, in many real-world applications, fine-scale solutions can only be observed at a limited number of locations. In order to obtain approximations or predictions of fine-scale solutions over general regions of interest, we propose to learn the operator mapping from coarse-scale solutions to fine-scale solutions using a limited number (and possibly noisy) observations of the fine-scale solutions. The approach is to train multi-fidelity homogenization maps using mathematically motivated neural operators. The operator learning framework can efficiently obtain the solution of multiscale PDEs at any arbitrary point, making our proposed framework a mesh-free solver. We verify our results on multiple numerical examples showing that our approach is an efficient mesh-free solver for multiscale PDEs.


title: Topology and dynamics of higher-order multiplex networks

abstract: Higher-order networks are gaining significant scientific attention due to their ability to encode the many-body interactions present in complex systems. However, higher-order networks have the limitation that they only capture many-body interactions of the same type. To address this limitation, we present a mathematical framework that determines the topology of higher-order multiplex networks and illustrates the interplay between their topology and dynamics. Specifically, we examine the diffusion of topological signals associated not only to the nodes but also to the links and to the higher-dimensional simplices of multiplex simplicial complexes. We leverage on the ubiquitous presence of the overlap of the simplices to couple the dynamics among multiplex layers, introducing a definition of multiplex Hodge Laplacians and Dirac operators. We show that the spectral properties of these operators determine higher-order diffusion on higher-order multiplex networks and encode their multiplex Betti numbers. Our numerical investigation of the spectral properties of synthetic and real (connectome, microbiome) multiplex simplicial complexes indicates that the coupling between the layers can either speed up or slow down the higher-order diffusion of topological signals. This mathematical framework is very general and can be applied to study generic higher-order systems with interactions of multiple types. In particular, these results might find applications in brain networks which are understood to be both multilayer and higher-order.

categories: nlin.AO cond-mat.dis-nn cs.SI physics.soc-ph


title: Score-Based Generative Models for PET Image Reconstruction

abstract: Score-based generative models have demonstrated highly promising results for medical image reconstruction tasks in magnetic resonance imaging or computed tomography. However, their application to Positron Emission Tomography (PET) is still largely unexplored. PET image reconstruction involves a variety of challenges, including Poisson noise with high variance and a wide dynamic range. To address these challenges, we propose several PET-specific adaptations of score-based generative models. The proposed framework is developed for both 2D and 3D PET. In addition, we provide an extension to guided reconstruction using magnetic resonance images. We validate the approach through extensive 2D and 3D $\textit{in-silico}$ experiments with a model trained on patient-realistic data without lesions, and evaluate on data without lesions as well as out-of-distribution data with lesions. This demonstrates the proposed method's robustness and significant potential for improved PET reconstruction.


title: SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation

abstract: Artificial Intelligence Generated Content (AIGC) has shown remarkable progress in generating realistic images. However, in this paper, we take a step "backward" and address AIGC for the most rudimentary visual modality of human sketches. Our objective is on the creative nature of sketches, and that creative sketching should take the form of an interactive process. We further enable text to drive the sketch ideation process, allowing creativity to be freely defined, while simultaneously tackling the challenge of "I can't sketch". We present a method to generate controlled sketches using a text-conditioned diffusion model trained on pixel representations of images. Our proposed approach, referred to as SketchDreamer, integrates a differentiable rasteriser of Bezier curves that optimises an initial input to distil abstract semantic knowledge from a pretrained diffusion model. We utilise Score Distillation Sampling to learn a sketch that aligns with a given caption, which importantly enable both text and sketch to interact with the ideation process. Our objective is to empower non-professional users to create sketches and, through a series of optimisation processes, transform a narrative into a storyboard by expanding the text prompt while making minor adjustments to the sketch input. Through this work, we hope to aspire the way we create visual content, democratise the creative process, and inspire further research in enhancing human creativity in AIGC. The code is available at \url{https://github.com/WinKawaks/SketchDreamer}.


title: Convergence analysis of stochastic gradient descent with adaptive preconditioning for non-convex and convex functions

abstract: Preconditioning is a crucial operation in gradient-based numerical optimisation. It helps decrease the local condition number of a function by appropriately transforming its gradient. For a convex function, where the gradient can be computed exactly, the optimal linear transformation corresponds to the inverse of the Hessian operator, while the optimal convex transformation is the convex conjugate of the function. Different conditions result in variations of these dependencies. Practical algorithms often employ low-rank or stochastic approximations of the inverse Hessian matrix for preconditioning. However, theoretical guarantees for these algorithms typically lack a justification for the defining property of preconditioning. This paper presents a simple theoretical framework that demonstrates, given a smooth function and an available unbiased stochastic approximation of its gradient, that it is possible to refine the dependency of the convergence rate on the Lipschitz constant of the gradient.


title: Local Maximal Monotonicity in Variational Analysis and Optimization

abstract: The paper is devoted to a systematic study and characterizations of notions of local maximal monotonicity and their strong counterparts for set-valued operators that appear in variational analysis, optimization, and their applications. We obtain novel resolvent characterizations of these notions together with efficient conditions for their preservation under summation in broad infinite-dimensional settings. Further characterizations of these notions are derived by using generalized differentiation of variational analysis in the framework of Hilbert spaces.


title: Generalized equations of hydrodynamics in fractional derivatives

abstract: We present a general approach for obtaining the generalized transport equations with fractional derivatives using the Liouville equation with fractional derivatives for a system of classical particles and the Zubarev non-equilibrium statistical operator (NSO) method within the Gibbs statistics. We obtain the non-Markov equations of hydrodynamics for the non-equilibrium average values of densities of particle number, momentum and energy of liquid in a spatially heterogeneous medium with a fractal structure. For isothermal processes ($\beta=1/k_{B}T =const$), the non-Markov Navier-Stokes equation in fractional derivatives is obtained. We consider models for the frequency dependence of memory function (viscosity), which lead to the Navier-Stokes equations in fractional derivatives in space and time.


title: Fabrication of a Silicon Electron Multiplier sensor using Metal Assisted Chemical Etching and its characterisation

abstract: The Silicon Electron Multiplier (SiEM) sensor is a novel sensor concept that enables charge multiplication by high electric fields generated by embedded metal electrodes within the sensor bulk. Metal assisted chemical etching (MacEtch) in gas phase with platinum as a catalyst has been used to fabricate test structures consisting of vertically aligned silicon pillars and strips on top of a silicon bulk. The pillars exceed 10 $\mu m$ in height with a diameter of 1.0 $\mu m$ and are arranged as a hexagonal lattice with a pitch of 1.5 $\mu m$. Electrical characterisations through current $-$ voltage measurements inside a scanning electron microscope and a climate chamber have demonstrated that the MacEtch process is compatible with active media and p-n junctions.


title: Identification and Estimation of Demand Models with Endogenous Product Entry and Exit

abstract: This paper deals with the endogeneity of firms' entry and exit decisions in demand estimation. Product entry decisions lack a single crossing property in terms of demand unobservables, which causes the inconsistency of conventional methods dealing with selection. We present a novel and straightforward two-step approach to estimate demand while addressing endogenous product entry. In the first step, our method estimates a finite mixture model of product entry accommodating latent market types. In the second step, it estimates demand controlling for the propensity scores of all latent market types. We apply this approach to data from the airline industry.


title: JWST Observations of the Extraordinary GRB 221009A Reveal an Ordinary Supernova Without Signs of $r$-Process Enrichment in a Low-Metallicity Galaxy

abstract: Identifying the astrophysical sites of the $r$-process, one of the primary mechanisms by which heavy elements are formed, is a key goal of modern astrophysics. The discovery of the brightest gamma-ray burst of all time, GRB 221009A, at a relatively nearby redshift, presented the first opportunity to spectroscopically test the idea that $r$-process elements are produced following the collapse of rapidly rotating massive stars. Here we present spectroscopic and photometric $\textit{James Webb Space Telescope}$ (JWST) observations of GRB 221009A obtained $+168$ and $+170$ rest-frame days after the initial gamma-ray trigger, and demonstrate they are well-described by a supernova (SN) and power-law afterglow, with no evidence for an additional component from $r$-process emission, and that the SN component strongly resembles the near-infrared spectra of previous SNe, including SN 1998bw. We further find that the SN associated with GRB 221009A is slightly fainter than the expected brightness of SN 1998bw at this phase, concluding that the SN is therefore not an unusual GRB-SN. We infer a nickel mass of $\approx0.09$ M$_{\odot}$, consistent with the lack of an obvious SN detection in the early-time data. We find that the host galaxy of GRB 221009A has a very low metallicity of $\approx0.12$ Z$_{\odot}$ and our resolved host spectrum shows that GRB 221009A occurred in a unique environment in its host characterized by strong H$_2$ emission lines consistent with recent star formation, which may hint at environmental factors being responsible for its extreme energetics.


title: Stationary Descendents and the Discriminant Modular Form

abstract: The generating functions of stationary descendent Gromov-Witten invariants of an elliptic curve are known to be Fourier expansions of quasimodular forms. When one restricts to the subspace of forms of a fixed weight $k$, there is an abundance of linear relations among these generating functions. This naturally leads one to study the resulting linear matroid, which we refer to as the descendent matroid of weight $k$. In the case of weight 12, we use this matroid to compute and organize all of the ways to express the discriminant modular form in terms of stationary descendents. As a consequence, we find a closed-form expression of Ramanujan tau values in terms of Gromov-Witten invariants of an elliptic curve. All computations were aided with the use of Sage, and the classes and functions written in Sage are discussed in the appendix.


title: Symbolic and Language Agnostic Large Language Models

abstract: We argue that the relative success of large language models (LLMs) is not a reflection on the symbolic vs. subsymbolic debate but a reflection on employing an appropriate strategy of bottom-up reverse engineering of language at scale. However, due to the subsymbolic nature of these models whatever knowledge these systems acquire about language will always be buried in millions of microfeatures (weights) none of which is meaningful on its own. Moreover, and due to their stochastic nature, these models will often fail in capturing various inferential aspects that are prevalent in natural language. What we suggest here is employing the successful bottom-up strategy in a symbolic setting, producing symbolic, language agnostic and ontologically grounded large language models.


title: Magnetic Schr\"{o}dinger operator with the potential supported in a curved two-dimensional strip

abstract: We consider the magnetic Schr\"odinger operator $H=(i \nabla +A)^2- V$ with a non-negative potential $V$ supported over a strip which is a local deformation of a straight one, and the magnetic field $B:=\mathrm{rot}(A)$ is assumed to be nonzero and local. We show that the magnetic field does not change the essential spectrum of this system, and investigate a sufficient condition for the discrete spectrum of $H$ to be empty.


title: Lorentz- and CPT-violating effects in Penning traps at linear boost

abstract: We present in this work an analysis of Lorentz- and CPT-violating signals at linear boost order in Penning-trap experiments. The theory of quantum electrodynamics with Penning traps is revisited and the dominant shifts in the cyclotron and anomaly frequencies of confined particles and antiparticles are reproduced. To study time variations of the experimental signals at linear boost order, we provide a general discussion on transformations of coefficients for Lorentz violation between different frames, and derive the expressions of the cyclotron and anomaly frequency shifts in the Sun-centered frame. Relating these frequency shifts to the charge-to-mass ratios, the $g$ factors, and their comparisons between particles and antiparticles, we extract numerous new or improved bounds on coefficients for Lorentz violation from existing Penning-trap measurements.


title: On the proportion of irreducible polynomials in unicritically generated semigroups

abstract: Let $p$ be a prime number and let $S=\{x^p+c_1,\dots,x^p+c_r\}$ be a finite set of unicritical polynomials for some $c_1,\dots,c_r\in\mathbb{Z}$. Moreover, assume that $S$ contains at least one irreducible polynomial over $\mathbb{Q}$. Then we construct a large, explicit subset of irreducible polynomials within the semigroup generated by $S$ under composition; in fact, we show that this subset has positive asymptotic density within the full semigroup when we count polynomials by degree. In addition, when $p=2$ or $3$ we construct an infinite family of semigroups that break the local-global principle for irreducibility. To do this, we use a mix of algebraic and arithmetic techniques and results, including Runge's method, the elliptic curve Chabauty method, and Fermat's Last Theorem.


title: Rectifiability of sets of solutions of first order systems of partial differential equations

abstract: We find sufficient conditions on a set $\mathscr{M}\subset\mathbf{R}^n\times\mathscr{L}(\mathbf{R}^n,\mathbf{R}^m)$ ensuring that the set of functions such that $(F(x),DF(x))\in\mathscr{M}$ is rectifiable. We also prove a more general version in which the set to which $DF(x)$ is costrained can depend also on $F(x))$, and show the relation with some classical rigidity statements such as Liouville's theorem on conformal maps


title: Pseudocycle Gromov-Witten invariants are a strict subset of polyfold Gromov-Witten invariants

abstract: Given a semipositive symplectic manifold, we prove that the pseudocycle genus-zero Gromov-Witten invariants are equal to the polyfold genus-zero Gromov-Witten invariants.


title: Schur-Positive sets

abstract: In this thesis we prove Schur-positivity of certain graph families. In addition, we exlpor existence of cyclic descent extensions on several families of Schur-positive sets.


title: Using Knowledge Representation and Task Planning for Robot-agnostic Skills on the Example of Contact-Rich Wiping Tasks

abstract: The transition to agile manufacturing, Industry 4.0, and high-mix-low-volume tasks require robot programming solutions that are flexible. However, most deployed robot solutions are still statically programmed and use stiff position control, which limit their usefulness. In this paper, we show how a single robot skill that utilizes knowledge representation, task planning, and automatic selection of skill implementations based on the input parameters can be executed in different contexts. We demonstrate how the skill-based control platform enables this with contact-rich wiping tasks on different robot systems. To achieve that in this case study, our approach needs to address different kinematics, gripper types, vendors, and fundamentally different control interfaces. We conducted the experiments with a mobile platform that has a Universal Robots UR5e 6 degree-of-freedom robot arm with position control and a 7 degree-of-freedom KUKA iiwa with torque control.


title: Predictive Sparse Manifold Transform

abstract: We present Predictive Sparse Manifold Transform (PSMT), a minimalistic, interpretable and biologically plausible framework for learning and predicting natural dynamics. PSMT incorporates two layers where the first sparse coding layer represents the input sequence as sparse coefficients over an overcomplete dictionary and the second manifold learning layer learns a geometric embedding space that captures topological similarity and dynamic temporal linearity in sparse coefficients. We apply PSMT on a natural video dataset and evaluate the reconstruction performance with respect to contextual variability, the number of sparse coding basis functions and training samples. We then interpret the dynamic topological organization in the embedding space. We next utilize PSMT to predict future frames compared with two baseline methods with a static embedding space. We demonstrate that PSMT with a dynamic embedding space can achieve better prediction performance compared to static baselines. Our work establishes that PSMT is an efficient unsupervised generative framework for prediction of future visual stimuli.


title: Castelnuovo-Mumford regularity for $321$-avoiding Kazhdan-Lusztig varieties

abstract: We introduce an algorithm which combinatorially computes the Castelnuovo-Mumford regularity of 321-avoiding Kazhdan-Lusztig varieties using excited diagrams. This extends earlier work of Rajchgot, Weigandt, and the author (2022) which computes the regularity of Grassmannian Kazhdan-Lusztig varieties. Our results specialize to compute the regularity of all two-sided mixed ladder determinantal varieties in terms of lattice paths.


title: On schurity of the dihedral group $\boldsymbol{D_{2p}}$

abstract: A finite group $G$ is called a Schur group if every $S$-ring over $G$ is schurian, i.e. associated in a natural way with a subgroup of $Sym(G)$ that contains all right translations. One of the crucial open questions in the $S$-ring theory is the question on existence of an infinite family of nonabelian Schur groups. We prove that a dihedral group of order $2p$, where $p$ is a Fermat prime or prime of the form $p=4q+1$, where $q$ is also prime, is Schur. Towards this result, we prove nonexistence of a difference set in a cyclic group of order $p\neq 13$ and classify all $S$-rings over some dihedral groups.


title: Compact-form solution to the time-dependent Schr\"odinger equation with an arbitrary potential

abstract: We obtain exact solutions to the class of parabolic partial differential equations of arbitrary dimensionality and with arbitrary potentials. The solutions are presented in a compact-form: as explicit mathematical expressions consisting of finite number of standard mathematical operations with finite (condition-independent) number of variables in a discrete or continous region of consideration. The general approach to obtain the compact-form solutions combines a number of methods in the fields of partial differential equations, enumerative combinatorics, and number theory, which we describe in detail. We discuss their advantages and perspectives for the various fields in physics, mathematics, and advanced calculus.


title: Can GitHub Issues Help in the App Review Classifications?

abstract: App reviews reflect various user requirements that can aid in planning maintenance tasks. Recently, proposed approaches for automatically classifying user reviews rely on machine learning algorithms. Devine et al. demonstrated that models trained on existing labeled datasets exhibit poor performance when predicting new ones. Although integrating datasets improves the results to some extent, there is still a need for greater generalizability to be taken into consideration. Therefore, a comprehensive labeled dataset is essential to train a more precise model. This paper introduces an approach to train a more generalizable model by leveraging information from an additional source, such as the GitHub issue tracking system, that contains valuable information about user requirements. We propose an approach that assists in augmenting labeled datasets by utilizing information extracted from GitHub issues. First, we identify issues concerning review intentions (bug reports, feature requests, and others) by examining the issue labels. Then, we analyze issue bodies and define 19 language patterns for extracting targeted information. Finally, we augment the manually labeled review dataset with a subset of processed issues through the Within-App, Within-Context, and Between-App Analysis methods. The first two methods train the app-specific models, and the last suits the general-purpose models. We conducted several experiments to evaluate the proposed approach. Our results demonstrate that using labeled issues for data augmentation can improve the F1-score and recall to 13.9 and 29.9 in the bug reports, respectively, and to 7.5 and 13.5 for feature requests. Furthermore, we identify an effective volume range of 0.3 to 0.7, which provides better performance improvements.


title: Exploring the Transfer Learning Capabilities of CLIP in Domain Generalization for Diabetic Retinopathy

abstract: Diabetic Retinopathy (DR), a leading cause of vision impairment, requires early detection and treatment. Developing robust AI models for DR classification holds substantial potential, but a key challenge is ensuring their generalization in unfamiliar domains with varying data distributions. To address this, our paper investigates cross-domain generalization, also known as domain generalization (DG), within the context of DR classification. DG, a challenging problem in the medical domain, is complicated by the difficulty of gathering labeled data across different domains, such as patient demographics and disease stages. Some recent studies have shown the effectiveness of using CLIP to handle the DG problem in natural images. In this study, we investigate CLIP's transfer learning capabilities and its potential for cross-domain generalization in diabetic retinopathy (DR) classification. We carry out comprehensive experiments to assess the efficacy and potential of CLIP in addressing DG for DR classification. Further, we introduce a multi-modal fine-tuning strategy named Context Optimization with Learnable Visual Tokens (CoOpLVT), which enhances context optimization by conditioning on visual features. Our findings demonstrate that the proposed method increases the F1-score by 1.8% over the baseline, thus underlining its promise for effective DG in DR classification. Our code is publicly available at https://github.com/Sanoojan/CLIP-DRDG.


title: Post-Hoc Explainability of BI-RADS Descriptors in a Multi-task Framework for Breast Cancer Detection and Segmentation

abstract: Despite recent medical advancements, breast cancer remains one of the most prevalent and deadly diseases among women. Although machine learning-based Computer-Aided Diagnosis (CAD) systems have shown potential to assist radiologists in analyzing medical images, the opaque nature of the best-performing CAD systems has raised concerns about their trustworthiness and interpretability. This paper proposes MT-BI-RADS, a novel explainable deep learning approach for tumor detection in Breast Ultrasound (BUS) images. The approach offers three levels of explanations to enable radiologists to comprehend the decision-making process in predicting tumor malignancy. Firstly, the proposed model outputs the BI-RADS categories used for BUS image analysis by radiologists. Secondly, the model employs multi-task learning to concurrently segment regions in images that correspond to tumors. Thirdly, the proposed approach outputs quantified contributions of each BI-RADS descriptor toward predicting the benign or malignant class using post-hoc explanations with Shapley Values.


title: Multiparameter quantum sensing and magnetic communications with a hybrid dc and rf optically pumped magnetometer

abstract: We introduce and demonstrate a hybrid optically pumped magnetometer (HOPM) that simultaneously measures one dc field component and one rf field component quadrature with a single atomic spin ensemble. The HOPM achieves sub-pT/$\sqrt{\mathrm{Hz}}$ sensitivity for both dc and rf fields, and is limited in sensitivity by spin projection noise at low frequencies and by photon shot noise at high frequencies. We demonstrate with the HOPM a new application of multiparameter quantum sensing: background-cancelling spread spectrum magnetic communication. We encode a digital message as rf amplitude, spread among sixteen channels from \SI{29}{\kilo\hertz} to \SI{33}{\kilo\hertz} in a noisy magnetic environment, and observe quantum-noise-limited rf magnetic signal recovery enabled by quantum-noise-limited dc noise cancellation, reaching noise rejection of \SI{15}{\decibel} at \SI{100}{\hertz} and more than \SI{20}{\decibel} at \SI{60}{\hertz} and below. We measure signal fidelity versus signal strength and extrinsic noise in communication of a short text message. The combination of high sensitivity, quantum-noise-limited performance, and real-world application potential makes the HOPM ideally suited for study of high-performance multiparameter quantum sensing.

categories: quant-ph physics.app-ph physics.atom-ph physics.ins-det


title: TimeTrail: Unveiling Financial Fraud Patterns through Temporal Correlation Analysis

abstract: In the field of financial fraud detection, understanding the underlying patterns and dynamics is important to ensure effective and reliable systems. This research introduces a new technique, "TimeTrail," which employs advanced temporal correlation analysis to explain complex financial fraud patterns. The technique leverages time-related insights to provide transparent and interpretable explanations for fraud detection decisions, enhancing accountability and trust. The "TimeTrail" methodology consists of three key phases: temporal data enrichment, dynamic correlation analysis, and interpretable pattern visualization. Initially, raw financial transaction data is enriched with temporal attributes. Dynamic correlations between these attributes are then quantified using innovative statistical measures. Finally, a unified visualization framework presents these correlations in an interpretable manner. To validate the effectiveness of "TimeTrail," a study is conducted on a diverse financial dataset, surrounding various fraud scenarios. Results demonstrate the technique's capability to uncover hidden temporal correlations and patterns, performing better than conventional methods in both accuracy and interpretability. Moreover, a case study showcasing the application of "TimeTrail" in real-world scenarios highlights its utility for fraud detection.


title: Machine Learning for Administrative Health Records: A Systematic Review of Techniques and Applications

abstract: Machine learning provides many powerful and effective techniques for analysing heterogeneous electronic health records (EHR). Administrative Health Records (AHR) are a subset of EHR collected for administrative purposes, and the use of machine learning on AHRs is a growing subfield of EHR analytics. Existing reviews of EHR analytics emphasise that the data-modality of the EHR limits the breadth of suitable machine learning techniques, and pursuable healthcare applications. Despite emphasising the importance of data modality, the literature fails to analyse which techniques and applications are relevant to AHRs. AHRs contain uniquely well-structured, categorically encoded records which are distinct from other data-modalities captured by EHRs, and they can provide valuable information pertaining to how patients interact with the healthcare system. This paper systematically reviews AHR-based research, analysing 70 relevant studies and spanning multiple databases. We identify and analyse which machine learning techniques are applied to AHRs and which health informatics applications are pursued in AHR-based research. We also analyse how these techniques are applied in pursuit of each application, and identify the limitations of these approaches. We find that while AHR-based studies are disconnected from each other, the use of AHRs in health informatics research is substantial and accelerating. Our synthesis of these studies highlights the utility of AHRs for pursuing increasingly complex and diverse research objectives despite a number of pervading data- and technique-based limitations. Finally, through our findings, we propose a set of future research directions that can enhance the utility of AHR data and machine learning techniques for health informatics research.


title: Generations of Knowledge Graphs: The Crazy Ideas and the Business Impact

abstract: Knowledge Graphs (KGs) have been used to support a wide range of applications, from web search to personal assistant. In this paper, we describe three generations of knowledge graphs: entity-based KGs, which have been supporting general search and question answering (e.g., at Google and Bing); text-rich KGs, which have been supporting search and recommendations for products, bio-informatics, etc. (e.g., at Amazon and Alibaba); and the emerging integration of KGs and LLMs, which we call dual neural KGs. We describe the characteristics of each generation of KGs, the crazy ideas behind the scenes in constructing such KGs, and the techniques developed over time to enable industry impact. In addition, we use KGs as examples to demonstrate a recipe to evolve research ideas from innovations to production practice, and then to the next level of innovations, to advance both science and business.


title: On Eisenhart's type theorem for sub-Riemannian metrics on step $2$ distributions with $\mathrm{ad}$-surjective Tanaka symbols

abstract: The classical result of Eisenhart states that if a Riemannian metric $g$ admits a Riemannian metric that is not constantly proportional to $g$ and has the same (parameterized) geodesics as $g$ in a neighborhood of a given point, then $g$ is a direct product of two Riemannian metrics in this neighborhood. We introduce a new generic class of step $2$ graded nilpotent Lie algebras, called $\mathrm{ad}$-surjective, and extend the Eisenhart theorem to sub-Riemannian metrics on step 2 distributions with $\mathrm{ad}$-surjective Tanaka symbols. The class of ad-surjective step 2 nilpotent Lie algebras contains a well-known class of algebras of H-type as a very particular case.


title: Discovery of a Bloch point quadrupole constituting hybrid topological strings

abstract: Topological magnetic (anti)skrymions are robust string-like objects heralded as potential components in next-generation topological spintronics devices due to their manipulability via low-energy stimuli such as magnetic fields, heat, and electric/thermal current. While these two-dimensional (2D) topological objects are widely studied, intrinsically three-dimensional (3D) electron-spin real-space topology remains less explored despite its prevalence in bulky magnets. Here, we capture the 3D structure of antiskyrmions in a single-crystal, precision-doped (Fe_{0.63}Ni_{0.3}Pd_{0.07})_{3}P lamellae using holographic vector field electron tomography at room temperature and zero field. Our measurements reveal hybrid string-like solitons composed of skyrmions with topological number W = -1 on the lamellae's surfaces and an antiskyrmion (W = +1) connecting them. High resolution images uncover a Bloch point (BP) quadrupole (four magnetic (anti)monopoles) positioned along the rectangular antiskyrmion's four corners (Bloch lines), which enable the observed lengthwise topological transitions. Furthermore, we calculate and compare the energy densities of hybrid strings with ideal (anti)skyrmion strings using micromagnetic simulations, which suggest that this composite (anti)BP structure stabilizes via the subtle interplay between the magnetostatic interaction and anisotropic Dzyaloshinskii-Moriya interaction. The discovery of these hybrid spin textures enables topological tunabilty, a tunable topological Hall effect, and the suppression of skyrmion Hall motion, disrupting existing paradigms within spintronics.


title: On Active Learning for Gaussian Process-based Global Sensitivity Analysis

abstract: This paper explores the application of active learning strategies to adaptively learn Sobol indices for global sensitivity analysis. We demonstrate that active learning for Sobol indices poses unique challenges due to the definition of the Sobol index as a ratio of variances estimated from Gaussian process surrogates. Consequently, learning strategies must either focus on convergence in the numerator or the denominator of this ratio. However, rapid convergence in either one does not guarantee convergence in the Sobol index. We propose a novel strategy for active learning that focuses on resolving the main effects of the Gaussian process (associated with the numerator of the Sobol index) and compare this with existing strategies based on convergence in the total variance (the denominator of the Sobol index). The new strategy, implemented through a new learning function termed the MUSIC (minimize uncertainty in Sobol index convergence), generally converges in Sobol index error more rapidly than the existing strategies based on the Expected Improvement for Global Fit (EIGF) and the Variance Improvement for Global Fit (VIGF). Both strategies are compared with simple sequential random sampling and the MUSIC learning function generally converges most rapidly for low-dimensional problems. However, for high-dimensional problems, the performance is comparable to random sampling. The new learning strategy is demonstrated for a practical case of adaptive experimental design for large-scale Boundary Layer Wind Tunnel experiments.


title: High-Resolution Document Shadow Removal via A Large-Scale Real-World Dataset and A Frequency-Aware Shadow Erasing Net

abstract: Shadows often occur when we capture the documents with casual equipment, which influences the visual quality and readability of the digital copies. Different from the algorithms for natural shadow removal, the algorithms in document shadow removal need to preserve the details of fonts and figures in high-resolution input. Previous works ignore this problem and remove the shadows via approximate attention and small datasets, which might not work in real-world situations. We handle high-resolution document shadow removal directly via a larger-scale real-world dataset and a carefully designed frequency-aware network. As for the dataset, we acquire over 7k couples of high-resolution (2462 x 3699) images of real-world document pairs with various samples under different lighting circumstances, which is 10 times larger than existing datasets. As for the design of the network, we decouple the high-resolution images in the frequency domain, where the low-frequency details and high-frequency boundaries can be effectively learned via the carefully designed network structure. Powered by our network and dataset, the proposed method clearly shows a better performance than previous methods in terms of visual quality and numerical results. The code, models, and dataset are available at: https://github.com/CXH-Research/DocShadow-SD7K


title: Accurate complex Jacobi rotations

abstract: This note shows how to compute, to high relative accuracy under mild assumptions, complex Jacobi rotations for diagonalization of Hermitian matrices of order two, using the correctly rounded functions $\mathtt{cr\_hypot}$ and $\mathtt{cr\_rsqrt}$, proposed for standardization in the C programming language as recommended by the IEEE-754 floating-point standard. The rounding to nearest (ties to even) and the non-stop arithmetic are assumed. The numerical examples compare the observed with theoretical bounds on the relative errors in the rotations' elements, and show that the maximal observed departure of the rotations' determinants from unity is smaller than that of the transformations computed by LAPACK.


title: Soft glassy materials with tunable extensibility

abstract: Extensibility is beyond the paradigm of classical soft glassy materials, and more broadly, yield-stress fluids. Recently, model yield-stress fluids with significant extensibility have been designed by adding polymeric phases to classically viscoplastic dispersions [1, 2, 3]. However, fundamental questions remain about the design of and coupling between the shear and extensional rheology of such systems. In this work, we propose a model material, a mixture of soft glassy microgels and solutions of high molecular weight linear polymers. We establish systematic criteria for the design and thorough rheological characterization of such systems, both in shear and in extension. Using our material, we show that it is possible to dramatically change the behavior in extension with minimal change in the shear yield stress and elastic modulus, thus enabling applications that exploit orthogonal modulation of shear and extensional material properties.


title: Modeling Player Personality Factors from In-Game Behavior and Affective Expression

abstract: Developing a thorough understanding of the target audience (and/or single individuals) is a key factor for success - which is exceptionally important and powerful for the domain of video games that can not only benefit from informed decision making during development, but ideally even tailor game content, difficulty and player experience while playing. The granular assessment of individual personality and differences across players is a particularly difficult endeavor, given the highly variant human nature, disagreement in psychological background models and because of the effortful data collection that most often builds upon long, time-consuming and deterrent questionnaires. In this work, we explore possibilities to predict a series of player personality questionnaire metrics from recorded in-game behavior and extend related work by explicitly adding affective dialog decisions to the game environment which could elevate the model's accuracy. Using random forest regression, we predicted a wide variety of personality metrics from seven established questionnaires across 62 players over 60 minute gameplay of a customized version of the role-playing game Fallout: New Vegas. While some personality variables could already be identified from reasonable underlying in-game actions and affective expressions, we did not find ways to predict others or encountered questionable correlations that could not be justified by theoretical background literature. Yet, building on the initial opportunities of this explorative study, we are striving to massively enlarge our data set to players from an ecologically valid industrial game environment and investigate the performance of more sophisticated machine learning approaches.


title: Partial actions of groups on generalized matrix rings

abstract: Let $n$ be a positive integer and $R=(M_{ij})_{1\leq i,j\leq n}$ be a generalized matrix ring. For each $1\leq i,j\leq n$, let $I_i$ be an ideal of the ring $R_i:=M_{ii}$ and denote $I_{ij}=I_iM_{ij}+M_{ij}I_j$. We give sufficient conditions for the subset $I=(I_{ij})_{1\leq i,j\leq n}$ of $R$ to be an ideal of $R$. Also, suppose that $\alpha^{(i)}$ is a partial action of a group $\mathtt{G}$ on $R_i$, for all $1\leq i\leq n$. We construct, under certain conditions, a partial action $\gamma$ of $\mathtt{G}$ on $R$ such that $\gamma$ restricted to $R_i$ coincides with $\alpha^{(i)}$. We study the relation between this construction and the notion of Morita equivalent partial group action given in [1]. Moreover, we investigate properties related to Galois theory for the extension $R^{\gamma}\subset R$. Some examples to illustrate the results are considered in the last part of the paper.


title: On pro-${\it p}$-groups with a single defining relator

abstract: In this paper we establish necessary condition for the Freiheitsatz of Magnus can be extended to free pro-${\it p}$-groups


title: Fulde-Ferrell-Larkin-Ovchinnikov state induced by antiferromagnetic order in $\kappa$-type organic conductors

abstract: We theoretically investigate superconductivity under a spin-split band structure owing to a collinear-type antiferromagnetic order in quasi-two-dimensional organic compounds $\kappa$-(BEDT-TTF)$_2X$. We find that the magnetic order can induce a Fulde--Ferrell--Larkin--Ovchinnikov (FFLO) state, where the Cooper pair possesses a finite center-of-mass momentum. We show this from two types of analyses: (1) an effective model where simple intraband attractive interactions are assumed, and (2) many-body calculations of the repulsive Hubbard model based on the fluctuation-exchange approximation and the linearized Eliashberg equation. Our results show the possibility of realizing the FFLO state without applying an external magnetic field.


title: Broadcast Channels with Heterogeneous Arrival and Decoding Deadlines: Second-Order Achievability

abstract: A standard assumption in the design of ultra-reliable low-latency communication systems is that the duration between message arrivals is larger than the number of channel uses before the decoding deadline. Nevertheless, this assumption fails when messages arrive rapidly and reliability constraints require that the number of channel uses exceed the time between arrivals. In this paper, we consider a broadcast setting in which a transmitter wishes to send two different messages to two receivers over Gaussian channels. Messages have different arrival times and decoding deadlines such that their transmission windows overlap. For this setting, we propose a coding scheme that exploits Marton's coding strategy. We derive rigorous bounds on the achievable rate regions. Those bounds can be easily employed in point-to-point settings with one or multiple parallel channels. In the point-to-point setting with one or multiple parallel channels, the proposed achievability scheme outperforms the Normal Approximation, especially when the number of channel uses is smaller than $200$. In the broadcast setting, our scheme agrees with Marton's strategy for sufficiently large numbers of channel uses and shows significant performance improvements over standard approaches based on time sharing for transmission of short packets.


title: Replica Symmetry Broken States of some Glass Models

abstract: We have studied in detail the $M$-$p$ balanced spin glass model, especially the case $p=4$. These types of model have relevance to structural glasses. The models possess two kinds of broken replica states; those with one-step replica symmetry breaking (1RSB) and those with full replica symmetry breaking (FRSB). To determine which arises requires studying the Landau expansion to quintic order. There are 9 quintic order coefficients, and 5 quartic order coefficients, whose values we determine for this model. We show that it is only for $2 \leq M < 2.4714 \cdots$ that the transition at mean-field level is to a state with FRSB, while for larger $M$ values there is either a continuous transition to a state with 1RSB (when $ M \leq 3$) or a discontinuous transition for $M > 3$. The Gardner transition from a 1RSB state at low temperatures to a state with FRSB also requires the Landau expansion to be taken to quintic order. Our result for the form of FRSB in the Gardner phase is similar to that found when $2 \leq M < 2.4714\cdots$, but differs from that given in the early paper of Gross et al. [Phys. Rev. Lett. 55, 304 (1985)]. Finally we discuss the effects of fluctuations on our mean-field solutions using the scheme of H\"{o}ller and Read [Phys. Rev. E 101, 042114 (2020)}] and argue that such fluctuations will remove both the continuous 1RSB transition and discontinuous 1RSB transitions when $8 >d \geq 6$ leaving just the FRSB continuous transition. We suggest values for $M$ and $p$ which might be used in simulations to confirm whether fluctuation corrections do indeed remove the 1RSB transitions.


title: Global well-posedness for the one-phase Muskat problem in 3D

abstract: This paper is concerned with the long time dynamics of the free boundary of a Darcy fluid in three space dimensions, also known as the one-phase Muskat problem. The dynamics of the free boundary is governed by a nonlocal fully nonlinear parabolic partial differential equation. It is proven that for any periodic Lipschitz graph given as initial data, the problem has a unique global-in-time solution which satisfies the equation in the strong sense. Moreover, all H\"older norms of the solution decay exponentially in time. These results have been previously established in two space dimensions. This paper addresses new challenges to extend the results to the more difficult three dimensional setting. The approach developed is critical in three space dimensions and crucially relies on Dahlberg-Kenig's $W^{1, 2+\varepsilon}$ optimal regularity for layer potentials together with delicate structures of the Dirichlet-to-Neumann operator and layer potentials in Lipschitz domains of $\mathbb{T}^2\times \mathbb{R}$.


title: Efficient Reconstruction of Neural Mass Dynamics Modeled by Linear-Threshold Networks

abstract: This paper studies the data-driven reconstruction of firing rate dynamics of brain activity described by linear-threshold network models. Identifying the system parameters directly leads to a large number of variables and a highly non-convex objective function. Instead, our approach introduces a novel reformulation that incorporates biological organizational features and turns the identification problem into a scalar variable optimization of a discontinuous, non-convex objective function. We prove that the minimizer of the objective function is unique and establish that the solution of the optimization problem leads to the identification of all the desired system parameters. These results are the basis to introduce an algorithm to find the optimizer by searching the different regions corresponding to the domain of definition of the objective function. To deal with measurement noise in sampled data, we propose a modification of the original algorithm whose identification error is linearly bounded by the magnitude of the measurement noise. We demonstrate the effectiveness of the proposed algorithms through simulations on synthetic and experimental data.


title: Research Report -- Persistent Autonomy and Robot Learning Lab

abstract: Robots capable of performing manipulation tasks in a broad range of missions in unstructured environments can develop numerous applications to impact and enhance human life. Existing work in robot learning has shown success in applying conventional machine learning algorithms to enable robots for replicating rather simple manipulation tasks in manufacturing, service and healthcare applications, among others. However, learning robust and versatile models for complex manipulation tasks that are inherently multi-faceted and naturally intricate demands algorithmic advancements in robot learning. Our research supports the long-term goal of making robots more accessible and serviceable to the general public by expanding robot applications to real-world scenarios that require systems capable of performing complex tasks. To achieve this goal, we focus on identifying and investigating knowledge gaps in robot learning of complex manipulation tasks by leveraging upon human-robot interaction and robot learning from human instructions. This document presents an overview of the recent research developments in the Persistent Autonomy and Robot Learning (PeARL) lab at the University of Massachusetts Lowell. Here, I briefly discuss different research directions, and present a few proposed approaches in our most recent publications. For each proposed approach, I then mention potential future directions that can advance the field.


title: General validity of the exponential law for the effect of concentration polarization in reverse osmosis in a stirred-cell geometry, including an activity correction for 1:1 salt solutions

abstract: Reverse osmosis (RO) is a method to desalinate water with membranes and an applied pressure. Very important in the theory of mass transport in RO is the concentration polarization (CP) layer, which develops on the upstream side of the membrane because of a combination of salt convection and diffusion. Because of the CP-effect, the salt concentration at the membrane surface is higher than in the channel, and this increases the osmotic pressure there, and thus transmembrane water flux is reduced (the osmotic pressure acts against water flux), while salt leakage through the membrane increases. So it is very important to understand and describe the CP-layer accurately. We analyze a one-dimensional geometry, which is of relevance for a typical lab-scale RO setup using small membrane coupons where the solution on the feed side of the membrane is stirred. For this geometry, the standard film layer approach is often used that assumes a stagnant film layer of a defined thickness, which however does not exist in reality. We set up a model without that assumption but including refreshment of solution because of the flow of water along the membrane due to stirring. We show that the `exponential law' for the CP-layer that is predicted by the the film model, also applies for this more accurate model. We further improve the model by including the activity coefficient of salt ions, as described by the Bjerrum theory that is based on ion-ion Coulombic interactions. We evaluate the original linearized Bjerrum theory as well as an extended Bjerrum equation that is valid up to 1.5 M salt concentration. We show how including this activity correction leads to a reduction of the diffusional driving force at high concentration, and thus the salt concentration at the membrane further increases. However, the effect can be easily included by reducing the CP-layer mass transfer coefficient by a fixed percentage.


title: An initial analysis of a strongly-lensed QSOs candidate identified by LAMOST

abstract: From 2011 to 2021, LAMOST has released a total of 76,167 quasar data. We try to search for gravitationally lensed QSOs by limiting coordinate differences and redshift differences of these QSOs. The name, brightness, spectrum, photometry and other information of each QSO will be visually checked carefully. Special attention should be paid to check whether there are groups of galaxies, gravitationally lensed arcs, Einstein crosses, or Einstein rings near the QSOs. Through careful selection, we select LAMOST J160603.01+290050.8 (A) and LAMOST J160602.81+290048.7 (B) as a candidate and perform an initial analysis. The component A and B are 3.36 arc seconds apart and they display blue during photometric observations. The redshift values of component A and B are 0.2\% different, their Gaia$\_$g values are 1.3\% different, and their ugriz values are 1.0\% or less different. For the spectra covering from 3,690 {\AA} to 9,100 {\AA}, the emission lines of C\,II, Mg, H\,$\gamma$, O\,III, and H\,$\beta$ are present for both component A and B and the ratio of flux(B) to flux(A) from LAMOST is basically a constant, around 2.2. We accidentally find a galaxy group near the component A and B. If the center of dark matter in the galaxy group is at the center between component A and B, the component A and B are probably gravitationally lensed QSOs. We estimate that the Einstein mass is 1.46 $\times$ $10^{11}$ $M_{\odot}$ and the total mass of the lens is 1.34 $\times$ $10^{13}$ $M_{\odot}$. The deflection angle is 1.97 arc seconds at positions A and B and the velocity dispersion is 261\,$km\,s^{-1}$. Theoretically, this candidate could be a pair of fold images of a strong lensing system by a galaxy group, and we will investigate the possibility when the redshifts of nearby galaxies are available.


title: An Empirical Analysis on Financial Markets: Insights from the Application of Statistical Physics

abstract: In this study, we introduce a physical model inspired by statistical physics for predicting price volatility and expected returns by leveraging Level 3 order book data. By drawing parallels between orders in the limit order book and particles in a physical system, we establish unique measures for the system's kinetic energy and momentum as a way to comprehend and evaluate the state of limit order book. Our model goes beyond examining merely the top layers of the order book by introducing the concept of 'active depth', a computationally-efficient approach for identifying order book levels that have impact on price dynamics. We empirically demonstrate that our model outperforms the benchmarks of traditional approaches and machine learning algorithm. Our model provides a nuanced comprehension of market microstructure and produces more accurate forecasts on volatility and expected returns. By incorporating principles of statistical physics, this research offers valuable insights on understanding the behaviours of market participants and order book dynamics.

categories: q-fin.TR q-fin.CP q-fin.MF q-fin.PR q-fin.ST


title: A conservative Turing complete $S^4$ flow

abstract: We present a Turing complete, volume preserving, smooth flow on the $4$-sphere.


title: Explicit equations of the fake projective plane $(a=7,p=2,\emptyset,D_3 X_7)$

abstract: We find explicit equations of the fake projective plane $(a=7,p=2,\emptyset,D_3 X_7)$, which lies in the same class as the fake projective plane $(a=7,p=2,\emptyset,D_3 2_7)$ with $21$ automorphisms whose equations were previously found by Borisov and Keum. The method involves finding a birational model of a common Galois cover of these two surfaces.


title: Dynamic Mechanism of Catastrophic Collapse: An New Perspective on Earthquake Physics

abstract: The collapse of man-made and natural structures is a complex phenomenon that has been studied for centuries. We propose a new approach to understanding catastrophic instabilities, based on the idea that they do not occur at the critical point, but rather develop out of the subcritical regime as short-lived extreme events. We use an extension of Onsager's reciprocal theorem to study the subcritical regime, and we show that excitable systems in this regime are attracted to a nonlocal equilibrium that defines the maximum entropy production of at least two interacting phases. In most cases, these feedback systems are arrested by dissipative processes at larger scale, but in rare cases they can form tensor networks of instabilities that ripple from the small scale to the largest scale, forming extreme events.


title: Quantum Next Generation Reservoir Computing: An Efficient Quantum Algorithm for Forecasting Quantum Dynamics

abstract: Next Generation Reservoir Computing (NG-RC) is a modern class of model-free machine learning that enables an accurate forecasting of time series data generated by dynamical systems. We demonstrate that NG-RC can accurately predict full many-body quantum dynamics in both integrable and chaotic systems. This is in contrast to the conventional application of reservoir computing that concentrates on the prediction of the dynamics of observables. In addition, we apply a technique which we refer to as skipping ahead to predict far future states accurately without the need to extract information about the intermediate states. However, adopting a classical NG-RC for many-body quantum dynamics prediction is computationally prohibitive due to the large Hilbert space of sample input data. In this work, we propose an end-to-end quantum algorithm for many-body quantum dynamics forecasting with a quantum computational speedup via the block-encoding technique. This proposal presents an efficient model-free quantum scheme to forecast quantum dynamics coherently, bypassing inductive biases incurred in a model-based approach.

categories: quant-ph cond-mat.dis-nn cond-mat.stat-mech cs.LG physics.comp-ph


title: Track Geometry Degradation Modelling Considering Multiple Indicators

abstract: Railway infrastructure requires effective maintenance to ensure safe and comfortable transportation. Among the various degradation modes, track geometry deformation caused by repeated loading is a critical mechanism impacting operational safety. Detecting and maintaining acceptable track geometry relies on track recording vehicles (TRVs) that inspect and record geometric parameters. This study aims to develop a novel track geometry degradation model considering multiple indicators and their correlation, while accounting for both imperfect manual and mechanized tamping. A multi-variate Wiener model is formulated to capture the characteristics of track geometry degradation. To overcome data limitations, a hierarchical Bayesian approach with Markov Chain Monte Carlo (MCMC) simulation is utilized. This study offers a contribution on the analysis of a multi-variate predictive model which considers correlation between the degradation rates of multiple indicators, providing insights for rail operators and new track-monitoring systems. The performance of the models is rigorously validated through a real-world case study on a commuter track in Queensland, Australia, utilizing actual data and independent test datasets. This experimental calibration and validation procedure represents a novel contribution to the existing literature, offering valuable guidance for rail asset management and decision-making.


title: Too Many Cooks: Exploring How Graphical Perception Studies Influence Visualization Recommendations in Draco

abstract: Findings from graphical perception can guide visualization recommendation algorithms in identifying effective visualization designs. However, existing algorithms use knowledge from, at best, a few studies, limiting our understanding of how complementary (or contradictory) graphical perception results influence generated recommendations. In this paper, we present a pipeline of applying a large body of graphical perception results to develop new visualization recommendation algorithms and conduct an exploratory study to investigate how results from graphical perception can alter the behavior of downstream algorithms. Specifically, we model graphical perception results from 30 papers in Draco -- a framework to model visualization knowledge -- to develop new recommendation algorithms. By analyzing Draco-generated algorithms, we showcase the feasibility of our method to (1) identify gaps in existing graphical perception literature informing recommendation algorithms, (2) cluster papers by their preferred design rules and constraints, and (3) investigate why certain studies can dominate Draco's recommendations, whereas others may have little influence. Given our findings, we discuss the potential for mutually reinforcing advancements in graphical perception and visualization recommendation research.


title: The Cultural Psychology of Large Language Models: Is ChatGPT a Holistic or Analytic Thinker?

abstract: The prevalent use of Large Language Models (LLMs) has necessitated studying their mental models, yielding noteworthy theoretical and practical implications. Current research has demonstrated that state-of-the-art LLMs, such as ChatGPT, exhibit certain theory of mind capabilities and possess relatively stable Big Five and/or MBTI personality traits. In addition, cognitive process features form an essential component of these mental models. Research in cultural psychology indicated significant differences in the cognitive processes of Eastern and Western people when processing information and making judgments. While Westerners predominantly exhibit analytical thinking that isolates things from their environment to analyze their nature independently, Easterners often showcase holistic thinking, emphasizing relationships and adopting a global viewpoint. In our research, we probed the cultural cognitive traits of ChatGPT. We employed two scales that directly measure the cognitive process: the Analysis-Holism Scale (AHS) and the Triadic Categorization Task (TCT). Additionally, we used two scales that investigate the value differences shaped by cultural thinking: the Dialectical Self Scale (DSS) and the Self-construal Scale (SCS). In cognitive process tests (AHS/TCT), ChatGPT consistently tends towards Eastern holistic thinking, but regarding value judgments (DSS/SCS), ChatGPT does not significantly lean towards the East or the West. We suggest that the result could be attributed to both the training paradigm and the training data in LLM development. We discuss the potential value of this finding for AI research and directions for future research.