title: GENEVA: GENErating and Visualizing branching narratives using LLMs

abstract: Dialogue-based Role Playing Games (RPGs) require powerful storytelling. The narratives of these may take years to write and typically involve a large creative team. In this work, we demonstrate the potential of large generative text models to assist this process. \textbf{GENEVA}, a prototype tool, generates a rich narrative graph with branching and reconverging storylines that match a high-level narrative description and constraints provided by the designer. A large language model (LLM), GPT-4, is used to generate the branching narrative and to render it in a graph format in a two-step process. We illustrate the use of GENEVA in generating new branching narratives for four well-known stories under different contextual constraints. This tool has the potential to assist in game development, simulations, and other applications with game-like properties.


title: Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models

abstract: Large language models (LLMs) have achieved remarkable advancements in natural language processing. However, the massive scale and computational demands of these models present formidable challenges when considering their practical deployment in resource-constrained environments. While techniques such as chain-of-thought (CoT) distillation have displayed promise in distilling LLMs into small language models (SLMs), there is a risk that distilled SLMs may still inherit flawed reasoning and hallucinations from LLMs. To address these issues, we propose a twofold methodology: First, we introduce a novel method for distilling the self-evaluation capability from LLMs into SLMs, aiming to mitigate the adverse effects of flawed reasoning and hallucinations inherited from LLMs. Second, we advocate for distilling more comprehensive thinking by incorporating multiple distinct CoTs and self-evaluation outputs, to ensure a more thorough and robust knowledge transfer into SLMs. Experiments on three NLP benchmarks demonstrate that our method significantly improves the performance of distilled SLMs, offering a new perspective for developing more effective and efficient SLMs in resource-constrained environments.


title: ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy

abstract: Modern computer vision offers a great variety of models to practitioners, and selecting a model from multiple options for specific applications can be challenging. Conventionally, competing model architectures and training protocols are compared by their classification accuracy on ImageNet. However, this single metric does not fully capture performance nuances critical for specialized tasks. In this work, we conduct an in-depth comparative analysis of model behaviors beyond ImageNet accuracy, for both ConvNet and Vision Transformer architectures, each across supervised and CLIP training paradigms. Although our selected models have similar ImageNet accuracies and compute requirements, we find that they differ in many other aspects: types of mistakes, output calibration, transferability, and feature invariance, among others. This diversity in model characteristics, not captured by traditional metrics, highlights the need for more nuanced analysis when choosing among different models. Our code is available at https://github.com/kirill-vish/Beyond-INet.


title: Assessing Translation capabilities of Large Language Models involving English and Indian Languages

abstract: Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. In this work, our aim is to explore the multilingual capabilities of large language models by using machine translation as a task involving English and 22 Indian languages. We first investigate the translation capabilities of raw large language models, followed by exploring the in-context learning capabilities of the same raw models. We fine-tune these large language models using parameter efficient fine-tuning methods such as LoRA and additionally with full fine-tuning. Through our study, we have identified the best performing large language model for the translation task involving LLMs, which is based on LLaMA. Our results demonstrate significant progress, with average BLEU scores of 13.42, 15.93, 12.13, 12.30, and 12.07, as well as CHRF scores of 43.98, 46.99, 42.55, 42.42, and 45.39, respectively, using 2-stage fine-tuned LLaMA-13b for English to Indian languages on IN22 (conversational), IN22 (general), flores200-dev, flores200-devtest, and newstest2019 testsets. Similarly, for Indian languages to English, we achieved average BLEU scores of 14.03, 16.65, 16.17, 15.35 and 12.55 along with chrF scores of 36.71, 40.44, 40.26, 39.51, and 36.20, respectively, using fine-tuned LLaMA-13b on IN22 (conversational), IN22 (general), flores200-dev, flores200-devtest, and newstest2019 testsets. Overall, our findings highlight the potential and strength of large language models for machine translation capabilities, including for languages that are currently underrepresented in LLMs.


title: DMV3D: Denoising Multi-View Diffusion using 3D Large Reconstruction Model

abstract: We propose \textbf{DMV3D}, a novel 3D generation approach that uses a transformer-based 3D large reconstruction model to denoise multi-view diffusion. Our reconstruction model incorporates a triplane NeRF representation and can denoise noisy multi-view images via NeRF reconstruction and rendering, achieving single-stage 3D generation in $\sim$30s on single A100 GPU. We train \textbf{DMV3D} on large-scale multi-view image datasets of highly diverse objects using only image reconstruction losses, without accessing 3D assets. We demonstrate state-of-the-art results for the single-image reconstruction problem where probabilistic modeling of unseen object parts is required for generating diverse reconstructions with sharp textures. We also show high-quality text-to-3D generation results outperforming previous 3D diffusion models. Our project website is at: https://justimyhxu.github.io/projects/dmv3d/ .


title: Massive quantum systems as interfaces of quantum mechanics and gravity

abstract: The traditional view from particle physics is that quantum gravity effects should only become detectable at extremely high energies and small length scales. Due to the significant technological challenges involved, there has been limited progress in identifying experimentally detectable effects that can be accessed in the foreseeable future. However, in recent decades, the size and mass of quantum systems that can be controlled in the laboratory have reached unprecedented scales, enabled by advances in ground-state cooling and quantum-control techniques. Preparations of massive systems in quantum states paves the way for the explorations of a low-energy regime in which gravity can be both sourced and probed by quantum systems. Such approaches constitute an increasingly viable alternative to accelerator-based, laser-interferometric, torsion-balance, and cosmological tests of gravity. In this review, we provide an overview of proposals where massive quantum systems act as interfaces between quantum mechanics and gravity. We discuss conceptual difficulties in the theoretical description of quantum systems in the presence of gravity, review tools for modeling massive quantum systems in the laboratory, and provide an overview of the current state-of-the-art experimental landscape. Proposals covered in this review include, among others, precision tests of gravity, tests of gravitationally-induced wavefunction collapse and decoherence, as well as gravity-mediated entanglement. We conclude the review with an outlook and discussion of future questions.


title: Compact Scalars at the Cosmological Collider

abstract: We study the dynamics of scalar fields with compact field spaces, or axions, in de Sitter space. We argue that the field space topology can qualitatively affect the physics of these fields beyond just which terms are allowed in their actions. We argue that the sharpest difference is for massless fields -- the free massless noncompact scalar field does not admit a two-point function that is both de Sitter-invariant and well-behaved at long distances, while the massless compact scalar does. As proof that this difference can be observable, we show that the long-distance behavior of a heavy scalar field, and thus its cosmological collider signal, can qualitatively change depending on whether it interacts with a light compact or noncompact scalar field. We find an interesting interplay between the circumference of the field space and the Hubble scale. When the field space is much larger than Hubble, the compact field behaves similarly to a light noncompact field and forces the heavy field to dilute much faster than any free field can. However, depending on how much smaller the field space is compared to Hubble, the compact field can cause the heavy scalar to decay either faster or slower than any free field and so we conclude that there can be qualitative and observable consequences of the field space's topology in inflationary correlation functions.


title: Stability of topologically protected slow light against disorder

abstract: Slowing down light in on-chip photonic devices strongly enhances light-matter interaction, but typically also leads to increased backscattering and small-bandwidth operation. It was shown recently that, if one modifies the edge termination of a photonic Chern insulator such that the edge mode wraps many times around the Brillouin zone, light can be slowed to arbitrarily low group velocity over a large bandwidth, without being subject to backscattering. Here we study the robustness of these in-gap slow light modes against fabrication disorder, finding that disorder on scales significantly larger than the minigaps between edge bands is tolerable. We identify the mechanism for wavepacket breakup as disorder-induced velocity renormalization and calculate the associated breakup time.


title: Single-Image 3D Human Digitization with Shape-Guided Diffusion

abstract: We present an approach to generate a 360-degree view of a person with a consistent, high-resolution appearance from a single input image. NeRF and its variants typically require videos or images from different viewpoints. Most existing approaches taking monocular input either rely on ground-truth 3D scans for supervision or lack 3D consistency. While recent 3D generative models show promise of 3D consistent human digitization, these approaches do not generalize well to diverse clothing appearances, and the results lack photorealism. Unlike existing work, we utilize high-capacity 2D diffusion models pretrained for general image synthesis tasks as an appearance prior of clothed humans. To achieve better 3D consistency while retaining the input identity, we progressively synthesize multiple views of the human in the input image by inpainting missing regions with shape-guided diffusion conditioned on silhouette and surface normal. We then fuse these synthesized multi-view images via inverse rendering to obtain a fully textured high-resolution 3D mesh of the given person. Experiments show that our approach outperforms prior methods and achieves photorealistic 360-degree synthesis of a wide range of clothed humans with complex textures from a single image.


title: Low Particulates Nitrogen Purge and Backfill During Prototype HB650 Cryomodule String Assembly

abstract: A low particulate vacuum and purging system was developed to support PIP-II cryomodule string assembly. The overpressure can be controlled at a precision of 1 mbar above the atmospheric pressure regardless of the cavity or string assembly air volume. The system minimized the risk of uncontrolled nitrogen flow during the string assembly. Design features are presented.


title: Non-line-of-sight imaging in the presence of scattering media using phasor fields

abstract: Non-line-of-sight (NLOS) imaging aims to reconstruct partially or completely occluded scenes. Recent approaches have demonstrated high-quality reconstructions of complex scenes with arbitrary reflectance, occlusions, and significant multi-path effects. However, previous works focused on surface scattering only, which reduces the generality in more challenging scenarios such as scenes submerged in scattering media. In this work, we investigate current state-of-the-art NLOS imaging methods based on phasor fields to reconstruct scenes submerged in scattering media. We empirically analyze the capability of phasor fields in reconstructing complex synthetic scenes submerged in thick scattering media. We also apply the method to real scenes, showing that it performs similarly to recent diffuse optical tomography methods.


title: The Cybersecurity Crisis of Artificial Intelligence: Unrestrained Adoption and Natural Language-Based Attacks

abstract: The widespread integration of autoregressive-large language models (AR-LLMs), such as ChatGPT, across established applications, like search engines, has introduced critical vulnerabilities with uniquely scalable characteristics. In this commentary, we analyse these vulnerabilities, their dependence on natural language as a vector of attack, and their challenges to cybersecurity best practices. We offer recommendations designed to mitigate these challenges.


title: Autonomous Driving using Spiking Neural Networks on Dynamic Vision Sensor Data: A Case Study of Traffic Light Change Detection

abstract: Autonomous driving is a challenging task that has gained broad attention from both academia and industry. Current solutions using convolutional neural networks require large amounts of computational resources, leading to high power consumption. Spiking neural networks (SNNs) provide an alternative computation model to process information and make decisions. This biologically plausible model has the advantage of low latency and energy efficiency. Recent work using SNNs for autonomous driving mostly focused on simple tasks like lane keeping in simplified simulation environments. This project studies SNNs on photo-realistic driving scenes in the CARLA simulator, which is an important step toward using SNNs on real vehicles. The efficacy and generalizability of the method will be investigated.


abstract: 'Digital humans' are digital reproductions of humans powered by artificial intelligence (AI) and capable of communicating and forming emotional bonds. The value creation potential of digital humans is overlooked due to the limitations of digital human technologies. This article explores the value creation potential and the value realisation limitations of digital humans. The analysis is based on a review of 62 articles retrieved from the Web of Science database. The analysis suggests that digital humans have the potential to alleviate labour and skill shortages, reduce the natural human element in high-risk tasks, avoid design errors, improve the ergonomics of products and workplaces, and provide guidance and emotional support, all of which will benefit natural humans in the workplace. However, technical limits, evolving understanding of digital humans, the social significance and acceptance of digital humans, ethical considerations, and the adjustment of legal tradition limit the value realisation. This review suggests that digital humans' perceived usefulness and ease of development determine organisations' willingness to utilise this technology. Overcoming the limitations, which still involve engineering challenges and a change in how they are perceived, will positively affect realising the value potential of digital humans in organisations.


title: Open-Sourcing Highly Capable Foundation Models: An evaluation of risks, benefits, and alternative methods for pursuing open-source objectives

abstract: Recent decisions by leading AI labs to either open-source their models or to restrict access to their models has sparked debate about whether, and how, increasingly capable AI models should be shared. Open-sourcing in AI typically refers to making model architecture and weights freely and publicly accessible for anyone to modify, study, build on, and use. This offers advantages such as enabling external oversight, accelerating progress, and decentralizing control over AI development and use. However, it also presents a growing potential for misuse and unintended consequences. This paper offers an examination of the risks and benefits of open-sourcing highly capable foundation models. While open-sourcing has historically provided substantial net benefits for most software and AI development processes, we argue that for some highly capable foundation models likely to be developed in the near future, open-sourcing may pose sufficiently extreme risks to outweigh the benefits. In such a case, highly capable foundation models should not be open-sourced, at least not initially. Alternative strategies, including non-open-source model sharing options, are explored. The paper concludes with recommendations for developers, standard-setting bodies, and governments for establishing safe and responsible model sharing practices and preserving open-source benefits where safe.


title: Does Starting Deep Learning Homework Earlier Improve Grades?

abstract: Intuitively, students who start a homework assignment earlier and spend more time on it should receive better grades on the assignment. However, existing literature on the impact of time spent on homework is not clear-cut and comes mostly from K-12 education. It is not clear that these prior studies can inform coursework in deep learning due to differences in demographics, as well as the computational time needed for assignments to be completed. We study this problem in a post-hoc study of three semesters of a deep learning course at the University of Maryland, Baltimore County (UMBC), and develop a hierarchical Bayesian model to help make principled conclusions about the impact on student success given an approximate measure of the total time spent on the homework, and how early they submitted the assignment. Our results show that both submitting early and spending more time positively relate with final grade. Surprisingly, the value of an additional day of work is apparently equal across students, even when some require less total time to complete an assignment.


title: Developing a Novel Holistic, Personalized Dementia Risk Prediction Model via Integration of Machine Learning and Network Systems Biology Approaches

abstract: The prevalence of dementia has increased over time as global life expectancy improves and populations age. An individual's risk of developing dementia is influenced by various genetic, lifestyle, and environmental factors, among others. Predicting dementia risk may enable individuals to employ mitigation strategies or lifestyle changes to delay dementia onset. Current computational approaches to dementia prediction only return risk upon narrow categories of variables and do not account for interactions between different risk variables. The proposed framework utilizes a novel holistic approach to dementia risk prediction and is the first to incorporate various sources of tabular environmental pollution and lifestyle factor data with network systems biology-based genetic data. LightGBM gradient boosting was employed to ensure validity of included factors. This approach successfully models interactions between variables through an original weighted integration method coined Sysable. Multiple machine learning models trained the algorithm to reduce reliance on a single model. The developed approach surpassed all existing dementia risk prediction approaches, with a sensitivity of 85%, specificity of 99%, geometric accuracy of 92%, and AUROC of 91.7%. A transfer learning model was implemented as well. De-biasing algorithms were run on the model via the AI Fairness 360 Library. Effects of demographic disparities on dementia prevalence were analyzed to potentially highlight areas in need and promote equitable and accessible care. The resulting model was additionally integrated into a user-friendly app providing holistic predictions and personalized risk mitigation strategies. The developed model successfully employs holistic computational dementia risk prediction for clinical use.


title: Evaluating and Improving Value Judgments in AI: A Scenario-Based Study on Large Language Models' Depiction of Social Conventions

abstract: The adoption of generative AI technologies is swiftly expanding. Services employing both linguistic and mul-timodal models are evolving, offering users increasingly precise responses. Consequently, human reliance on these technologies is expected to grow rapidly. With the premise that people will be impacted by the output of AI, we explored approaches to help AI output produce better results. Initially, we evaluated how contemporary AI services competitively meet user needs, then examined society's depiction as mirrored by Large Language Models (LLMs). We did a query experiment, querying about social conventions in various countries and eliciting a one-word response. We compared the LLMs' value judgments with public data and suggested an model of decision-making in value-conflicting scenarios which could be adopted for future machine value judgments. This paper advocates for a practical approach to using AI as a tool for investigating other remote worlds. This re-search has significance in implicitly rejecting the notion of AI making value judgments and instead arguing a more critical perspective on the environment that defers judgmental capabilities to individuals. We anticipate this study will empower anyone, regardless of their capacity, to receive safe and accurate value judgment-based out-puts effectively.


title: Key Factors Affecting European Reactions to AI in European Full and Flawed Democracies

abstract: This study examines the key factors that affect European reactions to artificial intelligence (AI) in the context of both full and flawed democracies in Europe. Analysing a dataset of 4,006 respondents, categorised into full democracies and flawed democracies based on the Democracy Index developed by the Economist Intelligence Unit (EIU), this research identifies crucial factors that shape European attitudes toward AI in these two types of democracies. The analysis reveals noteworthy findings. Firstly, it is observed that flawed democracies tend to exhibit higher levels of trust in government entities compared to their counterparts in full democracies. Additionally, individuals residing in flawed democracies demonstrate a more positive attitude toward AI when compared to respondents from full democracies. However, the study finds no significant difference in AI awareness between the two types of democracies, indicating a similar level of general knowledge about AI technologies among European citizens. Moreover, the study reveals that trust in AI measures, specifically "Trust AI Solution", does not significantly vary between full and flawed democracies. This suggests that despite the differences in democratic quality, both types of democracies have similar levels of confidence in AI solutions.


title: What Attracts Employees to Work Onsite in Times of Increased Remote Working?

abstract: COVID-19 pandemic has irreversibly changed the attitude towards office presence. While previously remote workers were met with skepticism and distrust, today the same applies to companies prohibiting remote working. Albeit many workspaces are half empty. In this paper, we offer insights into the role of the office, corporate policies and actions regarding remote work in eight companies: Ericsson, Knowit, SpareBank 1 Utvikling, Spotify, Storebrand, Telenor, Company-X, Company-Y, and their sites in Sweden, Norway and the UK. Our findings are twofold. First, we found that companies indeed struggle with office presence and a large share of corporate space (35-67%) is underutilized. Second, we found that the main motivator for office presence is Connection and community, followed by Material offerings, Preference and Duty. Finally, we summarize actionable advice to promote onsite work, which is likely to help many other companies to rejuvenate life in their offices.


title: Neural Packing: from Visual Sensing to Reinforcement Learning

abstract: We present a novel learning framework to solve the transport-and-packing (TAP) problem in 3D. It constitutes a full solution pipeline from partial observations of input objects via RGBD sensing and recognition to final box placement, via robotic motion planning, to arrive at a compact packing in a target container. The technical core of our method is a neural network for TAP, trained via reinforcement learning (RL), to solve the NP-hard combinatorial optimization problem. Our network simultaneously selects an object to pack and determines the final packing location, based on a judicious encoding of the continuously evolving states of partially observed source objects and available spaces in the target container, using separate encoders both enabled with attention mechanisms. The encoded feature vectors are employed to compute the matching scores and feasibility masks of different pairings of box selection and available space configuration for packing strategy optimization. Extensive experiments, including ablation studies and physical packing execution by a real robot (Universal Robot UR5e), are conducted to evaluate our method in terms of its design choices, scalability, generalizability, and comparisons to baselines, including the most recent RL-based TAP solution. We also contribute the first benchmark for TAP which covers a variety of input settings and difficulty levels.


title: Genetic Algorithms for Evolution of QWOP Gaits

abstract: QWOP is a browser-based, 2-dimensional flash game in which the player controls an Olympic sprinter competing in a simulated 100-meter race. The goal of the game is to advance the runner to the end of the 100-meter race as quickly as possible using the Q, W, O, and P keys, which control the muscles in the sprinters legs. Despite the game simple controls and straightforward goal, it is renowned for its difficulty and unintuitive gameplay. In this paper, we attempt to automatically discover effective QWOP gaits. We describe a programmatic interface developed to play the game, and we introduce several variants of a genetic algorithm tailored to solve this problem. We present experimental results on the effectiveness of various representations, initialization strategies, evolution paradigms, and parameter control mechanisms.


title: Scalable Diffusion for Materials Generation

abstract: Generative models trained on internet-scale data are capable of generating novel and realistic texts, images, and videos. A natural next question is whether these models can advance science, for example by generating novel stable materials. Traditionally, models with explicit structures (e.g., graphs) have been used in modeling structural relationships in scientific data (e.g., atoms and bonds in crystals), but generating structures can be difficult to scale to large and complex systems. Another challenge in generating materials is the mismatch between standard generative modeling metrics and downstream applications. For instance, common metrics such as the reconstruction error do not correlate well with the downstream goal of discovering stable materials. In this work, we tackle the scalability challenge by developing a unified crystal representation that can represent any crystal structure (UniMat), followed by training a diffusion probabilistic model on these UniMat representations. Our empirical results suggest that despite the lack of explicit structure modeling, UniMat can generate high fidelity crystal structures from larger and more complex chemical systems, outperforming previous graph-based approaches under various generative modeling metrics. To better connect the generation quality of materials to downstream applications, such as discovering novel stable materials, we propose additional metrics for evaluating generative models of materials, including per-composition formation energy and stability with respect to convex hulls through decomposition energy from Density Function Theory (DFT). Lastly, we show that conditional generation with UniMat can scale to previously established crystal datasets with up to millions of crystals structures, outperforming random structure search (the current leading method for structure discovery) in discovering new stable materials.


title: A review of the sufficient conditions for consciousness

abstract: How subjective experience (i.e., consciousness) arises out of objective material processes has been called the hard problem. The neuroscience of consciousness has set out to find the sufficient conditions for consciousness and theoretical and empirical endeavours have placed a particular focus on the cortex and subcortex, whilst discounting the cerebellum. However, when looking at neuroimaging research, it becomes clear there is substantial evidence that cerebellar, cortical and subcortical functions are correlated with consciousness. Neurostimulation evidence suggests that alterations in any part of the brain may provoke alterations in experience, but the most extreme changes are provoked via the subcortex. I then evaluate neuropsychological evidence and find abnormality in any part of the brain may provoke changes in experience; but only damage to the oldest regions seem to completely obliterate experience. Finally, I review congenital and experimental decorticate cases, and find that behavioral evidence of experience is largely compatible with the absence of the cortex. The evidence, taken together, indicates that the body, subcortex and environment are sufficient for behaviours that suggest bastic experiences. I then emphasise both the importance of the individual's developmental trajectory and the interdependencies between different neural systems.


title: An Innovative Tool for Uploading/Scraping Large Image Datasets on Social Networks

abstract: Nowadays, people can retrieve and share digital information in an increasingly easy and fast fashion through the well-known digital platforms, including sensitive data, inappropriate or illegal content, and, in general, information that might serve as probative evidence in court. Consequently, to assess forensics issues, we need to figure out how to trace back to the posting chain of a digital evidence (e.g., a picture, an audio) throughout the involved platforms -- this is what Digital (also Forensics) Ballistics basically deals with. With the entry of Machine Learning as a tool of the trade in many research areas, the need for vast amounts of data has been dramatically increasing over the last few years. However, collecting or simply find the "right" datasets that properly enables data-driven research studies can turn out to be not trivial in some cases, if not extremely challenging, especially when it comes with highly specialized tasks, such as creating datasets analyzed to detect the source media platform of a given digital media. In this paper we propose an automated approach by means of a digital tool that we created on purpose. The tool is capable of automatically uploading an entire image dataset to the desired digital platform and then downloading all the uploaded pictures, thus shortening the overall time required to output the final dataset to be analyzed.


title: Toward Ultra-Low-Power Remote Health Monitoring: An Optimal and Adaptive Compressed Sensing Framework for Activity Recognition

abstract: Activity recognition, as an important component of behavioral monitoring and intervention, has attracted enormous attention, especially in Mobile Cloud Computing (MCC) and Remote Health Monitoring (RHM) paradigms. While recently resource constrained wearable devices have been gaining popularity, their battery life is limited and constrained by the frequent wireless transmission of data to more computationally powerful back-ends. This paper proposes an ultra-low power activity recognition system using a novel adaptive compressed sensing technique that aims to minimize transmission costs. Coarse-grained on-body sensor localization and unsupervised clustering modules are devised to autonomously reconfigure the compressed sensing module for further power saving. We perform a thorough heuristic optimization using Grammatical Evolution (GE) to ensure minimal computation overhead of the proposed methodology. Our evaluation on a real-world dataset and a low power wearable sensing node demonstrates that our approach can reduce the energy consumption of the wireless data transmission up to $81.2\%$ and $61.5\%$, with up to $60.6\%$ and $35.0\%$ overall power savings in comparison with baseline and a naive state-of-the-art approaches, respectively. These solutions lead to an average activity recognition accuracy of $89.0\%$ -- only $4.8\%$ less than the baseline accuracy -- while having a negligible energy overhead of on-node computation.


title: On the impossibility of using analogue machines to calculate non-computable functions

abstract: A number of examples have been given of physical systems (both classical and quantum mechanical) which when provided with a (continuously variable) computable input will give a non-computable output. It has been suggested that these systems might allow one to design analogue machines which would calculate the values of some number-theoretic non-computable function. Analysis of the examples show that the suggestion is wrong. In Section 4 I claim that given a reasonable definition of analogue machine it will always be wrong. The claim is to be read not so much as a dogmatic assertion, but rather as a challenge. In Sections 1 and 2 I discuss analogue machines, and lay down some conditions which I believe they must satisfy. In Section I discuss the particular forms which a paradigm undecidable problem (or non-computable function) may take. In Sections 5 and 6 I justify any claim for two particular examples lying within the range of classical physics, and in Section 7 I justify it for two (closely connected) examples from quantum mechanics, and discuss, very briefly, other possible quantum mechanical situations. Section 8 contains various remarks and comments. In Section 9 I consider the suggestion made by Penrose that a (future) theory of quantum gravity may predict non-locally-determined, and perhaps non-computable patterns of growth for microsopic structures. My conclusion is that such a theory will have to have non-computability built into it.


title: Devil in the Landscapes: Inferring Epidemic Exposure Risks from Street View Imagery

abstract: Built environment supports all the daily activities and shapes our health. Leveraging informative street view imagery, previous research has established the profound correlation between the built environment and chronic, non-communicable diseases; however, predicting the exposure risk of infectious diseases remains largely unexplored. The person-to-person contacts and interactions contribute to the complexity of infectious disease, which is inherently different from non-communicable diseases. Besides, the complex relationships between street view imagery and epidemic exposure also hinder accurate predictions. To address these problems, we construct a regional mobility graph informed by the gravity model, based on which we propose a transmission-aware graph convolutional network (GCN) to capture disease transmission patterns arising from human mobility. Experiments show that the proposed model significantly outperforms baseline models by 8.54% in weighted F1, shedding light on a low-cost, scalable approach to assess epidemic exposure risks from street view imagery.


title: Chain of Images for Intuitively Reasoning

abstract: The human brain is naturally equipped to comprehend and interpret visual information rapidly. When confronted with complex problems or concepts, we use flowcharts, sketches, and diagrams to aid our thought process. Leveraging this inherent ability can significantly enhance logical reasoning. However, current Large Language Models (LLMs) do not utilize such visual intuition to help their thinking. Even the most advanced version language models (e.g., GPT-4V and LLaVA) merely align images into textual space, which means their reasoning processes remain purely verbal. To mitigate such limitations, we present a Chain of Images (CoI) approach, which can convert complex language reasoning problems to simple pattern recognition by generating a series of images as intermediate representations. Furthermore, we have developed a CoI evaluation dataset encompassing 15 distinct domains where images can intuitively aid problem-solving. Based on this dataset, we aim to construct a benchmark to assess the capability of future multimodal large-scale models to leverage images for reasoning. In supporting our CoI reasoning, we introduce a symbolic multimodal large language model (SyMLLM) that generates images strictly based on language instructions and accepts both text and image as input. Experiments on Geometry, Chess and Common Sense tasks sourced from the CoI evaluation dataset show that CoI improves performance significantly over the pure-language Chain of Thoughts (CoT) baselines. The code is available at https://github.com/GraphPKU/CoI.


title: Mapping Eye Vergence Angle to the Depth of Real and Virtual Objects as an Objective Measure of Depth Perception

abstract: Recently, extended reality (XR) displays including augmented reality (AR) and virtual reality (VR) have integrated eye tracking capabilities, which could enable novel ways of interacting with XR content. The vergence angle of the eyes constantly changes according to the distance of fixated objects. Here we measured vergence angle for eye fixations on real and simulated target objects in three different environments: real objects in the real-world (real), virtual objects in the real-world (AR), and virtual objects in the virtual world (VR) using gaze data from an eye-tracking device. In a repeated-measures design with 13 participants, Gaze-measured Vergence Angle (GVA) was measured while participants fixated on targets at varying distances. As expected, results showed a significant main effect of target depth such that increasing GVA was associated with closer targets. However, there were consistent individual differences in baseline GVA. When these individual differences were controlled for, there was a small but statistically-significant main effect of environment (real, AR, VR). Importantly, GVA was stable with respect to the starting depth of previously fixated targets and invariant to directionality (convergence vs. divergence). In addition, GVA proved to be a more veridical depth estimate than subjective depth judgements.


title: Evaluating the Efficacy of Interactive Language Therapy Based on LLM for High-Functioning Autistic Adolescent Psychological Counseling

abstract: This study investigates the efficacy of Large Language Models (LLMs) in interactive language therapy for high-functioning autistic adolescents. With the rapid advancement of artificial intelligence, particularly in natural language processing, LLMs present a novel opportunity to augment traditional psychological counseling methods. This research primarily focuses on evaluating the LLM's ability to engage in empathetic, adaptable, and contextually appropriate interactions within a therapeutic setting. A comprehensive evaluation was conducted by a panel of clinical psychologists and psychiatrists using a specially developed scorecard. The assessment covered various aspects of the LLM's performance, including empathy, communication skills, adaptability, engagement, and the ability to establish a therapeutic alliance. The study avoided direct testing with patients, prioritizing privacy and ethical considerations, and instead relied on simulated scenarios to gauge the LLM's effectiveness. The results indicate that LLMs hold significant promise as supportive tools in therapy, demonstrating strengths in empathetic engagement and adaptability in conversation. However, challenges in achieving the depth of personalization and emotional understanding characteristic of human therapists were noted. The study also highlights the importance of ethical considerations in the application of AI in therapeutic contexts. This research provides valuable insights into the potential and limitations of using LLMs in psychological counseling for autistic adolescents. It lays the groundwork for future explorations into AI's role in mental health care, emphasizing the need for ongoing development to enhance the capabilities of these models in therapeutic settings.


title: Quality Evaluation of Projection-Based VR Displays

abstract: We present a collection of heuristics and simple tests for evaluating the quality of a projection-based virtual reality display. A typical VR system includes numerous potential sources of error. By understanding the characteristics of a correctly working system, and the types of errors that are likely to occur, users can quickly determine if their display is inaccurate and what components may need correction.


title: Affine Invariance in Continuous-Domain Convolutional Neural Networks

abstract: The notion of group invariance helps neural networks in recognizing patterns and features under geometric transformations. Indeed, it has been shown that group invariance can largely improve deep learning performances in practice, where such transformations are very common. This research studies affine invariance on continuous-domain convolutional neural networks. Despite other research considering isometric invariance or similarity invariance, we focus on the full structure of affine transforms generated by the generalized linear group $\mathrm{GL}_2(\mathbb{R})$. We introduce a new criterion to assess the similarity of two input signals under affine transformations. Then, unlike conventional methods that involve solving complex optimization problems on the Lie group $G_2$, we analyze the convolution of lifted signals and compute the corresponding integration over $G_2$. In sum, our research could eventually extend the scope of geometrical transformations that practical deep-learning pipelines can handle.


title: Smell of Fire Increases Behavioural Realism in Virtual Reality: A Case Study on a Recreated MGM Grand Hotel Fire

abstract: Virtual reality allows creating highly immersive visual and auditory experiences, making users feel physically present in the environment. This makes it an ideal platform to simulate dangerous scenarios, including fire evacuation, and study human behaviour without exposing users to harmful elements. However, human perception of the surroundings is based on the integration of multiple sensory cues (visual, auditory, tactile, or/and olfactory) present in the environment. When some of the sensory stimuli are missing in the virtual experience, it can break the illusion of being there in the environment and could lead to actions that deviate from normal behaviour. In this work, we added an olfactory cue in a well-documented historic hotel fire scenario that was recreated in VR, and examined the effects of the olfactory cue on human behaviour. We conducted a between subject study on 40 naive participants. Our results show that the addition of the olfactory cue could increase behavioural realism. We found that 80% of the studied actions for the VR with olfactory cue condition matched the ones performed by the survivors. In comparison, only 40% of the participants' actions for VR only condition were similar to the survivors.


title: Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks

abstract: We explore the abstract reasoning abilities of text-only and multimodal versions of GPT-4, using the ConceptARC benchmark [10], which is designed to evaluate robust understanding and reasoning with core-knowledge concepts. We extend the work of Moskvichev et al. [10] by evaluating GPT-4 on more detailed, one-shot prompting (rather than simple, zero-shot prompts) with text versions of ConceptARC tasks, and by evaluating GPT-4V, the multimodal version of GPT-4, on zero- and one-shot prompts using image versions of the simplest tasks. Our experimental results support the conclusion that neither version of GPT-4 has developed robust abstraction abilities at humanlike levels.


title: Smart Home Goal Feature Model -- A guide to support Smart Homes for Ageing in Place

abstract: Smart technologies are significant in supporting ageing in place for elderly. Leveraging Artificial Intelligence (AI) and Machine Learning (ML), it provides peace of mind, enabling the elderly to continue living independently. Elderly use smart technologies for entertainment and social interactions, this can be extended to provide safety and monitor health and environmental conditions, detect emergencies and notify informal and formal caregivers when care is needed. This paper provides an overview of the smart home technologies commercially available to support ageing in place, the advantages and challenges of smart home technologies, and their usability from elderlys perspective. Synthesizing prior knowledge, we created a structured Smart Home Goal Feature Model (SHGFM) to resolve heuristic approaches used by the Subject Matter Experts (SMEs) at aged care facilities and healthcare researchers in adapting smart homes. The SHGFM provides SMEs the ability to (i) establish goals and (ii) identify features to set up strategies to design, develop and deploy smart homes for the elderly based on personalised needs. Our model provides guidance to healthcare researchers and aged care industries to set up smart homes based on the needs of elderly, by defining a set of goals at different levels mapped to a different set of features.


title: The number of fundamental constants from a spacetime-based perspective

abstract: We revisit Duff, Okun, and Veneziano's divergent views on the number of fundamental constants and argue that the issue can be set to rest by having spacetime as the starting point. This procedure disentangles the resolution in what depends on the assumed spacetime (whether relativistic or not) from the theories built over it. By defining that the number of fundamental constants equals the minimal number of independent standards necessary to express all observables, as assumed by Duff, Okun, and Veneziano, it is shown that the same units fixed by the apparatuses used to construct the spacetimes are enough to express all observables of the physical laws defined over them. As a result, the number of fundamental constants equals two in Galilei spacetime and one in relativistic spacetimes.


title: Local structure of theta divisors and related loci of generic curves

abstract: For a generic compact Riemann surface the theta function is at every point on the Jacobian equal to its first Taylor term, up to a holomorphic change of local coordinates and multiplication by a local holomorphic unit. More generally, any Brill-Noether locus of twisted stable vector bundles on a smooth projective curve is at every point L locally \'etale isomorphic with its tangent cone if the Petri map at L is injective. This assumption has various consequences for Brill-Noether loci: positive answers to the monodromy conjecture for generalized theta divisors and to questions of Schnell-Yang on log resolutions and Whitney stratifications, and formulas for local b-functions, log canonical thresholds, topological zeta functions, and minimal discrepancies.


title: A Simple and Powerful Framework for Stable Dynamic Network Embedding

abstract: In this paper, we address the problem of dynamic network embedding, that is, representing the nodes of a dynamic network as evolving vectors within a low-dimensional space. While the field of static network embedding is wide and established, the field of dynamic network embedding is comparatively in its infancy. We propose that a wide class of established static network embedding methods can be used to produce interpretable and powerful dynamic network embeddings when they are applied to the dilated unfolded adjacency matrix. We provide a theoretical guarantee that, regardless of embedding dimension, these unfolded methods will produce stable embeddings, meaning that nodes with identical latent behaviour will be exchangeable, regardless of their position in time or space. We additionally define a hypothesis testing framework which can be used to evaluate the quality of a dynamic network embedding by testing for planted structure in simulated networks. Using this, we demonstrate that, even in trivial cases, unstable methods are often either conservative or encode incorrect structure. In contrast, we demonstrate that our suite of stable unfolded methods are not only more interpretable but also more powerful in comparison to their unstable counterparts.


title: In the Red(dit): Social Media and Stock Prices

abstract: Spearheaded by retail traders on the website reddit, the GameStop short squeeze of early 2021 shows that social media embeds information that correlates with market movements. This paper seeks to examine this relationship by using daily frequencies of classified comments and buzzwords as additional factors in a Fama-French three factor model. Comments are classified using an unsupervised clustering method, while past studies have used pretrained models that are not specific to the domains being studied.


title: The Perception-Robustness Tradeoff in Deterministic Image Restoration

abstract: We study the behavior of deterministic methods for solving inverse problems in imaging. These methods are commonly designed to achieve two goals: (1) attaining high perceptual quality, and (2) generating reconstructions that are consistent with the measurements. We provide a rigorous proof that the better a predictor satisfies these two requirements, the larger its Lipschitz constant must be, regardless of the nature of the degradation involved. In particular, to approach perfect perceptual quality and perfect consistency, the Lipschitz constant of the model must grow to infinity. This implies that such methods are necessarily more susceptible to adversarial attacks. We demonstrate our theory on single image super-resolution algorithms, addressing both noisy and noiseless settings. We also show how this undesired behavior can be leveraged to explore the posterior distribution, thereby allowing the deterministic model to imitate stochastic methods.


title: A Bayesian Agent-Based Framework for Argument Exchange Across Networks

abstract: In this paper, we introduce a new framework for modelling the exchange of multiple arguments across agents in a social network. To date, most modelling work concerned with opinion dynamics, testimony, or communication across social networks has involved only the simulated exchange of a single opinion or single claim. By contrast, real-world debate involves the provision of numerous individual arguments relevant to such an opinion. This may include arguments both for and against, and arguments varying in strength. This prompts the need for appropriate aggregation rules for combining diverse evidence as well as rules for communication. Here, we draw on the Bayesian framework to create an agent-based modelling environment that allows the study of belief dynamics across complex domains characterised by Bayesian Networks. Initial case studies illustrate the scope of the framework.


title: Artificial intelligence and the skill premium

abstract: What will likely be the effect of the emergence of ChatGPT and other forms of artificial intelligence (AI) on the skill premium? To address this question, we develop a nested constant elasticity of substitution production function that distinguishes between industrial robots and AI. Industrial robots predominantly substitute for low-skill workers, whereas AI mainly helps to perform the tasks of high-skill workers. We show that AI reduces the skill premium as long as it is more substitutable for high-skill workers than low-skill workers are for high-skill workers.


title: Reading Between the Mud: A Challenging Motorcycle Racer Number Dataset

abstract: This paper introduces the off-road motorcycle Racer number Dataset (RnD), a new challenging dataset for optical character recognition (OCR) research. RnD contains 2,411 images from professional motorsports photographers that depict motorcycle racers in off-road competitions. The images exhibit a wide variety of factors that make OCR difficult, including mud occlusions, motion blur, non-standard fonts, glare, complex backgrounds, etc. The dataset has 5,578 manually annotated bounding boxes around visible motorcycle numbers, along with transcribed digits and letters. Our experiments benchmark leading OCR algorithms and reveal an end-to-end F1 score of only 0.527 on RnD, even after fine-tuning. Analysis of performance on different occlusion types shows mud as the primary challenge, degrading accuracy substantially compared to normal conditions. But the models struggle with other factors including glare, blur, shadows, and dust. Analysis exposes substantial room for improvement and highlights failure cases of existing models. RnD represents a valuable new benchmark to drive innovation in real-world OCR capabilities. The authors hope the community will build upon this dataset and baseline experiments to make progress on the open problem of robustly recognizing text in unconstrained natural environments. The dataset is available at https://github.com/JacobTyo/SwinTextSpotter.


title: UFOGen: You Forward Once Large Scale Text-to-Image Generation via Diffusion GANs

abstract: Text-to-image diffusion models have demonstrated remarkable capabilities in transforming textual prompts into coherent images, yet the computational cost of their inference remains a persistent challenge. To address this issue, we present UFOGen, a novel generative model designed for ultra-fast, one-step text-to-image synthesis. In contrast to conventional approaches that focus on improving samplers or employing distillation techniques for diffusion models, UFOGen adopts a hybrid methodology, integrating diffusion models with a GAN objective. Leveraging a newly introduced diffusion-GAN objective and initialization with pre-trained diffusion models, UFOGen excels in efficiently generating high-quality images conditioned on textual descriptions in a single step. Beyond traditional text-to-image generation, UFOGen showcases versatility in applications. Notably, UFOGen stands among the pioneering models enabling one-step text-to-image generation and diverse downstream tasks, presenting a significant advancement in the landscape of efficient generative models.


title: Single-Chip Silicon Photonic Processor for Analog Optical and Microwave Signals

abstract: The explosion of data volume in communications, AI training, and cloud computing requires efficient data handling, which is typically stored as digital electrical information and transmitted as wireless radio frequency (RF) signals or light waves in optical fibres. Today's communications systems mostly treat the RF and optical signals separately, which results in unnecessary conversion losses and increased cost. In this work, we report the first fully on-chip signal processor for high-speed RF and optical signals based on a silicon photonic circuit. Our chip is capable of both generation and detection of analog electrical and optical signals, and can program a user-defined filter response in both domains. The single silicon photonic chip integrates all essential components like modulators, optical filters, and photodetectors, as well as tunable lasers enabled by transfer-printed Indium Phosphide (InP) optical amplifiers. The system's configuration is locally programmed through thermo-optic phase shifters and monitored by photodetectors. We demonstrate our chip's capabilities with different combinations of RF and optical signal processing functions, including optical and RF signal generation and filtering. This represents a key step towards compact microwave photonic systems for future wireless communication and sensing applications.


title: ChemDuino Calorimetry to Determine the Enthalpy Change of Neutralization of an Acid_Base Reaction: Making a Familiar Experiment Greener

abstract: In thermochemistry experiments, a large volume and relatively high concentration of chemicals are often used to get a significant temperature change using an analogue thermometer. A greener experimental protocol is developed as an alternative using modern microcontroller boards, ChemDuino. The aim of this research is to develop a low cost and pocket sized prototype for measuring temperature of solutions using Arduino Uno and sensor based on green chemistry and Do It Yourself methods. The construction of ChemDuino for temperature sensing is made in the simplest manner for individuals with little knowledge of electronics. The details of all components are stipulated in this paper. This research was conducted in three phases, which includes preliminary, prototype development, and assessment phase. The device is used to determine the enthalpy change of neutralization of NaOH and HCl solution. The enthalpy change of neutralization, kJ/mol at 25.0 {\deg}C from literature is -57.13 kJ/mol, whereas the enthalpy change of neutralization, kJ/mol at 25.0 {\deg}C from the experiment using ChemDuino Calorimetry is -56.87 kJ/mol with the estimated standard deviation of 1.9. The device has successfully measured the temperature change of the reaction at a relatively lower concentration. ChemDuino Calorimetry has a great potential, because of its reliability and accuracy in measurements, inexpensive setup, and interconnectivity.


title: A Proposed Artificial Neural Network based Approach for Molecules Bitter Prediction

abstract: In recent years, the development of Artificial Intelligence (AI) has offered the possibility to tackle many interdisciplinary problems, and the field of chemistry is not an exception. Drug analysis is crucial in drug discovery, playing an important role in human life. However, this task encounters many difficulties due to the wide range of computational chemistry methods. Drug analysis also involves a massive amount of work, including determining taste. Thus, applying deep learning to predict a molecule's bitterness is inevitable to accelerate innovation in drug analysis by reducing the time spent. This paper proposes an artificial neural network (ANN) based approach (EC-ANN) for the molecule's bitter prediction. Our approach took the SMILE (Simplified molecular-input line-entry system) string of a molecule as the input data for the prediction, and the 256-bit ECFP descriptor is the input vector for our network. It showed impressive results compared to state-of-the-art, with a higher performance on two out of three test sets according to the experiences on three popular test sets: Phyto-Dictionary, Unimi, and Bitter-new set [1]. For the Phyto-Dictionary test set, our model recorded 0.95 and 0.983 in F1-score and AUPR, respectively, depicted as the highest score in F1-score. For the Unimi test set, our model achieved 0.88 in F1-score and 0.88 in AUPR, which is roughly 12.3% higher than the peak of previous models [1, 2, 3, 4, 5].


title: Emerging Drug Interaction Prediction Enabled by Flow-based Graph Neural Network with Biomedical Network

abstract: Accurately predicting drug-drug interactions (DDI) for emerging drugs, which offer possibilities for treating and alleviating diseases, with computational methods can improve patient care and contribute to efficient drug development. However, many existing computational methods require large amounts of known DDI information, which is scarce for emerging drugs. In this paper, we propose EmerGNN, a graph neural network (GNN) that can effectively predict interactions for emerging drugs by leveraging the rich information in biomedical networks. EmerGNN learns pairwise representations of drugs by extracting the paths between drug pairs, propagating information from one drug to the other, and incorporating the relevant biomedical concepts on the paths. The different edges on the biomedical network are weighted to indicate the relevance for the target DDI prediction. Overall, EmerGNN has higher accuracy than existing approaches in predicting interactions for emerging drugs and can identify the most relevant information on the biomedical network.


title: Disentangling the Potential Impacts of Papers into Diffusion, Conformity, and Contribution Values

abstract: The potential impact of an academic paper is determined by various factors, including its popularity and contribution. Existing models usually estimate original citation counts based on static graphs and fail to differentiate values from nuanced perspectives. In this study, we propose a novel graph neural network to Disentangle the Potential impacts of Papers into Diffusion, Conformity, and Contribution values (called DPPDCC). Given a target paper, DPPDCC encodes temporal and structural features within the constructed dynamic heterogeneous graph. Particularly, to capture the knowledge flow, we emphasize the importance of comparative and co-cited/citing information between papers and aggregate snapshots evolutionarily. To unravel popularity, we contrast augmented graphs to extract the essence of diffusion and predict the accumulated citation binning to model conformity. We further apply orthogonal constraints to encourage distinct modeling of each perspective and preserve the inherent value of contribution. To evaluate models' generalization for papers published at various times, we reformulate the problem by partitioning data based on specific time points to mirror real-world conditions. Extensive experimental results on three datasets demonstrate that DPPDCC significantly outperforms baselines for previously, freshly, and immediately published papers. Further analyses confirm its robust capabilities. We will make our datasets and codes publicly available.


title: Auto-ICL: In-Context Learning without Human Supervision

abstract: With in-context learning ability, the performance of large language models can be significantly boosted when provided with appropriate context. However, existing in-context learning methods mainly rely on human-provided contexts, such as labeled examples and explicit instructions. Writing context by humans is labor-intensive on various tasks and limits the model to tasks manageable by humans. To overcome these limitations, we propose Automatic In-Context Learning framework that enables the model to autonomously generate examples and instructions for problem-solving. With experiments across various models and datasets, results show that model-generated contexts outperform human-annotated contexts, including Few-Shot and Few-Shot-CoT methods, and surpass existing self-generated context methods like Zero-CoT and Auto-CoT.


title: Cross-domain feature disentanglement for interpretable modeling of tumor microenvironment impact on drug response

abstract: High-throughput screening technology has facilitated the generation of large-scale drug responses across hundreds of cancer cell lines. However, there exists significant discrepancy between in vitro cell lines and actual tumors in vivo in terms of their response to drug treatments, because of tumors comprise of complex cellular compositions and histopathology structure, known as tumor microenvironment (TME), which greatly influences the drug cytotoxicity against tumor cells. To date, no study has focused on modeling the impact of the TME on clinical drug response. This paper proposed a domain adaptation network for feature disentanglement to separate representations of cancer cells and TME of a tumor in patients. Two denoising autoencoders were separately used to extract features from cell lines (source domain) and tumors (target domain) for partial domain alignment and feature decoupling. The specific encoder was enforced to extract information only about TME. Moreover, to ensure generalizability to novel drugs, we applied a graph attention network to learn the latent representation of drugs, allowing us to linearly model the drug perturbation on cellular state in latent space. We calibrated our model on a benchmark dataset and demonstrated its superior performance in predicting clinical drug response and dissecting the influence of the TME on drug efficacy.


title: FastBlend: a Powerful Model-Free Toolkit Making Video Stylization Easier

abstract: With the emergence of diffusion models and rapid development in image processing, it has become effortless to generate fancy images in tasks such as style transfer and image editing. However, these impressive image processing approaches face consistency issues in video processing. In this paper, we propose a powerful model-free toolkit called FastBlend to address the consistency problem for video processing. Based on a patch matching algorithm, we design two inference modes, including blending and interpolation. In the blending mode, FastBlend eliminates video flicker by blending the frames within a sliding window. Moreover, we optimize both computational efficiency and video quality according to different application scenarios. In the interpolation mode, given one or more keyframes rendered by diffusion models, FastBlend can render the whole video. Since FastBlend does not modify the generation process of diffusion models, it exhibits excellent compatibility. Extensive experiments have demonstrated the effectiveness of FastBlend. In the blending mode, FastBlend outperforms existing methods for video deflickering and video synthesis. In the interpolation mode, FastBlend surpasses video interpolation and model-based video processing approaches. The source codes have been released on GitHub.


title: Adversarially Robust Spiking Neural Networks Through Conversion

abstract: Spiking neural networks (SNNs) provide an energy-efficient alternative to a variety of artificial neural network (ANN) based AI applications. As the progress in neuromorphic computing with SNNs expands their use in applications, the problem of adversarial robustness of SNNs becomes more pronounced. To the contrary of the widely explored end-to-end adversarial training based solutions, we address the limited progress in scalable robust SNN training methods by proposing an adversarially robust ANN-to-SNN conversion algorithm. Our method provides an efficient approach to embrace various computationally demanding robust learning objectives that have been proposed for ANNs. During a post-conversion robust finetuning phase, our method adversarially optimizes both layer-wise firing thresholds and synaptic connectivity weights of the SNN to maintain transferred robustness gains from the pre-trained ANN. We perform experimental evaluations in a novel setting proposed to rigorously assess the robustness of SNNs, where numerous adaptive adversarial attacks that account for the spike-based operation dynamics are considered. Results show that our approach yields a scalable state-of-the-art solution for adversarially robust deep SNNs with low-latency.


title: Neuroscience inspired scientific machine learning (Part-1): Variable spiking neuron for regression

abstract: Redundant information transfer in a neural network can increase the complexity of the deep learning model, thus increasing its power consumption. We introduce in this paper a novel spiking neuron, termed Variable Spiking Neuron (VSN), which can reduce the redundant firing using lessons from biological neuron inspired Leaky Integrate and Fire Spiking Neurons (LIF-SN). The proposed VSN blends LIF-SN and artificial neurons. It garners the advantage of intermittent firing from the LIF-SN and utilizes the advantage of continuous activation from the artificial neuron. This property of the proposed VSN makes it suitable for regression tasks, which is a weak point for the vanilla spiking neurons, all while keeping the energy budget low. The proposed VSN is tested against both classification and regression tasks. The results produced advocate favorably towards the efficacy of the proposed spiking neuron, particularly for regression tasks.


title: Logical Characterization of Contextual Hidden-Variable Theories based on Quantum Set Theory

abstract: While non-contextual hidden-variable theories are proved to be impossible, contextual ones are possible. In a contextual hidden-variable theory, an observable is called a beable if the hidden-variable assigns its value in a given measurement context specified by a state and a preferred observable. Halvorson and Clifton characterized the algebraic structure of beables as a von Neumann subalgebra, called a beable subalgebra, of the full observable algebra such that the probability distribution of every observable affiliated therewith admits the ignorance interpretation. On the other hand, we have shown that for every von Neumann algebra there is a unique set theoretical universe such that the internal "real numbers" bijectively correspond to the observables affiliated with the given von Neumann algebra. Here, we show that a set theoretical universe is associated with a beable subalgebra if and only if it is ZFC-satisfiable, namely, every theorem of ZFC set theory holds with probability equal to unity. Moreover, we show that there is a unique maximal ZFC-satisfiable subuniverse "implicitly definable", in the sense of Malament and others, by the given measurement context. The set theoretical language for the ZFC-satisfiable universe, characterized by the present work, rigorously reconstructs Bohr's notion of the "classical language" to describe the beables in a given measurement context.


title: NormNet: Scale Normalization for 6D Pose Estimation in Stacked Scenarios

abstract: Existing Object Pose Estimation (OPE) methods for stacked scenarios are not robust to changes in object scale. This paper proposes a new 6DoF OPE network (NormNet) for different scale objects in stacked scenarios. Specifically, each object's scale is first learned with point-wise regression. Then, all objects in the stacked scenario are normalized into the same scale through semantic segmentation and affine transformation. Finally, they are fed into a shared pose estimator to recover their 6D poses. In addition, we introduce a new Sim-to-Real transfer pipeline, combining style transfer and domain randomization. This improves the NormNet's performance on real data even if we only train it on synthetic data. Extensive experiments demonstrate that the proposed method achieves state-of-the-art performance on public benchmarks and the MultiScale dataset we constructed. The real-world experiments show that our method can robustly estimate the 6D pose of objects at different scales.


title: FedCode: Communication-Efficient Federated Learning via Transferring Codebooks

abstract: Federated Learning (FL) is a distributed machine learning paradigm that enables learning models from decentralized local data. While FL offers appealing properties for clients' data privacy, it imposes high communication burdens for exchanging model weights between a server and the clients. Existing approaches rely on model compression techniques, such as pruning and weight clustering to tackle this. However, transmitting the entire set of weight updates at each federated round, even in a compressed format, limits the potential for a substantial reduction in communication volume. We propose FedCode where clients transmit only codebooks, i.e., the cluster centers of updated model weight values. To ensure a smooth learning curve and proper calibration of clusters between the server and the clients, FedCode periodically transfers model weights after multiple rounds of solely communicating codebooks. This results in a significant reduction in communication volume between clients and the server in both directions, without imposing significant computational overhead on the clients or leading to major performance degradation of the models. We evaluate the effectiveness of FedCode using various publicly available datasets with ResNet-20 and MobileNet backbone model architectures. Our evaluations demonstrate a 12.2-fold data transmission reduction on average while maintaining a comparable model performance with an average accuracy loss of 1.3% compared to FedAvg. Further validation of FedCode performance under non-IID data distributions showcased an average accuracy loss of 2.0% compared to FedAvg while achieving approximately a 12.7-fold data transmission reduction.


title: An Empathetic User-Centric Chatbot for Emotional Support

abstract: This paper explores the intersection of Otome Culture and artificial intelligence, particularly focusing on how Otome-oriented games fulfill the emotional needs of young women. These games, which are deeply rooted in a subcultural understanding of love, provide players with feelings of satisfaction, companionship, and protection through carefully crafted narrative structures and character development. With the proliferation of Large Language Models (LLMs), there is an opportunity to transcend traditional static game narratives and create dynamic, emotionally responsive interactions. We present a case study of Tears of Themis, where we have integrated LLM technology to enhance the interactive experience. Our approach involves augmenting existing game narratives with a Question and Answer (QA) system, enriched through data augmentation and emotional enhancement techniques, resulting in a chatbot that offers realistic and supportive companionship.


title: Linear time Evidence Accumulation Clustering with KMeans

abstract: Among ensemble clustering methods, Evidence Accumulation Clustering is one of the simplest technics. In this approach, a co-association (CA) matrix representing the co-clustering frequency is built and then clustered to extract consensus clusters. Compared to other approaches, this one is simple as there is no need to find matches between clusters obtained from two different partitionings. Nevertheless, this method suffers from computational issues, as it requires to compute and store a matrix of size n x n, where n is the number of items. Due to the quadratic cost, this approach is reserved for small datasets. This work describes a trick which mimic the behavior of average linkage clustering. We found a way of computing efficiently the density of a partitioning, reducing the cost from a quadratic to linear complexity. Additionally, we proved that the k-means maximizes naturally the density. We performed experiments on several benchmark datasets where we compared the k-means and the bisecting version to other state-of-the-art consensus algorithms. The k-means results are comparable to the best state of the art in terms of NMI while keeping the computational cost low. Additionally, the k-means led to the best results in terms of density. These results provide evidence that consensus clustering can be solved with simple algorithms.


title: In-vehicle Sensing and Data Analysis for Older Drivers with Mild Cognitive Impairment

abstract: Driving is a complex daily activity indicating age and disease related cognitive declines. Therefore, deficits in driving performance compared with ones without mild cognitive impairment (MCI) can reflect changes in cognitive functioning. There is increasing evidence that unobtrusive monitoring of older adults driving performance in a daily-life setting may allow us to detect subtle early changes in cognition. The objectives of this paper include designing low-cost in-vehicle sensing hardware capable of obtaining high-precision positioning and telematics data, identifying important indicators for early changes in cognition, and detecting early-warning signs of cognitive impairment in a truly normal, day-to-day driving condition with machine learning approaches. Our statistical analysis comparing drivers with MCI to those without reveals that those with MCI exhibit smoother and safer driving patterns. This suggests that drivers with MCI are cognizant of their condition and tend to avoid erratic driving behaviors. Furthermore, our Random Forest models identified the number of night trips, number of trips, and education as the most influential factors in our data evaluation.


title: Constructing interpretable principal curve using Neural ODEs

abstract: The study of high dimensional data sets often rely on their low dimensional projections that preserve the local geometry of the original space. While numerous methods have been developed to summarize this space as variations of tree-like structures, they are usually non-parametric and "static" in nature. As data may come from systems that are dynamical such as a differentiating cell, a static, non-parametric characterization of the space may not be the most appropriate. Here, we developed a framework, the principal flow, that is capable of characterizing the space in a dynamical manner. The principal flow, defined using neural ODEs, directs motion of a particle through the space, where the trajectory of the particle resembles the principal curve of the dataset. We illustrate that our framework can be used to characterize shapes of various complexities, and is flexible to incorporate summaries of relaxation dynamics.


title: Improved Sparse Ising Optimization

abstract: Sparse Ising problems can be found in application areas such as logistics, condensed matter physics and training of deep Boltzmann networks, but can be very difficult to tackle with high efficiency and accuracy. This report presents new data demonstrating significantly higher performance on some longstanding benchmark problems with up to 20,000 variables. The data come from a new heuristic algorithm tested on the large sparse instances from the Gset benchmark suite. Relative to leading reported combinations of speed and accuracy (e.g., from Toshiba's Simulated Bifurcation Machine and Breakout Local Search), a proof-of-concept implementation reached targets 2-4 orders of magnitude faster. For two instances (G72 and G77) the new algorithm discovered a better solution than all previously reported values. Solution bitstrings confirming these two best solutions are provided. The data suggest exciting possibilities for pushing the sparse Ising performance frontier to potentially strengthen algorithm portfolios, AI toolkits and decision-making systems.


title: Leveraging Citizen Science for Flood Extent Detection using Machine Learning Benchmark Dataset

abstract: Accurate detection of inundated water extents during flooding events is crucial in emergency response decisions and aids in recovery efforts. Satellite Remote Sensing data provides a global framework for detecting flooding extents. Specifically, Sentinel-1 C-Band Synthetic Aperture Radar (SAR) imagery has proven to be useful in detecting water bodies due to low backscatter of water features in both co-polarized and cross-polarized SAR imagery. However, increased backscatter can be observed in certain flooded regions such as presence of infrastructure and trees - rendering simple methods such as pixel intensity thresholding and time-series differencing inadequate. Machine Learning techniques has been leveraged to precisely capture flood extents in flooded areas with bumps in backscatter but needs high amounts of labelled data to work desirably. Hence, we created a labeled known water body extent and flooded area extents during known flooding events covering about 36,000 sq. kilometers of regions within mainland U.S and Bangladesh. Further, We also leveraged citizen science by open-sourcing the dataset and hosting an open competition based on the dataset to rapidly prototype flood extent detection using community generated models. In this paper we present the information about the dataset, the data processing pipeline, a baseline model and the details about the competition, along with discussion on winning approaches. We believe the dataset adds to already existing datasets based on Sentinel-1C SAR data and leads to more robust modeling of flood extents. We also hope the results from the competition pushes the research in flood extent detection further.


title: Contrastive Chain-of-Thought Prompting

abstract: Despite the success of chain of thought in enhancing language model reasoning, the underlying process remains less well understood. Although logically sound reasoning appears inherently crucial for chain of thought, prior studies surprisingly reveal minimal impact when using invalid demonstrations instead. Furthermore, the conventional chain of thought does not inform language models on what mistakes to avoid, which potentially leads to more errors. Hence, inspired by how humans can learn from both positive and negative examples, we propose contrastive chain of thought to enhance language model reasoning. Compared to the conventional chain of thought, our approach provides both valid and invalid reasoning demonstrations, to guide the model to reason step-by-step while reducing reasoning mistakes. To improve generalization, we introduce an automatic method to construct contrastive demonstrations. Our experiments on reasoning benchmarks demonstrate that contrastive chain of thought can serve as a general enhancement of chain-of-thought prompting.


title: Symbol-LLM: Towards Foundational Symbol-centric Interface For Large Language Models

abstract: Although Large Language Models (LLMs) demonstrate remarkable ability in processing and generating human-like text, they do have limitations when it comes to comprehending and expressing world knowledge that extends beyond the boundaries of natural language(e.g., chemical molecular formula). Injecting a collection of symbolic data directly into the training of LLMs can be problematic, as it disregards the synergies among different symbolic families and overlooks the need for a balanced mixture of natural and symbolic data. In this work, we tackle these challenges from both a data and framework perspective and introduce Symbol-LLM series models. First, we curated a data collection consisting of 34 tasks and incorporating approximately 20 distinct symbolic families, intending to capture the interrelations and foster synergies between symbols. Then, a two-stage tuning framework succeeds in injecting symbolic knowledge without loss of the generality ability. Extensive experiments on both symbol- and NL-centric tasks demonstrate the balanced and superior performances of Symbol-LLM series models. The project page is https://xufangzhi.github.io/symbol-llm-page/.


title: Polaronic mechanism of Nagaoka ferromagnetism in Hubbard models

abstract: The search for elusive Nagaoka-type ferromagnetism in the Hubbard model has recently enjoyed renewed attention with the advent of a variety of experimental platforms enabling its realization, including moir\'e materials, quantum dots, and ultracold atoms in optical lattices. Here, we demonstrate a universal mechanism for Nagaoka ferromagnetism (that applies to both bipartite and nonbipartite lattices) based on the formation of ferromagnetic polarons consisting of a dopant dressed with polarized spins. Using large-scale density-matrix renormalization group calculations, we present a comprehensive study of the ferromagnetic polaron in an electron-doped Hubbard model, establishing various polaronic properties such as its size and energetics. Moreover, we systematically probe the internal structure of the magnetic state$\unicode{x2014}$through the use of pinning fields and three-point spin-charge-spin correlation functions$\unicode{x2014}$for both the single-polaron limit and the high-density regime of interacting polarons. Our results highlight the crucial role of mobile polarons in the birth of global ferromagnetic order from local ferromagnetism and provide a unified framework to understand the development and demise of the Nagaoka-type ferromagnetic state across dopings.


title: Dwarf-Dwarf Interactions Can Both Trigger and Quench Star Formation

abstract: It is exceedingly rare to find quiescent low-mass galaxies in the field. UGC5205 is an example of such a quenched field dwarf ($M_\star\sim3\times10^8M_\odot$). Despite a wealth of cold gas ($M_{\rm HI}\sim 3.5 \times 10^8 M_\odot$) and GALEX emission that indicates significant star formation in the past few hundred Myr, there is no detection of H$\alpha$ emission -- star formation in the last $\sim 10$ Myr -- across the face of the galaxy. Meanwhile, the near equal-mass companion of UGC5205, PGC027864, is starbursting ($\rm EW_{\rm H\alpha}>1000$ Angstrom). In this work, we present new Karl G. Jansky Very Large Array (VLA) 21 cm line observations of UGC5205 that demonstrate that the lack of star formation is caused by an absence of HI in the main body of the galaxy. The HI of UGC5205 is highly disturbed; the bulk of the HI resides in several kpc-long tails, while the HI of PGC027864 is dominated by ordered rotation. We model the stellar populations of UGC5205 to show that, as indicated by the UV-H$\alpha$ emission, the galaxy underwent a coordinated quenching event $\sim\!100-300$ Myr ago. The asymmetry of outcomes for UGC5205 and PGC027864 demonstrate that major mergers can both quench and trigger star formation in dwarfs. However, because the gas remains bound to the system, we suggest that such mergers only temporarily quench star formation. We estimate a total quenched time of $\sim 560$ Myr for UGC5205, consistent with established upper limits on the quenched fraction of a few percent for dwarfs in the field.


title: Gravitational-wave constraints on scalar-tensor gravity from a neutron star and black-hole binary GW200115

abstract: In nonminimally coupled theories where a scalar field is coupled to the Ricci scalar, neutron stars (NSs) can have scalar charges through an interaction with matter mediated by gravity. On the other hand, the same theories do not give rise to hairy black hole (BH) solutions. The observations of gravitational waves (GWs) emitted from an inspiralling NS-BH binary system allows a possibility of constraining the NS scalar charge. Moreover, the nonminimally coupled scalar-tensor theories generate a breathing scalar mode besides two tensor polarizations. Using the GW200115 data of the coalescence of a BH-NS binary, we place observational constraints on the NS scalar charge as well as the nonminimal coupling strength for a subclass of massless Horndeski theories with a luminal GW propagation. Unlike past related works, we exploit a waveform for a mixture of tensor and scalar polarizations. Taking the breathing mode into account, the scalar charge is more tightly constrained in comparison to the analysis of the tensor GWs alone. In nonminimally coupled theories including Brans-Dicke gravity and spontaneous scalarization scenarios with/without a kinetic screening, we put new bounds on model parameters of each theory.


title: Neutrino Mass and Mixing with Modular Symmetry

abstract: This is a review article about neutrino mass and mixing and flavour model building strategies based on modular symmetry. After an introduction to neutrino mass and lepton mixing, we then turn to the main subject of this review, namely a pedagogical introduction to modular symmetry as a candidate for family symmetry, from the bottom-up point of view. After an informal introduction to modular symmetry, we introduce the modular group, and discuss its fixed points and residual symmetry, assuming supersymmetry throughout. We then introduce finite modular groups of level $N$ and modular forms with integer or rational modular weights, corresponding to simple geometric groups or their double or metaplectic covers, including the most general finite modular groups and vector-valued modular forms, with detailed results for $N=2, 3, 4, 5$. The interplay between modular symmetry and generalized CP symmetry is discussed, deriving CP transformations on matter multiplets and modular forms, highlighting the CP fixed points and their implications. In general, compactification of extra dimensions generally leads to a number of moduli, and modular invariance with factorizable and non-factorizable multiple moduli based on symplectic modular invariance and automorphic forms is reviewed. Modular strategies for understanding fermion mass hierarchies are discussed, including the weighton mechanism, small deviations from fixed points, and texture zeroes. Then examples of modular models are discussed based on single modulus $A_4$ models, a minimal $S'_4$ model of leptons (and quarks), and a multiple moduli model based on three $S_4$ groups capable of reproducing the Littlest Seesaw model. We then extend the discussion to include Grand Unified Theories (GUTs) based on modular (flipped) $SU(5)$ and $SO(10)$. Finally we discuss top-down approaches, including eclectic flavour symmetry and moduli stabilisation.


title: Extremal Higgs couplings

abstract: We critically assess to what extent it makes sense to bound the Wilson coefficients of dimension-six operators. In the context of Higgs physics, we establish that a closely related observable, $c_H$, is well-defined and satisfies a two-sided bound. $c_H$ is derived from the low momentum expansion of the scattering amplitude, or the derivative of the amplitude at the origin with respect to the Mandelstam variable $s$, expressed as $M(H_iH_i\rightarrow H_jH_j)=c_H s +O(g_\text{SM}, s^{-2})$ where $g_\text{SM}$ represents all Standard Model couplings. This observable is non-dispersive and, as a result, not sign-definite. We also determine the conditions under which the bound on $c_H$ is equivalent to a bound on the dimension-six operator $O_H=\partial| H|^2 \partial |H|^2$.


title: All Loop Scattering For All Multiplicity

abstract: This is part of a series of papers describing the new curve integral formalism for scattering amplitudes of the colored scalar tr$\phi^3$ theory. We show that the curve integral manifests a very surprising fact about these amplitudes: the dependence on the number of particles, $n$, and the loop order, $L$, is effectively decoupled. We derive the curve integrals at tree-level for all $n$. We then show that, for higher loop-order, it suffices to study the curve integrals for $L$-loop tadpole-like amplitudes, which have just one particle per color trace-factor. By combining these tadpole-like formulas with the the tree-level result, we find formulas for the all $n$ amplitudes at $L$ loops. We illustrate this result by giving explicit curve integrals for all the amplitudes in the theory, including the non-planar amplitudes, through to two loops, for all $n$.


title: Instanton NDA and Applications to Axion Models

abstract: We present a simple set of power counting rules which allows us to easily estimate calculable instanton effects up to $O(1)$ factors. We apply the resulting Instanton NDA to examine the effects of small instantons on various axion models. We confirm that mechanisms that increase the axion mass via small instantons generically also lead to an enhancement of misaligned instanton contributions to the axion potential, deepening the axion quality problem. For generic models, new sources of CP violation in the UV must be absent in order to raise the axion mass above the QCD prediction. However, we find that $Z_N$ and composite axions are UV-safe against these misalignment effects. Axion GUT models are also insensitive to UV contributions at the GUT scale, unless a very large number of extra states are introduced below this scale.


title: The Halos and Environments of Nearby Galaxies (HERON) Survey IV: Complexity in the boxy galaxies NGC 720 and NGC 2768

abstract: The shapes of galaxies, in particular their outer regions, are important guideposts to their formation and evolution. Here we report on the discovery of strongly box-shaped morphologies of the, otherwise well-studied, elliptical and lenticular galaxies NGC 720 and NGC 2768 from deep imaging. The boxiness is strongly manifested in the shape parameter $A_4/a$ of $-0.04$ in both objects, and also significant center shifts of the isophotes of $\sim$ 2--4 kpc are seen. One reason for such asymmetries commonly stated in the literature is a merger origin, although the number of such cases is still sparse and the exact properties of the individual boxy objects is highly diverse. Indeed, for NGC 2768, we identify a progenitor candidate (dubbed Pelops) in the residual images, which appears to be a dwarf satellite that is currently merging with NGC 2768. At its absolute magnitude of M$_r$ of $-$12.2 mag, the corresponding Sersic radius of 2.4 kpc is more extended than those of typical dwarf galaxies from the literature. However, systematically larger radii are known to occur in systems that are in tidal disruption. This finding is bolstered by the presence of a tentative tidal stream feature on archival GALEX data. Finally, further structures in the fascinating host galaxy comprise rich dust lanes and a vestigial X-shaped bulge component.


title: Probing diffuse radio emission in bridges between galaxy clusters with uGMRT

abstract: The main purpose of this work is to investigate the properties of the non-thermal emission in the interacting clusters pairs Abell 0399-Abell 0401 and Abell 21-PSZ2 G114.9, found in an interacting state. In both cases their connection along a filament is supported by SZ effect detected by the Planck satellite and, in the special case of Abell 0399-Abell 0401, the presence of a radio bridge has been already confirmed by LOFAR observations at 140MHz. Here, we analyse new high sensitivity wideband (250-500MHz) uGMRT data of these two systems and describe an injection procedure to place limits on the spectrum of Abell 0399-Abell 0401 and on the radio emission between Abell 21-PSZ2 G114.9. For the A399-A401 pair, we are able to constrain the steep spectral index of the bridge emission to be alpha>2.2 with a 95% confidence level between 140MHz and 400MHz. For the A21-PSZ2 G114.9 pair, we are able to place an upper limit on the flux density of the bridge emission with two different methods, finding at the central frequency of 383MHz a conservative value of fu_1<260mJy at 95% confidence level, and a lower value of fu_2<125mJy at 80% confidence level, based on visual inspection and a morphological criterion. Our work provides a constraint on the spectrum in the bridge A399-A401 which disfavours shock-acceleration as the main mechanism for the radio emission.


title: U(2) is Right for Leptons and Left for Quarks

abstract: We posit that the distinct patterns observed in fermion masses and mixings are due to a minimally broken $\mathrm{U}(2)_{q+e}$ flavor symmetry acting on left-handed quarks and right-handed charged leptons, giving rise to an accidental $\mathrm{U}(2)^5$ symmetry at the renormalizable level without imposing selection rules on the Weinberg operator. We show that the symmetry can be consistently gauged by explicit examples and comment on realizations in $\mathrm{SU}(5)$ unification. Via a model-independent SMEFT analysis, we find that selection rules due to $\mathrm{U}(2)_{q+e}$ enhance the importance of charged lepton flavor violation as a probe, where significant experimental progress is expected in the near future.


title: Wilson Loops and Wormholes

abstract: We analyse the properties of Wilson loop observables for holographic gauge theories, when the dual bulk geometries have a single and/or multiple boundaries (Euclidean spacetime wormholes). Such observables lead to a generalisation and refinement of the characterisation in arXiv:2202.01372 based on the compressibility of cycles and the pinching limit of higher genus Riemann surfaces, since they carry information about the dynamics and phase structure of the dual gauge theory of an arbitrary dimensionality. Finally, we describe how backreacting correlated observables such as Wilson loops can lead to wormhole saddles in the dual gravitational path integral, by taking advantage of a representation theoretic entanglement structure proposed in arXiv:2110.14655 and arXiv:2204.01764 .


title: Kagome Materials II: SG 191: FeGe as a LEGO Building Block for the Entire 1:6:6 series: hidden d-orbital decoupling of flat band sectors, effective models and interaction Hamiltonians

abstract: The electronic structure and interactions of kagome materials such as 1:1 (FeGe class) and 1:6:6 (MgFe$_6$Ge$_6$ class) are complicated and involve many orbitals and bands at the Fermi level. Current theoretical models treat the systems in an $s$-orbital kagome representation, unsuited and incorrect both quantitatively and qualitatively to the material realities. In this work, we lay the basis of a faithful framework of the electronic model for this large class of materials. We show that the complicated ``spaghetti" of electronic bands near the Fermi level can be decomposed into three groups of $d$-Fe orbitals coupled to specific Ge orbitals. Such decomposition allows for a clear analytical understanding (leading to different results than the simple $s$-orbital kagome models) of the flat bands in the system based on the $S$-matrix formalism of generalized bipartite lattices. Our three minimal Hamiltonians can reproduce the quasi-flat bands, van Hove singularities, topology, and Dirac points close to the Fermi level, which we prove by extensive ab initio studies. We also obtain the interacting Hamiltonian of $d$ orbitals in FeGe using the constraint random phase approximation (cRPA) method. We then use this as a fundamental ``LEGO"-like building block for a large family of 1:6:6 kagome materials, which can be obtained by doubling and perturbing the FeGe Hamiltonian. We applied the model to its kagome siblings FeSn and CoSn, and also MgFe$_6$Ge$_6$. Our work serves as the first complete framework for the study of the interacting phase diagram of kagome compounds.


title: Efficient Local Classical Shadow Tomography with Number Conservation

abstract: Shadow tomography aims to build a classical description of a quantum state from a sequence of simple random measurements. Physical observables are then reconstructed from the resulting classical shadow. Shadow protocols which use single-body random measurements are simple to implement and capture few-body observables efficiently, but do not apply to systems with fundamental number conservation laws, such as ultracold atoms. We address this shortcoming by proposing and analyzing a new local shadow protocol adapted to such systems. The "All-Pairs" protocol requires one layer of two-body gates and only $\textrm{poly}(V)$ samples to reconstruct arbitrary few body observables. Moreover, by exploiting the permutation symmetry of the protocol, we derive a linear time post-processing algorithm. We provide a proof-of-principle reference implementation and demonstrate the reconstruction of 2- and 4-point functions in a paired Luttinger liquid of hardcore bosons.