title: Illuminating the Black Box: A Psychometric Investigation into the Multifaceted Nature of Large Language Models

abstract: This study explores the idea of AI Personality or AInality suggesting that Large Language Models (LLMs) exhibit patterns similar to human personalities. Assuming that LLMs share these patterns with humans, we investigate using human-centered psychometric tests such as the Myers-Briggs Type Indicator (MBTI), Big Five Inventory (BFI), and Short Dark Triad (SD3) to identify and confirm LLM personality types. By introducing role-play prompts, we demonstrate the adaptability of LLMs, showing their ability to switch dynamically between different personality types. Using projective tests, such as the Washington University Sentence Completion Test (WUSCT), we uncover hidden aspects of LLM personalities that are not easily accessible through direct questioning. Projective tests allowed for a deep exploration of LLMs cognitive processes and thought patterns and gave us a multidimensional view of AInality. Our machine learning analysis revealed that LLMs exhibit distinct AInality traits and manifest diverse personality types, demonstrating dynamic shifts in response to external instructions. This study pioneers the application of projective tests on LLMs, shedding light on their diverse and adaptable AInality traits.


title: Shai: A large language model for asset management

abstract: This paper introduces "Shai" a 10B level large language model specifically designed for the asset management industry, built upon an open-source foundational model. With continuous pre-training and fine-tuning using a targeted corpus, Shai demonstrates enhanced performance in tasks relevant to its domain, outperforming baseline models. Our research includes the development of an innovative evaluation framework, which integrates professional qualification exams, tailored tasks, open-ended question answering, and safety assessments, to comprehensively assess Shai's capabilities. Furthermore, we discuss the challenges and implications of utilizing large language models like GPT-4 for performance assessment in asset management, suggesting a combination of automated evaluation and human judgment. Shai's development, showcasing the potential and versatility of 10B-level large language models in the financial sector with significant performance and modest computational requirements, hopes to provide practical insights and methodologies to assist industry peers in their similar endeavors.


title: Meta Transfer of Self-Supervised Knowledge: Foundation Model in Action for Post-Traumatic Epilepsy Prediction

abstract: Despite the impressive advancements achieved using deep-learning for functional brain activity analysis, the heterogeneity of functional patterns and scarcity of imaging data still pose challenges in tasks such as prediction of future onset of Post-Traumatic Epilepsy (PTE) from data acquired shortly after traumatic brain injury (TBI). Foundation models pre-trained on separate large-scale datasets can improve the performance from scarce and heterogeneous datasets. For functional Magnetic Resonance Imaging (fMRI), while data may be abundantly available from healthy controls, clinical data is often scarce, limiting the ability of foundation models to identify clinically-relevant features. We overcome this limitation by introducing a novel training strategy for our foundation model by integrating meta-learning with self-supervised learning to improve the generalization from normal to clinical features. In this way we enable generalization to other downstream clinical tasks, in our case prediction of PTE. To achieve this, we perform self-supervised training on the control dataset to focus on inherent features that are not limited to a particular supervised task while applying meta-learning, which strongly improves the model's generalizability using bi-level optimization. Through experiments on neurological disorder classification tasks, we demonstrate that the proposed strategy significantly improves task performance on small-scale clinical datasets. To explore the generalizability of the foundation model in downstream applications, we then apply the model to an unseen TBI dataset for prediction of PTE using zero-shot learning. Results further demonstrated the enhanced generalizability of our foundation model.


title: Chemical distance in the supercritical phase of planar Gaussian fields

abstract: Our study concerns the large scale geometry of the excursion set of planar random fields: E ${\ell}$ = {x $\in$ R 2 |f (x) $\ge$-${\ell}$}, where ${\ell}$ $\in$ R is a real parameter and f is a continuous, stationary, centered, planar Gaussian field satisfying some regularity assumptions (in particular, this study applies to the planar Bargmann-Fock field). It is already known that under those hypotheses there is a phase transition at ${\ell}$c = 0. When ${\ell}$ > 0, we are in a supercritical regime and almost surely E ${\ell}$ has a unique unbounded connected component. We prove that in this supercritical regime, whenever two points are in the same connected components of E ${\ell}$ then, with high probability, the chemical distance (the length of the shortest path in E ${\ell}$ between these points) is close to the Euclidean distance between those two points Contents


title: LLM4VG: Large Language Models Evaluation for Video Grounding

abstract: Recently, researchers have attempted to investigate the capability of LLMs in handling videos and proposed several video LLM models. However, the ability of LLMs to handle video grounding (VG), which is an important time-related video task requiring the model to precisely locate the start and end timestamps of temporal moments in videos that match the given textual queries, still remains unclear and unexplored in literature. To fill the gap, in this paper, we propose the LLM4VG benchmark, which systematically evaluates the performance of different LLMs on video grounding tasks. Based on our proposed LLM4VG, we design extensive experiments to examine two groups of video LLM models on video grounding: (i) the video LLMs trained on the text-video pairs (denoted as VidLLM), and (ii) the LLMs combined with pretrained visual description models such as the video/image captioning model. We propose prompt methods to integrate the instruction of VG and description from different kinds of generators, including caption-based generators for direct visual description and VQA-based generators for information enhancement. We also provide comprehensive comparisons of various VidLLMs and explore the influence of different choices of visual models, LLMs, prompt designs, etc, as well. Our experimental evaluations lead to two conclusions: (i) the existing VidLLMs are still far away from achieving satisfactory video grounding performance, and more time-related video tasks should be included to further fine-tune these models, and (ii) the combination of LLMs and visual models shows preliminary abilities for video grounding with considerable potential for improvement by resorting to more reliable models and further guidance of prompt instructions.


title: An Algebraic Roadmap of Particle Theories, Part III: Intersections

abstract: In this article, we bypass the detailed symmetry breaking pathways established in [1]. Instead, a direct route from the Spin(10) model to the Standard Model is enabled via a single algebraic constraint. This single constraint, however, may be reconfigured as a requirement that three $\mathfrak{so}(10)$ actions coincide on a fixed space of multi-vector fermions. This $\mathfrak{so}(10) \mapsto \mathfrak{su}(3)_{C} \oplus \mathfrak{su}(2)_{L} \oplus{u}(1)_{Y}$ breaking (from a three-way intersection) mirrors, in certain ways, the $\mathfrak{so}(8) \mapsto \mathfrak{g}_2$ breaking (from a three-way intersection) in the context of octonionic triality. By extending this result to include quaternions and complex numbers, we find that a five-way intersection breaks $\mathfrak{so}(10) \mapsto \mathfrak{su}(3)_{C} \oplus \mathfrak{u}(1)_{Q}$. These are the Standard Model's unbroken gauge symmetries, post-Higgs-mechanism.


title: Towards the explanation of flatness of galaxies rotation curves

abstract: We suggest a new explanation of flatness of galaxies rotation curves without invoking dark matter. For this purpose a new gravitational tensor field is introduced in addition to the metric tensor.


title: TextFusion: Unveiling the Power of Textual Semantics for Controllable Image Fusion

abstract: Advanced image fusion methods are devoted to generating the fusion results by aggregating the complementary information conveyed by the source images. However, the difference in the source-specific manifestation of the imaged scene content makes it difficult to design a robust and controllable fusion process. We argue that this issue can be alleviated with the help of higher-level semantics, conveyed by the text modality, which should enable us to generate fused images for different purposes, such as visualisation and downstream tasks, in a controllable way. This is achieved by exploiting a vision-and-language model to build a coarse-to-fine association mechanism between the text and image signals. With the guidance of the association maps, an affine fusion unit is embedded in the transformer network to fuse the text and vision modalities at the feature level. As another ingredient of this work, we propose the use of textual attention to adapt image quality assessment to the fusion task. To facilitate the implementation of the proposed text-guided fusion paradigm, and its adoption by the wider research community, we release a text-annotated image fusion dataset IVT. Extensive experiments demonstrate that our approach (TextFusion) consistently outperforms traditional appearance-based fusion methods. Our code and dataset will be publicly available at https://github.com/AWCXV/TextFusion.


title: Forecasting Fold Bifurcations through Physics-Informed Convolutional Neural Networks

abstract: This study proposes a physics-informed convolutional neural network (CNN) for identifying dynamical systems' time series near a fold bifurcation. The peculiarity of this work is that the CNN is trained with a relatively small amount of data and on a single, very simple system. In contrast, the CNN is validated on much more complicated systems. A similar task requires significant extrapolation capabilities, which are obtained by exploiting physics-based information. Physics-based information is provided through a specific pre-processing of the input data, consisting mostly of a transformation into polar coordinates, normalization, transformation into the logarithmic scale, and filtering through a moving mean. The results illustrate that such data pre-processing enables the CNN to grasp the important features related to approaching a fold bifurcation, namely, the trend of the oscillation amplitude, and neglect other characteristics that are not particularly relevant, such as the vibration frequency. The developed CNN was able to correctly classify trajectories near a fold for a mass-on-moving-belt system, a van der Pol-Duffing oscillator with an attached tuned mass damper, and a pitch-and-plunge wing profile. The results obtained pave the way for the development of similar CNNs effective in real-life applications.


title: Experimenting with Large Language Models and vector embeddings in NASA SciX

abstract: Open-source Large Language Models enable projects such as NASA SciX (i.e., NASA ADS) to think out of the box and try alternative approaches for information retrieval and data augmentation, while respecting data copyright and users' privacy. However, when large language models are directly prompted with questions without any context, they are prone to hallucination. At NASA SciX we have developed an experiment where we created semantic vectors for our large collection of abstracts and full-text content, and we designed a prompt system to ask questions using contextual chunks from our system. Based on a non-systematic human evaluation, the experiment shows a lower degree of hallucination and better responses when using Retrieval Augmented Generation. Further exploration is required to design new features and data augmentation processes at NASA SciX that leverages this technology while respecting the high level of trust and quality that the project holds.


title: Beyond mirkwood: Enhancing SED Modeling with Conformal Predictions

abstract: Traditional spectral energy distribution (SED) fitting techniques face uncertainties due to assumptions in star formation histories and dust attenuation curves. We propose an advanced machine learning-based approach that enhances flexibility and uncertainty quantification in SED fitting. Unlike the fixed NGBoost model used in mirkwood, our approach allows for any sklearn-compatible model, including deterministic models. We incorporate conformalized quantile regression to convert point predictions into error bars, enhancing interpretability and reliability. Using CatBoost as the base predictor, we compare results with and without conformal prediction, demonstrating improved performance using metrics such as coverage and interval width. Our method offers a more versatile and accurate tool for deriving galaxy physical properties from observational data.


title: A Reinforcement-Learning-Based Multiple-Column Selection Strategy for Column Generation

abstract: Column generation (CG) is one of the most successful approaches for solving large-scale linear programming (LP) problems. Given an LP with a prohibitively large number of variables (i.e., columns), the idea of CG is to explicitly consider only a subset of columns and iteratively add potential columns to improve the objective value. While adding the column with the most negative reduced cost can guarantee the convergence of CG, it has been shown that adding multiple columns per iteration rather than a single column can lead to faster convergence. However, it remains a challenge to design a multiple-column selection strategy to select the most promising columns from a large number of candidate columns. In this paper, we propose a novel reinforcement-learning-based (RL) multiple-column selection strategy. To the best of our knowledge, it is the first RL-based multiple-column selection strategy for CG. The effectiveness of our approach is evaluated on two sets of problems: the cutting stock problem and the graph coloring problem. Compared to several widely used single-column and multiple-column selection strategies, our RL-based multiple-column selection strategy leads to faster convergence and achieves remarkable reductions in the number of CG iterations and runtime.


title: Tension between neutrino masses and gauge coupling unification in natural grand unified theories

abstract: The natural grand unified theories solve various problems of the supersymmetric grand unified theory and give realistic quark and lepton mass matrices under the natural assumption that all terms allowed by the symmetry are introduced with O(1) coefficients. However, because of the natural assumption, it is difficult to achieve the gauge coupling unification without tuning, while keeping neutrino masses at realistic values. In this paper, we try to avoid this tension between the neutrino masses and the gauge coupling unification, by introducing suppression factors for several terms. These suppression factors can be understood by approximate symmetries in some of the solutions. We show that one of the most important results in the natural GUT scenario, that the nucleon decay mediated by superheavy gauge fields is enhanced due to smaller unification scale while the nucleon decay mediated by superheavy colored Higgs is suppressed, can change in those models proposed in this paper.


title: SimLM: Can Language Models Infer Parameters of Physical Systems?

abstract: Several machine learning methods aim to learn or reason about complex physical systems. A common first-step towards reasoning is to infer system parameters from observations of its behavior. In this paper, we investigate the performance of Large Language Models (LLMs) at performing parameter inference in the context of physical systems. Our experiments suggest that they are not inherently suited to this task, even for simple systems. We propose a promising direction of exploration, which involves the use of physical simulators to augment the context of LLMs. We assess and compare the performance of different LLMs on a simple example with and without access to physical simulation.


title: DreamDistribution: Prompt Distribution Learning for Text-to-Image Diffusion Models

abstract: The popularization of Text-to-Image (T2I) diffusion models enables the generation of high-quality images from text descriptions. However, generating diverse customized images with reference visual attributes remains challenging. This work focuses on personalizing T2I diffusion models at a more abstract concept or category level, adapting commonalities from a set of reference images while creating new instances with sufficient variations. We introduce a solution that allows a pretrained T2I diffusion model to learn a set of soft prompts, enabling the generation of novel images by sampling prompts from the learned distribution. These prompts offer text-guided editing capabilities and additional flexibility in controlling variation and mixing between multiple distributions. We also show the adaptability of the learned prompt distribution to other tasks, such as text-to-3D. Finally we demonstrate effectiveness of our approach through quantitative analysis including automatic evaluation and human assessment. Project website: https://briannlongzhao.github.io/DreamDistribution


title: Adversarial Infrared Curves: An Attack on Infrared Pedestrian Detectors in the Physical World

abstract: Deep neural network security is a persistent concern, with considerable research on visible light physical attacks but limited exploration in the infrared domain. Existing approaches, like white-box infrared attacks using bulb boards and QR suits, lack realism and stealthiness. Meanwhile, black-box methods with cold and hot patches often struggle to ensure robustness. To bridge these gaps, we propose Adversarial Infrared Curves (AdvIC). Using Particle Swarm Optimization, we optimize two Bezier curves and employ cold patches in the physical realm to introduce perturbations, creating infrared curve patterns for physical sample generation. Our extensive experiments confirm AdvIC's effectiveness, achieving 94.8\% and 67.2\% attack success rates for digital and physical attacks, respectively. Stealthiness is demonstrated through a comparative analysis, and robustness assessments reveal AdvIC's superiority over baseline methods. When deployed against diverse advanced detectors, AdvIC achieves an average attack success rate of 76.8\%, emphasizing its robust nature. we explore adversarial defense strategies against AdvIC and examine its impact under various defense mechanisms. Given AdvIC's substantial security implications for real-world vision-based applications, urgent attention and mitigation efforts are warranted.


title: AutoAugment Input Transformation for Highly Transferable Targeted Attacks

abstract: Deep Neural Networks (DNNs) are widely acknowledged to be susceptible to adversarial examples, wherein imperceptible perturbations are added to clean examples through diverse input transformation attacks. However, these methods originally designed for non-targeted attacks exhibit low success rates in targeted attacks. Recent targeted adversarial attacks mainly pay attention to gradient optimization, attempting to find the suitable perturbation direction. However, few of them are dedicated to input transformation.In this work, we observe a positive correlation between the logit/probability of the target class and diverse input transformation methods in targeted attacks. To this end, we propose a novel targeted adversarial attack called AutoAugment Input Transformation (AAIT). Instead of relying on hand-made strategies, AAIT searches for the optimal transformation policy from a transformation space comprising various operations. Then, AAIT crafts adversarial examples using the found optimal transformation policy to boost the adversarial transferability in targeted attacks. Extensive experiments conducted on CIFAR-10 and ImageNet-Compatible datasets demonstrate that the proposed AAIT surpasses other transfer-based targeted attacks significantly.


title: DCFL: Non-IID awareness Data Condensation aided Federated Learning

abstract: Federated learning is a decentralized learning paradigm wherein a central server trains a global model iteratively by utilizing clients who possess a certain amount of private datasets. The challenge lies in the fact that the client side private data may not be identically and independently distributed, significantly impacting the accuracy of the global model. Existing methods commonly address the Non-IID challenge by focusing on optimization, client selection and data complement. However, most approaches tend to overlook the perspective of the private data itself due to privacy constraints.Intuitively, statistical distinctions among private data on the client side can help mitigate the Non-IID degree. Besides, the recent advancements in dataset condensation technology have inspired us to investigate its potential applicability in addressing Non-IID issues while maintaining privacy. Motivated by this, we propose DCFL which divides clients into groups by using the Centered Kernel Alignment (CKA) method, then uses dataset condensation methods with non-IID awareness to complete clients. The private data from clients within the same group is complementary and their condensed data is accessible to all clients in the group. Additionally, CKA-guided client selection strategy, filtering mechanisms, and data enhancement techniques are incorporated to efficiently and precisely utilize the condensed data, enhance model performance, and minimize communication time. Experimental results demonstrate that DCFL achieves competitive performance on popular federated learning benchmarks including MNIST, FashionMNIST, SVHN, and CIFAR-10 with existing FL protocol.


title: Single-Cell RNA-seq Synthesis with Latent Diffusion Model

abstract: The single-cell RNA sequencing (scRNA-seq) technology enables researchers to study complex biological systems and diseases with high resolution. The central challenge is synthesizing enough scRNA-seq samples; insufficient samples can impede downstream analysis and reproducibility. While various methods have been attempted in past research, the resulting scRNA-seq samples were often of poor quality or limited in terms of useful specific cell subpopulations. To address these issues, we propose a novel method called Single-Cell Latent Diffusion (SCLD) based on the Diffusion Model. This method is capable of synthesizing large-scale, high-quality scRNA-seq samples, including both 'holistic' or targeted specific cellular subpopulations within a unified framework. A pre-guidance mechanism is designed for synthesizing specific cellular subpopulations, while a post-guidance mechanism aims to enhance the quality of scRNA-seq samples. The SCLD can synthesize large-scale and high-quality scRNA-seq samples for various downstream tasks. Our experimental results demonstrate state-of-the-art performance in cell classification and data distribution distances when evaluated on two scRNA-seq benchmarks. Additionally, visualization experiments show the SCLD's capability in synthesizing specific cellular subpopulations.


title: Noninvasive Estimation of Mean Pulmonary Artery Pressure Using MRI, Computer Models, and Machine Learning

abstract: Pulmonary Hypertension (PH) is a severe disease characterized by an elevated pulmonary artery pressure. The gold standard for PH diagnosis is measurement of mean Pulmonary Artery Pressure (mPAP) during an invasive Right Heart Catheterization. In this paper, we investigate noninvasive approach to PH detection utilizing Magnetic Resonance Imaging, Computer Models and Machine Learning. We show using the ablation study, that physics-informed feature engineering based on models of blood circulation increases the performance of Gradient Boosting Decision Trees-based algorithms for classification of PH and regression of values of mPAP. We compare results of regression (with thresholding of estimated mPAP) and classification and demonstrate that metrics achieved in both experiments are comparable. The predicted mPAP values are more informative to the physicians than the probability of PH returned by classification models. They provide the intuitive explanation of the outcome of the machine learning model (clinicians are accustomed to the mPAP metric, contrary to the PH probability).


title: Hierarchical Topology Isomorphism Expertise Embedded Graph Contrastive Learning

abstract: Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised graph representation learning approach, GCL achieves impressive successes in various graph benchmarks. However, such an approach falls short of recognizing the topology isomorphism of graphs, resulting in that graphs with relatively homogeneous node features cannot be sufficiently discriminated. By revisiting classic graph topology recognition works, we disclose that the corresponding expertise intuitively complements GCL methods. To this end, we propose a novel hierarchical topology isomorphism expertise embedded graph contrastive learning, which introduces knowledge distillations to empower GCL models to learn the hierarchical topology isomorphism expertise, including the graph-tier and subgraph-tier. On top of this, the proposed method holds the feature of plug-and-play, and we empirically demonstrate that the proposed method is universal to multiple state-of-the-art GCL models. The solid theoretical analyses are further provided to prove that compared with conventional GCL methods, our method acquires the tighter upper bound of Bayes classification error. We conduct extensive experiments on real-world benchmarks to exhibit the performance superiority of our method over candidate GCL methods, e.g., for the real-world graph representation learning experiments, the proposed method beats the state-of-the-art method by 0.23% on unsupervised representation learning setting, 0.43% on transfer learning setting. Our code is available at https://github.com/jyf123/HTML.


title: Fast Diffusion-Based Counterfactuals for Shortcut Removal and Generation

abstract: Shortcut learning is when a model -- e.g. a cardiac disease classifier -- exploits correlations between the target label and a spurious shortcut feature, e.g. a pacemaker, to predict the target label based on the shortcut rather than real discriminative features. This is common in medical imaging, where treatment and clinical annotations correlate with disease labels, making them easy shortcuts to predict disease. We propose a novel detection and quantification of the impact of potential shortcut features via a fast diffusion-based counterfactual image generation that can synthetically remove or add shortcuts. Via a novel inpainting-based modification we spatially limit the changes made with no extra inference step, encouraging the removal of spatially constrained shortcut features while ensuring that the shortcut-free counterfactuals preserve their remaining image features to a high degree. Using these, we assess how shortcut features influence model predictions. This is enabled by our second contribution: An efficient diffusion-based counterfactual explanation method with significant inference speed-up at comparable image quality as state-of-the-art. We confirm this on two large chest X-ray datasets, a skin lesion dataset, and CelebA.


title: $Z_c$ and $Z_{cs}$ systems with operator mixing at NLO in QCD sum rules

abstract: We study the mass spectra of hidden-charm tetraquark systems with quantum numbers $(I^G)J^P=(1^+)1^+$ using QCD sum rules. The analysis incorporates the complete next-to-leading order (NLO) contribution to the perturbative QCD part of the operator product expansions, with particular attention to operator mixing effects due to renormalization group evolution. For the $\bar{d}c\bar{c}u$ system, the masses of two mixed operators, $J_{1,5}^{\text{Mixed}}$ and $J_{2,6}^{\text{Mixed}}$, are determined to be $3.89^{+0.18}_{-0.12}$ GeV and $4.03^{+0.06}_{-0.07}$ GeV, respectively, closely matching those of $Z_c$(3900) and $Z_c(4020)$. Similarly, for the $\bar{s}c\bar{c}u$ states, the masses of $J_{1,5}^{\text{Mixed}}$ and $J_{2,6}^{\text{Mixed}}$ are found to be $4.02^{+0.17}_{-0.09}$ GeV and $4.21^{+0.08}_{-0.07}$ GeV, respectively, in close proximity to $Z_{cs}$(3983)/$Z_{cs}$(4000) and $Z_{cs}$(4220), consistent with the expectation that they are the partners of $Z_c$(3900) and $Z_c$(4020). Our results highlight the crucial role of operator mixing, an inevitable effect in a complete NLO calculation, in achieving a robust phenomenological description for the tetraquark system.


title: Stochastic path power and the Laplace transform

abstract: Transition probabilities for stochastic systems can be expressed in terms of a functional integral over paths taken by the system. Evaluating the integral by the saddle point method in the weak-noise limit leads to a remarkable mapping between dominant stochastic paths and conservative, Hamiltonian mechanics in an effective potential. The conserved ``energy'' in the effective system has dimensions of power. We show that this power, H, can be identified with the Laplace parameter of the time-transformed dynamics. This identification leads to insights into the non-equilibrium behaviour of the system. Moreover, it facilitates the explicit summation over families of trajectories, which is far harder in the time domain. This is crucial for making contact with the long-time equilibrium limit.


title: Deep de Finetti: Recovering Topic Distributions from Large Language Models

abstract: Large language models (LLMs) can produce long, coherent passages of text, suggesting that LLMs, although trained on next-word prediction, must represent the latent structure that characterizes a document. Prior work has found that internal representations of LLMs encode one aspect of latent structure, namely syntax; here we investigate a complementary aspect, namely the document's topic structure. We motivate the hypothesis that LLMs capture topic structure by connecting LLM optimization to implicit Bayesian inference. De Finetti's theorem shows that exchangeable probability distributions can be represented as a mixture with respect to a latent generating distribution. Although text is not exchangeable at the level of syntax, exchangeability is a reasonable starting assumption for topic structure. We thus hypothesize that predicting the next token in text will lead LLMs to recover latent topic distributions. We examine this hypothesis using Latent Dirichlet Allocation (LDA), an exchangeable probabilistic topic model, as a target, and we show that the representations formed by LLMs encode both the topics used to generate synthetic data and those used to explain natural corpus data.


title: ElasticTrainer: Speeding Up On-Device Training with Runtime Elastic Tensor Selection

abstract: On-device training is essential for neural networks (NNs) to continuously adapt to new online data, but can be time-consuming due to the device's limited computing power. To speed up on-device training, existing schemes select trainable NN portion offline or conduct unrecoverable selection at runtime, but the evolution of trainable NN portion is constrained and cannot adapt to the current need for training. Instead, runtime adaptation of on-device training should be fully elastic, i.e., every NN substructure can be freely removed from or added to the trainable NN portion at any time in training. In this paper, we present ElasticTrainer, a new technique that enforces such elasticity to achieve the required training speedup with the minimum NN accuracy loss. Experiment results show that ElasticTrainer achieves up to 3.5x more training speedup in wall-clock time and reduces energy consumption by 2x-3x more compared to the existing schemes, without noticeable accuracy loss.


title: Artificial Hair Sensor Placement Optimization on Airfoils for Angle of Attack Prediction

abstract: Arrays of bioinspired artificial hair-cell airflow velocity sensors can enable flight-by-feel of small, unmanned aircraft. Natural fliers - bats, insects, and birds - have hundred or thousands of velocity sensors distributed across their wings. Aircraft designers do not have this luxury due to size, weight, and power constraints. The challenge is to identify the best locations for a small set of sensors to extract relevant information from the flow field for the prediction of flight control parameters. In this paper, we introduce the data-reducing Sparse Sensor Placement Optimization for Prediction algorithm which locates near-optimal sensor placement on airfoils and wings. For two or more sensors this algorithm finds a set of sensor locations (design point) which predicts angle of attack to within 0.10 degrees and ranks within the top 1% of all possible design points found by brute force search. We demonstrate this algorithm on several variations of airfoil sections of infinite and finite wings in clean and noisy data, evaluate model sensitivities, and show that the algorithm can be used to identify an appropriate number of sensors for a given accuracy requirement. Applications for this algorithm are explored for aircraft design and flight-by-feel control.


title: Real-time Neural Network Inference on Extremely Weak Devices: Agile Offloading with Explainable AI

abstract: With the wide adoption of AI applications, there is a pressing need of enabling real-time neural network (NN) inference on small embedded devices, but deploying NNs and achieving high performance of NN inference on these small devices is challenging due to their extremely weak capabilities. Although NN partitioning and offloading can contribute to such deployment, they are incapable of minimizing the local costs at embedded devices. Instead, we suggest to address this challenge via agile NN offloading, which migrates the required computations in NN offloading from online inference to offline learning. In this paper, we present AgileNN, a new NN offloading technique that achieves real-time NN inference on weak embedded devices by leveraging eXplainable AI techniques, so as to explicitly enforce feature sparsity during the training phase and minimize the online computation and communication costs. Experiment results show that AgileNN's inference latency is >6x lower than the existing schemes, ensuring that sensory data on embedded devices can be timely consumed. It also reduces the local device's resource consumption by >8x, without impairing the inference accuracy.


title: Don't slip into binary thinking about AI

abstract: In discussions about the development and governance of AI, a false binary is often drawn between two groups: those most concerned about the existing, social impacts of AI, and those most concerned about possible future risks of powerful AI systems taking actions that don't align with human interests. In this piece, we (i) describe the emergence of this false binary, (ii) explain why the seemingly clean distinctions drawn between these two groups don't hold up under scrutiny and (iii) highlight efforts to bridge this divide.


title: Building Your Own Product Copilot: Challenges, Opportunities, and Needs

abstract: A race is underway to embed advanced AI capabilities into products. These product copilots enable users to ask questions in natural language and receive relevant responses that are specific to the user's context. In fact, virtually every large technology company is looking to add these capabilities to their software products. However, for most software engineers, this is often their first encounter with integrating AI-powered technology. Furthermore, software engineering processes and tools have not caught up with the challenges and scale involved with building AI-powered applications. In this work, we present the findings of an interview study with 26 professional software engineers responsible for building product copilots at various companies. From our interviews, we found pain points at every step of the engineering process and the challenges that strained existing development practices. We then conducted group brainstorming sessions to collaborative on opportunities and tool designs for the broader software engineering community.


title: Parrot Captions Teach CLIP to Spot Text

abstract: Despite CLIP being the foundation model in numerous vision-language applications, the CLIP suffers from a severe text spotting bias. Such bias causes CLIP models to `Parrot' the visual text embedded within images while disregarding the authentic visual semantics. We uncover that in the most popular image-text dataset LAION-2B, the captions also densely parrot (spell) the text embedded in images. Our analysis shows that around 50% of images are embedded with visual text content, and around 30% of captions words are in these embedded visual content. Based on such observation, we thoroughly inspect the different released versions of CLIP models and verify that the visual text is the dominant factor in measuring the LAION-style image-text similarity for these models. To examine whether these parrot captions shape the text spotting bias, we train a series of CLIP models with LAION subsets curated by different parrot-caption-oriented criteria. We show that training with parrot captions easily shapes such bias but harms the expected visual-language representation learning in CLIP models. This suggests that it is urgent to revisit either the design of CLIP-like models or the existing image-text dataset curation pipeline built on CLIP score filtering.


title: VCoder: Versatile Vision Encoders for Multimodal Large Language Models

abstract: Humans possess the remarkable skill of Visual Perception, the ability to see and understand the seen, helping them make sense of the visual world and, in turn, reason. Multimodal Large Language Models (MLLM) have recently achieved impressive performance on vision-language tasks ranging from visual question-answering and image captioning to visual reasoning and image generation. However, when prompted to identify or count (perceive) the entities in a given image, existing MLLM systems fail. Working towards developing an accurate MLLM system for perception and reasoning, we propose using Versatile vision enCoders (VCoder) as perception eyes for Multimodal LLMs. We feed the VCoder with perception modalities such as segmentation or depth maps, improving the MLLM's perception abilities. Secondly, we leverage the images from COCO and outputs from off-the-shelf vision perception models to create our COCO Segmentation Text (COST) dataset for training and evaluating MLLMs on the object perception task. Thirdly, we introduce metrics to assess the object perception abilities in MLLMs on our COST dataset. Lastly, we provide extensive experimental evidence proving the VCoder's improved object-level perception skills over existing Multimodal LLMs, including GPT-4V. We open-source our dataset, code, and models to promote research. We open-source our code at https://github.com/SHI-Labs/VCoder


title: Operator dynamics in Floquet many-body systems

abstract: We study operator dynamics in many-body quantum systems, focusing on generic features of systems which are ergodic, spatially extended, and lack conserved densities, as exemplified by spin chains with Floquet time evolution. To characterise dynamics we examine, in solvable models and numerically, the behaviour of operator autocorrelation functions, as a function of time and the size of the operator support. The standard expectation is that operator autocorrelation functions in such systems are maximum at time zero and decay, over a few Floquet periods, to a fluctuating value that reduces to zero under an average over an ensemble of statistically similar systems. Our central result is that ensemble-averaged correlation functions also display a second generic feature, which consists of a peak at a later time. In individual many-body systems, this peak can also be revealed by averaging autocorrelation functions over complete sets of operators supported within a finite spatial region, thereby generating a partial spectral form factor. The duration of the peak grows indefinitely with the size of the operator support, and its amplitude shrinks, but both are essentially independent of system size provided this is sufficiently large to contain the operator. In finite systems, the averaged correlation functions also show a further feature at still later times, which is a counterpart to the so-called ramp and plateau of the spectral form factor; its amplitude in the autocorrelation function decreases to zero with increasing system size. Both the later-time peak and the ramp-and-plateau feature are specific to models with time-translation symmetry, such as Floquet systems or models with a time-independent Hamiltonian, and are absent in models with an evolution operator that is a random function of time, such as the extensively-studied random unitary circuits.


title: Neural Spline Fields for Burst Image Fusion and Layer Separation

abstract: Each photo in an image burst can be considered a sample of a complex 3D scene: the product of parallax, diffuse and specular materials, scene motion, and illuminant variation. While decomposing all of these effects from a stack of misaligned images is a highly ill-conditioned task, the conventional align-and-merge burst pipeline takes the other extreme: blending them into a single image. In this work, we propose a versatile intermediate representation: a two-layer alpha-composited image plus flow model constructed with neural spline fields -- networks trained to map input coordinates to spline control points. Our method is able to, during test-time optimization, jointly fuse a burst image capture into one high-resolution reconstruction and decompose it into transmission and obstruction layers. Then, by discarding the obstruction layer, we can perform a range of tasks including seeing through occlusions, reflection suppression, and shadow removal. Validated on complex synthetic and in-the-wild captures we find that, with no post-processing steps or learned priors, our generalizable model is able to outperform existing dedicated single-image and multi-view obstruction removal approaches.


title: Edge-sharing quasi-one-dimensional cuprate fragments in optimally substituted Cu/Pb apatite

abstract: The flurry of theoretical and experimental studies following the report of room-temperature superconductivity at ambient pressure in Cu-substituted lead apatite Cu$_x$Pb$_{10-x}$(PO$_4$)$_6$O (`LK99') have explored whether and how this system might host strongly correlated physics including superconductivity. While first-principles calculations at low doping ($x\approx1$) have indicated a Cu-$d^{9}$ configuration coordinated with oxygen giving rise to isolated, correlated bands, its other structural, electronic, and magnetic properties diverge significantly from those of other known cuprate systems. Here we find that higher densities of ordered Cu substitutions can result in the formation of contiguous edge-sharing Cu-O chains, akin to those found in some members of the cuprate superconductor family. Interestingly, while such quasi-one-dimensional edge-sharing chains are typically ferromagnetically coupled along the chain, we find an antiferromagnetic ground-state magnetic order for our cuprate fragments which is in proximity to a ferromagnetic quantum critical point. This is a result of the elongated Cu-Cu distance in Cu-substituted apatite that leads to larger Cu-O-Cu angles supporting antiferromagnetism, which we demonstrate to be controllable by strain. Finally, our electronic structure calculations confirm the low-dimensional nature of the system and show that the bandwidth is driven by the Cu-O plaquette connectivity, resulting in an intermediate correlated regime.


title: AI-Lorenz: A physics-data-driven framework for black-box and gray-box identification of chaotic systems with symbolic regression

abstract: Discovering mathematical models that characterize the observed behavior of dynamical systems remains a major challenge, especially for systems in a chaotic regime. The challenge is even greater when the physics underlying such systems is not yet understood, and scientific inquiry must solely rely on empirical data. Driven by the need to fill this gap, we develop a framework that learns mathematical expressions modeling complex dynamical behaviors by identifying differential equations from noisy and sparse observable data. We train a small neural network to learn the dynamics of a system, its rate of change in time, and missing model terms, which are used as input for a symbolic regression algorithm to autonomously distill the explicit mathematical terms. This, in turn, enables us to predict the future evolution of the dynamical behavior. The performance of this framework is validated by recovering the right-hand sides and unknown terms of certain complex, chaotic systems such as the well-known Lorenz system, a six-dimensional hyperchaotic system, and the non-autonomous Sprott chaotic system, and comparing them with their known analytical expressions.

categories: physics.comp-ph cs.LG nlin.CD physics.data-an


title: InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks

abstract: The exponential growth of large language models (LLMs) has opened up numerous possibilities for multimodal AGI systems. However, the progress in vision and vision-language foundation models, which are also critical elements of multi-modal AGI, has not kept pace with LLMs. In this work, we design a large-scale vision-language foundation model (InternVL), which scales up the vision foundation model to 6 billion parameters and progressively aligns it with the LLM, using web-scale image-text data from various sources. This model can be broadly applied to and achieve state-of-the-art performance on 32 generic visual-linguistic benchmarks including visual perception tasks such as image-level or pixel-level recognition, vision-language tasks such as zero-shot image/video classification, zero-shot image/video-text retrieval, and link with LLMs to create multi-modal dialogue systems. It has powerful visual capabilities and can be a good alternative to the ViT-22B. We hope that our research could contribute to the development of multi-modal large models. Code and models are available at https://github.com/OpenGVLab/InternVL.


title: PlatoNeRF: 3D Reconstruction in Plato's Cave via Single-View Two-Bounce Lidar

abstract: 3D reconstruction from a single-view is challenging because of the ambiguity from monocular cues and lack of information about occluded regions. Neural radiance fields (NeRF), while popular for view synthesis and 3D reconstruction, are typically reliant on multi-view images. Existing methods for single-view 3D reconstruction with NeRF rely on either data priors to hallucinate views of occluded regions, which may not be physically accurate, or shadows observed by RGB cameras, which are difficult to detect in ambient light and low albedo backgrounds. We propose using time-of-flight data captured by a single-photon avalanche diode to overcome these limitations. Our method models two-bounce optical paths with NeRF, using lidar transient data for supervision. By leveraging the advantages of both NeRF and two-bounce light measured by lidar, we demonstrate that we can reconstruct visible and occluded geometry without data priors or reliance on controlled ambient lighting or scene albedo. In addition, we demonstrate improved generalization under practical constraints on sensor spatial- and temporal-resolution. We believe our method is a promising direction as single-photon lidars become ubiquitous on consumer devices, such as phones, tablets, and headsets.


title: Strings near black holes are Carrollian

abstract: We demonstrate that strings near the horizon of a Schwarzschild black hole, when viewed by a stationary observer at infinity, probe a string Carroll geometry, where the effective lightspeed is given by the distance from the horizon. We expand the Polyakov action in powers of this lightspeed to find a theory of Carrollian strings. We show that the string shrinks to a point to leading order near the horizon, which follows a null geodesic in a two-dimensional Rindler space. At the next-to-leading order the string oscillates in the embedding fields associated with the near-horizon two-sphere.


title: Compact stars: To cross or go around? That is the question

abstract: The travel times of light signals between two antipodal points on the surface of a compact star are calculated for two different trajectories: a straight line that passes through the center of the star and a semi-circular trajectory that connects the antipodal points along the surface of the star. Interestingly, it is explicitly proved that, for highly dense stars, the longer trajectory (the one that goes along the surface of the star) may be characterized by the {\it shorter} travel time as measured by asymptotic observers. In particular, for constant density stars we determine {\it analytically} the critical value of the dimensionless density-area parameter $\Lambda\equiv 4\pi R^2\rho$ that marks the boundary between situations in which a direct crossing of the star through its center has the shorter travel time and situations in which the semi-circular trajectory along the surface of the star is characterized by the shorter travel time as measured by asymptotic observers [here $\{R,\rho\}$ are respectively the radius of the star and its density].


title: Hofstadter-Toda spectral duality and quantum groups

abstract: The Hofstadter model allows to describe and understand several phenomena in condensed matter such as the quantum Hall effect, Anderson localization, charge pumping, and flat-bands in quasiperiodic structures, and is a rare example of fractality in the quantum world. An apparently unrelated system, the relativistic Toda lattice, has been extensively studied in the context of complex nonlinear dynamics, and more recently for its connection to supersymmetric Yang-Mills theories and topological string theories on Calabi-Yau manifolds in high-energy physics. Here we discuss a recently discovered spectral relationship between the Hofstadter model and the relativistic Toda lattice which has been later conjectured to be related to the Langlands duality of quantum groups. Moreover, by employing similarity transformations compatible with the quantum group structure, we establish a formula parametrizing the energy spectrum of the Hofstadter model in terms of elementary symmetric polynomials and Chebyshev polynomials. The main tools used are the spectral duality of tridiagonal matrices and the representation theory of the elementary quantum group.

categories: hep-th cond-mat.mes-hall cond-mat.stat-mech math-ph math.MP


title: Equilibrium parametric amplification in Raman-cavity hybrids

abstract: Parametric resonances and amplification have led to extraordinary photo-induced phenomena in pump-probe experiments. While these phenomena manifest themselves in out-of-equilibrium settings, here, we present the striking result of parametric amplification in equilibrium. In particular, we demonstrate that quantum and thermal fluctuations of a Raman-active mode amplifies light inside a cavity, at equilibrium, when the Raman mode frequency is twice the cavity mode frequency. This noise-driven amplification leads to the creation of an unusual parametric Raman polariton, intertwining the Raman mode with cavity squeezing fluctuations, with smoking gun signatures in Raman spectroscopy. In the resonant regime, we show the emergence of not only quantum light amplification but also localization and static shift of the Raman mode. Apart from the fundamental interest of equilibrium parametric amplification our study suggests a resonant mechanism for controlling Raman modes and thus matter properties by cavity fluctuations. We conclude by outlining how to compute the Raman-cavity coupling, and suggest possible experimental realization


title: Absence of quantization in the circular photogalvanic effect in disordered chiral Weyl semimetals

abstract: The circularly polarized photogalvanic effect (CPGE) is studied in chiral Weyl semimetals with short-ranged quenched disorder. Without disorder, the topological properties of chiral Weyl semimetals lead to the quantization of the CPGE, which is a second-order optical response. Using a combination of diagrammatic perturbation theory in the continuum and exact numerical calculations via the kernel polynomial method on a lattice model we show that disorder perturbatively destabilizes the quantization of the CPGE.


title: Scalable simulation of non-equilibrium quantum dynamics via classically optimised unitary circuits

abstract: The advent of near-term digital quantum computers could offer us an exciting opportunity to investigate quantum many-body phenomena beyond that of classical computing. To make the best use of the hardware available, it is paramount that we have methods that accurately simulate Hamiltonian dynamics for limited circuit depths. In this paper, we propose a method to classically optimise unitary brickwall circuits to approximate quantum time evolution operators. Our method is scalable in system size through the use of tensor networks. We demonstrate that, for various three-body Hamiltonians, our approach produces quantum circuits that can outperform Trotterization in both their accuracy and the quantum circuit depth needed to implement the dynamics, with the exact details being dependent on the Hamiltonian. We also explain how to choose an optimal time step that minimises the combined errors of the quantum device and the brickwall circuit approximation.


title: Perturbation Analysis of Markov Chain Monte Carlo for Graphical Models

abstract: The basic question in perturbation analysis of Markov chains is: how do small changes in the transition kernels of Markov chains translate to chains in their stationary distributions? Many papers on the subject have shown, roughly, that the change in stationary distribution is small as long as the change in the kernel is much less than some measure of the convergence rate. This result is essentially sharp for generic Markov chains. In this paper we show that much larger errors, up to size roughly the square root of the convergence rate, are permissible for many target distributions associated with graphical models. The main motivation for this work comes from computational statistics, where there is often a tradeoff between the per-step error and per-step cost of approximate MCMC algorithms. Our results show that larger perturbations (and thus less-expensive chains) still give results with small error.


title: Deep Reinforcement Learning Based Placement for Integrated Access Backhauling in UAV-Assisted Wireless Networks

abstract: The advent of fifth generation (5G) networks has opened new avenues for enhancing connectivity, particularly in challenging environments like remote areas or disaster-struck regions. Unmanned aerial vehicles (UAVs) have been identified as a versatile tool in this context, particularly for improving network performance through the Integrated access and backhaul (IAB) feature of 5G. However, existing approaches to UAV-assisted network enhancement face limitations in dynamically adapting to varying user locations and network demands. This paper introduces a novel approach leveraging deep reinforcement learning (DRL) to optimize UAV placement in real-time, dynamically adjusting to changing network conditions and user requirements. Our method focuses on the intricate balance between fronthaul and backhaul links, a critical aspect often overlooked in current solutions. The unique contribution of this work lies in its ability to autonomously position UAVs in a way that not only ensures robust connectivity to ground users but also maintains seamless integration with central network infrastructure. Through various simulated scenarios, we demonstrate how our approach effectively addresses these challenges, enhancing coverage and network performance in critical areas. This research fills a significant gap in UAV-assisted 5G networks, providing a scalable and adaptive solution for future mobile networks.


title: Towards Understanding Underwater Weather Events in Rivers Using Autonomous Surface Vehicles

abstract: Climate change has increased the frequency and severity of extreme weather events such as hurricanes and winter storms. The complex interplay of floods with tides, runoff, and sediment creates additional hazards -- including erosion and the undermining of urban infrastructure -- consequently impacting the health of our rivers and ecosystems. Observations of these underwater phenomena are rare, because satellites and sensors mounted on aerial vehicles cannot penetrate the murky waters. Autonomous Surface Vehicles (ASVs) provides a means to track and map these complex and dynamic underwater phenomena. This work highlights preliminary results of high-resolution data gathering with ASVs, equipped with a suite of sensors capable of measuring physical and chemical parameters of the river. Measurements were acquired along the lower Schuylkill River in the Philadelphia area at high-tide and low-tide conditions. The data will be leveraged to improve our understanding of changes in bathymetry due to floods; the dynamics of mixing and stagnation zones and their impact on water quality; and the dynamics of suspension and resuspension of fine sediment. The data will also provide insight into the development of adaptive sampling strategies for ASVs that can maximize the information gain for future field experiments.


title: GenoCraft: A Comprehensive, User-Friendly Web-Based Platform for High-Throughput Omics Data Analysis and Visualization

abstract: The surge in high-throughput omics data has reshaped the landscape of biological research, underlining the need for powerful, user-friendly data analysis and interpretation tools. This paper presents GenoCraft, a web-based comprehensive software solution designed to handle the entire pipeline of omics data processing. GenoCraft offers a unified platform featuring advanced bioinformatics tools, covering all aspects of omics data analysis. It encompasses a range of functionalities, such as normalization, quality control, differential analysis, network analysis, pathway analysis, and diverse visualization techniques. This software makes state-of-the-art omics data analysis more accessible to a wider range of users. With GenoCraft, researchers and data scientists have access to an array of cutting-edge bioinformatics tools under a user-friendly interface, making it a valuable resource for managing and analyzing large-scale omics data. The API with an interactive web interface is publicly available at https://genocraft.stanford. edu/. We also release all the codes in https://github.com/futianfan/GenoCraft.


title: HElium: A Language and Compiler for Fully Homomorphic Encryption with Support for Proxy Re-Encryption

abstract: Privacy-preserving analysis of confidential data can increase the value of such data and even improve peoples' lives. Fully homomorphic encryption (FHE) can enable privacy-preserving analysis. However, FHE adds a large amount of computational overhead and its efficient use requires a high level of expertise. Compilers can automate certain aspects such as parameterization and circuit optimizations. This in turn makes FHE accessible to non-cryptographers. Yet, multi-party scenarios remain complicated and exclude many promising use cases such as analyses of large amounts of health records for medical research. Proxy re-encryption (PRE), a technique that allows the conversion of data from multiple sources to a joint encryption key, can enable FHE for multi-party scenarios. Today, there are no optimizing compilers for FHE with PRE capabilities. We propose HElium, the first optimizing FHE compiler with native support for proxy re-encryption. HElium features HEDSL, a domain-specific language (DSL) specifically designed for multi-party scenarios. By tracking encryption keys and transforming the computation circuit during compilation, HElium minimizes the number of expensive PRE operations. We evaluate the effectiveness of HElium's optimizations based on the real-world use case of the tumor recurrence rate, a well-known subject of medical research. Our empirical evaluation shows that HElium substantially reduces the overhead introduced through complex PRE operations, an effect that increases for larger amounts of input data.


title: Pressure-dependent "Insulator-Metal-Insulator" Behavior in Sr-doped La$_3$Ni$_2$O$_7$

abstract: Recently, superconductivity at high temperatures has been observed in bulk La$_3$Ni$_2$O$_{7-{\delta}}$ under high pressure. However, the attainment of high-purity La$_3$Ni$_2$O$_{7-{\delta}}$ single crystals, exhibiting controlled and homogeneous stoichiometry through the post-annealing process in an oxygen-rich floating zone furnace, remains a formidable challenge. Here, we report the crystal structure and physical properties of single crystals of Sr-doped La$_3$Ni$_2$O$_7$ synthesized at high pressure (20 GPa) and high temperature (1400 {\deg}C). Through single crystal X-ray diffraction, we showed that high-pressure-synthesized paramagnetic Sr-doped La$_3$Ni$_2$O$_7$ crystallizes in an orthorhombic structure with Ni-O-Ni bond angles of 173.4(2){\deg}out-of-plane and 175.0(2){\deg}and 176.7(2){\deg}in plane. The substitution of Sr alters in band filling and the ratio of Ni$^{2+}$/Ni$^{3+}$ in Sr-doped La$_3$Ni$_2$O$_7$, aligning them with those of "La$_3$Ni$_2$O$_{7.05}$", thereby leading to significant modifications in properties under high pressure relative to the unsubstituted parent phase. At ambient pressure, Sr-doped La$_3$Ni$_2$O$_7$ exhibits insulating properties, and the conductivity increases as pressure goes up to 10 GPa. However, upon further increasing pressure beyond 10.7 GPa, Sr-doped La$_3$Ni$_2$O$_7$ transits back from a metal-like behavior to an insulator. The insulator-metal-insulator trend under high pressure dramatically differs from the behavior of the parent compound La$_3$Ni$_2$O$_{7-{\delta}}$, despite their similar behavior in the low-pressure regime. These experimental results underscore the considerable challenge in achieving superconductivity in nickelates.


title: Learning Adaptive Constraints in Nonlinear FETI-DP Methods

abstract: While linear FETI-DP (Finite Element Tearing and Interconnecting - Dual Primal) is an efficient iterative domain decomposition solver for discretized linear PDEs (partial differential equations), nonlinear FETI-DP is its consequent extension to the nonlinear case. In both methods, the parallel efficiency of the method results from a decomposition of the computational domain into nonoverlapping subdomains and a resulting localization of the computational work. For a fast linear convergence of the linear FETI-DP method, a global coarse problem has to be considered. Adaptive coarse spaces are provably robust variants for many complicated micro-heterogeneous problems, as, for example, stationary diffusion problems with large jumps in the diffusion coefficient. Unfortunately, the set-up and exact computation of adaptive coarse spaces is known to be computationally expensive. Therefore, recently, surrogate models based on neural networks have been trained to directly predict the adaptive coarse constraints. Here, these learned constraints are implemented in nonlinear FETI-DP and it is shown numerically that they are able to improve the nonlinear as well as linear convergence speed of nonlinear FETI-DP.


title: Quantum Entanglement on Black Hole Horizons in String Theory and Holography

abstract: We compute the exact one-loop partition function of $\mathbb{Z}_N$ orbifolds of Euclidean BTZ black hole with the aim to compute the entanglement entropy of the black hole horizon in string theory as a function of the mass and spin of the black hole and the $\mathrm{AdS}_3$ radius. We analyze the tachyonic contribution to the modular integrand for the partition function known for odd integers $N>1$ and show that it admits an analytic continuation resulting in a finite answer for the modular integral in the physical region $0< N \leq 1$. We discuss the flat space limit and the relevance of this computation for quantum gravity near black hole horizons and holography in relation to the thermal entropy.


title: Contextual Feature Selection with Conditional Stochastic Gates

abstract: Feature selection is a crucial tool in machine learning and is widely applied across various scientific disciplines. Traditional supervised methods generally identify a universal set of informative features for the entire population. However, feature relevance often varies with context, while the context itself may not directly affect the outcome variable. Here, we propose a novel architecture for contextual feature selection where the subset of selected features is conditioned on the value of context variables. Our new approach, Conditional Stochastic Gates (c-STG), models the importance of features using conditional Bernoulli variables whose parameters are predicted based on contextual variables. We introduce a hypernetwork that maps context variables to feature selection parameters to learn the context-dependent gates along with a prediction model. We further present a theoretical analysis of our model, indicating that it can improve performance and flexibility over population-level methods in complex feature selection settings. Finally, we conduct an extensive benchmark using simulated and real-world datasets across multiple domains demonstrating that c-STG can lead to improved feature selection capabilities while enhancing prediction accuracy and interpretability.


title: Entropy versus volume via Heegaard diagrams

abstract: The following inequalities are established, improving a former inequality due to Kojima. For any closed arithmetic hyperbolic $3$--manifold fibering over a circle, the entropy of the pseudo-Anosov monodromy is bounded by the hyperbolic volume of the $3$--manifold, up to a universal constant factor. For any closed hyperbolic $3$--manifold fibering over a circle with systole $\geq\varepsilon>0$, the entropy is bounded by the hyperbolic volume times $\log(3+1/\varepsilon)$, up to a universal constant factor. The proof relies on Heegaard Floer homology and hyperbolic geometry.


title: An extension of May's Theorem to three alternatives: axiomatizing Minimax voting

abstract: May's Theorem [K. O. May, Econometrica 20 (1952) 680-684] characterizes majority voting on two alternatives as the unique preferential voting method satisfying several simple axioms. Here we show that by adding some desirable axioms to May's axioms, we can uniquely determine how to vote on three alternatives. In particular, we add two axioms stating that the voting method should mitigate spoiler effects and avoid the so-called strong no show paradox. We prove a theorem stating that any preferential voting method satisfying our enlarged set of axioms, which includes some weak homogeneity and preservation axioms, agrees with Minimax voting in all three-alternative elections, except perhaps in some improbable knife-edged elections in which ties may arise and be broken in different ways.


title: A new approach to $P-V$ phase transitions: Einstein gravity and holographic dark energy

abstract: In the framework of Einstein gravity, we study the thermodynamic equation state, $P=P(V,T)$, associated with a flat Friedmann-Lemaitre-Robertson-Walker (FLRW) universe with two dominant non-interacting fluids at late times related by the cosmological coincidence parameter. We find that under these circumstances, first-order $P-V$ phase transitions are admitted if the dark energy density and the cosmological coincidence parameter can be related to the geometry of the apparent horizon.


title: Absorption, scattering, quasinormal modes and shadow by canonical acoustic black holes in Lorentz-violating background

abstract: In the present work, we study the scattering for a black hole described by the canonical acoustic metric with Lorentz violation using asymptotic and numerical methods. In this scenario, we also check the effects of quasinormal modes and the acoustic shadow radius. In the eikonal limit the relationship between the shadow radius and the real part of the quasinormal frequency is preserved.


title: Multi-Agent Bandit Learning through Heterogeneous Action Erasure Channels

abstract: Multi-Armed Bandit (MAB) systems are witnessing an upswing in applications within multi-agent distributed environments, leading to the advancement of collaborative MAB algorithms. In such settings, communication between agents executing actions and the primary learner making decisions can hinder the learning process. A prevalent challenge in distributed learning is action erasure, often induced by communication delays and/or channel noise. This results in agents possibly not receiving the intended action from the learner, subsequently leading to misguided feedback. In this paper, we introduce novel algorithms that enable learners to interact concurrently with distributed agents across heterogeneous action erasure channels with different action erasure probabilities. We illustrate that, in contrast to existing bandit algorithms, which experience linear regret, our algorithms assure sub-linear regret guarantees. Our proposed solutions are founded on a meticulously crafted repetition protocol and scheduling of learning across heterogeneous channels. To our knowledge, these are the first algorithms capable of effectively learning through heterogeneous action erasure channels. We substantiate the superior performance of our algorithm through numerical experiments, emphasizing their practical significance in addressing issues related to communication constraints and delays in multi-agent environments.


title: Elevating Defenses: Bridging Adversarial Training and Watermarking for Model Resilience

abstract: Machine learning models are being used in an increasing number of critical applications; thus, securing their integrity and ownership is critical. Recent studies observed that adversarial training and watermarking have a conflicting interaction. This work introduces a novel framework to integrate adversarial training with watermarking techniques to fortify against evasion attacks and provide confident model verification in case of intellectual property theft. We use adversarial training together with adversarial watermarks to train a robust watermarked model. The key intuition is to use a higher perturbation budget to generate adversarial watermarks compared to the budget used for adversarial training, thus avoiding conflict. We use the MNIST and Fashion-MNIST datasets to evaluate our proposed technique on various model stealing attacks. The results obtained consistently outperform the existing baseline in terms of robustness performance and further prove the resilience of this defense against pruning and fine-tuning removal attacks.


title: Low-power event-based face detection with asynchronous neuromorphic hardware

abstract: The rise of mobility, IoT and wearables has shifted processing to the edge of the sensors, driven by the need to reduce latency, communication costs and overall energy consumption. While deep learning models have achieved remarkable results in various domains, their deployment at the edge for real-time applications remains computationally expensive. Neuromorphic computing emerges as a promising paradigm shift, characterized by co-localized memory and computing as well as event-driven asynchronous sensing and processing. In this work, we demonstrate the possibility of solving the ubiquitous computer vision task of object detection at the edge with low-power requirements, using the event-based N-Caltech101 dataset. We present the first instance of an on-chip spiking neural network for event-based face detection deployed on the SynSense Speck neuromorphic chip, which comprises both an event-based sensor and a spike-based asynchronous processor implementing Integrate-and-Fire neurons. We show how to reduce precision discrepancies between off-chip clock-driven simulation used for training and on-chip event-driven inference. This involves using a multi-spike version of the Integrate-and-Fire neuron on simulation, where spikes carry values that are proportional to the extent the membrane potential exceeds the firing threshold. We propose a robust strategy to train spiking neural networks with back-propagation through time using multi-spike activation and firing rate regularization and demonstrate how to decode output spikes into bounding boxes. We show that the power consumption of the chip is directly proportional to the number of synaptic operations in the spiking neural network, and we explore the trade-off between power consumption and detection precision with different firing rate regularization, achieving an on-chip face detection mAP[0.5] of ~0.6 while consuming only ~20 mW.


title: Exploring the intersection of Generative AI and Software Development

abstract: In the ever-evolving landscape of Artificial Intelligence (AI), the synergy between generative AI and Software Engineering emerges as a transformative frontier. This whitepaper delves into the unexplored realm, elucidating how generative AI techniques can revolutionize software development. Spanning from project management to support and updates, we meticulously map the demands of each development stage and unveil the potential of generative AI in addressing them. Techniques such as zero-shot prompting, self-consistency, and multimodal chain-of-thought are explored, showcasing their unique capabilities in enhancing generative AI models. The significance of vector embeddings, context, plugins, tools, and code assistants is underscored, emphasizing their role in capturing semantic information and amplifying generative AI capabilities. Looking ahead, this intersection promises to elevate productivity, improve code quality, and streamline the software development process. This whitepaper serves as a guide for stakeholders, urging discussions and experiments in the application of generative AI in Software Engineering, fostering innovation and collaboration for a qualitative leap in the efficiency and effectiveness of software development.


title: z~2 dual AGN host galaxies are disky: stellar kinematics in the ASTRID Simulation

abstract: We study dual AGN host galaxy morphologies at $z=2$ using the ASTRID simulation, selecting black hole (BH) pairs with small separation ($\Delta r<30\rm{kpc}$), high mass ($M_{\text{BH,12}}>10^7M_\odot$), and luminosity ($L_{\text{bol,12}}>10^{43}\rm{erg/s}$). We kinematically decompose (using MORDOR) $\sim1000$ dual AGN hosts into standard components - a `disk' (thin and thick disk, pseudo-bulge) and 'bulge' (bulge and halo) and define disk-dominated galaxies by the disk-to-total $D/T\geq0.5$. In ASTRID, $60.9\pm2.1\%$ of dual AGN hosts (independent of separation) are disk-dominated, with the $D/T$ distribution peaking at $\sim0.7$. Notably, hosts of BH pairs have similar morphologies (most either both disk or bulge-dominated). In dual-AGN hosts, the $D/T$ increases from $\sim17\% $ at $M_{\rm *}\sim 10^{9} M_{\odot}$ to $ 64\% $ for $M_{\rm *} \sim 10^{11.5} M_{\odot}$, and the pseudo-bulge is the dominant component of the disk fraction at the high mass end. Moreover, dual AGN hosts exhibit a higher fraction of disk/large pseudo-bulge than single-AGN hosts. The Disk-to-Total ratio is approximately constant with BH mass or AGN luminosity. We also create mock images of dual AGN host galaxies, employing morphological fitting software Statmorph to calculate morphological parameters and compare them with our kinematic decomposition results. Around $83.3\pm2.4\%$ of galaxies display disk-like profiles, of which $\sim60.7\pm2.2\%$ are kinematically confirmed as disks. Se\'rsic indices and half-mass radii of dual AGN host galaxies align with observational measurements from HST at $z\sim2$. Around $34\%$ are identified as mergers from the $\text{Gini}-M_{20}$ relation. We find two dual AGN hosted by galaxies that exhibit disk-like se\'rsic index $n_{12}<1$ and $(D/T)_{12}>0.5$, which are in remarkable agreement with properties of recently discovered dual quasars in disk galaxies at $z\sim 2$.


title: Experimental demonstration of magnetic tunnel junction-based computational random-access memory

abstract: Conventional computing paradigm struggles to fulfill the rapidly growing demands from emerging applications, especially those for machine intelligence, because much of the power and energy is consumed by constant data transfers between logic and memory modules. A new paradigm, called "computational random-access memory (CRAM)" has emerged to address this fundamental limitation. CRAM performs logic operations directly using the memory cells themselves, without having the data ever leave the memory. The energy and performance benefits of CRAM for both conventional and emerging applications have been well established by prior numerical studies. However, there lacks an experimental demonstration and study of CRAM to evaluate its computation accuracy, which is a realistic and application-critical metrics for its technological feasibility and competitiveness. In this work, a CRAM array based on magnetic tunnel junctions (MTJs) is experimentally demonstrated. First, basic memory operations as well as 2-, 3-, and 5-input logic operations are studied. Then, a 1-bit full adder with two different designs is demonstrated. Based on the experimental results, a suite of modeling has been developed to characterize the accuracy of CRAM computation. Scalar addition, multiplication, and matrix multiplication, which are essential building blocks for many conventional and machine intelligence applications, are evaluated and show promising accuracy performance. With the confirmation of MTJ-based CRAM's accuracy, there is a strong case that this technology will have a significant impact on power- and energy-demanding applications of machine intelligence.

categories: cs.ET cond-mat.mes-hall cs.AI cs.AR cs.SY eess.SY


title: Applications of Lipschitz neural networks to the Run 3 LHCb trigger system

abstract: The operating conditions defining the current data taking campaign at the Large Hadron Collider, known as Run 3, present unparalleled challenges for the real-time data acquisition workflow of the LHCb experiment at CERN. To address the anticipated surge in luminosity and consequent event rate, the LHCb experiment is transitioning to a fully software-based trigger system. This evolution necessitated innovations in hardware configurations, software paradigms, and algorithmic design. A significant advancement is the integration of monotonic Lipschitz neural networks into the LHCb trigger system. These deep learning models offer certified robustness against detector instabilities, and the ability to encode domain-specific inductive biases. Such properties are crucial for the inclusive heavy-flavour triggers and, most notably, for the topological triggers designed to inclusively select $b$-hadron candidates by exploiting the unique kinematic and decay topologies of beauty decays. This paper describes the recent progress in integrating Lipschitz neural networks into the topological triggers, highlighting the resulting enhanced sensitivity to highly displaced multi-body candidates produced within the LHCb acceptance.


title: Polyhedral surfaces in flat (2+1)-spacetimes and balanced cellulations on hyperbolic surfaces

abstract: We first prove that given a hyperbolic metric $h$ on a closed surface $S$, any flat metric on $S$ with negative singular curvatures isometrically embeds as a convex polyhedral Cauchy surface in a unique future-complete flat globally hyperbolic maximal (2+1)-spacetime whose linear part of the holonomy is given by $h$. The Gauss map allows to translate this statement to a purely 2-dimensional problem of finding a balanced geodesic cellulation on the hyperbolic surface, from which the flat metric can be easily recovered. We show next that given two such flat metrics on the surface, there exists a unique pair of future- and past-complete flat globally hyperbolic maximal (2+1)-spacetimes with the same holonomy, in which the flat metrics embed respectively as convex polyhedral Cauchy surfaces. The proof follows from convexity properties of the total length of the associated balanced geodesic cellulations over Teichm\"uller space.


title: Rethinking the external globus pallidus and information flow in cortico-basal ganglia-thalamic circuits

abstract: For decades the external globus pallidus (GPe) has been viewed as a passive way-station in the indirect pathway of the cortico-basal ganglia-thalamic (CBGT) circuit, sandwiched between striatal inputs and basal ganglia outputs. According to this model, one-way descending striatal signals in the indirect pathway amplify the suppression of downstream thalamic nuclei by inhibiting GPe activity. Here we revisit this assumption, in light of new and emerging work on the cellular complexity, connectivity, and functional role of the GPe in behavior. We show how, according to this new circuit-level logic, the GPe is ideally positioned for relaying ascending and descending control signals within the basal ganglia. Focusing on the problem of inhibitory control, we illustrate how this bidirectional flow of information allows for the integration of reactive and proactive control mechanisms during action selection. Taken together, this new evidence points to the GPe as being a central hub in the CBGT circuit, participating in bidirectional information flow and linking multifaceted control signals to regulate behavior.


title: Statistics of a granular cluster ensemble at a liquid-solid-like phase transition

abstract: We report on the construction of a granular network of particles to study the formation, evolution and statistical properties of clusters of particles developing at the vicinity of a liquid-solid-like phase transition within a vertically vibrated quasi two-dimensional granular system. Using the data of particle positions and local order from Castillo et al [Phys. Rev. Lett. 109, 095701 (2012)], we extract granular clusters taken as communities of the granular network via modularity optimization. Each one of these communities is a patch of particles with a very well defined local orientational order embedded within an array of other patches forming a complex cluster network. The distribution of cluster sizes and life-spans for the cluster network depend on the distance to the liquid-solid-like phase transition of the quasi two-dimensional granular system. Specifically, the cluster size distribution displays a scale-invariant behavior for at least a decade in cluster sizes, while cluster lifespans grows monotonically with each cluster size. We believe this systematic community analysis for clustering in granular systems can serve to study and understand the spatio-temporal evolution of mesoscale structures in systems displaying out-of-equilibrium phase transitions.


title: The GAPS programme at TNG LII. Spot modeling of V1298 Tau using SpotCCF tool

abstract: The intrinsic variability due to the magnetic activity of young active stars is one of the main challenges in detecting and characterising exoplanets. We present a method able to model the stellar photosphere and its surface inhomogeneities (starspots) in young/active and fast-rotating stars, based on the cross-correlation function (CCF) technique, to extract information about the spot configuration of the star. Within the Global Architecture of Planetary Systems (GAPS) Project at the Telescopio Nazionale Galileo, we analysed more than 300 spectra of the young planet-hosting star V1298 Tau provided by HARPS-N high-resolution spectrograph. By applying the SpotCCF model to the CCFs we extracted the spot configuration (latitude, longitude and projected filling factor) of this star, and also provided the new RVs time series of this target. We find that the features identified in the CCF profiles of V1298 Tau are modulated by the stellar rotation, supporting our assumption that they are caused by starspots. The analysis suggests a differential rotation velocity of the star with lower rotation at higher latitudes. Also, we find that SpotCCF provides an improvement in RVs extraction with a significantly lower dispersion with respect to the commonly used pipelines, with consequent mitigation of the stellar activity contribution modulated with stellar rotation. A detection sensitivity test, by the direct injection of a planetary signal into the data, confirmed that the SpotCCF model improves the sensitivity and ability to recover planetary signals. Our method enables the modelling of the stellar photosphere, extracting the spot configuration of young/active and rapidly rotating stars. It also allows for the extraction of optimised RV time series, thereby enhancing our detection capabilities for new exoplanets and advancing our understanding of stellar activity.


title: Inertial Waves in a Nonlinear Simulation of the Sun's Convection Zone and Radiative Interior

abstract: Recent observations of Rossby waves and other more exotic forms of inertial oscillations in the Sun's convection zone have kindled the hope that such waves might be used as a seismic probe of the Sun's interior. Here we present a 3D numerical simulation in spherical geometry that models the Sun's convection zone and upper radiative interior. This model features a wide variety of inertial oscillations, including both sectoral and tesseral equatorial Rossby waves, retrograde mixed inertial modes, prograde thermal Rossby waves, the recently observed high-frequency retrograde (HFR) vorticity modes, and what may be latitudinal overtones of these HFR modes. With this model, we demonstrate that sectoral and tesseral Rossby waves are ubiquitous within the radiative interior as well as within the convection zone. We suggest that there are two different Rossby-wave families in this simulation that live in different wave cavities: one in the radiative interior and one in the convection zone. Finally, we suggest that many of the retrograde inertial waves that appear in the convection zone, including the HFR modes, are in fact all related, being latitudinal overtones that are mixed modes with the prograde thermal Rossby waves.


title: The Volume of a Surface or Orbifold Pair

abstract: A surface pair $(X,C)$ is a germ of a normal surface singularity $(X,0)$ and a sum $C=\sum c_iC_i$ of curves on $X$, with $c_i\in [0,1]$. An orbifold pair has $c_i=1/n_i$, as intersecting with a small sphere gives a $3$-dimensional orbifold $(\Sigma, \gamma_i,n_i)$. There are natural notions of morphism and log cover of surface pairs. We introduce a volume $Vol(X,C)$ in $\mathbb Q_{\geq 0}$, computable from any log resolution, analogous to that in our 1990 JAMS paper when $C=0$. Denoting $\bar{C}=\sum (1-c_i)C_i$, one has $(X,C)$ log canonical iff $Vol(X,\bar{C})=0$. The main theorem (5.4-5.6) is that $Vol(X,C)$ is ``characteristic'': if $f:(X',C')\rightarrow (X,C)$ is a morphism of degree $d$, then $Vol(X',C')\geq d\cdot Vol(X,C)$, with equality if $f$ is a log cover. We prove (6.7) that $Vol(X,\sum (1/n_i)C_i)=0$ iff the associated orbifold has finite or solvable orbifold fundamental group, and these are classified. In (8.2) is proved a key case of the DCC Volumes Conjecture: The set $\{Vol(X,\sum (1/n_i)C_i)|\ X\ \text{RDP}\}$ satisfies the DCC, with minimum non-$0$ volume 1/3528.


title: On Some Types of Limit

abstract: In this paper, we consider the concept of limit, one of the basic concepts of mathematical analysis. At a point $a\in{\mathbb{R}}$, the limit of a function $f$ from $A\subset\mathbb{R}$ to $\mathbb{R}$ is $L\in{\mathbb{R}}$ if and only if there exists $\delta>0$ such that the set $$ \left\{x\in\left(\left(a-\delta,a+\delta\right)\backslash\left\{a\right\}\right)\cap A:\lvert f\left(x\right)-L\rvert \ge\varepsilon\right\} $$ is the empty set for each $\varepsilon>0$. This study investigates what happens when the above set is not empty. More clearly, when we take the above set as finite or a set whose accumulation points is empty, we prove that the limit concept does not change. However, when we take the above set as countable or a set of measure zero, we prove that they are new limit concepts. Also, we show that these new limit concepts have the properties of existence, uniqueness, additivity, multiplicativity, etc. Finally, by giving some examples, we compare the limit concepts we have obtained with the previous ones.


title: Towards Non-contact Muscle Activity Estimation using FMCW Radar

abstract: Surface electromyography (sEMG) is a widely used muscle activity monitoring technique. sEMG measures muscle activity through monopolar and bipolar, multi-electrode electrodes. The surface electrodes are placed on the surface of the skin above the target muscle and the received signal can be used to infer the state of the muscle - active, inactive or fatigued - which serves as vital information during neurological and orthopaedic rehabilitation. Additionally, the sEMG signal can also be used for the control of prostheses. sEMG requires contact with the participant's skin and is thus a potentially uncomfortable method for the measurement of muscle activity. Moreover, the setup procedure has been termed time-consuming by sEMG experts and is listed as one of the main barriers to the clinical employment of the technique. Previous studies have shown that architectural changes, particularly muscle deformation, can provide information about the activity of the muscle, providing an alternative to sEMG. In all these studies, the muscle deformation signal is acquired using ultrasound imaging, an approach known as sonomyography (SMG). Despite its advantages, such as improved spatial resolution, SMG is still a contact based approach. In this paper, we propose a non-contact muscle activity monitoring approach that measures the muscle deformation signal using a Frequency Modulated Continuous Wave (FMCW) mmWave radar which we call radiomyography (RMG). In future, this system will enable muscle activation to be measured in an unconstrained and less cumbersome manner for both the person conducting the test and the individual being tested.


title: Nonlinear Model Predictive Control of a Conductance-Based Neuron Model via Data-Driven Forecasting

abstract: Precise control of neural systems is essential to experimental investigations of how the brain controls behavior and holds the potential for therapeutic manipulations to correct aberrant network states like epilepsy. Although purely reactive controllers work well with single neurons and other simple neural systems, more sophisticated techniques are likely to be needed to control complex circuits and systems with nonlinear recurrent dynamics, high levels of exogenous noise, and limited information about the connectivity and state of the network. One potential approach is model predictive control (MPC), which uses a dynamical model to find optimal control inputs by forecasting how the system will respond. However, the challenge still remains of selecting the right model, constraining its parameters, and synchronizing to the neural system. As a proof of principle, we used recent advances in data-driven forecasting to construct a nonlinear machine-learning model of a Hodgkin-Huxley type neuron when only the membrane voltage is observable and there are an unknown number of intrinsic currents. We show that this approach is able to learn the dynamics of different neuron types and can be used with MPC to force the neuron to engage in arbitrary, researcher-defined spiking behaviors.


title: Two-site reduced density matrix from one- and two-particle Green's functions

abstract: Strongly correlated electron systems are challenging to calculate, and entanglement in such systems is not widely analyzed. We present an approach that can be used as a post-processing step for calculating the two-site reduced density matrix and from it entanglement measures such as the mutual information and entanglement negativity. Input is only the one- and two-particle Green's function which is the output of numerous many-body methods. As an illustration, we present results for a toy model, the Hubbard model on a $2\times2$ cluster and a $6$ site ring.


title: Deep Neural Networks and Finite Elements of Any Order on Arbitrary Dimensions

abstract: In this study, we establish that deep neural networks employing ReLU and ReLU$^2$ activation functions can effectively represent Lagrange finite element functions of any order on various simplicial meshes in arbitrary dimensions. We introduce two novel formulations for globally expressing the basis functions of Lagrange elements, tailored for both specific and arbitrary meshes. These formulations are based on a geometric decomposition of the elements, incorporating several insightful and essential properties of high-dimensional simplicial meshes, barycentric coordinate functions, and global basis functions of linear elements. This representation theory facilitates a natural approximation result for such deep neural networks. Our findings present the first demonstration of how deep neural networks can systematically generate general continuous piecewise polynomial functions on both specific or arbitrary simplicial meshes.


title: High-dimensional order parameters and neural network classifiers applied to amorphous ices

abstract: Amorphous ice phases are key constituents of water's complex structural landscape. This study investigates the polyamorphic nature of water, focusing on the complexities within low-density amorphous ice (LDA), high-density amorphous ice (HDA), and the recently discovered medium-density amorphous ice (MDA). We use rotationally-invariant, high-dimensional order parameters to capture a wide spectrum of local symmetries for the characterisation of local oxygen environments. We train a neural network (NN) to classify these local environments, and investigate the distinctiveness of MDA within the structural landscape of amorphous ice. Our results highlight the difficulty in accurately differentiating MDA from LDA due to structural similarities. Beyond water, our methodology can be applied to investigate the structural properties and phases of disordered materials.


title: Ductile-to-brittle transition and yielding in soft amorphous materials: perspectives and open questions

abstract: Soft amorphous materials are viscoelastic solids ubiquitously found around us, from clays and cementitious pastes to emulsions and physical gels encountered in food or biomedical engineering. Under an external deformation, these materials undergo a noteworthy transition from a solid to a liquid state that reshapes the material microstructure. This yielding transition was the main theme of a workshop held from January 9 to 13, 2023 at the Lorentz Center in Leiden. The manuscript presented here offers a critical perspective on the subject, synthesizing insights from the various brainstorming sessions and informal discussions that unfolded during this week of vibrant exchange of ideas. The result of these exchanges takes the form of a series of open questions that represent outstanding experimental, numerical, and theoretical challenges to be tackled in the near future.


title: Characterizing and Classifying Developer Forum Posts with their Intentions

abstract: With the rapid growth of the developer community, the amount of posts on online technical forums has been growing rapidly, which poses difficulties for users to filter useful posts and find important information. Tags provide a concise feature dimension for users to locate their interested posts and for search engines to index the most relevant posts according to the queries. However, most tags are only focused on the technical perspective (e.g., program language, platform, tool). In most cases, forum posts in online developer communities reveal the author's intentions to solve a problem, ask for advice, share information, etc. The modeling of the intentions of posts can provide an extra dimension to the current tag taxonomy. By referencing previous studies and learning from industrial perspectives, we create a refined taxonomy for the intentions of technical forum posts. Through manual labeling and analysis on a sampled post dataset extracted from online forums, we understand the relevance between the constitution of posts (code, error messages) and their intentions. Furthermore, inspired by our manual study, we design a pre-trained transformer-based model to automatically predict post intentions. The best variant of our intention prediction framework, which achieves a Micro F1-score of 0.589, Top 1-3 accuracy of 62.6% to 87.8%, and an average AUC of 0.787, outperforms the state-of-the-art baseline approach. Our characterization and automated classification of forum posts regarding their intentions may help forum maintainers or third-party tool developers improve the organization and retrieval of posts on technical forums. We have released our annotated dataset and codes in our supplementary material package.