title: Photonic molecule approach to multi-orbital topology

abstract: The concepts of topology provide a powerful tool to tailor the propagation and localization of light. While electromagnetic waves have only two polarization states, engineered degeneracies of photonic modes provide novel opportunities resembling orbital or spin degrees of freedom in condensed matter. Here, we tailor such degeneracies for the array of femtosecond laser written waveguides in the optical range exploiting the idea of photonic molecules -- clusters of strongly coupled waveguides. In our experiments, we observe the emergence of topological modes caused by the inter-orbital coupling and track multiple topological transitions in the system with the change of the lattice spacings and excitation wavelength. This strategy opens an avenue in designing novel types of photonic topological phases and states.


title: Neural architecture impact on identifying temporally extended Reinforcement Learning tasks

abstract: Inspired by recent developments in attention models for image classification and natural language processing, we present various Attention based architectures in reinforcement learning (RL) domain, capable of performing well on OpenAI Gym Atari-2600 game suite. In spite of the recent success of Deep Reinforcement learning techniques in various fields like robotics, gaming and healthcare, they suffer from a major drawback that neural networks are difficult to interpret. We try to get around this problem with the help of Attention based models. In Attention based models, extracting and overlaying of attention map onto images allows for direct observation of information used by agent to select actions and easier interpretation of logic behind the chosen actions. Our models in addition to playing well on gym-Atari environments, also provide insights on how agent perceives its environment. In addition, motivated by recent developments in attention based video-classification models using Vision Transformer, we come up with an architecture based on Vision Transformer, for image-based RL domain too. Compared to previous works in Vision Transformer, our model is faster to train and requires fewer computational resources. 3


title: Metaverse CAN: Embracing Continuous, Active, and Non-intrusive Biometric Authentication

abstract: The Metaverse is a virtual world, an immersive experience, a new human-computer interaction, built upon various advanced technologies. How to protect Metaverse personal information and virtual properties is also facing new challenges, such as new attacks and new expectations of user experiences. While traditional methods (e.g., those employed in smartphone authentication) generally pass the basic design considerations, they are repeatedly reported to be either unsafe or inconvenient in the Metaverse. In this paper, we address this discrepancy by introducing CAN: a new design consideration especially for the Metaverse. Specifically, we focus on the legacy and novel biometric authentication systems and evaluate them thoroughly with basic and CAN considerations. We also propose an ear-based method as one example of CAN systems. To conclude, a continuous, active and non-intrusive biometric system is suggested for Metaverse authentication for its capability in continuous sessions, against imposters, and immersive experience.


title: FedNAR: Federated Optimization with Normalized Annealing Regularization

abstract: Weight decay is a standard technique to improve generalization performance in modern deep neural network optimization, and is also widely adopted in federated learning (FL) to prevent overfitting in local clients. In this paper, we first explore the choices of weight decay and identify that weight decay value appreciably influences the convergence of existing FL algorithms. While preventing overfitting is crucial, weight decay can introduce a different optimization goal towards the global objective, which is further amplified in FL due to multiple local updates and heterogeneous data distribution. To address this challenge, we develop {\it Federated optimization with Normalized Annealing Regularization} (FedNAR), a simple yet effective and versatile algorithmic plug-in that can be seamlessly integrated into any existing FL algorithms. Essentially, we regulate the magnitude of each update by performing co-clipping of the gradient and weight decay. We provide a comprehensive theoretical analysis of FedNAR's convergence rate and conduct extensive experiments on both vision and language datasets with different backbone federated optimization algorithms. Our experimental results consistently demonstrate that incorporating FedNAR into existing FL algorithms leads to accelerated convergence and heightened model accuracy. Moreover, FedNAR exhibits resilience in the face of various hyperparameter configurations. Specifically, FedNAR has the ability to self-adjust the weight decay when the initial specification is not optimal, while the accuracy of traditional FL algorithms would markedly decline. Our codes are released at \href{https://github.com/ljb121002/fednar}{https://github.com/ljb121002/fednar}.


title: A Hierarchical Random Effects State-space Model for Modeling Brain Activities from Electroencephalogram Data

abstract: Mental disorders present challenges in diagnosis and treatment due to their complex and heterogeneous nature. Electroencephalogram (EEG) has shown promise as a potential biomarker for these disorders. However, existing methods for analyzing EEG signals have limitations in addressing heterogeneity and capturing complex brain activity patterns between regions. This paper proposes a novel random effects state-space model (RESSM) for analyzing large-scale multi-channel resting-state EEG signals, accounting for the heterogeneity of brain connectivities between groups and individual subjects. We incorporate multi-level random effects for temporal dynamical and spatial mapping matrices and address nonstationarity so that the brain connectivity patterns can vary over time. The model is fitted under a Bayesian hierarchical model framework coupled with a Gibbs sampler. Compared to previous mixed-effects state-space models, we directly model high-dimensional random effects matrices without structural constraints and tackle the challenge of identifiability. Through extensive simulation studies, we demonstrate that our approach yields valid estimation and inference. We apply RESSM to a multi-site clinical trial of Major Depressive Disorder (MDD). Our analysis uncovers significant differences in resting-state brain temporal dynamics among MDD patients compared to healthy individuals. In addition, we show the subject-level EEG features derived from RESSM exhibit a superior predictive value for the heterogeneous treatment effect compared to the EEG frequency band power, suggesting the potential of EEG as a valuable biomarker for MDD.


title: Enhancing Accuracy in Deep Learning Using Random Matrix Theory

abstract: We explore the applications of random matrix theory (RMT) in the training of deep neural networks (DNNs), focusing on layer pruning that is reducing the number of DNN parameters (weights). Our numerical results show that this pruning leads to a drastic reduction of parameters while not reducing the accuracy of DNNs and CNNs. Moreover, pruning the fully connected DNNs actually increases the accuracy and decreases the variance for random initializations. Our numerics indicate that this enhancement in accuracy is due to the simplification of the loss landscape. We next provide rigorous mathematical underpinning of these numerical results by proving the RMT-based Pruning Theorem. Our results offer valuable insights into the practical application of RMT for the creation of more efficient and accurate deep-learning models.


title: Raze to the Ground: Query-Efficient Adversarial HTML Attacks on Machine-Learning Phishing Webpage Detectors

abstract: Machine-learning phishing webpage detectors (ML-PWD) have been shown to suffer from adversarial manipulations of the HTML code of the input webpage. Nevertheless, the attacks recently proposed have demonstrated limited effectiveness due to their lack of optimizing the usage of the adopted manipulations, and they focus solely on specific elements of the HTML code. In this work, we overcome these limitations by first designing a novel set of fine-grained manipulations which allow to modify the HTML code of the input phishing webpage without compromising its maliciousness and visual appearance, i.e., the manipulations are functionality- and rendering-preserving by design. We then select which manipulations should be applied to bypass the target detector by a query-efficient black-box optimization algorithm. Our experiments show that our attacks are able to raze to the ground the performance of current state-of-the-art ML-PWD using just 30 queries, thus overcoming the weaker attacks developed in previous work, and enabling a much fairer robustness evaluation of ML-PWD.


title: Heavy-ion collisions, Gubser flow, and Carroll hydrodynamics

abstract: Gubser flow provides an analytic model for describing the spacetime dynamics of the quark-gluon plasma produced in heavy-ion collisions. Along with boost and rotation invariance along the beam axis, the model assumes invariance under a combination of translations and special conformal transformations in the transverse plane, leading to a flow profile which evolves not just along the beam axis, but also radially. We argue that Gubser flow and its associated symmetry assumptions arise naturally as a consequence of Carrollian symmetries for a conformal Carroll fluid, thereby providing a dual geometric picture for the flow. Given the inherent ultrarelativistic nature of the flow, this duality with Carroll hydrodynamics - which arises in the $c \to 0$ limit of relativistic hydrodynamics, is natural. We provide a precise map between Gubser flow and the conformal Carroll fluid, appropriate to capture the duality between the two not just at the ideal level, but also with the inclusion of hydrodynamic derivative corrections.


title: Analysis of a space-time phase-field fracture complementarity model and its optimal control formulation

abstract: The purpose of this work is the formulation of optimality conditions for phase-field optimal control problems. The forward problem is first stated as an abstract nonlinear optimization problem, and then the necessary optimality conditions are derived. The sufficient optimality conditions are also examined. The choice of suitable function spaces to ensure the regularity of the nonlinear optimization problem is a true challenge here. Afterwards the optimal control problem with a tracking type cost functional is formulated. The constraints are given by the previously derived first order optimality conditions of the forward problem. Herein regularity is proven under certain conditions and first order optimality conditions are formulated.


title: Metadynamics calculations of the effect of thermal spin fluctuations on skyrmion stability

abstract: The stability of magnetic skyrmions has been investigated in the past, but mostly in the absence of thermal fluctuations. However, thermal spin fluctuations modify the magnetic properties (exchange stiffness, Dzyaloshinskii-Moriya interaction (DMI) and anisotropy) that define skyrmion stability. Thermal magnons also excite internal skrymion dynamics, deforming the skyrmion shape. Entropy has also been shown to modify skyrmion lifetimes in experiments, but is absent or approximated in previous studies. Here we use metadynamics to calculate the free energy surface of a magnetic thin film in terms of the topological charge and magnetization. We identify the free energy minima corresponding to different spin textures and the lowest energy paths between the ferromagnetic and single skyrmion states. We show that at low temperatures the lowest free energy barrier is a skyrmion collapse process. However, this energy barrier increases with temperature. An alternative path, where a singularity forms on the skrymion edge, has a larger free energy barrier at low temperatures but decreases with increasing temperature and eventually becomes the lowest energy barrier.


title: Critical Role of Disorder for Superconductivity in the Series of Epitaxial Ti(O,N) Films

abstract: Experimental manipulation of superconductivity is of paramount importance, not only for practical applications but also for identifying the key factors involved in electron pairing. In this work, we have undertaken a meticulous study of the superconductivity in a series of titanium compounds with a rocksalt structure, synthesized as epitaxial films. We find that substituting nitrogen (N) for oxygen (O) in titanium monoxide (TiO) with the stoichiometry close to TiO$_{0.6}$N$_{0.4}$ leads to superconductivity with a transition temperature (T$_c$) of ~2.6 K, about five times higher than that of TiO at ~0.5 K and half as high as the T$_c$ of ~6 K in titanium nitride (TiN). However, Eliashberg theoretical calculations predict similar Tc in TiO, Ti oxynitride and TiN. The analysis of electron mean free path suggests the presence of significant disorder in TiO and a remarkable reduction in the impact of disorder in oxynitrides. Density functional theory (DFT) calculations reveal that disorder decreases the coherence of electronic states for non-zero momenta, which would degrade the influence of electron-phonon. Our findings demonstrate the disorder and superconductivity depend strongly on the N/O ratio, highlighting the critical role of disorder for superconductivity in this series of Ti(O,N) materials.


title: Online Knowledge Production in Polarized Political Memes: The Case of Critical Race Theory

abstract: Visual culture has long been deployed by actors across the political spectrum as tools of political mobilization, and have recently incorporated new communication tools, such as memes, GIFs, and emojis. In this study, we analyze the top-circulated Facebook memes relating to critical race theory (CRT) from May 2021 - May 2022 to investigate their visual and textual appeals. Using image clustering techniques and critical discourse analysis, we find that both pro- and anti-CRT memes deploy similar rhetorical tactics to make bifurcating arguments, most of which do not pertain to the academic formulations of CRT. Instead, these memes manipulate definitions of racism and antiracism to appeal to their respective audiences. We argue that labeling such discursive practices as simply a symptom of "post-truth" politics is a potentially unproductive stance. Instead, theorizing the knowledge-building practices of these memes through a lens of political epistemology allows us to understand how they produce meaning.


title: Optimization and Evaluation of Multi Robot Surface Inspection Through Particle Swarm Optimization

abstract: Robot swarms can be tasked with a variety of automated sensing and inspection applications in aerial, aquatic, and surface environments. In this paper, we study a simplified two-outcome surface inspection task. We task a group of robots to inspect and collectively classify a 2D surface section based on a binary pattern projected on the surface. We use a decentralized Bayesian decision-making algorithm and deploy a swarm of miniature 3-cm sized wheeled robots to inspect randomized black and white tiles of $1m\times 1m$. We first describe the model parameters that characterize our simulated environment, the robot swarm, and the inspection algorithm. We then employ a noise-resistant heuristic optimization scheme based on the Particle Swarm Optimization (PSO) using a fitness evaluation that combines decision accuracy and decision time. We use our fitness measure definition to asses the optimized parameters through 100 randomized simulations that vary surface pattern and initial robot poses. The optimized algorithm parameters show up to a 55% improvement in median of fitness evaluations against an empirically chosen parameter set.


title: $\mathcal{B}$-Coder: Value-Based Deep Reinforcement Learning for Program Synthesis

abstract: Program synthesis aims to create accurate, executable programs from problem specifications, specifically from natural language descriptions in our context. Recent studies have leveraged the power of reinforcement learning (RL) in conjunction with large language models (LLMs), significantly enhancing code generation capabilities. The application of RL focuses on directly optimizing for functional correctness, offering an advantage over conventional supervised methods. Despite policy-based RL methods dominating the literature on RL for program synthesis, the nature of program synthesis tasks hints at a natural alignment with value-based methods. This stems from the rich collection of off-policy programs, including those developed by human programmers and also historical samples, coupled with the straightforward verification of generated programs through automated unit testing, meaning rewards are easy to obtain. Diverging from the dominant use of policy-based algorithms, our work explores the feasibility of value-based approaches, leading to the development of our $\mathcal{B}$-Coder (pronounced Bellman coder). Yet, training value-based methods presents challenges due to the enormous search space inherent to program synthesis. To this end, we introduce an initialization protocol for RL agents utilizing pre-trained LMs and a conservative Bellman operator to reduce training complexities. Moreover, we demonstrate how to leverage the learned value functions as a dual strategy to post-process generated programs. Our empirical evaluations demonstrated $\mathcal{B}$-Coder's capability in achieving state-of-the-art performance when compared to policy-based methods. Remarkably, this achievement is reached with minimal reward engineering effort, highlighting the effectiveness of value-based RL, independent of reward designs.


title: Test Case Recommendations with Distributed Representation of Code Syntactic Features

abstract: Frequent modifications of unit test cases are inevitable due to software's continuous underlying changes in source code, design, and requirements. Since manually maintaining software test suites is tedious, timely, and costly, automating the process of generation and maintenance of test units will significantly impact the effectiveness and efficiency of software testing processes. To this end, we propose an automated approach which exploits both structural and semantic properties of source code methods and test cases to recommend the most relevant and useful unit tests to the developers. The proposed approach initially trains a neural network to transform method-level source code, as well as unit tests, into distributed representations (embedded vectors) while preserving the importance of the structure in the code. Retrieving the semantic and structural properties of a given method, the approach computes cosine similarity between the method's embedding and the previously-embedded training instances. Further, according to the similarity scores between the embedding vectors, the model identifies the closest methods of embedding and the associated unit tests as the most similar recommendations. The results on the Methods2Test dataset showed that, while there is no guarantee to have similar relevant test cases for the group of similar methods, the proposed approach extracts the most similar existing test cases for a given method in the dataset, and evaluations show that recommended test cases decrease the developers' effort to generating expected test cases.


title: Impedance Leakage Vulnerability and its Utilization in Reverse-engineering Embedded Software

abstract: Discovering new vulnerabilities and implementing security and privacy measures are important to protect systems and data against physical attacks. One such vulnerability is impedance, an inherent property of a device that can be exploited to leak information through an unintended side channel, thereby posing significant security and privacy risks. Unlike traditional vulnerabilities, impedance is often overlooked or narrowly explored, as it is typically treated as a fixed value at a specific frequency in research and design endeavors. Moreover, impedance has never been explored as a source of information leakage. This paper demonstrates that the impedance of an embedded device is not constant and directly relates to the programs executed on the device. We define this phenomenon as impedance leakage and use this as a side channel to extract software instructions from protected memory. Our experiment on the ATmega328P microcontroller and the Artix 7 FPGA indicates that the impedance side channel can detect software instructions with 96.1% and 92.6% accuracy, respectively. Furthermore, we explore the dual nature of the impedance side channel, highlighting the potential for beneficial purposes and the associated risk of intellectual property theft. Finally, potential countermeasures that specifically address impedance leakage are discussed.


title: Sensitivity analysis for causality in observational studies for regulatory science

abstract: Recognizing the importance of real-world data (RWD) for regulatory purposes, the United States (US) Congress passed the 21st Century Cures Act1 mandating the development of Food and Drug Administration (FDA) guidance on regulatory use of real-world evidence. The Forum on the Integration of Observational and Randomized Data (FIORD) conducted a meeting bringing together various stakeholder groups to build consensus around best practices for the use of RWD to support regulatory science. Our companion paper describes in detail the context and discussion carried out in the meeting, which includes a recommendation to use a causal roadmap for complete pre-specification of study designs using RWD. This article discusses one step of the roadmap: the specification of a procedure for sensitivity analysis, defined as a procedure for testing the robustness of substantive conclusions to violations of assumptions made in the causal roadmap. We include a worked-out example of a sensitivity analysis from a RWD study on the effectiveness of Nifurtimox in treating Chagas disease, as well as an overview of various methods available for sensitivity analysis in causal inference, emphasizing practical considerations on their use for regulatory purposes.


title: Exploring Solute-Defect Interactions in Nanosized Palladium Hydrides across Multiple Time Scales

abstract: We employ two different atomistic methods to investigate solute-defect interactions in nanosized palladium-hydrogen (Pd-H) systems across multiple time scales. The first method, referred to as Diffusive Molecular Dynamics (DMD), focuses on capturing hydride phase transformation and the evolution of solute-induced lattice defects over a diffusive time scale. The second method, Molecular Dynamics (MD), provides more detailed insights into atomic movements and lattice relaxation over the time scale of thermal vibrations. These two methods are connected with MD simulations initialized using statistical measures of microscopic variables obtained from DMD at different H/Pd ratios. Our study demonstrates that DMD effectively captures the propagation of an atomistically sharp hydride phase boundary as well as the dynamics of solute-induced misfit dislocations and stacking faults. While the H-concentrated phase leads to a reduction in the vibrational energy, the presence of stacking faults locally increases the vibrational energy of both Pd and H atoms. Furthermore, the MD simulation results align with DMD in terms of equilibrium potential energy, the preservation of hydride phase boundary, and the spatial distribution of stacking faults. We thoroughly characterize the lattice crystalline structures in four key regions of the particle. We observe a preference for H atoms to occupy tetrahedral interstitial sites near stacking faults due to the lower stacking fault energies provided by these sites within the H-concentrated phase.


title: Digital Ethics in Federated Learning

abstract: The Internet of Things (IoT) consistently generates vast amounts of data, sparking increasing concern over the protection of data privacy and the limitation of data misuse. Federated learning (FL) facilitates collaborative capabilities among multiple parties by sharing machine learning (ML) model parameters instead of raw user data, and it has recently gained significant attention for its potential in privacy preservation and learning efficiency enhancement. In this paper, we highlight the digital ethics concerns that arise when human-centric devices serve as clients in FL. More specifically, challenges of game dynamics, fairness, incentive, and continuity arise in FL due to differences in perspectives and objectives between clients and the server. We analyze these challenges and their solutions from the perspectives of both the client and the server, and through the viewpoints of centralized and decentralized FL. Finally, we explore the opportunities in FL for human-centric IoT as directions for future development.


title: Multi-Domain Walking with Reduced-Order Models of Locomotion

abstract: Drawing inspiration from human multi-domain walking, this work presents a novel reduced-order model based framework for realizing multi-domain robotic walking. At the core of our approach is the viewpoint that human walking can be represented by a hybrid dynamical system, with continuous phases that are fully-actuated, under-actuated, and over-actuated and discrete changes in actuation type occurring with changes in contact. Leveraging this perspective, we synthesize a multi-domain linear inverted pendulum (MLIP) model of locomotion. Utilizing the step-to-step dynamics of the MLIP model, we successfully demonstrate multi-domain walking behaviors on the bipedal robot Cassie -- a high degree of freedom 3D bipedal robot. Thus, we show the ability to bridge the gap between multi-domain reduced order models and full-order multi-contact locomotion. Additionally, our results showcase the ability of the proposed method to achieve versatile speed-tracking performance and robust push recovery behaviors.


title: Accessing Convective Hazards Frequency Shift with Climate Change using Physics-Informed Machine Learning

abstract: In this paper we discuss and address the challenges of predicting extreme atmospheric events like intense rainfall, hail, and strong winds. These events can cause significant damage and have become more frequent due to climate change. Integrating climate projections with machine learning techniques helps improve forecasting accuracy and identify regions where these events become most frequent and dangerous. To achieve reliable and accurate prediction, we propose a robust neural network architecture that outperforms multiple baselines in accuracy and reliability. Our physics-informed algorithm heavily utilizes the whole range of problem-specific physics, including a specific set of features and climate projections data. The analysis also emphasizes the landscape impact on the frequency distribution of these events, providing valuable insights for effective adaptation strategies in response to climate change.


title: Stochastic optimal control in Hilbert spaces: $C^{1,1}$ regularity of the value function and optimal synthesis via viscosity solutions

abstract: We study optimal control problems governed by abstract infinite dimensional stochastic differential equations using the dynamic programming approach. In the first part, we prove Lipschitz continuity, semiconcavity and semiconvexity of the value function under several sets of assumptions, and thus derive its $C^{1,1}$ regularity in the space variable. Based on this regularity result, we construct optimal feedback controls using the notion of the $B$-continuous viscosity solutions for the associated Hamilton--Jacobi--Bellman equation. This is done in the case when the noise coefficient is independent of the control variable. We also discuss applications of our results to optimal control problems for controlled stochastic reaction-diffusion equations and, under economic motivations, to stochastic delay differential equations.


title: Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models

abstract: Medical image classification is a critical problem for healthcare, with the potential to alleviate the workload of doctors and facilitate diagnoses of patients. However, two challenges arise when deploying deep learning models to real-world healthcare applications. First, neural models tend to learn spurious correlations instead of desired features, which could fall short when generalizing to new domains (e.g., patients with different ages). Second, these black-box models lack interpretability. When making diagnostic predictions, it is important to understand why a model makes a decision for trustworthy and safety considerations. In this paper, to address these two limitations, we propose a new paradigm to build robust and interpretable medical image classifiers with natural language concepts. Specifically, we first query clinical concepts from GPT-4, then transform latent image features into explicit concepts with a vision-language model. We systematically evaluate our method on eight medical image classification datasets to verify its effectiveness. On challenging datasets with strong confounding factors, our method can mitigate spurious correlations thus substantially outperform standard visual encoders and other baselines. Finally, we show how classification with a small number of concepts brings a level of interpretability for understanding model decisions through case studies in real medical data.


title: Extremes of vector-valued processes by finite dimensional models

abstract: Finite dimensional (FD) models, i.e., deterministic functions of time/space and finite sets of random variables, are constructed for target vector-valued random processes/fields. They are required to have two properties. First, standard Monte Carlo algorithms can be used to generate their samples, referred to as FD samples. Second, under some conditions specified by several theorems, FD samples can be used to estimate distributions of extremes and other functionals of target random functions. Numerical illustrations involving two-dimensional random processes and apparent properties of random microstructures are presented to illustrate the implementation of FD models for these stochastic problems and show that they are accurate if the conditions of our theorems are satisfied.


title: Retrieval-augmented Generation to Improve Math Question-Answering: Trade-offs Between Groundedness and Human Preference

abstract: For middle-school math students, interactive question-answering (QA) with tutors is an effective way to learn. The flexibility and emergent capabilities of generative large language models (LLMs) has led to a surge of interest in automating portions of the tutoring process - including interactive QA to support conceptual discussion of mathematical concepts. However, LLM responses to math questions can be incorrect or mismatched to the educational context - such as being misaligned with a school's curriculum. One potential solution is retrieval-augmented generation (RAG), which involves incorporating a vetted external knowledge source in the LLM prompt to increase response quality. In this paper, we designed prompts that retrieve and use content from a high-quality open-source math textbook to generate responses to real student questions. We evaluate the efficacy of this RAG system for middle-school algebra and geometry QA by administering a multi-condition survey, finding that humans prefer responses generated using RAG, but not when responses are too grounded in the textbook content. We argue that while RAG is able to improve response quality, designers of math QA systems must consider trade-offs between generating responses preferred by students and responses closely matched to specific educational resources.


title: Misusing Tools in Large Language Models With Visual Adversarial Examples

abstract: Large Language Models (LLMs) are being enhanced with the ability to use tools and to process multiple modalities. These new capabilities bring new benefits and also new security risks. In this work, we show that an attacker can use visual adversarial examples to cause attacker-desired tool usage. For example, the attacker could cause a victim LLM to delete calendar events, leak private conversations and book hotels. Different from prior work, our attacks can affect the confidentiality and integrity of user resources connected to the LLM while being stealthy and generalizable to multiple input prompts. We construct these attacks using gradient-based adversarial training and characterize performance along multiple dimensions. We find that our adversarial images can manipulate the LLM to invoke tools following real-world syntax almost always (~98%) while maintaining high similarity to clean images (~0.9 SSIM). Furthermore, using human scoring and automated metrics, we find that the attacks do not noticeably affect the conversation (and its semantics) between the user and the LLM.


title: Inferring Inference

abstract: Patterns of microcircuitry suggest that the brain has an array of repeated canonical computational units. Yet neural representations are distributed, so the relevant computations may only be related indirectly to single-neuron transformations. It thus remains an open challenge how to define canonical distributed computations. We integrate normative and algorithmic theories of neural computation into a mathematical framework for inferring canonical distributed computations from large-scale neural activity patterns. At the normative level, we hypothesize that the brain creates a structured internal model of its environment, positing latent causes that explain its sensory inputs, and uses those sensory inputs to infer the latent causes. At the algorithmic level, we propose that this inference process is a nonlinear message-passing algorithm on a graph-structured model of the world. Given a time series of neural activity during a perceptual inference task, our framework finds (i) the neural representation of relevant latent variables, (ii) interactions between these variables that define the brain's internal model of the world, and (iii) message-functions specifying the inference algorithm. These targeted computational properties are then statistically distinguishable due to the symmetries inherent in any canonical computation, up to a global transformation. As a demonstration, we simulate recordings for a model brain that implicitly implements an approximate inference algorithm on a probabilistic graphical model. Given its external inputs and noisy neural activity, we recover the latent variables, their neural representation and dynamics, and canonical message-functions. We highlight features of experimental design needed to successfully extract canonical computations from neural data. Overall, this framework provides a new tool for discovering interpretable structure in neural recordings.


title: Synthesis of Data-Driven Nonlinear State Observers using Lipschitz-Bounded Neural Networks

abstract: This paper focuses on the model-free synthesis of state observers for nonlinear autonomous systems without knowing the governing equations. Specifically, the Kazantzis-Kravaris/Luenberger (KKL) observer structure is leveraged, where the outputs are fed into a linear time-invariant (LTI) system to obtain the observer states, which can be viewed as the states nonlinearly transformed by an immersion mapping, and a neural network is used to approximate the inverse of the nonlinear immersion and estimate the states. In view of the possible existence of noises in output measurements, this work proposes to impose an upper bound on the Lipschitz constant of the neural network for robust and safe observation. A relation that bounds the generalization loss of state observation according to the Lipschitz constant, as well as the $H_2$-norm of the LTI part in the KKL observer, is established, thus reducing the model-free observer synthesis problem to that of Lipschitz-bounded neural network training, for which a direct parameterization technique is used. The proposed approach is demonstrated on a chaotic Lorenz system.


title: Talking Models: Distill Pre-trained Knowledge to Downstream Models via Interactive Communication

abstract: Many recent breakthroughs in machine learning have been enabled by the pre-trained foundation models. By scaling up model parameters, training data, and computation resources, foundation models have significantly advanced the state-of-the-art in many applications. However, it is still an open question of how to use these models to perform downstream tasks efficiently. Knowledge distillation (KD) has been explored to tackle this challenge. KD transfers knowledge from a large teacher model to a smaller student model. While KD has been successful in improving student model performance, recent research has discovered that a powerful teacher does not necessarily lead to a powerful student, due to their huge capacity gap. In addition, the potential distribution shifts between the pre-training data and downstream tasks can make knowledge transfer in KD sub-optimal for improving downstream task performance. In this paper, we extend KD with an interactive communication process to help students of downstream tasks learn effectively from pre-trained foundation models. Our design is inspired by the way humans learn from teachers who can explain knowledge in a way that meets the students' needs. Specifically, we let each model (i.e., student and teacher) train two components: (1) an encoder encoding the model's hidden states to a message and (2) a decoder decoding any messages to its own hidden states. With encoder and decoder, not only can the teacher transfer rich information by encoding its hidden states, but also the student can send messages with information of downstream tasks to the teacher. Therefore, knowledge passing from teacher to student can be tailored to the student's capacity and downstream tasks' distributions. We conducted experiments on benchmark datasets to show that our communication mechanism outperforms state-of-the-art distillation techniques.


title: Passive stabilization of crossflow instabilities by a reverse lift-up effect

abstract: A novel mechanism is identified, through which a spanwise-invariant surface feature (a two-dimensional forward-facing step) significantly stabilizes the stationary crossflow instability of a three-dimensional boundary layer. The mechanism is termed here as reverse lift-up effect, inasmuch as it acts reversely to the classic lift-up effect; that is, kinetic energy of an already existing shear-flow instability is transferred to the underlying laminar flow through the action of cross-stream perturbations. To characterize corresponding energy-transfer mechanisms, a theoretical framework is presented, which is applicable to generic three-dimensional flows and surface features of arbitrary shape with one invariant spatial direction. The identification of a passive geometry-induced effect responsible for dampening stationary crossflow vortices is a promising finding for Laminar Flow Control applications.


title: One-dimensional Stein's method with bespoke derivatives

abstract: We introduce a version of Stein's method of comparison of operators specifically tailored to the problem of bounding the Wasserstein-1 distance between continuous and discrete distributions on the real line. Our approach rests on a new family of weighted discrete derivative operators, which we call bespoke derivatives. We also propose new bounds on the derivatives of the solutions of Stein equations for Integrated Pearson random variables; this is a crucial step in Stein's method. We apply our result to several examples, including the Central Limit Theorem, Polya-Eggenberger urn models, the empirical distribution of the ground state of a many-interacting-worlds harmonic oscillator, the stationary distribution for the number of genes in the Moran model, and the stationary distribution of the Erlang-C system. Whenever our bounds can be compared with bounds from the literature, our constants are sharper.


title: Sim-to-Real Learning for Humanoid Box Loco-Manipulation

abstract: In this work we propose a learning-based approach to box loco-manipulation for a humanoid robot. This is a particularly challenging problem due to the need for whole-body coordination in order to lift boxes of varying weight, position, and orientation while maintaining balance. To address this challenge, we present a sim-to-real reinforcement learning approach for training general box pickup and carrying skills for the bipedal robot Digit. Our reward functions are designed to produce the desired interactions with the box while also valuing balance and gait quality. We combine the learned skills into a full system for box loco-manipulation to achieve the task of moving boxes from one table to another with a variety of sizes, weights, and initial configurations. In addition to quantitative simulation results, we demonstrate successful sim-to-real transfer on the humanoid r


title: Generative AI in the Classroom: Can Students Remain Active Learners?

abstract: Generative Artificial Intelligence (GAI) can be seen as a double-edged weapon in education. Indeed, it may provide personalized, interactive and empowering pedagogical sequences that could favor students' intrinsic motivation, active engagement and help them have more control over their learning. But at the same time, other GAI properties such as the lack of uncertainty signalling even in cases of failure (particularly with Large Language Models (LLMs)) could lead to opposite effects, e.g. over-estimation of one's own competencies, passiveness, loss of curious and critical-thinking sense, etc. These negative effects are due in particular to the lack of a pedagogical stance in these models' behaviors. Indeed, as opposed to standard pedagogical activities, GAI systems are often designed to answers users' inquiries easily and conveniently, without asking them to make an effort, and without focusing on their learning process and/or outcomes. This article starts by outlining some of these opportunities and challenges surrounding the use of GAI in education, with a focus on the effects on students' active learning strategies and related metacognitive skills. Then, we present a framework for introducing pedagogical transparency in GAI-based educational applications. This framework presents 1) training methods to include pedagogical principles in the models, 2) methods to ensure controlled and pedagogically-relevant interactions when designing activities with GAI and 3) educational methods enabling students to acquire the relevant skills to properly benefit from the use of GAI in their learning activities (meta-cognitive skills, GAI litteracy).


title: The Rise of Open Science: Tracking the Evolution and Perceived Value of Data and Methods Link-Sharing Practices

abstract: In recent years, funding agencies and journals increasingly advocate for open science practices (e.g. data and method sharing) to improve the transparency, access, and reproducibility of science. However, quantifying these practices at scale has proven difficult. In this work, we leverage a large-scale dataset of 1.1M papers from arXiv that are representative of the fields of physics, math, and computer science to analyze the adoption of data and method link-sharing practices over time and their impact on article reception. To identify links to data and methods, we train a neural text classification model to automatically classify URL types based on contextual mentions in papers. We find evidence that the practice of link-sharing to methods and data is spreading as more papers include such URLs over time. Reproducibility efforts may also be spreading because the same links are being increasingly reused across papers (especially in computer science); and these links are increasingly concentrated within fewer web domains (e.g. Github) over time. Lastly, articles that share data and method links receive increased recognition in terms of citation count, with a stronger effect when the shared links are active (rather than defunct). Together, these findings demonstrate the increased spread and perceived value of data and method sharing practices in open science.

categories: cs.DL cs.CL cs.CY physics.hist-ph physics.soc-ph


title: Double variational principle for mean dimension of $\mathbb{Z}^{K}$-actions

abstract: In this paper, we introduce mean dimension and rate distortion dimension for $\mathbb{Z}^{k}$-actions dynamical system $(\mathcal{X},\mathbb{Z}^k,T)$. Suppose $(\mathcal{X},\mathbb{Z}^k,T)$ has the marker property. Taking these two variables, the metric $d$ on $\mathcal{X}$ and $\mathbb{Z}^{k}$-invariant measure $\mu$, into consideration, a minimax-type variational principle for mean dimension of $\mathbb{Z}^{k}$-actions is established. This result extends the double variational principle obtained recently by Lindenstrauss and Tsukamoto \cite{LT19} from $\mathbb{Z}$-actions dynamical systems to $\mathbb{Z}^{k}$-actions dynamical systems.


title: Deep reinforcement learning for machine scheduling: Methodology, the state-of-the-art, and future directions

abstract: Machine scheduling aims to optimize job assignments to machines while adhering to manufacturing rules and job specifications. This optimization leads to reduced operational costs, improved customer demand fulfillment, and enhanced production efficiency. However, machine scheduling remains a challenging combinatorial problem due to its NP-hard nature. Deep Reinforcement Learning (DRL), a key component of artificial general intelligence, has shown promise in various domains like gaming and robotics. Researchers have explored applying DRL to machine scheduling problems since 1995. This paper offers a comprehensive review and comparison of DRL-based approaches, highlighting their methodology, applications, advantages, and limitations. It categorizes these approaches based on computational components: conventional neural networks, encoder-decoder architectures, graph neural networks, and metaheuristic algorithms. Our review concludes that DRL-based methods outperform exact solvers, heuristics, and tabular reinforcement learning algorithms in terms of computation speed and generating near-global optimal solutions. These DRL-based approaches have been successfully applied to static and dynamic scheduling across diverse machine environments and job characteristics. However, DRL-based schedulers face limitations in handling complex operational constraints, configurable multi-objective optimization, generalization, scalability, interpretability, and robustness. Addressing these challenges will be a crucial focus for future research in this field. This paper serves as a valuable resource for researchers to assess the current state of DRL-based machine scheduling and identify research gaps. It also aids experts and practitioners in selecting the appropriate DRL approach for production scheduling.


title: OffLine simulation and reconstruction software framework for the JEM-EUSO missions

abstract: The Joint Experiment Missions for Extreme Universe Observatory comprises a collection of complementary missions dedicated to pioneering technologies and techniques for a future space-based multi-messenger observatory which will have sufficient sensitivity and exposure to measure properties of extremely rare ultra-high energy (E>50 EeV) cosmic rays and very high energy (E>100 PeV) neutrinos. Here we describe a general-purpose software framework designed to facilitate detailed simulation and reconstruction of events observed by the various missions using both detection of fluorescence and Cherenkov light produced when cosmic ray or neutrino-induced extensive air showers traverse Earth's atmosphere. The software builds on a framework developed by the Pierre Auger Collaboration. We describe the techniques used to organize contributions from numerous collaborators, manage an abundance of configuration information, and provide simple access to time-dependent detector and atmospheric information. We also explain how we support a multitude of computing platforms, provide fast installation and maintain the broad testing coverage required for stability of the large and heterogeneous code base. We provide a few examples of simulated and reconstructed data gathered by some of the JEM-EUSO missions, including the EUSO-SPB2 instrument.


title: Anomalous Dimension in QCD

abstract: The anomalous dimension $\gamma_m =1$ in the infrared region near conformal edge in the broken phase of the large $N_f$ QCD has been shown by the ladder Schwinger-Dyson equation and also by the lattice simulation for $N_f=8$ for $ N_c=3$. Recently Zwicky claimed another independent argument (without referring to explicit dynamics) for the same result, $\gamma_m =1$. We show that this is not justified by explicit evaluation of each matrix element based on the ``dilaton chiral perturbation theory (dChPT)'' : $<\pi(p_2)| 2\cdot \sum^{N_f}_{i=1} m_f \bar \psi_i \psi_i |\pi(p_1)>= 2M_\pi^2 + [(1-\gamma_m) M_\pi^2\cdot 2/(1+\gamma_m)]= 2 M_\pi^2 \cdot 2/(1+\gamma_m) \ne 2 M_\pi^2$ in contradiction with his estimate, which is compared with $<\pi(p_2)| (1+\gamma_m) \cdot \sum^{N_f}_{i=1} m_f \bar \psi_i \psi_i |\pi(p_1)> =(1+\gamma_m) M_\pi^2+ [(1-\gamma_m) M_\pi^2]=2 M_\pi^2$ (both up to trace anomaly), where the terms in $[ \,\,]$ are from the $\sigma$ (pseudo-dilaton) pole contribution. Thus there is no constraint on $\gamma_m$ when the $\sigma$ pole contribution is treated consistently for both.


title: Photoconductive Effects in Single Crystals of BaZrS$_3$

abstract: Chalcogenide perovskites, such as BaZrS$_3$, are emerging semiconductors with potential for high photovoltaic power conversion efficiency. The role of defects in the efficiency of the generation and collection of photo-excited carriers has not been experimentally investigated extensively. We study the effect of processing-induced defects on the photoconductive properties of single crystals of BaZrS$_3$. We achieved ohmic contacts to single crystals of BaZrS$_3$ and observed positive surface photovoltage, which is typically observed in p-type semiconductors. However, mechanical polishing of BaZrS$_3$ to remove the surface oxide leads to dense deformation grain boundaries and leads to trap-dominated photoconductive response. In comparison, ohmic contacts achieved in cleaved crystals leave fewer deformation defects and greatly improve optoelectronic properties. Defect-controlled crystal growth and contact fabrication are potentially limiting factors for achieving high photon-to-excited electron conversion efficiency in BaZrS$_3$.


title: 11th Low-Level RF Workshop (LLRF2023)

abstract: This volume contains contributions presented at the 11th Low-Level RF Workshop which was held in Gyeongju, South Korea on October 22-27, 2023. This workshop continued the series of successful international workshops held in Newport News, USA (2001), Geneva, Switzerland (2005), Knoxville, USA (2007), Tsukuba, Japan (2009), Hamburg, Germany (2011), Tahoe City, USA (2013), Shanghai, China (2015), Barcelona, Spain (2017), Chicago, USA (2019), and Brugg-Windisch, Switzerland (2023).


title: Amazon Books Rating prediction & Recommendation Model

abstract: This paper uses the dataset of Amazon to predict the books ratings listed on Amazon website. As part of this project, we predicted the ratings of the books, and also built a recommendation cluster. This recommendation cluster provides the recommended books based on the column's values from dataset, for instance, category, description, author, price, reviews etc. This paper provides a flow of handling big data files, data engineering, building models and providing predictions. The models predict book ratings column using various PySpark Machine Learning APIs. Additionally, we used hyper-parameters and parameters tuning. Also, Cross Validation and TrainValidationSplit were used for generalization. Finally, we performed a comparison between Binary Classification and Multiclass Classification in their accuracies. We converted our label from multiclass to binary to see if we could find any difference between the two classifications. As a result, we found out that we get higher accuracy in binary classification than in multiclass classification.


title: A Hidden Convexity in Continuum Mechanics, with application to classical, continuous-time, rate-(in)dependent plasticity

abstract: A methodology for defining variational principles for a class of PDE models from continuum mechanics is demonstrated, and some of its features explored. The scheme is applied to quasi-static and dynamic models of rate-independent and rate-dependent, single crystal plasticity at finite deformation.


title: ResolverFuzz: Automated Discovery of DNS Resolver Vulnerabilities with Query-Response Fuzzing

abstract: Domain Name System (DNS) is a critical component of the Internet. DNS resolvers, which act as the cache between DNS clients and DNS nameservers, are the central piece of the DNS infrastructure, essential to the scalability of DNS. However, finding the resolver vulnerabilities is non-trivial, and this problem is not well addressed by the existing tools. To list a few reasons, first, most of the known resolver vulnerabilities are non-crash bugs that cannot be directly detected by the existing oracles (or sanitizers). Second, there lacks rigorous specifications to be used as references to classify a test case as a resolver bug. Third, DNS resolvers are stateful, and stateful fuzzing is still challenging due to the large input space. In this paper, we present a new fuzzing system termed ResolverFuzz to address the aforementioned challenges related to DNS resolvers, with a suite of new techniques being developed. First, ResolverFuzz performs constrained stateful fuzzing by focusing on the short query-response sequence, which has been demonstrated as the most effective way to find resolver bugs, based on our study of the published DNS CVEs. Second, to generate test cases that are more likely to trigger resolver bugs, we combine probabilistic context-free grammar (PCFG) based input generation with byte-level mutation for both queries and responses. Third, we leverage differential testing and clustering to identify non-crash bugs like cache poisoning bugs. We evaluated ResolverFuzz against 6 mainstream DNS software under 4 resolver modes. Overall, we identify 23 vulnerabilities that can result in cache poisoning, resource consumption, and crash attacks. After responsible disclosure, 19 of them have been confirmed or fixed, and 15 CVE numbers have been assigned.


title: Efficient network exploration by means of resetting self-avoiding random walkers

abstract: The self-avoiding random walk (SARW) is a stochastic process whose state variable avoids returning to previously visited states. This non-Markovian feature has turned SARWs a powerful tool for modelling a plethora of relevant aspects in network science, such as network navigability, robustness and resilience. We analytically characterize self-avoiding random walkers that evolve on complex networks and whose memory suffers stochastic resetting, that is, at each step, with a certain probability, they forget their previous trajectory and start free diffusion anew. Several out-of-equilibrium properties are addressed, such as the time-dependent position of the walker, the time-dependent degree distribution of the non-visited network and the first-passage time distribution, and its moments, to target nodes. We examine these metrics for different resetting parameters and network topologies, both synthetic and empirical, and find a good agreement with simulations in all cases. We also explore the role of resetting on network exploration and report a non-monotonic behavior of the cover time: frequent memory resets induce a global minimum in the cover time, significantly outperforming the well-known case of the pure random walk, while reset events that are too spaced apart become detrimental for the network discovery. Our results provide new insights into the profound interplay between topology and dynamics in complex networks, and shed light on the fundamental properties of SARWs in nontrivial environments.


title: An Extremely Massive White Dwarf Escaped From the Hyades Star Cluster

abstract: We searched the Gaia DR3 database for ultramassive white dwarfs with kinematics consistent with having escaped the nearby Hyades open cluster, identifying three such candidates. Two of these candidates have masses estimated from Gaia photometry of approximately 1.1 solar masses; their status as products of single stellar evolution that have escaped the cluster was deemed too questionable for immediate follow-up analysis. The remaining candidate has an expected mass >1.3 solar masses, significantly reducing the probability of it being an interloper. Analysis of follow-up Gemini GMOS spectroscopy for this source reveals a non-magnetized hydrogen atmosphere white dwarf with a mass and age consistent with having formed from a single star. Assuming a single-stellar evolution formation channel, we estimate a 97.8% chance that the candidate is a true escapee from the Hyades. With a determined mass of 1.317 solar masses, this is potentially the most massive known single-evolution white dwarf and is by far the most massive with a strong association with an open cluster.


title: A Large-Scale 3D Face Mesh Video Dataset via Neural Re-parameterized Optimization

abstract: We propose NeuFace, a 3D face mesh pseudo annotation method on videos via neural re-parameterized optimization. Despite the huge progress in 3D face reconstruction methods, generating reliable 3D face labels for in-the-wild dynamic videos remains challenging. Using NeuFace optimization, we annotate the per-view/-frame accurate and consistent face meshes on large-scale face videos, called the NeuFace-dataset. We investigate how neural re-parameterization helps to reconstruct image-aligned facial details on 3D meshes via gradient analysis. By exploiting the naturalness and diversity of 3D faces in our dataset, we demonstrate the usefulness of our dataset for 3D face-related tasks: improving the reconstruction accuracy of an existing 3D face reconstruction model and learning 3D facial motion prior. Code and datasets will be available at https://neuface-dataset.github.io.


title: Regret Analysis of Distributed Online Control for LTI Systems with Adversarial Disturbances

abstract: This paper addresses the distributed online control problem over a network of linear time-invariant (LTI) systems (with possibly unknown dynamics) in the presence of adversarial perturbations. There exists a global network cost that is characterized by a time-varying convex function, which evolves in an adversarial manner and is sequentially and partially observed by local agents. The goal of each agent is to generate a control sequence that can compete with the best centralized control policy in hindsight, which has access to the global cost. This problem is formulated as a regret minimization. For the case of known dynamics, we propose a fully distributed disturbance feedback controller that guarantees a regret bound of $O(\sqrt{T}\log T)$, where $T$ is the time horizon. For the unknown dynamics case, we design a distributed explore-then-commit approach, where in the exploration phase all agents jointly learn the system dynamics, and in the learning phase our proposed control algorithm is applied using each agent system estimate. We establish a regret bound of $O(T^{2/3} \text{poly}(\log T))$ for this setting.


title: Universal slices of the category of graphs

abstract: We characterise the slices of the category of graphs that are algebraically universal in terms of the structure of the slicing graph. In particular, we show that algebraic universality is obtained if, and only if, the slicing graph contains one of four fixed graphs as a subgraph.


title: Index-Modulated Metasurface Transceiver Design using Reconfigurable Intelligent Surfaces for 6G Wireless Networks

abstract: Higher spectral and energy efficiencies are the envisioned defining characteristics of high data-rate sixth-generation (6G) wireless networks. One of the enabling technologies to meet these requirements is index modulation (IM), which transmits information through permutations of indices of spatial, frequency, or temporal media. In this paper, we propose novel electromagnetics-compliant designs of reconfigurable intelligent surface (RIS) apertures for realizing IM in 6G transceivers. We consider RIS modeling and implementation of spatial and subcarrier IMs, including beam steering, spatial multiplexing, and phase modulation capabilities. Numerical experiments for our proposed implementations show that the bit error rates obtained via RIS-aided IM outperform traditional implementations. We further establish the programmability of these transceivers to vary the reflection phase and generate frequency harmonics for IM through full-wave electromagnetic analyses of a specific reflect-array metasurface implementation.


title: Planar Hall effect in Weyl semimetals induced by pseudoelectromagnetic fields

abstract: The planar Hall effect (PHE), the appearance of an in-plane transverse voltage in the presence of coplanar electric and magnetic fields, has been ascribed to the chiral anomaly and Berry curvature effects in Weyl semimetals. In the presence of position- and time-dependent perturbations, such as strain, Weyl semimetals react as if they would be subjected to emergent electromagnetic fields, kwnon as pseudo-fields. In this paper we investigate the possibility of inducing nonlinear phenomena, including the PHE, in strained Weyl semimetals. Using the chiral kinetic theory in the presence of pseudo-fields, we derive general expressions for the magnetoconductivity tensor by considering the simultaneous effects of the Berry curvature and orbital magnetic moment of carriers, which are indeed of the same order of magnitude. Since pseudo-fields couple to the Weyl fermions of opposite chirality with opposite signs, we study chirality-dependent phenomena, including the longitudinal magnetoconductivity and the planar Hall effect. We discuss our results in terms of the chiral anomaly with pseudo-fields. These may open new possibilities in chiralitytronics.


title: Can Language Models Employ the Socratic Method? Experiments with Code Debugging

abstract: When employing the Socratic method of teaching, instructors guide students toward solving a problem on their own rather than providing the solution directly. While this strategy can substantially improve learning outcomes, it is usually time-consuming and cognitively demanding. Automated Socratic conversational agents can augment human instruction and provide the necessary scale, however their development is hampered by the lack of suitable data for training and evaluation. In this paper, we introduce a manually created dataset of multi-turn Socratic advice that is aimed at helping a novice programmer fix buggy solutions to simple computational problems. The dataset is then used for benchmarking the Socratic debugging abilities of a number of language models, ranging from fine-tuning the instruction-based text-to-text transformer Flan-T5 to zero-shot and chain of thought prompting of the much larger GPT-4. The code and datasets are made freely available for research at the link below. https://github.com/taisazero/socratic-debugging-benchmark


title: On the Performance of Multimodal Language Models

abstract: Instruction-tuned large language models (LLMs) have demonstrated promising zero-shot generalization capabilities across various downstream tasks. Recent research has introduced multimodal capabilities to LLMs by integrating independently pretrained vision encoders through model grafting. These multimodal variants undergo instruction tuning, similar to LLMs, enabling effective zero-shot generalization for multimodal tasks. This study conducts a comparative analysis of different multimodal instruction tuning approaches and evaluates their performance across a range of tasks, including complex reasoning, conversation, image captioning, multiple-choice questions (MCQs), and binary classification. Through rigorous benchmarking and ablation experiments, we reveal key insights for guiding architectural choices when incorporating multimodal capabilities into LLMs. However, current approaches have limitations; they do not sufficiently address the need for a diverse multimodal instruction dataset, which is crucial for enhancing task generalization. Additionally, they overlook issues related to truthfulness and factuality when generating responses. These findings illuminate current methodological constraints in adapting language models for image comprehension and provide valuable guidance for researchers and practitioners seeking to harness multimodal versions of LLMs.


title: PDR-CapsNet: an Energy-Efficient Parallel Approach to Dynamic Routing in Capsule Networks

abstract: Convolutional Neural Networks (CNNs) have produced state-of-the-art results for image classification tasks. However, they are limited in their ability to handle rotational and viewpoint variations due to information loss in max-pooling layers. Capsule Networks (CapsNets) employ a computationally-expensive iterative process referred to as dynamic routing to address these issues. CapsNets, however, often fall short on complex datasets and require more computational resources than CNNs. To overcome these challenges, we introduce the Parallel Dynamic Routing CapsNet (PDR-CapsNet), a deeper and more energy-efficient alternative to CapsNet that offers superior performance, less energy consumption, and lower overfitting rates. By leveraging a parallelization strategy, PDR-CapsNet mitigates the computational complexity of CapsNet and increases throughput, efficiently using hardware resources. As a result, we achieve 83.55\% accuracy while requiring 87.26\% fewer parameters, 32.27\% and 47.40\% fewer MACs, and Flops, achieving 3x faster inference and 7.29J less energy consumption on a 2080Ti GPU with 11GB VRAM compared to CapsNet and for the CIFAR-10 dataset.


title: Non-perturbative mass renormalization effects in non-relativistic quantum electrodynamics

abstract: This work lays the foundation to accurately describe ground-state properties in multimode photonic environments and highlights the importance of the mass renormalization procedure for ab-initio quantum electrodynamics simulations. We first demonstrate this for free particles, where the energy dispersion is employed to determine the mass of the particles. We then show how the multimode photon field influences various ground and excited-state properties of atomic and molecular systems. For instance, we observe the enhancement of localization for the atomic system, and the modification of the potential energy surfaces of the molecular dimer due to photon-mediated long-range interactions. These phenomena get enhanced under strong light-matter coupling in a cavity environment and become relevant for the emerging field of polaritonic chemistry. We conclude by demonstrating how non-trivial ground-state effects due to the multimode field can be accurately captured by approximations that are simple and numerically feasible even for realistic systems.


title: FreshLLMs: Refreshing Large Language Models with Search Engine Augmentation

abstract: Most large language models (LLMs) are trained once and never updated; thus, they lack the ability to dynamically adapt to our ever-changing world. In this work, we perform a detailed study of the factuality of LLM-generated text in the context of answering questions that test current world knowledge. Specifically, we introduce FreshQA, a novel dynamic QA benchmark encompassing a diverse range of question and answer types, including questions that require fast-changing world knowledge as well as questions with false premises that need to be debunked. We benchmark a diverse array of both closed and open-source LLMs under a two-mode evaluation procedure that allows us to measure both correctness and hallucination. Through human evaluations involving more than 50K judgments, we shed light on limitations of these models and demonstrate significant room for improvement: for instance, all models (regardless of model size) struggle on questions that involve fast-changing knowledge and false premises. Motivated by these results, we present FreshPrompt, a simple few-shot prompting method that substantially boosts the performance of an LLM on FreshQA by incorporating relevant and up-to-date information retrieved from a search engine into the prompt. Our experiments show that FreshPrompt outperforms both competing search engine-augmented prompting methods such as Self-Ask (Press et al., 2022) as well as commercial systems such as Perplexity.AI. Further analysis of FreshPrompt reveals that both the number of retrieved evidences and their order play a key role in influencing the correctness of LLM-generated answers. Additionally, instructing the LLM to generate concise and direct answers helps reduce hallucination compared to encouraging more verbose answers. To facilitate future work, we release FreshQA at github.com/freshllms/freshqa and commit to updating it at regular intervals.


title: Biorthogonal Majorana zero modes, ELC waves and soliton-fermion duality in non-Hermitian $sl(2)$ affine Toda coupled to fermions

abstract: We study a non-Hermitian (NH) $sl(2)$ affine Toda model coupled to fermions through soliton theory techniques and the realizations of the pseudo-chiral and pseudo-Hermitian symmetries. The interplay of non-Hermiticity, integrability, nonlinearity, and topology significantly influence the formation and behavior of a continuum of bound state modes (CBM) and extended waves in the localized continuum (ELC). The non-Hermitian soliton-fermion duality, the complex scalar field topological charges and winding numbers in the spectral topology are uncovered. The biorthogonal Majorana zero modes, dual to the NH Toda solitons with topological charges $\frac{2}{\pi} \arg{(z=\pm i)}=\pm 1$, appear at the complex-energy point gap and are pinned at zero energy. The zero eigenvalue $\l (z = \pm i)=0$, besides being a zero mode, plays the role of exceptional points (EPs), and each EP separates a real eigenvalue ${\cal A}$-symmetric and ${\cal A}$-symmetry broken regimes for an antilinear symmetry ${\cal A}\in \{ {\cal P}{\cal T}, \g_5{\cal P}{\cal T}\}$. Our findings improve the understanding of exotic quantum states, but also paves the way for future research in harnessing non-Hermitian phenomena for topological quantum computation, as well as the exploration of integrability and NH solitons in the theory of topological phases of matter.

categories: hep-th cond-mat.other math-ph math.MP nlin.SI


title: On the Lipschitz saturation of toric singularities

abstract: We begin the study of Lipschitz saturation for germs of toric singularities. By looking at their associated analytic algebras, we prove that if (X,0) is a germ of toric singularity with smooth normalization then its Lipschitz saturation is again toric. Finally we show how to calculate the Lipschitz saturation for some families of toric singularities starting from the semigroup that defines them.


title: Formal and Practical Elements for the Certification of Machine Learning Systems

abstract: Over the past decade, machine learning has demonstrated impressive results, often surpassing human capabilities in sensing tasks relevant to autonomous flight. Unlike traditional aerospace software, the parameters of machine learning models are not hand-coded nor derived from physics but learned from data. They are automatically adjusted during a training phase, and their values do not usually correspond to physical requirements. As a result, requirements cannot be directly traced to lines of code, hindering the current bottom-up aerospace certification paradigm. This paper attempts to address this gap by 1) demystifying the inner workings and processes to build machine learning models, 2) formally establishing theoretical guarantees given by those processes, and 3) complementing these formal elements with practical considerations to develop a complete certification argument for safety-critical machine learning systems. Based on a scalable statistical verifier, our proposed framework is model-agnostic and tool-independent, making it adaptable to many use cases in the industry. We demonstrate results on a widespread application in autonomous flight: vision-based landing.


title: Learning Energy-Based Prior Model with Diffusion-Amortized MCMC

abstract: Latent space Energy-Based Models (EBMs), also known as energy-based priors, have drawn growing interests in the field of generative modeling due to its flexibility in the formulation and strong modeling power of the latent space. However, the common practice of learning latent space EBMs with non-convergent short-run MCMC for prior and posterior sampling is hindering the model from further progress; the degenerate MCMC sampling quality in practice often leads to degraded generation quality and instability in training, especially with highly multi-modal and/or high-dimensional target distributions. To remedy this sampling issue, in this paper we introduce a simple but effective diffusion-based amortization method for long-run MCMC sampling and develop a novel learning algorithm for the latent space EBM based on it. We provide theoretical evidence that the learned amortization of MCMC is a valid long-run MCMC sampler. Experiments on several image modeling benchmark datasets demonstrate the superior performance of our method compared with strong counterparts


title: $c_1$-cohomological rigidity for smooth toric Fano varieties of Picard number two

abstract: The $c_1$-cohomological rigidity conjecture states that two smooth toric Fano varieties are isomorphic as varieties if there is a $c_1$-preserving isomorphism between their integral cohomology rings. In this paper, we confirm the conjecture for smooth toric Fano varieties of Picard number two.


title: Modeling spatial asymmetries in teleconnected extreme temperatures

abstract: Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.


title: Know2BIO: A Comprehensive Dual-View Benchmark for Evolving Biomedical Knowledge Graphs

abstract: Knowledge graphs (KGs) have emerged as a powerful framework for representing and integrating complex biomedical information. However, assembling KGs from diverse sources remains a significant challenge in several aspects, including entity alignment, scalability, and the need for continuous updates to keep pace with scientific advancements. Moreover, the representative power of KGs is often limited by the scarcity of multi-modal data integration. To overcome these challenges, we propose Know2BIO, a general-purpose heterogeneous KG benchmark for the biomedical domain. Know2BIO integrates data from 30 diverse sources, capturing intricate relationships across 11 biomedical categories. It currently consists of ~219,000 nodes and ~6,200,000 edges. Know2BIO is capable of user-directed automated updating to reflect the latest knowledge in biomedical science. Furthermore, Know2BIO is accompanied by multi-modal data: node features including text descriptions, protein and compound sequences and structures, enabling the utilization of emerging natural language processing methods and multi-modal data integration strategies. We evaluate KG representation models on Know2BIO, demonstrating its effectiveness as a benchmark for KG representation learning in the biomedical field. Data and source code of Know2BIO are available at https://github.com/Yijia-Xiao/Know2BIO/.


title: The bright side of simple heuristics for the TSP

abstract: The greedy and nearest-neighbor TSP heuristics can both have $\log n$ approximation factors from optimal in worst case, even just for $n$ points in Euclidean space. In this note, we show that this approximation factor is only realized when the optimal tour is unusually short. In particular, for points from any fixed $d$-Ahlfor's regular metric space (which includes any $d$-manifold like the $d$-cube $[0,1]^d$ in the case $d$ is an integer but also fractals of dimension $d$ when $d$ is real-valued), our results imply that the greedy and nearest-neighbor heuristics have \emph{additive} errors from optimal on the order of the \emph{optimal} tour length through \emph{random} points in the same space, for $d>1$.


title: TacoGFN: Target-conditioned GFlowNet for Structure-based Drug Design

abstract: Searching the vast chemical space for drug-like and synthesizable molecules with high binding affinity to a protein pocket is a challenging task in drug discovery. Recently, molecular deep generative models have been introduced which promise to be more efficient than exhaustive virtual screening, by directly generating molecules based on the protein structure. However, since they learn the distribution of a limited protein-ligand complex dataset, the existing methods struggle with generating novel molecules with significant property improvements. In this paper, we frame the generation task as a Reinforcement Learning task, where the goal is to search the wider chemical space for molecules with desirable properties as opposed to fitting a training data distribution. More specifically, we propose TacoGFN, a Generative Flow Network conditioned on protein pocket structure, using binding affinity, drug-likeliness and synthesizability measures as our reward. Empirically, our method outperforms state-of-art methods on the CrossDocked2020 benchmark for every molecular property (Vina score, QED, SA), while significantly improving the generation time. TacoGFN achieves $-8.82$ in median docking score and $52.63\%$ in Novel Hit Rate.


title: Matrix Completion from One-Bit Dither Samples

abstract: We explore the impact of coarse quantization on matrix completion in the extreme scenario of dithered one-bit sensing, where the matrix entries are compared with time-varying threshold levels. In particular, instead of observing a subset of high-resolution entries of a low-rank matrix, we have access to a small number of one-bit samples, generated as a result of these comparisons. In order to recover the low-rank matrix using its coarsely quantized known entries, we begin by transforming the problem of one-bit matrix completion (one-bit MC) with time-varying thresholds into a nuclear norm minimization problem. The one-bit sampled information is represented as linear inequality feasibility constraints. We then develop the popular singular value thresholding (SVT) algorithm to accommodate these inequality constraints, resulting in the creation of the One-Bit SVT (OB-SVT). Our findings demonstrate that incorporating multiple time-varying sampling threshold sequences in one-bit MC can significantly improve the performance of the matrix completion algorithm. In pursuit of achieving this objective, we utilize diverse thresholding schemes, namely uniform, Gaussian, and discrete thresholds. To accelerate the convergence of our proposed algorithm, we introduce three variants of the OB-SVT algorithm. Among these variants is the randomized sketched OB-SVT, which departs from using the entire information at each iteration, opting instead to utilize sketched data. This approach effectively reduces the dimension of the operational space and accelerates the convergence. We perform numerical evaluations comparing our proposed algorithm with the maximum likelihood estimation method previously employed for one-bit MC, and demonstrate that our approach can achieve a better recovery performance.


title: Safe Exploration in Reinforcement Learning: A Generalized Formulation and Algorithms

abstract: Safe exploration is essential for the practical use of reinforcement learning (RL) in many real-world scenarios. In this paper, we present a generalized safe exploration (GSE) problem as a unified formulation of common safe exploration problems. We then propose a solution of the GSE problem in the form of a meta-algorithm for safe exploration, MASE, which combines an unconstrained RL algorithm with an uncertainty quantifier to guarantee safety in the current episode while properly penalizing unsafe explorations before actual safety violation to discourage them in future episodes. The advantage of MASE is that we can optimize a policy while guaranteeing with a high probability that no safety constraint will be violated under proper assumptions. Specifically, we present two variants of MASE with different constructions of the uncertainty quantifier: one based on generalized linear models with theoretical guarantees of safety and near-optimality, and another that combines a Gaussian process to ensure safety with a deep RL algorithm to maximize the reward. Finally, we demonstrate that our proposed algorithm achieves better performance than state-of-the-art algorithms on grid-world and Safety Gym benchmarks without violating any safety constraints, even during training.


title: Biologically generated turbulent energy cascade in shear flow depends on tensor geometry

abstract: It has been proposed that biologically generated turbulence plays an important role in material transport and ocean mixing. Both experimental and numerical studies have reported evidence of the non-negligible mixing by moderate Reynolds number swimmers in quiescent water, such as zooplankton, especially at aggregation scales. However, the interaction between biologically generated agitation and the background flow as a key factor in biologically generated turbulence that could reshape our previous knowledge of biologically generated turbulence, has long been ignored. Here we show that the geometry between the biologically generated agitation and the background hydrodynamic shear can determine both the intensity and direction of biologically generated turbulent energy cascade. Measuring the migration of a centimeter-scale swimmer-as represented by the brine shrimp \textit{Artemia salina}-in a shear flow and verifying through an analogue experiment with an artificial jet revealed that different geometries between the biologically generated agitation and the background shear can result in spectral energy transferring toward larger or smaller scales, which consequently intensifies or attenuates the large scale hydrodynamic shear. Our results suggest that the long ignored geometry between the biologically generated agitation and the background flow field is an important factor that should be taken into consideration in future studies of biologically generated turbulence.


title: Tracial joint spectral measures

abstract: Given two Hermitian matrices, $A$ and $B$, we introduce a new type of spectral measure, a $\textit{tracial joint spectral measure}$ $\mu_{A, B}$ on the plane. Existence of this measure implies the following two results: 1) any two-dimensional subspace of the Schatten-$p$ class is isometric to a subspace of $L_{p}$, and 2) if $f : \mathbb{R} \to \mathbb{R}$ has non-negative $k$th derivative and $A$ and $B$ are Hermitian matrices with $A$ positive semidefinite, then $t \mapsto \mathrm{tr}~f(t A + B)$ has non-negative $k$th derivative. We also give an explicit expression for the measure $\mu_{A, B}$.


title: History Matching for Geological Carbon Storage using Data-Space Inversion with Spatio-Temporal Data Parameterization

abstract: History matching based on monitoring data will enable uncertainty reduction, and thus improved aquifer management, in industrial-scale carbon storage operations. In traditional model-based data assimilation, geomodel parameters are modified to force agreement between flow simulation results and observations. In data-space inversion (DSI), history-matched quantities of interest, e.g., posterior pressure and saturation fields conditioned to observations, are inferred directly, without constructing posterior geomodels. This is accomplished efficiently using a set of O(1000) prior simulation results, data parameterization, and posterior sampling within a Bayesian setting. In this study, we develop and implement (in DSI) a deep-learning-based parameterization to represent spatio-temporal pressure and CO2 saturation fields at a set of time steps. The new parameterization uses an adversarial autoencoder (AAE) for dimension reduction and a convolutional long short-term memory (convLSTM) network to represent the spatial distribution and temporal evolution of the pressure and saturation fields. This parameterization is used with an ensemble smoother with multiple data assimilation (ESMDA) in the DSI framework to enable posterior predictions. A realistic 3D system characterized by prior geological realizations drawn from a range of geological scenarios is considered. A local grid refinement procedure is introduced to estimate the error covariance term that appears in the history matching formulation. Extensive history matching results are presented for various quantities, for multiple synthetic true models. Substantial uncertainty reduction in posterior pressure and saturation fields is achieved in all cases. The framework is applied to efficiently provide posterior predictions for a range of error covariance specifications. Such an assessment would be expensive using a model-based approach.


title: Changes in core-mantle boundary heat flux patterns throughout the supercontinent cycle

abstract: The Earth's magnetic field is generated by a dynamo in the outer core and is crucial for shielding our planet from harmful radiation. Despite the established importance of the core-mantle boundary heat flux as driver for the dynamo, open questions remain about how heat flux heterogeneities affect the magnetic field. Here, we explore the distribution of core-mantle boundary heat flux on Earth and its changes over time using compressible global 3-D mantle convection models in the geodynamic modeling software ASPECT. We discuss the use of the consistent boundary flux method as a tool to more accurately compute boundary heat fluxes in finite element simulations and the workflow to provide the computed heat flux patterns as boundary conditions in geodynamo simulations. Our models use a plate reconstruction throughout the last 1 billion years -- encompassing the complete supercontinent cycle -- to determine the location and sinking speed of subducted plates. The results show how mantle upwellings and downwellings create localized heat flux anomalies at the core-mantle boundary that can vary drastically over Earth's history and depend on the properties and evolution of the lowermost mantle as well as the surface subduction zone configuration. The distribution of hot and cold structures at the core-mantle boundary changes throughout the supercontinent cycle in terms of location, shape and number, indicating that these structures fluctuate and might have looked very differently in Earth's past. Our results have implications for understanding the Earth's thermal evolution and the stability of its magnetic field over geological timescales. They provide insights into the potential effects of the mantle on the magnetic field and pave the way for further exploring questions about the nucleation of the inner core and the past state of the lowermost mantle.


title: The squish map and the $\text{SL}_2$ double dimer model

abstract: A plane partition, whose 3D Young diagram is made of unit cubes, can be approximated by a ``coarser" plane partition, made of cubes of side length 2. Indeed, there are two such approximations obtained by ``rounding up" or ``rounding down" to the nearest cube. We relate this coarsening (or downsampling) operation to the squish map introduced by the second author in earlier work. We exhibit a related measure-preserving map between the dimer model on the honeycomb graph, and the $\text{SL}_2$ double dimer model on a coarser honeycomb graph; we compute the most interesting special case of this map, related to plane partition $q$-enumeration with 2-periodic weights. As an application, we specialize the weights to be certain roots of unity, obtain novel generating functions (some known, some new, and some conjectural) that $(-1)$-enumerate certain classes of pairs of plane partitions according to how their dimer configurations interact.


title: Model Spectrum of Ultra-High-Energy Cosmic Rays Accelerated in FR-I Radio Galaxy Jets

abstract: Nearby radio galaxies (RGs) of Fanaroff-Riley Class I (FR-I) are considered possible sites for the production of observed ultra-high-energy cosmic rays (UHECRs). Among those, some exhibit blazar-like inner jets, while others display plume-like structures. We reproduce the flow dynamics of FR-I jets using relativistic hydrodynamic simulations. Subsequently, we track the transport and energization of cosmic ray (CR) particles within the simulated jet flows using Monte Carlo simulations. The key determinant of flow dynamics is the mean Lorentz factor of the jet-spine flow, $\langle\Gamma\rangle_{\rm{spine}}$. When $\langle\Gamma\rangle_{\rm{spine}}\gtrsim$ several, the jet spine remains almost unimpeded, but for $\langle\Gamma\rangle_{\rm{spine}}\lesssim$ a few, substantial jet deceleration occurs. CRs gain energy mainly through diffusive shock acceleration for $E\lesssim1$~EeV and shear acceleration for $E\gtrsim1$~EeV. The time-asymptotic energy spectrum of CRs escaping from the jet can be modeled by a double power law, transitioning from $\sim E^{-0.6}$ to $\sim E^{-2.6}$ around a break energy, $E_{\rm{break}}$, with an exponential cutoff at $E_{\rm{break}}\langle\Gamma\rangle_{\rm{spine}}^2$. $E_{\rm{break}}$ is limited either by the Hillas confinement condition or by particle escape from the cocoon via fast spatial diffusion. The spectral slopes primarily arise from multiple episodes of shock and relativistic shear accelerations, and the confinement-escape processes within the cocoon. The exponential cutoff is determined by non-gradual shear acceleration that boosts the energy of high-energy CRs by a factor of $\sim \langle\Gamma\rangle_{\rm{spine}}^2$. We suggest that the model spectrum derived in this work could be employed to investigate the contribution of RGs to the observed population of UHECRs.


title: Deep Representations of First-person Pronouns for Prediction of Depression Symptom Severity

abstract: Prior work has shown that analyzing the use of first-person singular pronouns can provide insight into individuals' mental status, especially depression symptom severity. These findings were generated by counting frequencies of first-person singular pronouns in text data. However, counting doesn't capture how these pronouns are used. Recent advances in neural language modeling have leveraged methods generating contextual embeddings. In this study, we sought to utilize the embeddings of first-person pronouns obtained from contextualized language representation models to capture ways these pronouns are used, to analyze mental status. De-identified text messages sent during online psychotherapy with weekly assessment of depression severity were used for evaluation. Results indicate the advantage of contextualized first-person pronoun embeddings over standard classification token embeddings and frequency-based pronoun analysis results in predicting depression symptom severity. This suggests contextual representations of first-person pronouns can enhance the predictive utility of language used by people with depression symptoms.


title: Study of azimuthal anisotropy of $\Upsilon$(1S) mesons in pPb collisions at $\sqrt{s_\mathrm{NN}}$ = 8.16 TeV

abstract: The azimuthal anisotropy of $\Upsilon$(1S) mesons in high-multiplicity proton-lead collisions is studied using data collected by the CMS experiment at a nucleon-nucleon center-of-mass energy of 8.16 TeV. The $\Upsilon$(1S) mesons are reconstructed using their dimuon decay channel. The anisotropy is characterized by the second Fourier harmonic coefficients, found using a two-particle correlation technique, in which the $\Upsilon$(1S) mesons are correlated with charged hadrons. A large pseudorapidity gap is used to suppress short-range correlations. Nonflow contamination from the dijet background is removed using a low-multiplicity subtraction method, and the results are presented as a function of $\Upsilon$(1S) transverse momentum. The azimuthal anisotropies are smaller than those found for charmonia in proton-lead collisions at the same collision energy, but are consistent with values found for $\Upsilon$(1S) mesons in lead-lead interactions at a nucleon-nucleon center-of-mass energy of 5.02 TeV.


title: Non-Smooth Weakly-Convex Finite-sum Coupled Compositional Optimization

abstract: This paper investigates new families of compositional optimization problems, called $\underline{\bf n}$on-$\underline{\bf s}$mooth $\underline{\bf w}$eakly-$\underline{\bf c}$onvex $\underline{\bf f}$inite-sum $\underline{\bf c}$oupled $\underline{\bf c}$ompositional $\underline{\bf o}$ptimization (NSWC FCCO). There has been a growing interest in FCCO due to its wide-ranging applications in machine learning and AI, as well as its ability to address the shortcomings of stochastic algorithms based on empirical risk minimization. However, current research on FCCO presumes that both the inner and outer functions are smooth, limiting their potential to tackle a more diverse set of problems. Our research expands on this area by examining non-smooth weakly-convex FCCO, where the outer function is weakly convex and non-decreasing, and the inner function is weakly-convex. We analyze a single-loop algorithm and establish its complexity for finding an $\epsilon$-stationary point of the Moreau envelop of the objective function. Additionally, we also extend the algorithm to solving novel non-smooth weakly-convex tri-level finite-sum coupled compositional optimization problems, which feature a nested arrangement of three functions. Lastly, we explore the applications of our algorithms in deep learning for two-way partial AUC maximization and multi-instance two-way partial AUC maximization, using empirical studies to showcase the effectiveness of the proposed algorithms.


title: Applying the causal roadmap to longitudinal national Danish registry data: a case study of second-line diabetes medication and dementia

abstract: The causal roadmap is a formal framework for causal and statistical inference that supports clear specification of the causal question, interpretable and transparent statement of required causal assumptions, robust inference, and optimal precision. The roadmap is thus particularly well-suited to evaluating longitudinal causal effects using large scale registries; however, application of the roadmap to registry data also introduces particular challenges. In this paper we provide a detailed case study of the longitudinal causal roadmap applied to the Danish National Registry to evaluate the comparative effectiveness of second-line diabetes drugs on dementia risk. Specifically, we evaluate the difference in counterfactual five-year cumulative risk of dementia if a target population of adults with type 2 diabetes had initiated and remained on GLP-1 receptor agonists (a second-line diabetes drug) compared to a range of active comparator protocols. Time-dependent confounding is accounted for through use of the iterated conditional expectation representation of the longitudinal g-formula as a statistical estimand. Statistical estimation uses longitudinal targeted maximum likelihood, incorporating machine learning. We provide practical guidance on the implementation of the roadmap using registry data, and highlight how rare exposures and outcomes over long-term follow up can raise challenges for flexible and robust estimators, even in the context of the large sample sizes provided by the registry. We demonstrate how simulations can be used to help address these challenges by supporting careful estimator pre-specification. We find a protective effect of GLP-1RAs compared to some but not all other second-line treatments.


title: Dissonance in harmony: The UV/optical periodic outbursts of ASASSN-14ko exhibit repeated bumps and rebrightenings

abstract: ASASSN-14ko was identified as an abnormal periodic nuclear transient with a potential decreasing period. Its outbursts in the optical and UV bands have displayed a consistent and smooth "fast-rise and slow-decay" pattern since its discovery, which has recently experienced an unexpected alteration in the last two epochs, as revealed by our proposed high-cadence Swift observations. The new light curve profiles show a bump during the rising stages and a rebrightening during the declining stages, making them much broader and symmetrical than the previous ones. In the last two epochs, there is no significant difference in the X-ray spectral slope compared to the previous one, and its overall luminosity is lower than those of the previous epochs. The energy released in the early bump and rebrightening phases ($\sim10^{50}$ erg) could be due to collision of the stripped stream from partial tidal disruption events (pTDEs) with an expanded accretion disk. We also discussed other potential explanations, such as disk instability and star-disk collisions. Further high-cadence multi-wavelength observations of subsequent cycles are encouraged to comprehend the unique periodic source with its new intriguing features.