title: Closing the AI generalization gap by adjusting for dermatology condition distribution differences across clinical settings

abstract: Recently, there has been great progress in the ability of artificial intelligence (AI) algorithms to classify dermatological conditions from clinical photographs. However, little is known about the robustness of these algorithms in real-world settings where several factors can lead to a loss of generalizability. Understanding and overcoming these limitations will permit the development of generalizable AI that can aid in the diagnosis of skin conditions across a variety of clinical settings. In this retrospective study, we demonstrate that differences in skin condition distribution, rather than in demographics or image capture mode are the main source of errors when an AI algorithm is evaluated on data from a previously unseen source. We demonstrate a series of steps to close this generalization gap, requiring progressively more information about the new source, ranging from the condition distribution to training data enriched for data less frequently seen during training. Our results also suggest comparable performance from end-to-end fine tuning versus fine tuning solely the classification layer on top of a frozen embedding model. Our approach can inform the adaptation of AI algorithms to new settings, based on the information and resources available.


title: Foundation Policies with Hilbert Representations

abstract: Unsupervised and self-supervised objectives, such as next token prediction, have enabled pre-training generalist models from large amounts of unlabeled data. In reinforcement learning (RL), however, finding a truly general and scalable unsupervised pre-training objective for generalist policies from offline data remains a major open question. While a number of methods have been proposed to enable generic self-supervised RL, based on principles such as goal-conditioned RL, behavioral cloning, and unsupervised skill learning, such methods remain limited in terms of either the diversity of the discovered behaviors, the need for high-quality demonstration data, or the lack of a clear adaptation mechanism for downstream tasks. In this work, we propose a novel unsupervised framework to pre-train generalist policies that capture diverse, optimal, long-horizon behaviors from unlabeled offline data such that they can be quickly adapted to any arbitrary new tasks in a zero-shot manner. Our key insight is to learn a structured representation that preserves the temporal structure of the underlying environment, and then to span this learned latent space with directional movements, which enables various zero-shot policy "prompting" schemes for downstream tasks. Through our experiments on simulated robotic locomotion and manipulation benchmarks, we show that our unsupervised policies can solve goal-conditioned and general RL tasks in a zero-shot fashion, even often outperforming prior methods designed specifically for each setting. Our code and videos are available at https://seohong.me/projects/hilp/.


title: A cluster of results on amplituhedron tiles

abstract: The amplituhedron is a mathematical object which was introduced to provide a geometric origin of scattering amplitudes in $\mathcal{N}=4$ super Yang Mills theory. It generalizes \emph{cyclic polytopes} and the \emph{positive Grassmannian}, and has a very rich combinatorics with connections to cluster algebras. In this article we provide a series of results about tiles and tilings of the $m=4$ amplituhedron. Firstly, we provide a full characterization of facets of BCFW tiles in terms of cluster variables for $\mbox{Gr}_{4,n}$. Secondly, we exhibit a tiling of the $m=4$ amplituhedron which involves a tile which does not come from the BCFW recurrence -- the \emph{spurion} tile, which also satisfies all cluster properties. Finally, strengthening the connection with cluster algebras, we show that each standard BCFW tile is the positive part of a cluster variety, which allows us to compute the canonical form of each such tile explicitly in terms of cluster variables for $\mbox{Gr}_{4,n}$. This paper is a companion to our previous paper ``Cluster algebras and tilings for the $m=4$ amplituhedron''.


title: Toward Fully Self-Supervised Multi-Pitch Estimation

abstract: Multi-pitch estimation is a decades-long research problem involving the detection of pitch activity associated with concurrent musical events within multi-instrument mixtures. Supervised learning techniques have demonstrated solid performance on more narrow characterizations of the task, but suffer from limitations concerning the shortage of large-scale and diverse polyphonic music datasets with multi-pitch annotations. We present a suite of self-supervised learning objectives for multi-pitch estimation, which encourage the concentration of support around harmonics, invariance to timbral transformations, and equivariance to geometric transformations. These objectives are sufficient to train an entirely convolutional autoencoder to produce multi-pitch salience-grams directly, without any fine-tuning. Despite training exclusively on a collection of synthetic single-note audio samples, our fully self-supervised framework generalizes to polyphonic music mixtures, and achieves performance comparable to supervised models trained on conventional multi-pitch datasets.


title: Fast Adversarial Attacks on Language Models In One GPU Minute

abstract: In this paper, we introduce a novel class of fast, beam search-based adversarial attack (BEAST) for Language Models (LMs). BEAST employs interpretable parameters, enabling attackers to balance between attack speed, success rate, and the readability of adversarial prompts. The computational efficiency of BEAST facilitates us to investigate its applications on LMs for jailbreaking, eliciting hallucinations, and privacy attacks. Our gradient-free targeted attack can jailbreak aligned LMs with high attack success rates within one minute. For instance, BEAST can jailbreak Vicuna-7B-v1.5 under one minute with a success rate of 89% when compared to a gradient-based baseline that takes over an hour to achieve 70% success rate using a single Nvidia RTX A6000 48GB GPU. Additionally, we discover a unique outcome wherein our untargeted attack induces hallucinations in LM chatbots. Through human evaluations, we find that our untargeted attack causes Vicuna-7B-v1.5 to produce ~15% more incorrect outputs when compared to LM outputs in the absence of our attack. We also learn that 22% of the time, BEAST causes Vicuna to generate outputs that are not relevant to the original prompt. Further, we use BEAST to generate adversarial prompts in a few seconds that can boost the performance of existing membership inference attacks for LMs. We believe that our fast attack, BEAST, has the potential to accelerate research in LM security and privacy. Our codebase is publicly available at https://github.com/vinusankars/BEAST.


title: Social Convos: Capturing Agendas and Emotions on Social Media

abstract: Social media platforms are popular tools for disseminating targeted information during major public events like elections or pandemics. Systematic analysis of the message traffic can provide valuable insights into prevailing opinions and social dynamics among different segments of the population. We are specifically interested in influence spread, and in particular whether more deliberate influence operations can be detected. However, filtering out the essential messages with telltale influence indicators from the extensive and often chaotic social media traffic is a major challenge. In this paper we present a novel approach to extract influence indicators from messages circulating among groups of users discussing particular topics. We build upon the concept of a convo to identify influential authors who are actively promoting some particular agenda around that topic within the group. We focus on two influence indicators: the (control of) agenda and the use of emotional language.


title: Improving Explainable Object-induced Model through Uncertainty for Automated Vehicles

abstract: The rapid evolution of automated vehicles (AVs) has the potential to provide safer, more efficient, and comfortable travel options. However, these systems face challenges regarding reliability in complex driving scenarios. Recent explainable AV architectures neglect crucial information related to inherent uncertainties while providing explanations for actions. To overcome such challenges, our study builds upon the "object-induced" model approach that prioritizes the role of objects in scenes for decision-making and integrates uncertainty assessment into the decision-making process using an evidential deep learning paradigm with a Beta prior. Additionally, we explore several advanced training strategies guided by uncertainty, including uncertainty-guided data reweighting and augmentation. Leveraging the BDD-OIA dataset, our findings underscore that the model, through these enhancements, not only offers a clearer comprehension of AV decisions and their underlying reasoning but also surpasses existing baselines across a broad range of scenarios.


title: Joint constraints from cosmic shear, galaxy-galaxy lensing and galaxy clustering: internal tension as an indicator of intrinsic alignment modelling error

abstract: In cosmological analyses it is common to combine different types of measurement from the same survey. In this paper we use simulated DES Y3 and LSST Y1 data to explore differences in sensitivity to intrinsic alignments (IA) between cosmic shear and galaxy-galaxy lensing. We generate mock shear, galaxy-galaxy lensing and galaxy clustering data, contaminated with a range of IA scenarios. Using a simple 2-parameter IA model (NLA) in a DES Y3 like analysis, we show that the galaxy-galaxy lensing + galaxy clustering combination ($2\times2$pt) is significantly more robust to IA mismodelling than cosmic shear. IA scenarios that produce up to $5\sigma$ biases for shear are seen to be unbiased at the level of $\sim1\sigma$ for $2\times2$pt. We demonstrate that this robustness can be largely attributed to the redshift separation in galaxy-galaxy lensing, which provides a cleaner separation of lensing and IA contributions. We identify secondary factors which may also contribute, including the possibility of cancellation of higher-order IA terms in $2\times2$pt and differences in sensitivity to physical scales. Unfortunately this does not typically correspond to equally effective self-calibration in a $3\times2$pt analysis of the same data, which can show significant biases driven by the cosmic shear part of the data vector. If we increase the precision of our mock analyses to a level roughly equivalent to LSST Y1, we find a similar pattern, with considerably more bias in a cosmic shear analysis than a $2\times2$pt one, and significant bias in a joint analysis of the two. Our findings suggest that IA model error can manifest itself as internal tension between $\xi_\pm$ and $\gamma_t + w$ data vectors. We thus propose that such tension (or the lack thereof) can be employed as a test of model sufficiency or insufficiency when choosing a fiducial IA model, alongside other data-driven methods.


title: KMS states on $\mathbb{Z}_2$-crossed products and twisted KMS functionals

abstract: KMS states on $\mathbb{Z}_2$-crossed products of unital $C^*$-algebras $\mathcal{A}$ are characterized in terms of KMS states and twisted KMS functionals of $\mathcal{A}$. These functionals are shown to describe the extensions of KMS states $\omega$ on $\mathcal{A}$ to the crossed product $\mathcal{A} \rtimes \mathbb{Z}_2$ and can also be characterized by the twisted center of the von Neumann algebra generated by the GNS representation corresponding to $\omega$. As a particular class of examples, KMS states on $\mathbb{Z}_2$-crossed products of CAR algebras with dynamics and grading given by Bogoliubov automorphisms are analyzed in detail. In this case, one or two extremal KMS states are found depending on a Gibbs type condition involving the odd part of the absolute value of the Hamiltonian. As an application in mathematical physics, the extended field algebra of the Ising QFT is shown to be a $\mathbb{Z}_2$-crossed product of a CAR algebra which has a unique KMS state.


title: Quasinormal modes and bound states of massive scalar fields in wormhole spacetimes

abstract: In this work we explore the propagation of massive scalar fields on some wormhole backgrounds. On one side, we consider the Bronnikov-Ellis wormhole solution and wormhole geometries with a non-constant redshift function by introducing a gravitational mass $M$, which goes over into the Bronnikov-Ellis wormhole when the gravitational mass parameter vanishes. We employ the continued fraction method to calculate accurately the quasinormal frequencies of massive scalar fields, particularly focusing on low values of the angular number, and we show an anomalous behaviour of the decay rate of the quasinormal frequencies, for $n \geq \ell$. Also, we show that for a massive scalar field and $M \neq 0$ the effective potential allows potential wells for some values of the parameters which support bound states, which are obtained using the continued fraction method and they are characterized by having only a frequency of oscillation and they do not decay; however, for the Bronnikov-Ellis wormhole the effective potential do not support bound states. On the other side, we consider a wormhole geometry which is an exact solution of $f(R)$ modified gravity. For this geometry the quasinormal frequencies can be obtained analytically, being the longest-lived modes the ones with lowest angular number $\ell$. So, in this wormhole background the anomalous behaviour is avoided.


title: Restoring the fluctuation-dissipation theorem in Kardar-Parisi-Zhang universality class through a new emergent fractal dimension

abstract: The Kardar-Parisi-Zhang (KPZ) equation describes a wide range of growth-like phenomena, with applications in physics, chemistry and biology. There are three central questions in the study of KPZ growth: the determination of height probability distributions; the search for ever more precise universal growth exponents; and the apparent absence of a fluctuation-dissipation theorem (FDT) for spatial dimension $d>1$. Notably, these questions were answered exactly only for $1+1$ dimensions. In this work, we propose a new FDT valid for the KPZ problem in $d+1$ dimensions. This is done by rearranging terms and identifying a new correlated noise which we argue to be characterized by a fractal dimension $d_n$. We present relations between the KPZ exponents and two emergent fractal dimensions, namely $d_f$, of the rough interface, and $d_n$. Also, we simulate KPZ growth to obtain values for transient versions of the roughness exponent $\alpha$, the surface fractal dimension $d_f$ and, through our relations, the noise fractal dimension $d_n$. Our results indicate that KPZ may have at least two fractal dimensions and that, within this proposal, a FDT is restored. Finally, we provide new insights into the old question about the upper critical dimension of the KPZ universality class.


title: Shell-model study of $^{58}$Ni using quantum computing algorithm

abstract: This study presents a simulated quantum computing approach for the investigation into the shell-model energy levels of $^{58}$Ni through the application of the variational eigensolver (VQE) method in combination with a problem-specific ansatz. The primary objective is to achieve a fully accurate low-lying energy spectrum of $^{58}$Ni. The chosen isotope, $^{58}$Ni is particularly interesting in nuclear physics through its role in astrophysical reactions while also being a simple but not-trivial nucleus for shell-model study, it being two particles outside a closed shell. Our ansatz, along with the VQE method are shown to be able to reproduce exact energy values for the ground state and first and second excited states. We compare a classical shell model code, the values obtained by diagonalization of the Hamiltonian after qubit mapping, and a noiseless simulated ansatz+VQE simulation. The exact agreement between classical and qubit-mapped diagonalisation shows the correctness of our method, and the high accuracy of the simulation means that the ansatz is suitable to allow a full reconstruction of the full nuclear wave function.


title: Self-Supervised Pre-Training for Table Structure Recognition Transformer

abstract: Table structure recognition (TSR) aims to convert tabular images into a machine-readable format. Although hybrid convolutional neural network (CNN)-transformer architecture is widely used in existing approaches, linear projection transformer has outperformed the hybrid architecture in numerous vision tasks due to its simplicity and efficiency. However, existing research has demonstrated that a direct replacement of CNN backbone with linear projection leads to a marked performance drop. In this work, we resolve the issue by proposing a self-supervised pre-training (SSP) method for TSR transformers. We discover that the performance gap between the linear projection transformer and the hybrid CNN-transformer can be mitigated by SSP of the visual encoder in the TSR model. We conducted reproducible ablation studies and open-sourced our code at https://github.com/poloclub/unitable to enhance transparency, inspire innovations, and facilitate fair comparisons in our domain as tables are a promising modality for representation learning.


title: CI w/o TN: Context Injection without Task Name for Procedure Planning

abstract: This paper explores the challenge of procedure planning in instructional videos, which involves creating goal-directed plans based on visual start and goal observations from videos. Previous research has tackled this problem with gradually weaker training supervision, from heavy intermediate visual observations or language instructions to task class supervision. However, with the advent of large language models, even given only the task name, these models can produce a detailed plan. In this study, we propose a much weaker setting without task name as supervision, which is not currently solvable by existing large language models since they require good prompts with sufficient information. Specifically, we hypothesize that previous intermediate supervisions can serve as context information, and we use captions of visual start and goal observations as a much cheaper form of supervision. This approach greatly reduces the labeling cost since the captions can be easily obtained by large pre-trained vision-language foundation models. Technically, we apply BLIP to generate captions as supervision to train the context feature with contrastive learning loss. Afterward, the context feature is fed into the generator to aid in plan generation. Our experiments on two datasets with varying scales demonstrate that our model can achieve comparable performance on multiple metrics, which validates our hypothesis.


title: CharacterMixer: Rig-Aware Interpolation of 3D Characters

abstract: We present CharacterMixer, a system for blending two rigged 3D characters with different mesh and skeleton topologies while maintaining a rig throughout interpolation. CharacterMixer also enables interpolation during motion for such characters, a novel feature. Interpolation is an important shape editing operation, but prior methods have limitations when applied to rigged characters: they either ignore the rig (making interpolated characters no longer posable) or use a fixed rig and mesh topology. To handle different mesh topologies, CharacterMixer uses a signed distance field (SDF) representation of character shapes, with one SDF per bone. To handle different skeleton topologies, it computes a hierarchical correspondence between source and target character skeletons and interpolates the SDFs of corresponding bones. This correspondence also allows the creation of a single "unified skeleton" for posing and animating interpolated characters. We show that CharacterMixer produces qualitatively better interpolation results than two state-of-the-art methods while preserving a rig throughout interpolation.


title: Fireball anti-nucleosynthesis

abstract: The tentative identification of approximately ten relativistic anti-helium cosmic-ray events at AMS-02 would, if confirmed, challenge our understanding of the astrophysical synthesis of heavy anti-nuclei. We propose a novel scenario for the enhanced production of such anti-nuclei that is triggered by isolated, catastrophic injections of large quantities of energetic Standard Model (SM) anti-quarks in our galaxy by physics beyond the Standard Model (BSM). We demonstrate that SM anti-nucleosynthetic processes that occur in the resulting rapidly expanding, thermalized fireballs of SM plasma can, for a reasonable range of parameters, produce the reported tentative $\sim 2:1$ ratio of anti-helium-3 to anti-helium-4 events at AMS-02, as well as their relativistic boosts. Moreover, we show that this can be achieved without violating anti-deuterium or anti-proton flux constraints for the appropriate anti-helium fluxes. A plausible BSM paradigm for the catastrophic injections is the collision of macroscopic composite dark-matter objects carrying large net anti-baryon number. Such a scenario would require these objects to be cosmologically stable, but to destabilize upon collision, promptly releasing a fraction of their mass energy into SM anti-particles within a tiny volume. We show that, in principle, the injection rate needed to attain the necessary anti-helium fluxes and the energetic conditions required to seed the fireballs appear possible to obtain in such a paradigm. We leave open the question of constructing a BSM particle physics model to realize this, but we suggest two concrete scenarios as promising targets for further investigation.

categories: hep-ph astro-ph.CO astro-ph.GA astro-ph.HE


title: Probabilistic Prediction of Material Stability: Integrating Convex Hulls into Active Learning

abstract: Active learning is a valuable tool for efficiently exploring complex spaces, finding a variety of uses in materials science. However, the determination of convex hulls for phase diagrams does not neatly fit into traditional active learning approaches due to their global nature. Specifically, the thermodynamic stability of a material is not simply a function of its own energy, but rather requires energetic information from all other competing compositions and phases. Here we present Convex hull-aware Active Learning (CAL), a novel Bayesian algorithm that chooses experiments to minimize the uncertainty in the convex hull. CAL prioritizes compositions that are close to or on the hull, leaving significant uncertainty in other compositions that are quickly determined to be irrelevant to the convex hull. The convex hull can thus be predicted with significantly fewer observations than approaches that focus solely on energy. Intrinsic to this Bayesian approach is uncertainty quantification in both the convex hull and all subsequent predictions (e.g., stability and chemical potential). By providing increased search efficiency and uncertainty quantification, CAL can be readily incorporated into the emerging paradigm of uncertainty-based workflows for thermodynamic prediction.


title: Cohere3D: Exploiting Temporal Coherence for Unsupervised Representation Learning of Vision-based Autonomous Driving

abstract: Due to the lack of depth cues in images, multi-frame inputs are important for the success of vision-based perception, prediction, and planning in autonomous driving. Observations from different angles enable the recovery of 3D object states from 2D image inputs if we can identify the same instance in different input frames. However, the dynamic nature of autonomous driving scenes leads to significant changes in the appearance and shape of each instance captured by the camera at different time steps. To this end, we propose a novel contrastive learning algorithm, Cohere3D, to learn coherent instance representations in a long-term input sequence robust to the change in distance and perspective. The learned representation aids in instance-level correspondence across multiple input frames in downstream tasks. In the pretraining stage, the raw point clouds from LiDAR sensors are utilized to construct the long-term temporal correspondence for each instance, which serves as guidance for the extraction of instance-level representation from the vision-based bird's eye-view (BEV) feature map. Cohere3D encourages a consistent representation for the same instance at different frames but distinguishes between representations of different instances. We evaluate our algorithm by finetuning the pretrained model on various downstream perception, prediction, and planning tasks. Results show a notable improvement in both data efficiency and task performance.


title: State Space Models for Event Cameras

abstract: Today, state-of-the-art deep neural networks that process event-camera data first convert a temporal window of events into dense, grid-like input representations. As such, they exhibit poor generalizability when deployed at higher inference frequencies (i.e., smaller temporal windows) than the ones they were trained on. We address this challenge by introducing state-space models (SSMs) with learnable timescale parameters to event-based vision. This design adapts to varying frequencies without the need to retrain the network at different frequencies. Additionally, we investigate two strategies to counteract aliasing effects when deploying the model at higher frequencies. We comprehensively evaluate our approach against existing methods based on RNN and Transformer architectures across various benchmarks, including Gen1 and 1 Mpx event camera datasets. Our results demonstrate that SSM-based models train 33% faster and also exhibit minimal performance degradation when tested at higher frequencies than the training input. Traditional RNN and Transformer models exhibit performance drops of more than 20 mAP, with SSMs having a drop of 3.76 mAP, highlighting the effectiveness of SSMs in event-based vision tasks.


title: Inference for Regression with Variables Generated from Unstructured Data

abstract: The leading strategy for analyzing unstructured data uses two steps. First, latent variables of economic interest are estimated with an upstream information retrieval model. Second, the estimates are treated as "data" in a downstream econometric model. We establish theoretical arguments for why this two-step strategy leads to biased inference in empirically plausible settings. More constructively, we propose a one-step strategy for valid inference that uses the upstream and downstream models jointly. The one-step strategy (i) substantially reduces bias in simulations; (ii) has quantitatively important effects in a leading application using CEO time-use data; and (iii) can be readily adapted by applied researchers.


title: Distilling Adversarial Robustness Using Heterogeneous Teachers

abstract: Achieving resiliency against adversarial attacks is necessary prior to deploying neural network classifiers in domains where misclassification incurs substantial costs, e.g., self-driving cars or medical imaging. Recent work has demonstrated that robustness can be transferred from an adversarially trained teacher to a student model using knowledge distillation. However, current methods perform distillation using a single adversarial and vanilla teacher and consider homogeneous architectures (i.e., residual networks) that are susceptible to misclassify examples from similar adversarial subspaces. In this work, we develop a defense framework against adversarial attacks by distilling adversarial robustness using heterogeneous teachers (DARHT). In DARHT, the student model explicitly represents teacher logits in a student-teacher feature map and leverages multiple teachers that exhibit low adversarial example transferability (i.e., exhibit high performance on dissimilar adversarial examples). Experiments on classification tasks in both white-box and black-box scenarios demonstrate that DARHT achieves state-of-the-art clean and robust accuracies when compared to competing adversarial training and distillation methods in the CIFAR-10, CIFAR-100, and Tiny ImageNet datasets. Comparisons with homogeneous and heterogeneous teacher sets suggest that leveraging teachers with low adversarial example transferability increases student model robustness.


title: A Study of Shape Modeling Against Noise

abstract: Shape modeling is a challenging task with many potential applications in computer vision and medical imaging. There are many shape modeling methods in the literature, each with its advantages and applications. However, many shape modeling methods have difficulties handling shapes that have missing pieces or outliers. In this regard, this paper introduces shape denoising, a fundamental problem in shape modeling that lies at the core of many computer vision and medical imaging applications and has not received enough attention in the literature. The paper introduces six types of noise that can be used to perturb shapes as well as an objective measure for the noise level and for comparing methods on their shape denoising capabilities. Finally, the paper evaluates seven methods capable of accomplishing this task, of which six are based on deep learning, including some generative models.


title: Sizing the bets in a focused portfolio

abstract: The paper provides a mathematical model and a tool for the focused investing strategy as advocated by Buffett, Munger, and others from this investment community. The approach presented here assumes that the investor's role is to think about probabilities of different outcomes for a set of businesses. Based on these assumptions, the tool calculates the optimal allocation of capital for each of the investment candidates. The model is based on a generalized Kelly Criterion with options to provide constraints that ensure: no shorting, limited use of leverage, providing a maximum limit to the risk of permanent loss of capital, and maximum individual allocation. The software is applied to an example portfolio from which certain observations about excessive diversification are obtained. In addition, the software is made available for public use.


title: Prompting LLMs to Compose Meta-Review Drafts from Peer-Review Narratives of Scholarly Manuscripts

abstract: One of the most important yet onerous tasks in the academic peer-reviewing process is composing meta-reviews, which involves understanding the core contributions, strengths, and weaknesses of a scholarly manuscript based on peer-review narratives from multiple experts and then summarizing those multiple experts' perspectives into a concise holistic overview. Given the latest major developments in generative AI, especially Large Language Models (LLMs), it is very compelling to rigorously study the utility of LLMs in generating such meta-reviews in an academic peer-review setting. In this paper, we perform a case study with three popular LLMs, i.e., GPT-3.5, LLaMA2, and PaLM2, to automatically generate meta-reviews by prompting them with different types/levels of prompts based on the recently proposed TELeR taxonomy. Finally, we perform a detailed qualitative study of the meta-reviews generated by the LLMs and summarize our findings and recommendations for prompting LLMs for this complex task.


title: Tidal Disruption Encores

abstract: Nuclear star clusters (NSCs), made up of a dense concentrations of stars and the compact objects they leave behind, are ubiquitous in the central regions of galaxies, surrounding the central supermassive black hole (SMBH). Close interactions between stars and stellar-mass black holes (sBH) lead to tidal disruption events (TDEs). We uncover an interesting new phenomenon: For a subset of these, the unbound debris (to the sBH) remain bound to the SMBH, accreting at a later time, and thus giving rise to a second flare. We compute the rate of such events, and find them ranging within $10^{-6}$ -$10^{-3}$ yr$^{-1}$gal$^{-1}$ for SMBH mass $\simeq 10^{6}-10^{9}M_\odot$. Time delays between the two flares spread over a wide range, from less than a year to hundreds of years. The temporal evolution of the light curves of the second flare can vary between the standard $t^{-5/3}$ power-law to much steeper decays, providing a natural explanation for observed light curves in tension with the classical TDE model. Our predictions have implications for learning about NSC properties and calibrating its sBH population. Some double flares may be electromagnetic counterparts to LISA Extreme-Mass-Ratio-Inspiral (EMRI) sources. Another important implication is the possible existence of TDE-like events in very massive SMBHs, where TDEs are not expected. Such flares can affect spin measurements relying on TDEs in the upper SMBH range.


title: RecWizard: A Toolkit for Conversational Recommendation with Modular, Portable Models and Interactive User Interface

abstract: We present a new Python toolkit called RecWizard for Conversational Recommender Systems (CRS). RecWizard offers support for development of models and interactive user interface, drawing from the best practices of the Huggingface ecosystems. CRS with RecWizard are modular, portable, interactive and Large Language Models (LLMs)-friendly, to streamline the learning process and reduce the additional effort for CRS research. For more comprehensive information about RecWizard, please check our GitHub https://github.com/McAuley-Lab/RecWizard.


title: Neural optimal controller for stochastic systems via pathwise HJB operator

abstract: The aim of this work is to develop deep learning-based algorithms for high-dimensional stochastic control problems based on physics-informed learning and dynamic programming. Unlike classical deep learning-based methods relying on a probabilistic representation of the solution to the Hamilton--Jacobi--Bellman (HJB) equation, we introduce a pathwise operator associated with the HJB equation so that we can define a problem of physics-informed learning. According to whether the optimal control has an explicit representation, two numerical methods are proposed to solve the physics-informed learning problem. We provide an error analysis on how the truncation, approximation and optimization errors affect the accuracy of these methods. Numerical results on various applications are presented to illustrate the performance of the proposed algorithms.


title: On the global well-posedness of interface dynamics for gravity Stokes flow

abstract: In this paper we establish the global-in-time well-posedness for an arbitrary $C^{1+\gamma}$, $0<\gamma<1$, initial internal wave for the free boundary gravity Stokes system in two dimensions. This classical well-posedness result is complemented with a weak solvability result in the case of $C^\gamma$ or Lipschitz interfaces. Furthermore, we also propose and study several one-dimensional models that capture different features of the full internal wave problem for the gravity Stokes system and show that all of them present finite time singularities. This fact evidences the fine structure of the non-linearity in the full system that allows for the free boundary problem to be globally well-posed while simplifications of it blow-up in finite time.


title: Alternating Weak Triphone/BPE Alignment Supervision from Hybrid Model Improves End-to-End ASR

abstract: In this paper, alternating weak triphone/BPE alignment supervision is proposed to improve end-to-end model training. Towards this end, triphone and BPE alignments are extracted using a pre-existing hybrid ASR system. Then, regularization effect is obtained by cross-entropy based intermediate auxiliary losses computed on such alignments at a mid-layer representation of the encoder for triphone alignments and at the encoder for BPE alignments. Weak supervision is achieved through strong label smoothing with parameter of 0.5. Experimental results on TED-LIUM 2 indicate that either triphone or BPE alignment based weak supervision improves ASR performance over standard CTC auxiliary loss. Moreover, their combination lowers the word error rate further. We also investigate the alternation of the two auxiliary tasks during model training, and additional performance gain is observed. Overall, the proposed techniques result in over 10% relative error rate reduction over a CTC-regularized baseline system.


title: Symmetry and reactivity of $\pi$-systems in electric and magnetic fields: a perspective from conceptual DFT

abstract: [Abridged] The extension of conceptual DFT to include external fields in chemical systems is utilised to investigate the effects of strong magnetic fields on the electronic charge distribution and its consequences on the reactivity of $\pi$-systems. Formaldehyde, H$_2$CO, is considered as a prototypical example and current-DFT calculations are used to evaluate the electric dipole moment together with the electron density and the Fukui functions, which provide insight into how H$_2$CO behaves chemically in a magnetic field. In particular, the symmetries of these quantities are analysed based on group, representation, and corepresentation theories using QSym$^2$. This allows us to leverage the simple symmetry constraints on the macroscopic electric dipole moments to make profound predictions on the more nuanced symmetry transformation properties of the microscopic frontier MOs, electron densities, and Fukui functions. This is especially useful for complex-valued MOs in magnetic fields whose detailed symmetry analyses lead us to define the new concepts of modular and phasal symmetry breaking. Through these, the connection between the vanishing constraints on the electric dipole moments and the symmetry of electron densities and Fukui functions can be formalised, and the inability of the magnetic field in all three orientations considered to induce asymmetry with respect to the molecular plane can be understood from a molecular perspective. Furthermore, the detailed forms of the Fukui functions reveal remarkable reversals in the direction of the C=O dipole moment in the presence of a parallel or perpendicular magnetic field, which can be attributed to the mixing between frontier MOs due to their subduced symmetries in magnetic fields. The findings in this work are also discussed in the wider context of a long-standing debate on the possibility to create enantioselectivity by external fields.


title: An experimental scheme for determining the Berry phase in two-dimensional quantum materials with a flat band

abstract: Experimentally feasible methods to determine the Berry phase, a fundamental quantity characterizing a quantum material, are often needed in applications. We develop an approach to detecting the Berry phase by using a class of two-dimensional (2D) Dirac materials with a flat band, the $\alpha$-$\mathcal{T}_3$ lattices. The properties of this class of quantum materials are controlled by a single parameter $0 \le \alpha \le 1$, where the left and right endpoints correspond to graphene with pseudospin-1/2 and the dice lattice with pseudospin-1 Dirac-Weyl quasiparticles, respectively, and each specific value of $\alpha$ represents a material with a unique Berry phase. Applying a constant electric field to the $\alpha$-$\mathcal{T}_3$ lattice, we calculate the resulting electric current and find a one-to-one correspondence between the current and the Berry phase in both the linear and nonlinear response regimes. In the linear (Kubo) regime, the main physics is the Zitterbewegung effect. In the nonlinear regime, the Schwinger mechanism dominates. Beyond the nonlinear regime, Bloch-Zener oscillations can arise. Measuring the current thus provides an effective and experimentally feasible way to determine the Berry phase for this spectrum of 2D quantum materials.


title: Generalized convex functions and their applications in optimality conditions

abstract: We introduce and study the notion of (e,y)-conjugate for a proper and e-convex function in locally convex spaces, which is an extension of the concept of the conjugate. The mutual relationships between the concepts of (e,y)-conjugacy and e-subdifferential are presented. Moreover, some applications of these notions in optimization are established.


title: DeepSet SimCLR: Self-supervised deep sets for improved pathology representation learning

abstract: Often, applications of self-supervised learning to 3D medical data opt to use 3D variants of successful 2D network architectures. Although promising approaches, they are significantly more computationally demanding to train, and thus reduce the widespread applicability of these methods away from those with modest computational resources. Thus, in this paper, we aim to improve standard 2D SSL algorithms by modelling the inherent 3D nature of these datasets implicitly. We propose two variants that build upon a strong baseline model and show that both of these variants often outperform the baseline in a variety of downstream tasks. Importantly, in contrast to previous works in both 2D and 3D approaches for 3D medical data, both of our proposals introduce negligible additional overhead over the baseline, improving the democratisation of these approaches for medical applications.


title: Simulating Transient X-ray Photoelectron Spectra of Fe(CO)5 and Its Photodissociation Products With Multireference Algebraic Diagrammatic Construction Theory

abstract: Accurate simulations of transient X-ray photoelectron spectra (XPS) provide unique opportunities to bridge the gap between theory and experiment in understanding the photoactivated dynamics in molecules and materials. However, simulating X-ray photoelectron spectra along a photochemical reaction pathway is challenging as it requires accurate description of electronic structure incorporating core-hole screening, orbital relaxation, electron correlation, and spin-orbit coupling in excited states or at nonequilibrium ground-state geometries. In this work, we employ the recently developed multireference algebraic diagrammatic construction theory (MR-ADC) to investigate the core-ionized states and X-ray photoelectron spectra of Fe(CO)5 and its photodissociation products (Fe(CO)4, Fe(CO)3) following excitation with 266 nm light. The simulated transient Fe 3p and CO 3{\sigma} XPS spectra incorporating spin-orbit coupling and high-order electron correlation effects are shown to be in a good agreement with the experimental measurements by Leitner et al. [J. Chem. Phys. 149, 044307 (2018)]. Our calculations suggest that core-hole screening, spin-orbit coupling, and ligand-field splitting effects are similarly important in reproducing the experimentally observed chemical shifts in transient Fe 3p XPS spectra of iron carbonyl complexes. Our results also demonstrate that the MR-ADC methods can be very useful in interpreting the transient XPS spectra of transition metal compounds.


title: A Graph-based Approach to Estimating the Number of Clusters

abstract: We consider the problem of estimating the number of clusters ($k$) in a dataset. We propose a non-parametric approach to the problem that is based on maximizing a statistic constructed from similarity graphs. This graph-based statistic is a robust summary measure of the similarity information among observations and is applicable even if the number of dimensions or number of clusters is possibly large. The approach is straightforward to implement, computationally fast, and can be paired with any kind of clustering technique. Asymptotic theory is developed to establish the selection consistency of the proposed approach. Simulation studies demonstrate that the graph-based statistic outperforms existing methods for estimating $k$. We illustrate its utility on a high-dimensional image dataset and RNA-seq dataset.


title: Error Bounds for Compositions of Piecewise Affine Approximations

abstract: Nonlinear expressions are often approximated by piecewise affine (PWA) functions to simplify analysis or reduce computational costs. To reduce computational complexity, multivariate functions can be represented as compositions of functions with one or two inputs, which can be approximated individually. This paper provides efficient methods to generate PWA approximations of nonlinear functions via functional decomposition. The key contributions focus on intelligent placement of breakpoints for PWA approximations without requiring optimization, and on bounding the error of PWA compositions as a function of the error tolerance for each component of that composition. The proposed methods are used to systematically construct a PWA approximation for a complicated function, either to within a desired error tolerance or to a given level of complexity.


title: Minimax Optimality of Score-based Diffusion Models: Beyond the Density Lower Bound Assumptions

abstract: We study the asymptotic error of score-based diffusion model sampling in large-sample scenarios from a non-parametric statistics perspective. We show that a kernel-based score estimator achieves an optimal mean square error of $\widetilde{O}\left(n^{-1} t^{-\frac{d+2}{2}}(t^{\frac{d}{2}} \vee 1)\right)$ for the score function of $p_0*\mathcal{N}(0,t\boldsymbol{I}_d)$, where $n$ and $d$ represent the sample size and the dimension, $t$ is bounded above and below by polynomials of $n$, and $p_0$ is an arbitrary sub-Gaussian distribution. As a consequence, this yields an $\widetilde{O}\left(n^{-1/2} t^{-\frac{d}{4}}\right)$ upper bound for the total variation error of the distribution of the sample generated by the diffusion model under a mere sub-Gaussian assumption. If in addition, $p_0$ belongs to the nonparametric family of the $\beta$-Sobolev space with $\beta\le 2$, by adopting an early stopping strategy, we obtain that the diffusion model is nearly (up to log factors) minimax optimal. This removes the crucial lower bound assumption on $p_0$ in previous proofs of the minimax optimality of the diffusion model for nonparametric families.


title: Differentially Private Fair Binary Classifications

abstract: In this work, we investigate binary classification under the constraints of both differential privacy and fairness. We first propose an algorithm based on the decoupling technique for learning a classifier with only fairness guarantee. This algorithm takes in classifiers trained on different demographic groups and generates a single classifier satisfying statistical parity. We then refine this algorithm to incorporate differential privacy. The performance of the final algorithm is rigorously examined in terms of privacy, fairness, and utility guarantees. Empirical evaluations conducted on the Adult and Credit Card datasets illustrate that our algorithm outperforms the state-of-the-art in terms of fairness guarantees, while maintaining the same level of privacy and utility.


title: Goal-Reaching Trajectory Design Near Danger with Piecewise Affine Reach-avoid Computation

abstract: Autonomous mobile robots must maintain safety, but should not sacrifice performance, leading to the classical reach-avoid problem: find a trajectory that is guaranteed to reach a goal and avoid obstacles. This paper addresses the near danger case, also known as a narrow gap, where the agent starts near the goal, but must navigate through tight obstacles that block its path. The proposed method builds off the common approach of using a simplified planning model to generate plans, which are then tracked using a high-fidelity tracking model and controller. Existing approaches use reachability analysis to overapproximate the error between these models and ensure safety, but doing so introduces numerical approximation error conservativeness that prevents goal-reaching. The present work instead proposes a Piecewise Affine Reach-avoid Computation (PARC) method to tightly approximate the reachable set of the planning model. PARC significantly reduces conservativeness through a careful choice of the planning model and set representation, along with an effective approach to handling time-varying tracking errors. The utility of this method is demonstrated through extensive numerical experiments in which PARC outperforms state-of-the-art reach avoid methods in near-danger goal reaching. Furthermore, in a simulated demonstration, PARC enables the generation of provably-safe extreme vehicle dynamics drift parking maneuvers. A preliminary hardware demo on a TurtleBot3 also validates the method.


title: Do You See What I See? A Qualitative Study Eliciting High-Level Visualization Comprehension

abstract: Designers often create visualizations to achieve specific high-level analytical or communication goals. These goals require people to naturally extract complex, contextualized, and interconnected patterns in data. While limited prior work has studied general high-level interpretation, prevailing perceptual studies of visualization effectiveness primarily focus on isolated, predefined, low-level tasks, such as estimating statistical quantities. This study more holistically explores visualization interpretation to examine the alignment between designers' communicative goals and what their audience sees in a visualization, which we refer to as their comprehension. We found that statistics people effectively estimate from visualizations in classical graphical perception studies may differ from the patterns people intuitively comprehend in a visualization. We conducted a qualitative study on three types of visualizations -- line graphs, bar graphs, and scatterplots -- to investigate the high-level patterns people naturally draw from a visualization. Participants described a series of graphs using natural language and think-aloud protocols. We found that comprehension varies with a range of factors, including graph complexity and data distribution. Specifically, 1) a visualization's stated objective often does not align with people's comprehension, 2) results from traditional experiments may not predict the knowledge people build with a graph, and 3) chart type alone is insufficient to predict the information people extract from a graph. Our study confirms the importance of defining visualization effectiveness from multiple perspectives to assess and inform visualization practices.


title: Homogeneous spaces in Hartree-Fock-Bogoliubov theory

abstract: We study the action of Bogoliubov transformations on admissible generalized one-particle density matrices arising in Hartree-Fock-Bogoliubov theory. We show that the orbits of this action are reductive homogeneous spaces, and we give several equivalences that characterize when they are embedded submanifolds of natural ambient spaces. We use Lie theoretic arguments to prove that these orbits admit an invariant symplectic form. If, in addition, the operators in the orbits have finite spectrum, or infinite spectrum and trivial kernel, then we obtain that the orbits are actually K\"ahler homogeneous spaces.


title: How Do Nonlinear Transformers Learn and Generalize in In-Context Learning?

abstract: Transformer-based large language models have displayed impressive in-context learning capabilities, where a pre-trained model can handle new tasks without fine-tuning by simply augmenting the query with some input-output examples from that task. Despite the empirical success, the mechanics of how to train a Transformer to achieve ICL and the corresponding ICL capacity is mostly elusive due to the technical challenges of analyzing the nonconvex training problems resulting from the nonlinear self-attention and nonlinear activation in Transformers. To the best of our knowledge, this paper provides the first theoretical analysis of the training dynamics of Transformers with nonlinear self-attention and nonlinear MLP, together with the ICL generalization capability of the resulting model. Focusing on a group of binary classification tasks, we train Transformers using data from a subset of these tasks and quantify the impact of various factors on the ICL generalization performance on the remaining unseen tasks with and without data distribution shifts. We also analyze how different components in the learned Transformers contribute to the ICL performance. Furthermore, we provide the first theoretical analysis of how model pruning affects ICL performance and prove that proper magnitude-based pruning can have a minimal impact on ICL while reducing inference costs. These theoretical findings are justified through numerical experiments.


title: Machine Learning-Based Completions Sequencing for Well Performance Optimization

abstract: Establishing accurate field development parameters to optimize long-term oil production takes time and effort due to the complexity of oil well development, and the uncertainty in estimating long-term well production. Traditionally, oil and gas companies use simulation software that are inherently computationally expensive to forecast production. Thus, machine learning approaches are recently utilized in literature as an efficient alternative to optimize well developments by enhancing completion conditions. The primary goal of this project is to develop effective machine-learning models that can integrate the effects of multidimensional predictive variables (i.e., completion conditions) to predict 12-Month Cumulative Production accurately. Three predictive regression machine learning models are implemented for predicting 12-month cumulative oil production: Random Forest, Gradient Boosting, and Long Short-Term Memory Models. All three models yielded cumulative production predictions with root mean squared error (RMSE ) values ranging from 7.35 to 20.01 thousand barrels of oil. Although we hypothesized that all models would yield accurate predictions, the results indicated a crucial need for further refinement to create reliable and rational predictive tools in the subsurface. While this study did not produce optimal models for completion sequencing to maximize long-term production, we established that machine learning models alone are not self-sufficient for problems of this nature. Hence, there is potential for significant improvement, including comprehensive feature engineering, and a recommendation of exploring the use of hybrid or surrogate models (i.e., coupling physics reduced models and machine learning models), to ascertain significant contribution to the progress of completion sequencing workflows.


title: Exploration and Exploitation in Consumer Automation: Visualizing IoT Interactions with Topological Data Analysis

abstract: This article proposes a method to uncover opportunities for exploitation and exploration from consumer IoT interaction data. We develop a unique decomposition of cosine similarity that quantifies exploitation through functional similarity of interactions, exploration through cross-capacity similarity of counterfactual interactions, and differentiation of the two opportunities through within-similarity. We propose a topological data analysis method that incorporates these components of similarity and provides for their visualization. Functionally similar automations reveal exploitation opportunities for substitutes-in-use or complements-in-use, while exploration opportunities extend functionality into new use cases. This data-driven approach provides marketers with a powerful capability to discover possibilities for refining existing automation features while exploring new innovations. More generally, our approach can aid marketing efforts to balance these strategic opportunities in high technology contexts.


title: Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning

abstract: Selective prediction minimizes incorrect predictions from vision-language models (VLMs) by allowing them to abstain from answering when uncertain. However, when deploying a vision-language system with low tolerance for inaccurate predictions, selective prediction may be over-cautious and abstain too frequently, even on many correct predictions. We introduce ReCoVERR, an inference-time algorithm to reduce the over-abstention of a selective vision-language system without increasing the error rate of the system's predictions. When the VLM makes a low-confidence prediction, instead of abstaining ReCoVERR tries to find relevant clues in the image that provide additional evidence for the prediction. ReCoVERR uses an LLM to pose related questions to the VLM, collects high-confidence evidences, and if enough evidence confirms the prediction the system makes a prediction instead of abstaining. ReCoVERR enables three VLMs (BLIP2, InstructBLIP, and LLaVA-1.5) to answer up to 20% more questions on the VQAv2 and A-OKVQA tasks without decreasing system accuracy, thus improving overall system reliability. Our code is available at https://github.com/tejas1995/ReCoVERR.


title: Data/moment-driven approaches for fast predictive control of collective dynamics

abstract: Feedback control synthesis for large-scale particle systems is reviewed in the framework of model predictive control (MPC). The high-dimensional character of collective dynamics hampers the performance of traditional MPC algorithms based on fast online dynamic optimization at every time step. Two alternatives to MPC are proposed. First, the use of supervised learning techniques for the offline approximation of optimal feedback laws is discussed. Then, a procedure based on sequential linearization of the dynamics based on macroscopic quantities of the particle ensemble is reviewed. Both approaches circumvent the online solution of optimal control problems enabling fast, real-time, feedback synthesis for large-scale particle systems. Numerical experiments assess the performance of the proposed algorithms.


title: A source list to support DEI/EDI work in mathematical sciences

abstract: This article presents a source list to support departments in creating more equitable, diverse, and inclusive mathematics classrooms. Included are relevant general-interest books, as well as articles and books presenting research results about how matters of inequity, exclusion, and homogeneity surface in educational contexts. We also present sources more specifically focused on research about the past and present of relationships between mathematics and gender, (dis)ability, race, and class, as well as articles proposing approaches and case studies in mathematics classrooms.


title: Towards Efficient Active Learning in NLP via Pretrained Representations

abstract: Fine-tuning Large Language Models (LLMs) is now a common approach for text classification in a wide range of applications. When labeled documents are scarce, active learning helps save annotation efforts but requires retraining of massive models on each acquisition iteration. We drastically expedite this process by using pretrained representations of LLMs within the active learning loop and, once the desired amount of labeled data is acquired, fine-tuning that or even a different pretrained LLM on this labeled data to achieve the best performance. As verified on common text classification benchmarks with pretrained BERT and RoBERTa as the backbone, our strategy yields similar performance to fine-tuning all the way through the active learning loop but is orders of magnitude less computationally expensive. The data acquired with our procedure generalizes across pretrained networks, allowing flexibility in choosing the final model or updating it as newer versions get released.


title: Spatial Variations of Stellar Elemental Abundances in FIRE Simulations of Milky Way-Mass Galaxies: Patterns Today Mostly Reflect Those at Formation

abstract: Spatial patterns of stellar elemental abundances encode rich information about a galaxy's formation history. We analyze the radial, vertical, and azimuthal variations of metals in stars, both today and at formation, in the FIRE-2 cosmological simulations of Milky Way (MW)-mass galaxies, and we compare with the MW. The radial gradient today is steeper (more negative) for younger stars, which agrees with the MW, although radial gradients are shallower in FIRE-2. Importantly, this age dependence was present already at birth: radial gradients today are only modestly ($\lesssim$ 0.01 dex kpc$^{-1}$) shallower than at birth. Disk vertical settling gives rise to negative vertical gradients across all stars, but vertical gradients of mono-age stellar populations are weak. Similar to the MW, vertical gradients in FIRE-2 are shallower at larger radii, but they are overall shallower in FIRE-2. This vertical dependence was present already at birth: vertical gradients today are only modestly ($\lesssim$ 0.1 dex kpc$^{-1}$) shallower than at birth. Azimuthal scatter is nearly constant with radius, and it is nearly constant with age $\lesssim$ 8 Gyr ago, but increases for older stars. Azimuthal scatter is slightly larger ($\lesssim$ 0.04 dex) today than at formation. Galaxies with larger azimuthal scatter have a stronger radial gradient, implying that azimuthal scatter today arises primarily from radial redistribution of gas and stars. Overall, spatial variations of stellar metallicities show only modest differences between formation and today; spatial variations today primarily reflect the conditions of stars at birth, with spatial redistribution of stars after birth contributing secondarily.


title: Attached and separated rotating flow over a finite height ridge

abstract: This paper discusses the effect of rotation on the boundary layer in high Reynolds number flow over a ridge using a numerical method based on stabilised finite elements that captures steady solutions up to Reynolds number of order $10^6$. The results are validated against boundary layer computations in shallow flows and for deep flows against experimental observations reported in Machicoane et al. (Phys. Rev. Fluids, 2018). In all cases considered the boundary layer remains attached, even at large Reynolds numbers, provided the Rossby number of the flow is sufficiently small. At any fixed Rossby number the flow detaches at sufficiently high Reynolds number to form a steady recirculating region in the lee of the ridge. At even higher Reynolds numbers no steady flow is found. This disappearance of steady solutions closely reproduces the transition to unsteadiness seen in the laboratory.


title: Minimal Models for Altermagnetism

abstract: Altermagnets feature vanishing net magnetization, like antiferromagnets, but exhibit time-reversal symmetry breaking and momentum-dependent spin-split band structures. Motivated by the prevalence of altermagnetic materials with non-symmorphic symmetry-dictated band degeneracies, we provide realistic minimal models for altermagnetism by constructing tight-binding models for nonsymmorphic space groups with a sublattice defined by two magnetic atoms. These models can be applied to monoclinic, orthorhombic, tetragonal, rhombohedral, hexagonal, and cubic materials and can describe d-wave, g-wave, and i-wave altermagnetism. By examining the altermagnetic susceptibility and mean field instabilities within a Hubbard model we reveal that these models have altermagnetic ground states and yield a Berry curvature that is linear in the spin-orbit coupling. We apply our models to RuO$_2$, MnF$_2$, FeSb$_2$, $\kappa$-Cl, CrSb, and MnTe.


title: Reinforcement Learning-Based Approaches for Enhancing Security and Resilience in Smart Control: A Survey on Attack and Defense Methods

abstract: Reinforcement Learning (RL), one of the core paradigms in machine learning, learns to make decisions based on real-world experiences. This approach has significantly advanced AI applications across various domains, notably in smart grid optimization and smart home automation. However, the proliferation of RL in these critical sectors has also exposed them to sophisticated adversarial attacks that target the underlying neural network policies, compromising system integrity. Given the pivotal role of RL in enhancing the efficiency and sustainability of smart grids and the personalized convenience in smart homes, ensuring the security of these systems is paramount. This paper aims to bolster the resilience of RL frameworks within these specific contexts, addressing the unique challenges posed by the intricate and potentially adversarial environments of smart grids and smart homes. We provide a thorough review of the latest adversarial RL threats and outline effective defense strategies tailored to safeguard these applications. Our comparative analysis sheds light on the nuances of adversarial tactics against RL-driven smart systems and evaluates the defense mechanisms, focusing on their innovative contributions, limitations, and the compromises they entail. By concentrating on the smart grid and smart home scenarios, this survey equips ML developers and researchers with the insights needed to secure RL applications against emerging threats, ensuring their reliability and safety in our increasingly connected world.


title: Role of chalcogen vacancies and hydrogen in the optical and electrical properties of bulk transition-metal dichalcogenides

abstract: Like in any other semiconductor, point defects in transition-metal dichalcogenides (TMDs) are expected to strongly impact their electronic and optical properties. However, identifying defects in these layered two-dimensional materials has been quite challenging with controversial conclusions despite the extensive literature in the past decade. Using first-principles calculations, we revisit the role of chalcogen vacancies and hydrogen impurity in bulk TMDs, reporting formation energies and thermodynamic and optical transition levels. We show that the S vacancy can explain recently observed cathodoluminescence spectra of MoS$_2$ flakes and predict similar optical levels in the other TMDs. In the case of the H impurity, we find it more stable sitting on an interstitial site in the Mo plane, acting as a shallow donor, and possibly explaining the often observed n-type conductivity in some TMDs. We also predict the frequencies of the local vibration modes for the H impurity, aiding its identification through Raman or infrared spectroscopy.


title: Towards Improved Uncertainty Quantification of Stochastic Epidemic Models Using Sequential Monte Carlo

abstract: Sequential Monte Carlo (SMC) algorithms represent a suite of robust computational methodologies utilized for state estimation and parameter inference within dynamical systems, particularly in real-time or online environments where data arrives sequentially over time. In this research endeavor, we propose an integrated framework that combines a stochastic epidemic simulator with a sequential importance sampling (SIS) scheme to dynamically infer model parameters, which evolve due to social as well as biological processes throughout the progression of an epidemic outbreak and are also influenced by evolving data measurement bias. Through iterative updates of a set of weighted simulated trajectories based on observed data, this framework enables the estimation of posterior distributions for these parameters, thereby capturing their temporal variability and associated uncertainties. Through simulation studies, we showcase the efficacy of SMC in accurately tracking the evolving dynamics of epidemics while appropriately accounting for uncertainties. Moreover, we delve into practical considerations and challenges inherent in implementing SMC for parameter estimation within dynamic epidemiological settings, areas where the substantial computational capabilities of high-performance computing resources can be usefully brought to bear.


title: Comparison of sectoral structures between China and Japan: A network perspective

abstract: Economic structure comparisons between China and Japan have long captivated development economists. To delve deeper into their sectoral differences from 1995 to 2018, we used the annual input-output tables (IOTs) of both nations to construct weighted and directed input-output networks (IONs). This facilitated deeper network analyses. Strength distributions underscored variations in inter-sector economic interactions. Weighted, directed assortativity coefficients encapsulated the homophily among connecting sectors' features. By adjusting emphasis in PageRank centrality, key sectors were identified. Community detection revealed their clustering tendencies among the sectors. As anticipated, the analysis pinpointed manufacturing as China's central sector, while Japan favored services. Yet, at a finer level of the specific sectors, both nations exhibited varied structural evolutions. Contrastingly, sectoral communities in both China and Japan demonstrated commendable stability over the examined duration.


title: A Generalization of the Graham-Pollak Tree Theorem to Even-Order Steiner Distance

abstract: Graham and Pollak showed in 1971 that the determinant of a tree's distance matrix depends only on its number of vertices, and, in particular, it is always nonzero. The Steiner distance of a collection of $k$ vertices in a graph is the fewest number of edges in any connected subgraph containing those vertices; for $k=2$, this reduces to the ordinary definition of graphical distance. Here, we show that the hyperdeterminant of the $k$-th order Steiner distance hypermatrix is always nonzero if $k$ is even, extending their result beyond $k=2$. Previously, the authors showed that the $k$-Steiner distance hyperdeterminant is always zero for $k$ odd, so together this provides a generalization to all $k$. We conjecture that not just the vanishing, but the value itself, of the $k$-Steiner distance hyperdeterminant of an $n$-vertex tree depends only on $k$ and $n$.


title: THz Higher-Order Topological Photonics in Ge-on-Si Heterostructures

abstract: We design germanium-based higher-order topological cavities for terahertz applications by breaking the symmetry of a two-dimensional photonic crystal following the Su-Schrieffer-Heeger model. Calculations demonstrate the parity inversion of the electric field in differently deformed unit cells. The interface between domains of opposite topology presents edge and corner modes. The former are chiral, locking light propagation to its helicity. The latter prove that Ge-based structures can be used as high-order topological photonic crystals. These findings can accelerate the development of Si-photonic components working in a spectral range of high technological interest.


title: Language-Based User Profiles for Recommendation

abstract: Most conventional recommendation methods (e.g., matrix factorization) represent user profiles as high-dimensional vectors. Unfortunately, these vectors lack interpretability and steerability, and often perform poorly in cold-start settings. To address these shortcomings, we explore the use of user profiles that are represented as human-readable text. We propose the Language-based Factorization Model (LFM), which is essentially an encoder/decoder model where both the encoder and the decoder are large language models (LLMs). The encoder LLM generates a compact natural-language profile of the user's interests from the user's rating history. The decoder LLM uses this summary profile to complete predictive downstream tasks. We evaluate our LFM approach on the MovieLens dataset, comparing it against matrix factorization and an LLM model that directly predicts from the user's rating history. In cold-start settings, we find that our method can have higher accuracy than matrix factorization. Furthermore, we find that generating a compact and human-readable summary often performs comparably with or better than direct LLM prediction, while enjoying better interpretability and shorter model input length. Our results motivate a number of future research directions and potential improvements.


title: Multiplicative property of the twisted Reidemeister torsion on the connected sum of compact $3$-manifolds

abstract: Let $M$ be a $3$-manifold with connected non-vacuos boundary which is not spherical. Assume that $N$ is another $3$-manifold with vacuous boundary and $N^{\ast}$ is the $3$-manifold obtained by removing from $N$ the interior of a $3$-cell. In the present paper, we prove that the twisted Reidemeister torsion of the connected sum $M\# N$ can be expressed as the product of the torsions of $M$ and $N^{\ast}.$ Indeed, we show that the twisted Reidemeister torsion has a multiplicative property on the connected sum of compact $3$-manifolds.


title: Learning Cyclic Causal Models from Incomplete Data

abstract: Causal learning is a fundamental problem in statistics and science, offering insights into predicting the effects of unseen treatments on a system. Despite recent advances in this topic, most existing causal discovery algorithms operate under two key assumptions: (i) the underlying graph is acyclic, and (ii) the available data is complete. These assumptions can be problematic as many real-world systems contain feedback loops (e.g., biological systems), and practical scenarios frequently involve missing data. In this work, we propose a novel framework, named MissNODAGS, for learning cyclic causal graphs from partially missing data. Under the additive noise model, MissNODAGS learns the causal graph by alternating between imputing the missing data and maximizing the expected log-likelihood of the visible part of the data in each training step, following the principles of the expectation-maximization (EM) framework. Through synthetic experiments and real-world single-cell perturbation data, we demonstrate improved performance when compared to using state-of-the-art imputation techniques followed by causal learning on partially missing interventional data.


title: Alignment Transport Between Ultracold Polar Molecules

abstract: We propose an array of ultracold polar molecules as a platform to study alignment transport between molecules. We envision a polar molecule being aligned with an intense off-resonant laser field whose alignment migrates to a nearby molecule due to dipole-dipole interactions. Our results show that the transport of the alignment is due to a complex interplay between electric field-driven excitations and dipole-dipole interactions. All mechanisms for transfer are elucidated and analyzed, and using NaCs, a prototype molecule, we find that the time for alignment transfer is $\mathcal{O}(10\mu\rm s)$, which makes the phenomena readily observable in the lab.


title: MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs

abstract: We present the design, implementation and engineering experience in building and deploying MegaScale, a production system for training large language models (LLMs) at the scale of more than 10,000 GPUs. Training LLMs at this scale brings unprecedented challenges to training efficiency and stability. We take a full-stack approach that co-designs the algorithmic and system components across model block and optimizer design, computation and communication overlapping, operator optimization, data pipeline, and network performance tuning. Maintaining high efficiency throughout the training process (i.e., stability) is an important consideration in production given the long extent of LLM training jobs. Many hard stability issues only emerge at large scale, and in-depth observability is the key to address them. We develop a set of diagnosis tools to monitor system components and events deep in the stack, identify root causes, and derive effective techniques to achieve fault tolerance and mitigate stragglers. MegaScale achieves 55.2% Model FLOPs Utilization (MFU) when training a 175B LLM model on 12,288 GPUs, improving the MFU by 1.34x compared to Megatron-LM. We share our operational experience in identifying and fixing failures and stragglers. We hope by articulating the problems and sharing our experience from a systems perspective, this work can inspire future LLM systems research.


title: Toward extracting the scattering phase shift from integrated correlation functions II: a relativistic lattice field theory model

abstract: In present work, a relativistic relation that connects the difference of interacting and non-interacting integrated two-particle correlation functions in finite volume to infinite volume scattering phase shift through an integral is derived. We show that the difference of integrated finite volume correlation functions converge rapidly to its infinite volume limit as the size of periodic box is increased. The fast convergence of our proposed formalism is illustrated by analytic solutions of a contact interaction model, the perturbation theory calculation, and also Monte Carlo simulation of a complex $\phi^4$ lattice field theory model.


title: Sufficient LMI Copositivity Conditions for Funnel Synthesis of Uncertain Nonlinear Systems

abstract: Funnel synthesis refers to a procedure for synthesizing a time-varying controlled invariant set and an associated control law around a nominal trajectory. The computation of the funnel involves solving a continuous-time differential equation or inequality, ensuring the invariance of the funnel. Previous approaches often compromise the invariance property of the funnel; for example, they may enforce the equation or the inequality only at discrete temporal nodes and not having formal guarantee of invariance at all times. This paper proposes a computational funnel synthesis method that can satisfy the invariance of the funnel without such compromises. We derive a finite number of linear matrix inequalities (LMIs) that imply the satifaction of a continuous-time differential linear matrix inequality guaranteeing the invariance of the funnel at all times from the initial to the final time. To this end, we utilize LMI conditions ensuring matrix copositivity, which then imply continuous-time invariance. The primary contribution of the paper is to prove that the resulting funnel is indeed invariant over a finite time horizon. We validate the proposed method via a three-dimensional trajectory planning and control problem with obstacle avoidance constraints.


title: In-beam test results of an RPC-based module for position-sensitive neutron detectors with timing readout

abstract: Recently we have proposed a new concept of a thermal neutron detector based on resistive plate chambers and 10B4C solid neutron converters, enabling to readout with high resolution in both the 3D position of neutron capture and the neutron time of flight (ToF). In this paper, we report the results of the first beam tests conducted with a new neutron RPC detection module, coupled to the position readout units of a new design. The main focus is on the measurements of the neutron ToF and identification of the converter layer where the neutron is captured, giving the position along the beam direction.


title: Fine-Grained Self-Endorsement Improves Factuality and Reasoning

abstract: This work studies improving large language model (LLM) generations at inference time by mitigating fact-conflicting hallucinations. Particularly, we propose a self-endorsement framework that leverages the fine-grained fact-level comparisons across multiple sampled responses. Compared with prior ensemble methods (Wang et al., 2022;Chen et al., 2023)) that perform response-level selection, our approach can better alleviate hallucinations, especially for longform generation tasks. Our approach can broadly benefit smaller and open-source LLMs as it mainly conducts simple content-based comparisons. Experiments on Biographies show that our method can effectively improve the factuality of generations with simple and intuitive prompts across different scales of LLMs. Besides, comprehensive analyses on TriviaQA and GSM8K demonstrate the potential of self-endorsement for broader application.


title: Statically Inferring Usage Bounds for Infrastructure as Code

abstract: Infrastructure as Code (IaC) has enabled cloud customers to have more agility in creating and modifying complex deployments of cloud-provisioned resources. By writing a configuration in IaC languages such as CloudFormation, users can declaratively specify their infrastructure and CloudFormation will handle the creation of the resources. However, understanding the complexity of IaC deployments has emerged as an unsolved issue. In particular, estimating the cost of an IaC deployment requires estimating the future usage and pricing models of every cloud resource in the deployment. Gaining transparency into predicted usage/costs is a leading challenge in cloud management. Existing work either relies on historical usage metrics to predict cost or on coarse-grain static analysis that ignores interactions between resources. Our key insight is that the topology of an IaC deployment imposes constraints on the usage of each resource, and we can formalize and automate the reasoning on constraints by using an SMT solver. This allows customers to have formal guarantees on the bounds of their cloud usage. We propose a tool for fine-grained static usage analysis that works by modeling the inter-resource interactions in an IaC deployment as a set of SMT constraints, and evaluate our tool on a benchmark of over 1000 real world IaC configurations.


title: The topology of data hides in quantum thermal states

abstract: We provide a quantum protocol to perform topological data analysis (TDA) via the distillation of quantum thermal states. Recent developments of quantum thermal state preparation algorithms reveal their characteristic scaling defined by properties of dissipative Lindbladians. This contrasts with protocols based on unitary evolution which have a scaling depending on the properties of the combinatorial Laplacian. To leverage quantum thermal state preparation algorithms, we translate quantum TDA from a real-time to an imaginary-time picture, shifting the paradigm from a unitary approach to a dissipative one. Starting from an initial state overlapping with the ground state of the system, one can dissipate its energy via channels unique to the dataset, naturally distilling its information. Therefore calculating Betti numbers translates into a purity estimation. Alternatively, this can be interpreted as the evaluation of the R\'{e}nyi 2-entropy, Uhlmann fidelity or Hilbert-Schmidt distance relative to thermal states with the embedded topology of simplicial complexes. Our work opens the field of TDA toward a more physical interpretation of the topology of data.


title: Sense-Then-Train: A Novel Beam Training Design for Near-Field MIMO Systems

abstract: A novel sense-then-train (STT) scheme is proposed for beam training in near-field multiple-input multiple-output (MIMO) systems. Compared to conventional codebook-based schemes, the proposed STT scheme is capable of not only addressing the complex spherical-wave propagation but also effectively exploiting the additional degrees-of-freedoms (DoFs). The STT scheme is tailored for both single-beam and multi-beam cases. 1) For the single-beam case, the STT scheme first utilizes a sensing phase to estimate a low-dimensional representation of the near-field MIMO channel in the wavenumber domain. Then, in the subsequent training phase, an online learning algorithm is proposed to obtain the optimal beam pair without predefined codebooks or training datasets. 2) For the multi-beam case, based on the single-beam STT, a Gram-Schmidt method is further utilized to guarantee the orthogonality between beams in the training phase. Numerical results unveil that 1) the proposed STT scheme can significantly enhance the beam training performance in the near field compared to the conventional far-field codebook-based schemes, and 2) the proposed STT scheme can perform fast and low-complexity beam training, while achieving a near-optimal performance without full channel state information in both cases.


title: Bagged Deep Image Prior for Recovering Images in the Presence of Speckle Noise

abstract: We investigate both the theoretical and algorithmic aspects of likelihood-based methods for recovering a complex-valued signal from multiple sets of measurements, referred to as looks, affected by speckle (multiplicative) noise. Our theoretical contributions include establishing the first existing theoretical upper bound on the Mean Squared Error (MSE) of the maximum likelihood estimator under the deep image prior hypothesis. Our theoretical results capture the dependence of MSE upon the number of parameters in the deep image prior, the number of looks, the signal dimension, and the number of measurements per look. On the algorithmic side, we introduce the concept of bagged Deep Image Priors (Bagged-DIP) and integrate them with projected gradient descent. Furthermore, we show how employing Newton-Schulz algorithm for calculating matrix inverses within the iterations of PGD reduces the computational complexity of the algorithm. We will show that this method achieves the state-of-the-art performance.

categories: cs.IT cs.CV cs.LG eess.IV math.IT stat.AP stat.ML


title: Smooth and Sparse Latent Dynamics in Operator Learning with Jerk Regularization

abstract: Spatiotemporal modeling is critical for understanding complex systems across various scientific and engineering disciplines, but governing equations are often not fully known or computationally intractable due to inherent system complexity. Data-driven reduced-order models (ROMs) offer a promising approach for fast and accurate spatiotemporal forecasting by computing solutions in a compressed latent space. However, these models often neglect temporal correlations between consecutive snapshots when constructing the latent space, leading to suboptimal compression, jagged latent trajectories, and limited extrapolation ability over time. To address these issues, this paper introduces a continuous operator learning framework that incorporates jerk regularization into the learning of the compressed latent space. This jerk regularization promotes smoothness and sparsity of latent space dynamics, which not only yields enhanced accuracy and convergence speed but also helps identify intrinsic latent space coordinates. Consisting of an implicit neural representation (INR)-based autoencoder and a neural ODE latent dynamics model, the framework allows for inference at any desired spatial or temporal resolution. The effectiveness of this framework is demonstrated through a two-dimensional unsteady flow problem governed by the Navier-Stokes equations, highlighting its potential to expedite high-fidelity simulations in various scientific and engineering applications.

categories: cs.LG cs.CE cs.NA math-ph math.MP math.NA


title: Addressing Order Sensitivity of In-Context Demonstration Examples in Causal Language Models

abstract: In-context learning has become a popular paradigm in natural language processing. However, its performance can be significantly influenced by the order of in-context demonstration examples. In this paper, we found that causal language models (CausalLMs) are more sensitive to this order compared to prefix language models (PrefixLMs). We attribute this phenomenon to the auto-regressive attention masks within CausalLMs, which restrict each token from accessing information from subsequent tokens. This results in different receptive fields for samples at different positions, thereby leading to representation disparities across positions. To tackle this challenge, we introduce an unsupervised fine-tuning method, termed the Information-Augmented and Consistency-Enhanced approach. This approach utilizes contrastive learning to align representations of in-context examples across different positions and introduces a consistency loss to ensure similar representations for inputs with different permutations. This enhances the model's predictive consistency across permutations. Experimental results on five benchmarks suggest that our proposed method can reduce the sensitivity of CausalLMs to the order of in-context examples and exhibit robust generalizability, particularly when demonstrations are sourced from a candidate pool different from that used in the training phase, or when the number of in-context examples differs from what is used during training.


title: Fair Resource Allocation in Multi-Task Learning

abstract: By jointly learning multiple tasks, multi-task learning (MTL) can leverage the shared knowledge across tasks, resulting in improved data efficiency and generalization performance. However, a major challenge in MTL lies in the presence of conflicting gradients, which can hinder the fair optimization of some tasks and subsequently impede MTL's ability to achieve better overall performance. Inspired by fair resource allocation in communication networks, we formulate the optimization of MTL as a utility maximization problem, where the loss decreases across tasks are maximized under different fairness measurements. To solve this problem, we propose FairGrad, a novel MTL optimization method. FairGrad not only enables flexible emphasis on certain tasks but also achieves a theoretical convergence guarantee. Extensive experiments demonstrate that our method can achieve state-of-the-art performance among gradient manipulation methods on a suite of multi-task benchmarks in supervised learning and reinforcement learning. Furthermore, we incorporate the idea of $\alpha$-fairness into loss functions of various MTL methods. Extensive empirical studies demonstrate that their performance can be significantly enhanced. Code is provided at \url{https://github.com/OptMN-Lab/fairgrad}.


title: Complexity of linearized quadratic penalty for optimization with nonlinear equality constraints

abstract: In this paper we consider a nonconvex optimization problem with nonlinear equality constraints. We assume that both, the objective function and the functional constraints, are locally smooth. For solving this problem, we propose a linearized quadratic penalty method, i.e., we linearize the objective function and the functional constraints in the penalty formulation at the current iterate and add a quadratic regularization, thus yielding a subproblem that is easy to solve, and whose solution is the next iterate. Under a dynamic regularization parameter choice, we derive convergence guarantees for the iterates of our method to an $\epsilon$ first-order optimal solution in $\mathcal{O}(1/{\epsilon^3})$ outer iterations. Finally, we show that when the problem data satisfy Kurdyka-Lojasiewicz property, e.g., are semialgebraic, the whole sequence generated by our algorithm converges and we derive convergence rates. We validate the theory and the performance of the proposed algorithm by numerically comparing it with the existing methods from the literature.


title: In-Depth Search for a Coupling between Gravity and Electromagnetism with Steady Fields

abstract: Any means to control gravity like electromagnetism is currently out of reach by many orders of magnitude even under extreme laboratory conditions. Some often poorly executed experiments or pseudoscience theories appear from time to time claiming for example anomalous forces from capacitors that suggest a connection between the two fields. We developed novel and high resolution horizontal-, vertical- and rotation-balances that allow to test electric devices completely shielded and remotely controlled under high vacuum conditions to perform the first in-depth search for such a coupling using steady fields. Our testing included a variety of capacitors of different shapes and compositions as well as for the first-time solenoids and tunneling currents from Zener diodes and varistors. A comprehensive coupling-scheme table was used to test almost all combinations including capacitors and solenoids with permittivity and permeability gradients as well as capacitors and varistors within crossed magnetic fields. We also tested a crossed-coil producing helical magnetic field lines as well as interactions between a pair of shielded toroidal coils to look for proposed extensions to Maxwell's equations. No anomalous forces or torques down to the Nanonewton or Nanonewton-Meter range were found providing new limits many orders of magnitude below previous assessments ruling out claims or theories and providing a basis for future research on the topic.


title: Technical Note: An Efficient Implementation of the Spherical Radon Transform with Cylindrical Apertures

abstract: The spherical Radon transform (SRT) is an integral transform that maps a function to its integrals over concentric spherical shells centered at specified sensor locations. It has several imaging applications, including synthetic aperture radar and photoacoustic computed tomography. However, computation of the SRT can be expensive. Efficient implementation of SRT on general purpose graphic processing units (GPGPUs) often utilizes non-matched implementation of the adjoint operator, leading to inconsistent gradients in optimization-based image reconstruction methods. This work details an efficient implementation of the SRT and its adjoint for the case of a cylindrical measurement aperture. Exploiting symmetry of the cylindrical geometry, the SRT can then be expressed as the composition of two circular Radon transforms (CRT). Utilizing this formulation then allows for an efficient implementation of the SRT as a discrete-to-discrete operator utilizing sparse matrix representation.


title: Multifractal Formalism from Large Deviations

abstract: It has often been observed that the Multifractal Formalism and the Large Deviation Principles are intimately related. In fact, Multifractal Formalism was heuristically derived using the Large Deviations ideas. In numerous examples in which the multifractal results have been rigorously established, the corresponding Large Deviation results are valid as well. Moreover, the proofs of multifractal and large deviations are remarkably similar. The natural question then is whether under which conditions multifractal formalism can be deduced from the corresponding large deviations results. More specifically, given a sequence of random variables $\{ {X_n} \}_{n\in\N}$, satisfying a Large Deviation Principle, what can be said about the multifractal nature of the level sets $K_\alpha=\{\omega: \lim_{n} \frac{X_n(\omega)}{n}=\alpha\}$. Under some technical assumptions, we establish the upper and lower bounds for multifractal spectra in terms of the large deviation rate functions, and show that many known results of multifractal formalism are covered by our setup.


title: Artful Path to Healing: Using Machine Learning for Visual Art Recommendation to Prevent and Reduce Post-Intensive Care

abstract: Staying in the intensive care unit (ICU) is often traumatic, leading to post-intensive care syndrome (PICS), which encompasses physical, psychological, and cognitive impairments. Currently, there are limited interventions available for PICS. Studies indicate that exposure to visual art may help address the psychological aspects of PICS and be more effective if it is personalized. We develop Machine Learning-based Visual Art Recommendation Systems (VA RecSys) to enable personalized therapeutic visual art experiences for post-ICU patients. We investigate four state-of-the-art VA RecSys engines, evaluating the relevance of their recommendations for therapeutic purposes compared to expert-curated recommendations. We conduct an expert pilot test and a large-scale user study (n=150) to assess the appropriateness and effectiveness of these recommendations. Our results suggest all recommendations enhance temporal affective states. Visual and multimodal VA RecSys engines compare favourably with expert-curated recommendations, indicating their potential to support the delivery of personalized art therapy for PICS prevention and treatment.


title: Resisting high-energy impact events through gap engineering in superconducting qubit arrays

abstract: Quantum error correction (QEC) provides a practical path to fault-tolerant quantum computing through scaling to large qubit numbers, assuming that physical errors are sufficiently uncorrelated in time and space. In superconducting qubit arrays, high-energy impact events produce correlated errors, violating this key assumption. Following such an event, phonons with energy above the superconducting gap propagate throughout the device substrate, which in turn generate a temporary surge in quasiparticle (QP) density throughout the array. When these QPs tunnel across the qubits' Josephson junctions, they induce correlated errors. Engineering different superconducting gaps across the qubit's Josephson junctions provides a method to resist this form of QP tunneling. By fabricating all-aluminum transmon qubits with both strong and weak gap engineering on the same substrate, we observe starkly different responses during high-energy impact events. Strongly gap engineered qubits do not show any degradation in T1 during impact events, while weakly gap engineered qubits show events of correlated degradation in T1. We also show that strongly gap engineered qubits are robust to QP poisoning from increasing optical illumination intensity, whereas weakly gap engineered qubits display rapid degradation in coherence. Based on these results, gap engineering removes the threat of high-energy impacts to QEC in superconducting qubit arrays.


title: An optimization based limiter for enforcing positivity in a semi-implicit discontinuous Galerkin scheme for compressible Navier-Stokes equations

abstract: We consider an optimization based limiter for enforcing positivity of internal energy in a semi-implicit scheme for solving gas dynamics equations. With Strang splitting, the compressible Navier-Stokes system is splitted into the compressible Euler equations, solved by the positivity-preserving Runge-Kutta discontinuous Galerkin (DG) method, and the parabolic subproblem, solved by Crank-Nicolson method with interior penalty DG method. Such a scheme is at most second order accurate in time, high order accurate in space, conservative, and preserves positivity of density. To further enforce the positivity of internal energy, we impose an optimization based limiter for the total energy variable to post process DG polynomial cell averages. The optimization based limiter can be efficiently implemented by the popular first order convex optimization algorithms such as the Douglas-Rachford splitting method if using the optimal algorithm parameters. Numerical tests suggest that the DG method with $\mathbb{Q}^k$ basis and the optimization-based limiter is robust for demanding low pressure problems such as high speed flows.