title: Mitigating Simplicity Bias in Deep Learning for Improved OOD Generalization and Robustness

abstract: Neural networks (NNs) are known to exhibit simplicity bias where they tend to prefer learning 'simple' features over more 'complex' ones, even when the latter may be more informative. Simplicity bias can lead to the model making biased predictions which have poor out-of-distribution (OOD) generalization. To address this, we propose a framework that encourages the model to use a more diverse set of features to make predictions. We first train a simple model, and then regularize the conditional mutual information with respect to it to obtain the final model. We demonstrate the effectiveness of this framework in various problem settings and real-world applications, showing that it effectively addresses simplicity bias and leads to more features being used, enhances OOD generalization, and improves subgroup robustness and fairness. We complement these results with theoretical analyses of the effect of the regularization and its OOD generalization properties.


title: Empirical Evaluation of the Segment Anything Model (SAM) for Brain Tumor Segmentation

abstract: Brain tumor segmentation presents a formidable challenge in the field of Medical Image Segmentation. While deep-learning models have been useful, human expert segmentation remains the most accurate method. The recently released Segment Anything Model (SAM) has opened up the opportunity to apply foundation models to this difficult task. However, SAM was primarily trained on diverse natural images. This makes applying SAM to biomedical segmentation, such as brain tumors with less defined boundaries, challenging. In this paper, we enhanced SAM's mask decoder using transfer learning with the Decathlon brain tumor dataset. We developed three methods to encapsulate the four-dimensional data into three dimensions for SAM. An on-the-fly data augmentation approach has been used with a combination of rotations and elastic deformations to increase the size of the training dataset. Two key metrics: the Dice Similarity Coefficient (DSC) and the Hausdorff Distance 95th Percentile (HD95), have been applied to assess the performance of our segmentation models. These metrics provided valuable insights into the quality of the segmentation results. In our evaluation, we compared this improved model to two benchmarks: the pretrained SAM and the widely used model, nnUNetv2. We find that the improved SAM shows considerable improvement over the pretrained SAM, while nnUNetv2 outperformed the improved SAM in terms of overall segmentation accuracy. Nevertheless, the improved SAM demonstrated slightly more consistent results than nnUNetv2, especially on challenging cases that can lead to larger Hausdorff distances. In the future, more advanced techniques can be applied in order to further improve the performance of SAM on brain tumor segmentation.


title: A minimality property for knots without Khovanov 2-torsion

abstract: A conjecture of Shumakovitch states that every nontrivial knot has 2-torsion in its Khovanov homology. We show that if a knot $K$ has no 2-torsion in its Khovanov homology, then the rank of its reduced Khovanov homology is minimal among all knots obtainable from $K$ by a proper rational tangle replacement. It follows, for example, that unknotting number 1 knots have 2-torsion in their Khovanov homology.


title: DEUX: Active Exploration for Learning Unsupervised Depth Perception

abstract: Depth perception models are typically trained on non-interactive datasets with predefined camera trajectories. However, this often introduces systematic biases into the learning process correlated to specific camera paths chosen during data acquisition. In this paper, we investigate the role of how data is collected for learning depth completion, from a robot navigation perspective, by leveraging 3D interactive environments. First, we evaluate four depth completion models trained on data collected using conventional navigation techniques. Our key insight is that existing exploration paradigms do not necessarily provide task-specific data points to achieve competent unsupervised depth completion learning. We then find that data collected with respect to photometric reconstruction has a direct positive influence on model performance. As a result, we develop an active, task-informed, depth uncertainty-based motion planning approach for learning depth completion, which we call DEpth Uncertainty-guided eXploration (DEUX). Training with data collected by our approach improves depth completion by an average greater than 18% across four depth completion models compared to existing exploration methods on the MP3D test set. We show that our approach further improves zero-shot generalization, while offering new insights into integrating robot learning-based depth estimation.


title: CAW-coref: Conjunction-Aware Word-level Coreference Resolution

abstract: State-of-the-art coreference resolutions systems depend on multiple LLM calls per document and are thus prohibitively expensive for many use cases (e.g., information extraction with large corpora). The leading word-level coreference system (WL-coref) attains 96.6% of these SOTA systems' performance while being much more efficient. In this work, we identify a routine yet important failure case of WL-coref: dealing with conjoined mentions such as 'Tom and Mary'. We offer a simple yet effective solution that improves the performance on the OntoNotes test set by 0.9% F1, shrinking the gap between efficient word-level coreference resolution and expensive SOTA approaches by 34.6%. Our Conjunction-Aware Word-level coreference model (CAW-coref) and code is available at https://github.com/KarelDO/wl-coref.


title: Threshold Policies with Tight Guarantees for Online Selection with Convex Costs

abstract: This paper provides threshold policies with tight guarantees for online selection with convex cost (OSCC). In OSCC, a seller wants to sell some asset to a sequence of buyers with the goal of maximizing her profit. The seller can produce additional units of the asset, but at non-decreasing marginal costs. At each time, a buyer arrives and offers a price. The seller must make an immediate and irrevocable decision in terms of whether to accept the offer and produce/sell one unit of the asset to this buyer. The goal is to develop an online algorithm that selects a subset of buyers to maximize the seller's profit, namely, the total selling revenue minus the total production cost. Our main result is the development of a class of simple threshold policies that are logistically simple and easy to implement, but have provable optimality guarantees among all deterministic algorithms. We also derive a lower bound on competitive ratios of randomized algorithms and prove that the competitive ratio of our threshold policy asymptotically converges to this lower bound when the total production output is sufficiently large. Our results generalize and unify various online search, pricing, and auction problems, and provide a new perspective on the impact of non-decreasing marginal costs on real-world online resource allocation problems.


title: Predictable Artificial Intelligence

abstract: We introduce the fundamental ideas and challenges of Predictable AI, a nascent research area that explores the ways in which we can anticipate key indicators of present and future AI ecosystems. We argue that achieving predictability is crucial for fostering trust, liability, control, alignment and safety of AI ecosystems, and thus should be prioritised over performance. While distinctive from other areas of technical and non-technical AI research, the questions, hypotheses and challenges relevant to Predictable AI were yet to be clearly described. This paper aims to elucidate them, calls for identifying paths towards AI predictability and outlines the potential impact of this emergent field.


title: Photostrictive Effect and Structure Phase Transition via Nonlinear Photocurrent

abstract: The phenomena of crystal size changes and structural phase transitions induced by light irradiation have garnered significant interest due to their potential for tuning and controlling a wide range of material properties through highly cooperative interactions. However, a microscopic theory that can comprehensively explain these phenomena in correlation with photon frequency and polarization has remained highly desirable. In this work, we propose that nonlinear photocurrent may correspond to driving these effects, which arise from a competition between light-injected energy and structural variations. By conducting first-principles simulations and comparing them with two established experiments, we show that shift current, a second-order photocurrent, can induce photostriction and nonreciprocal structure phase transitions. The quantitative comparisons across key parameters such as light frequency, irradiation time, polarization, and intensity provide further support for the nonlinear photocurrent mechanism. Beyond shift current, this microscopic understanding proposes to utilize more types of nonlinear photocurrent to enhance light-structure interactions and control material properties.


title: Synthesizing Robust Walking Gaits via Discrete-Time Barrier Functions with Application to Multi-Contact Exoskeleton Locomotion

abstract: Successfully achieving bipedal locomotion remains challenging due to real-world factors such as model uncertainty, random disturbances, and imperfect state estimation. In this work, we propose a novel metric for locomotive robustness -- the estimated size of the hybrid forward invariant set associated with the step-to-step dynamics. Here, the forward invariant set can be loosely interpreted as the region of attraction for the discrete-time dynamics. We illustrate the use of this metric towards synthesizing nominal walking gaits using a simulation-in-the-loop learning approach. Further, we leverage discrete-time barrier functions and a sampling-based approach to approximate sets that are maximally forward invariant. Lastly, we experimentally demonstrate that this approach results in successful locomotion for both flat-foot walking and multi-contact walking on the Atalante lower-body exoskeleton.


title: Toward More Accurate and Robust Optimal Power Flow for Distribution Systems

abstract: The objective of this paper is to improve the accuracy and robustness of optimal power flow (OPF) formulations for distribution systems modeled down to the low-voltage point of connection of individual buildings. An approach for addressing the uncertain switching behavior of building loads(e.g., air conditioners, water heaters, or pool pumps) and variable renewable generation (e.g., rooftop solar) in the OPF is proposed. Rather than using time-averaged forecasts to determine voltage magnitude constraints, we leverage worst-case minimum and maximum forecasts of loads and distributed energy resource generation. Sensitivities of the power flow equations are used to predict how these deviations in load and renewable generation will impact system voltages, and the voltage constraints in the OPF are dynamically adjusted to mitigate voltage violations due to this uncertainty. A methodology for incorporating models of split-phase components and transformer core losses in the OPF formulation is also proposed. The proposed approach is validated through numerical case studies on a realistic distribution feeder using GridLAB-D, a distribution system simulation software.


title: Memory-Consistent Neural Networks for Imitation Learning

abstract: Imitation learning considerably simplifies policy synthesis compared to alternative approaches by exploiting access to expert demonstrations. For such imitation policies, errors away from the training samples are particularly critical. Even rare slip-ups in the policy action outputs can compound quickly over time, since they lead to unfamiliar future states where the policy is still more likely to err, eventually causing task failures. We revisit simple supervised ``behavior cloning'' for conveniently training the policy from nothing more than pre-recorded demonstrations, but carefully design the model class to counter the compounding error phenomenon. Our ``memory-consistent neural network'' (MCNN) outputs are hard-constrained to stay within clearly specified permissible regions anchored to prototypical ``memory'' training samples. We provide a guaranteed upper bound for the sub-optimality gap induced by MCNN policies. Using MCNNs on 10 imitation learning tasks, with MLP, Transformer, and Diffusion backbones, spanning dexterous robotic manipulation and driving, proprioceptive inputs and visual inputs, and varying sizes and types of demonstration data, we find large and consistent gains in performance, validating that MCNNs are better-suited than vanilla deep neural networks for imitation learning applications. Website: https://sites.google.com/view/mcnn-imitation


title: Hypertoric 2-categories O and symplectic duality

abstract: We define 2-categories of microlocal perverse (resp. coherent) sheaves of categories on the skeleton of a hypertoric variety and show that the generators of these 2-categories lift the projectives (resp. simples) in hypertoric category $\mathcal{O}$. We then establish equivalences of 2-categories categorifying the Koszul duality between Gale dual hypertoric categories $\mathcal{O}$. These constructions give a prototype for understanding symplectic duality via the fully extended 3d mirror symmetry conjecture.


title: Radiation Modes in FRB 20220912A Microshots and a Crab PSR nanoshot

abstract: A microshot from FRB 20220912A \citep{H23} satisfies the uncertainty relation $\Delta \omega \Delta t \ge 1$ by a factor of only $\lessapprox 3$. A Crab pulsar nanoshot \citep{HE07} exceeds this bound by a similar factor. The number of orthogonal plasma modes contributing to the coherent radiation is also $\approx \Delta \omega \Delta t$, placing constraints on their excitation and growth.


title: Cost-Efficient Prompt Engineering for Unsupervised Entity Resolution

abstract: Entity Resolution (ER) is the problem of semi-automatically determining when two entities refer to the same underlying entity, with applications ranging from healthcare to e-commerce. Traditional ER solutions required considerable manual expertise, including domain-specific feature engineering, as well as identification and curation of training data. Recently released large language models (LLMs) provide an opportunity to make ER more seamless and domain-independent. However, it is also well known that LLMs can pose risks, and that the quality of their outputs can depend on how prompts are engineered. Unfortunately, a systematic experimental study on the effects of different prompting methods for addressing unsupervised ER, using LLMs like ChatGPT, has been lacking thus far. This paper aims to address this gap by conducting such a study. We consider some relatively simple and cost-efficient ER prompt engineering methods and apply them to ER on two real-world datasets widely used in the community. We use an extensive set of experimental results to show that an LLM like GPT3.5 is viable for high-performing unsupervised ER, and interestingly, that more complicated and detailed (and hence, expensive) prompting methods do not necessarily outperform simpler approaches. We provide brief discussions on qualitative and error analysis, including a study of the inter-consistency of different prompting methods to determine whether they yield stable outputs. Finally, we consider some limitations of LLMs when applied to ER.


title: Gaia Focused Product Release: Spatial distribution of two diffuse interstellar bands

abstract: Diffuse interstellar bands (DIBs) are absorption features seen in optical and infrared spectra of stars that are probably caused by large and complex molecules in the ISM. Here we investigate the Galactic distribution and properties of two DIBs identified in almost six million stellar spectra collected by the Gaia Radial Velocity Spectrometer. These measurements constitute a part of the Gaia Focused Product Release to be made public between the Gaia DR3 and DR4 data releases. In order to isolate the DIB signal from the stellar features in each individual spectrum, we identified a set of 160 000 spectra at high Galactic latitudes which we consider to be the DIB-free reference sample. Matching each target spectrum to its closest reference spectra in stellar parameter space allowed us to remove the stellar spectrum empirically, without reference to stellar models, leaving a set of six million ISM spectra. Identifying the two DIBs at 862.1 nm and 864.8 nm in the stacked spectra, we modelled their shapes and report the depth, central wavelength, width, and equivalent width (EW) for each, along with confidence bounds on these measurements. Our main results are as follows: (1) the strength and spatial distribution of the DIB $\lambda$862.1 are very consistent with what was found in Gaia DR3, but for this work we attained a higher signal-to-noise ratio in the stacked spectra to larger distances, which allowed us to trace DIBs in the outer spiral arm and beyond the Scutum--Centaurus spiral arm; (2) we produced an all-sky map below ${\pm}65^{\circ}$ of Galactic latitude to $\sim$4000 pc of both DIB features and their correlations; (3) we detected the signals of DIB\,$\lambda$862.1 inside the Local Bubble; and (4) there is a reasonable correlation with the dust reddening found from stellar absorption and EWs of both DIBs.


title: Factual and Personalized Recommendations using Language Models and Reinforcement Learning

abstract: Recommender systems (RSs) play a central role in connecting users to content, products, and services, matching candidate items to users based on their preferences. While traditional RSs rely on implicit user feedback signals, conversational RSs interact with users in natural language. In this work, we develop a comPelling, Precise, Personalized, Preference-relevant language model (P4LM) that recommends items to users while putting emphasis on explaining item characteristics and their relevance. P4LM uses the embedding space representation of a user's preferences to generate compelling responses that are factually-grounded and relevant w.r.t. the user's preferences. Moreover, we develop a joint reward function that measures precision, appeal, and personalization, which we use as AI-based feedback in a reinforcement learning-based language model framework. Using the MovieLens 25M dataset, we demonstrate that P4LM delivers compelling, personalized movie narratives to users.


title: DockGame: Cooperative Games for Multimeric Rigid Protein Docking

abstract: Protein interactions and assembly formation are fundamental to most biological processes. Predicting the assembly structure from constituent proteins -- referred to as the protein docking task -- is thus a crucial step in protein design applications. Most traditional and deep learning methods for docking have focused mainly on binary docking, following either a search-based, regression-based, or generative modeling paradigm. In this paper, we focus on the less-studied multimeric (i.e., two or more proteins) docking problem. We introduce DockGame, a novel game-theoretic framework for docking -- we view protein docking as a cooperative game between proteins, where the final assembly structure(s) constitute stable equilibria w.r.t. the underlying game potential. Since we do not have access to the true potential, we consider two approaches - i) learning a surrogate game potential guided by physics-based energy functions and computing equilibria by simultaneous gradient updates, and ii) sampling from the Gibbs distribution of the true potential by learning a diffusion generative model over the action spaces (rotations and translations) of all proteins. Empirically, on the Docking Benchmark 5.5 (DB5.5) dataset, DockGame has much faster runtimes than traditional docking methods, can generate multiple plausible assembly structures, and achieves comparable performance to existing binary docking baselines, despite solving the harder task of coordinating multiple protein chains.


title: Look-Up mAI GeMM: Increasing AI GeMMs Performance by Nearly 2.5x via msGeMM

abstract: AI models are increasing in size and recent advancement in the community has shown that unlike HPC applications where double precision datatype are required, lower-precision datatypes such as fp8 or int4 are sufficient to bring the same model quality both for training and inference. Following these trends, GPU vendors such as NVIDIA and AMD have added hardware support for fp16, fp8 and int8 GeMM operations with an exceptional performance via Tensor Cores. However, this paper proposes a new algorithm called msGeMM which shows that AI models with low-precision datatypes can run with ~2.5x fewer multiplication and add instructions. Efficient implementation of this algorithm requires special CUDA cores with the ability to add elements from a small look-up table at the rate of Tensor Cores.


abstract: Learning continuous-time point processes is essential to many discrete event forecasting tasks. However, integration poses a major challenge, particularly for spatiotemporal point processes (STPPs), as it involves calculating the likelihood through triple integrals over space and time. Existing methods for integrating STPP either assume a parametric form of the intensity function, which lacks flexibility; or approximating the intensity with Monte Carlo sampling, which introduces numerical errors. Recent work by Omi et al. [2019] proposes a dual network approach for efficient integration of flexible intensity function. However, their method only focuses on the 1D temporal point process. In this paper, we introduce a novel paradigm: AutoSTPP (Automatic Integration for Spatiotemporal Neural Point Processes) that extends the dual network approach to 3D STPP. While previous work provides a foundation, its direct extension overly restricts the intensity function and leads to computational challenges. In response, we introduce a decomposable parametrization for the integral network using ProdNet. This approach, leveraging the product of simplified univariate graphs, effectively sidesteps the computational complexities inherent in multivariate computational graphs. We prove the consistency of AutoSTPP and validate it on synthetic data and benchmark real-world datasets. AutoSTPP shows a significant advantage in recovering complex intensity functions from irregular spatiotemporal events, particularly when the intensity is sharply localized. Our code is open-source at https://github.com/Rose-STL-Lab/AutoSTPP.


title: Non-Drude THz conductivity of graphene due to structural distortions

abstract: The remarkable electrical, optical and mechanical properties of graphene make it a desirable material for electronics, optoelectronics and quantum applications. A fundamental understanding of the electrical conductivity of graphene across a wide frequency range is required for the development of such technologies. In this study, we use terahertz (THz) time-domain spectroscopy to measure the complex dynamic conductivity of electrostatically gated graphene, in a broad $\sim$0.1 - 7 THz frequency range. The conductivity of doped graphene follows the conventional Drude model, and is predominantly governed by intraband processes. In contrast, undoped charge-neutral graphene exhibits a THz conductivity that significantly deviates from Drude-type models. Via quantum kinetic equations and density matrix theory, we show that this discrepancy can be explained by additional interband processes, that can be exacerbated by electron backscattering. We propose a mechanism where such backscattering -- which involves flipping of the electron pseudo-spin -- is mediated by the substantial vector scattering potentials that are associated with structural deformations of graphene. Our findings highlight the significant impact that structural distortions and resulting electrostatic vector scattering potentials can have on the THz conductivity of charge-neutral graphene. Our results emphasise the importance of the planar morphology of graphene for its broadband THz electronic response.


title: Discovery of a Radiation Component from the Vela Pulsar Reaching 20 Teraelectronvolts

abstract: Gamma-ray observations have established energetic isolated pulsars as outstanding particle accelerators and antimatter factories in the Galaxy. There is, however, no consensus regarding the acceleration mechanisms and the radiative processes at play, nor the locations where these take place. The spectra of all observed gamma-ray pulsars to date show strong cutoffs or a break above energies of a few gigaelectronvolt (GeV). Using the H.E.S.S. array of Cherenkov telescopes, we discovered a novel radiation component emerging beyond this generic GeV cutoff in the Vela pulsar's broadband spectrum. The extension of gamma-ray pulsation energies up to at least 20 teraelectronvolts (TeV) shows that Vela pulsar can accelerate particles to Lorentz factors higher than $4\times10^7$. This is an order of magnitude larger than in the case of the Crab pulsar, the only other pulsar detected in the TeV energy range. Our results challenge the state-of-the-art models for high-energy emission of pulsars while providing a new probe, i.e. the energetic multi-TeV component, for constraining the acceleration and emission processes in their extreme energy limit.


title: PAC-Bayesian Spectrally-Normalized Bounds for Adversarially Robust Generalization

abstract: Deep neural networks (DNNs) are vulnerable to adversarial attacks. It is found empirically that adversarially robust generalization is crucial in establishing defense algorithms against adversarial attacks. Therefore, it is interesting to study the theoretical guarantee of robust generalization. This paper focuses on norm-based complexity, based on a PAC-Bayes approach (Neyshabur et al., 2017). The main challenge lies in extending the key ingredient, which is a weight perturbation bound in standard settings, to the robust settings. Existing attempts heavily rely on additional strong assumptions, leading to loose bounds. In this paper, we address this issue and provide a spectrally-normalized robust generalization bound for DNNs. Compared to existing bounds, our bound offers two significant advantages: Firstly, it does not depend on additional assumptions. Secondly, it is considerably tighter, aligning with the bounds of standard generalization. Therefore, our result provides a different perspective on understanding robust generalization: The mismatch terms between standard and robust generalization bounds shown in previous studies do not contribute to the poor robust generalization. Instead, these disparities solely due to mathematical issues. Finally, we extend the main result to adversarial robustness against general non-$\ell_p$ attacks and other neural network architectures.


title: 26.5 ps Time Resolution Using 50 {\mu}m Low Gain Avalanche Detectors Fabricated by Micron Semiconductor Ltd

abstract: Low Gain Avalanche Detectors (LGADs) are silicon semiconductor sensors with an implanted thin p-doped multiplication layer that is designed to provide low gain. Most importantly, LGADs are specifically engineered to provide excellent spatial and temporal resolution simultaneously. The technology shows promising prospects of fulfilling the 4D tracking requirements of future high energy physics experiments. Micron Semiconductor Ltd. has fabricated LGADs with an active thickness of 50 $\mu$m. The electrical and timing performance has been measured and compared with devices fabricated at IMB-CNM for reference. 50 $\mu$m thin LGADs by Micron Semiconductor Ltd. were measured to have a timing resolution in the region of 30 ps using a dedicated setup involving minimum ionising particles produced by Sr-90. Specifically, the best timing resolution of 26.5 ps was measured at a bias voltage of 200 V at -30{\deg}C.


title: A Brief Review of Single Event Burnout Failure Mechanisms and Design Tolerances of Silicon Carbide MOSFETs

abstract: Radiation hardening of the MOSFET is of the highest priority for sustaining high-power systems in the space radiation environment. SiC-based power electronics are being looked at as a strong alternative for high power spaceborne power electronic systems. The SiC MOSFET has been shown to be most prone to SEB of the radiation effects. The knowledge of SiC MOSFET device degradation and failure mechanisms are reviewed. Additionally, the viability of rad-tolerant SiC MOSFET designs and the methods of SEB simulation are evaluated. A merit system is proposed to consider the performance of radiation tolerance and nominal electrical performance. Criteria needed for high-fidelity SEB simulation are also reviewed. This paper stands as a necessary analytical review to intercede the development of rad-hard power devices for space and extreme environment applications.


title: Tight Bounds for the Maximum Distance Over a Polytope to a Given Point

abstract: In this paper we study the problem of maximizing the distance to a given point $C_0$ over a polytope $\mathcal{P}$. Assuming that the polytope is circumscribed by a known ball we construct an intersection of balls which preserves the vertices of the polytope on the boundary of this ball, and show that the intersection of balls approximates the polytope arbitrarily well. Then, we use some known results regarding the maximization of distances to a given point over an intersection of balls to create a new polytope which preserves the maximizers to the original problem. Next, a new intersection of balls is obtained in a similar fashion, and as such, after a finite number of iterations, we conjecture, we end up with an intersection of balls over which we can maximize the distance to the given point. The obtained distance is shown to be a non trivial upper bound to the original distance. Tests are made with maximizing the distance to a random point over the unit hypercube up to dimension $n = 100$. Several detailed 2-d examples are also shown.


title: Deformations of the Kerr-(A)dS Near Horizon Geometry

abstract: We investigate deformations of the Kerr-(A)dS near horizon geometry and derive partial infinitesimal rigidity results for it. The proof comprises two parts. First, we follow the analysis of Jezierski and Kami\'nski [Gen Rel Grav 45 (2013) 987--1004] to eliminate all but a finite number of Fourier modes of linear perturbations. In the second part, we give an argument using analyticity to prove that there are no odd Fourier modes.


title: Quasi-Monte Carlo sparse grid Galerkin finite element methods for linear elasticity equations with uncertainties

abstract: We explore a linear inhomogeneous elasticity equation with random Lam\'e parameters. The latter are parameterized by a countably infinite number of terms in separated expansions. The main aim of this work is to estimate expected values (considered as an infinite dimensional integral on the parametric space corresponding to the random coefficients) of linear functionals acting on the solution of the elasticity equation. To achieve this, the expansions of the random parameters are truncated, a high-order quasi-Monte Carlo (QMC) is combined with a sparse grid approach to approximate the high dimensional integral, and a Galerkin finite element method (FEM) is introduced to approximate the solution of the elasticity equation over the physical domain. The error estimates from (1) truncating the infinite expansion, (2) the Galerkin FEM, and (3) the QMC sparse grid quadrature rule are all studied. For this purpose, we show certain required regularity properties of the continuous solution with respect to both the parametric and physical variables. To achieve our theoretical regularity and convergence results, some reasonable assumptions on the expansions of the random coefficients are imposed. Finally, some numerical results are delivered.


title: Mapping of Spin-Wave Transport in Thulium Iron Garnet Thin Films Using Diamond Quantum Microscopy

abstract: Spin waves, collective dynamic magnetic excitations, offer crucial insights into magnetic material properties. Rare-earth iron garnets offer an ideal spin-wave (SW) platform with long propagation length, short wavelength, gigahertz frequency, and applicability to magnon spintronic platforms. Of particular interest, thulium iron garnet (TmIG) has attracted a huge interest recently due to its successful growth down to a few nanometers, observed topological Hall effect and spin orbit torque-induced switching effects. However, there is no direct spatial measurement of its SW properties. This work uses diamond nitrogen vacancy (NV) magnetometry in combination with SW electrical transmission spectroscopy to study SW transport properties in TmIG thin films. NV magnetometry allows probing spin waves at the sub-micrometer scale, seen by the amplification of the local microwave magnetic field due to the coupling of NV spin qubits with the stray magnetic field produced by the microwave-excited spin waves. By monitoring the NV spin resonances, the SW properties in TmIG thin films are measured as function of the applied magnetic field, including their amplitude, decay length (~ 50 um), and wavelength (0.8 - 2 um). These results pave the way for studying spin qubit-magnon interactions in rare-earth magnetic insulators, relevant to quantum magnonics applications.


title: Sliced skein algebras and geometric Kauffman bracket

abstract: The sliced skein algebra of a closed surface of genus $g$ with $m$ punctures, $\mathfrak{S}=\Sigma_{g,m}$, is the quotient of the Kauffman bracket skein algebra $\mathcal{S}_\xi(\mathfrak{S})$ corresponding to fixing the scalar values of its peripheral curves. We show that the sliced skein algebra of a finite type surface is a domain if the ground ring is a domain. When the quantum parameter $\xi$ is a root of unity we calculate the center of the sliced skein algebra and its PI-degree. Among applications we show that any smooth point of a sliced character variety is a fully Azumaya point of the skein algebra $\mathcal{S}_\xi(\mathfrak{S})$. For any $SL_2(\mathbb{C})$--representation $\rho$ of the fundamental group of an oriented connected 3-manifold $M$ and a root of unity $\xi$ with odd $ord(\xi^2)$, we introduce the $\rho$-reduced skein module $\mathcal{S}_{\xi,\rho}(M)$. We show that $\mathcal{S}_{\xi,\rho}(M)$ has dimension 1 when $M$ is closed and $\rho$ is irreducible. We also show that if $\rho$ is irreducible the $\rho$-reduced skein module of a handlebody, as a module over the skein algebra of its boundary, is simple and has the dimension equal to the PI-degree of the skein algebra of its boundary.


title: Ordered phases and superconductivity in two-dimensional electron systems subject to pair spin-orbit interaction

abstract: Pair spin-orbit interaction can emerge in strongly-interacting systems characterized by a large spin-orbit coupling. Here we study the role of this interaction in stabilizing ordered and unconventional superconducting phases. We find that, if the system avoids superconductivity, the order realized is a combination of charge-density and spin-vorticity waves. The latter is reminiscent of a loop-current state, albeit in the spin, rather in the charge, channel. If the system becomes superconducting, the order parameter assumes the form of a paired density wave, i.e. pairing occurs at finite momentum. Intriguingly, one of the possible pairings acquires a form analogous to Amperean superconductivity. However, the order parameter here is always a blend of paired density wave and Amperean pairing, rather than being purely one or the other.


title: Investigating the Correlation between Force Output, Strains, and Pressure for Active Skeletal Muscle Contractions

abstract: Experimental observations suggest that the force output of the skeletal muscle tissue can be correlated to the intra-muscular pressure generated by the muscle belly. However, pressure often proves difficult to measure through in-vivo tests. Simulations on the other hand, offer a tool to model muscle contractions and analyze the relationship between muscle force generation and deformations as well as pressure outputs, enabling us to gain insight into correlations among experimentally measurable quantities such as principal and volumetric strains, and the force output. In this work, a correlation study is performed using Pearson's and Spearman's correlation coefficients on the force output of the skeletal muscle, the principal and volumetric strains experienced by the muscle and the pressure developed within the muscle belly as the muscle tissue undergoes isometric contractions due to varying activation profiles. The study reveals strong correlations between force output and the strains at all locations of the belly, irrespective of the type of activation profile used. This observation enables estimation on the contribution of various muscle groups to the total force by the experimentally measurable principal and volumetric strains in the muscle belly. It is also observed that pressure does not correlate well with force output due to stress relaxation near the boundary of muscle belly.


title: Cup Stacking in Graphs

abstract: Here we introduce a new game on graphs, called cup stacking, following a line of what can be considered as $0$-, $1$-, or $2$-person games such as chip firing, percolation, graph burning, zero forcing, cops and robbers, graph pebbling, and graph pegging, among others. It can be more general, but the most basic scenario begins with a single cup on each vertex of a graph. (This simplification coincides with an earlier game devised by Gordon Hamilton.) For a vertex with $k$ cups on it we can move all its cups to a vertex at distance $k$ from it, provided the second vertex already has at least one cup on it. The object is to stack all cups onto some pre-described target vertex. We say that a graph is stackable if this can be accomplished for all possible target vertices. In this paper we study cup stacking on many families of graphs, developing a characterization of stackability in graphs and using it to prove the stackability of complete graphs, paths, cycles, grids, the Petersen graph, many Kneser graphs, some trees, cubes of dimension up to 20, "somewhat balanced" complete $t$-partite graphs, and Hamiltonian diameter two graphs. Additionally we use the Gallai-Edmonds Structure Theorem, the Edmonds Blossom Algorithm, and the Hungarian algorithm to devise a polynomial algorithm to decide if a diameter two graph is stackable. Our proof that cubes up to dimension 20 are stackable uses Kleitman's Symmetric Chain Decomposition and the new result of Merino, M\"utze, and Namrata that all generalized Johnson graphs (excluding the Petersen graph) are Hamiltonian. We conjecture that all cubes and higher-dimensional grids are stackable, and leave the reader with several open problems, questions, and generalizations.


title: A Natural Indirect Adaptive Controller for a Satellite-Mounted Manipulator

abstract: The work considers the design of an indirect adaptive controller for a satellite equipped with a robotic arm manipulating an object. Uncertainty on the manipulated object can considerably impact the overall behavior of the system. In addition, the dynamics of the actuators of the base satellite are non-linear and can be affected by malfunctioning. Neglecting these two phenomena may lead to excessive control effort or degrade performance. An indirect adaptive control approach is pursued, which allows consideration of relevant features of the actuators dynamics, such as loss of effectiveness. Furthermore, an adaptive law that preserves the physical consistency of the inertial parameters of the various rigid bodies comprising the system is employed. The performance and robustness of the controller are first analyzed and then validated in simulation.


title: Stability and Regret bounds on Distributed Truncated Predictive Control for Networked Dynamical Systems

abstract: This work is primarily concerned about the distributed control of networked linear timeinvariant (LTI) systems. In particular, we propose a truncated predictive control algorithm based on $\kappa$-hop neighbourhoods of the agents of the networked system. We establish stability and regret bounds for the proposed algorithm, which shows that the regret decays exponentially when the temporal prediction horizon $k$ and the spatial radius $\kappa$ increases.


title: Multiscale hierarchical decomposition methods for images corrupted by multiplicative noise

abstract: Recovering images corrupted by multiplicative noise is a well known challenging task. Motivated by the success of multiscale hierarchical decomposition methods (MHDM) in image processing, we adapt a variety of both classical and new multiplicative noise removing models to the MHDM form. On the basis of previous work, we further present a tight and a refined version of the corresponding multiplicative MHDM. We discuss existence and uniqueness of solutions for the proposed models, and additionally, provide convergence properties. Moreover, we present a discrepancy principle stopping criterion which prevents recovering excess noise in the multiscale reconstruction. Through comprehensive numerical experiments and comparisons, we qualitatively and quantitatively evaluate the validity of all proposed models for denoising and deblurring images degraded by multiplicative noise. By construction, these multiplicative multiscale hierarchical decomposition methods have the added benefit of recovering many scales of an image, which can provide features of interest beyond image denoising.


title: DiPS: Discriminative Pseudo-Label Sampling with Self-Supervised Transformers for Weakly Supervised Object Localization

abstract: Self-supervised vision transformers (SSTs) have shown great potential to yield rich localization maps that highlight different objects in an image. However, these maps remain class-agnostic since the model is unsupervised. They often tend to decompose the image into multiple maps containing different objects while being unable to distinguish the object of interest from background noise objects. In this paper, Discriminative Pseudo-label Sampling (DiPS) is introduced to leverage these class-agnostic maps for weakly-supervised object localization (WSOL), where only image-class labels are available. Given multiple attention maps, DiPS relies on a pre-trained classifier to identify the most discriminative regions of each attention map. This ensures that the selected ROIs cover the correct image object while discarding the background ones, and, as such, provides a rich pool of diverse and discriminative proposals to cover different parts of the object. Subsequently, these proposals are used as pseudo-labels to train our new transformer-based WSOL model designed to perform classification and localization tasks. Unlike standard WSOL methods, DiPS optimizes performance in both tasks by using a transformer encoder and a dedicated output head for each task, each trained using dedicated loss functions. To avoid overfitting a single proposal and promote better object coverage, a single proposal is randomly selected among the top ones for a training image at each training step. Experimental results on the challenging CUB, ILSVRC, OpenImages, and TelDrone datasets indicate that our architecture, in combination with our transformer-based proposals, can yield better localization performance than state-of-the-art methods.


title: Quantum Expanders and Quantifier Reduction for Tracial von Neumann Algebras

abstract: We provide a complete characterization of theories of tracial von Neumann algebras that admit quantifier elimination. We also show that the theory of a separable tracial von Neumann algebra $\mathcal{N}$ is never model complete if its direct integral decomposition contains $\mathrm{II}_1$ factors $\mathcal{M}$ such that $M_2(\mathcal{M})$ embeds into an ultrapower of $\mathcal{M}$. The proof in the case of $\mathrm{II}_1$ factors uses an explicit construction based on random matrices and quantum expanders.


title: Motion Memory: Leveraging Past Experiences to Accelerate Future Motion Planning

abstract: When facing a new motion-planning problem, most motion planners solve it from scratch, e.g., via sampling and exploration or starting optimization from a straight-line path. However, most motion planners have to experience a variety of planning problems throughout their lifetimes, which are yet to be leveraged for future planning. In this paper, we present a simple but efficient method called Motion Memory, which allows different motion planners to accelerate future planning using past experiences. Treating existing motion planners as either a closed or open box, we present a variety of ways that Motion Memory can contribute to reduce the planning time when facing a new planning problem. We provide extensive experiment results with three different motion planners on three classes of planning problems with over 30,000 problem instances and show that planning speed can be significantly reduced by up to 89% with the proposed Motion Memory technique and with increasing past planning experiences.


title: Efficacy of reduced order source terms for a coupled wave-circulation model in the Gulf of Mexico

abstract: During hurricanes, coupled wave-circulation models are critical tools for public safety. The standard approach is to use a high fidelity circulation model coupled with a wave model which uses the most advanced source terms. As a result, the models can be highly computationally expensive and so this study investigates the potential consequences of using highly simplified (reduced order) source terms within the wave model component of the coupled wave-circulation model. The trade-off between run time and accuracy with respect to observations is quantified for a set of two storms that impacted the Gulf of Mexico, Hurricane Ike and Hurricane Ida. Water surface elevations as well as wave statistics (significant wave height, peak period, and mean wave direction) are compared to observations. The usage of the reduced order source terms yielded significant savings in computational cost. Additionally, relatively low amounts of additional error with respect to observations during the simulations with reduced order source terms. However, large changes in global model outputs of the wave statistics were observed based on the choice of source terms particularly near the track of each hurricane.


title: The Importance of Prompt Tuning for Automated Neuron Explanations

abstract: Recent advances have greatly increased the capabilities of large language models (LLMs), but our understanding of the models and their safety has not progressed as fast. In this paper we aim to understand LLMs deeper by studying their individual neurons. We build upon previous work showing large language models such as GPT-4 can be useful in explaining what each neuron in a language model does. Specifically, we analyze the effect of the prompt used to generate explanations and show that reformatting the explanation prompt in a more natural way can significantly improve neuron explanation quality and greatly reduce computational cost. We demonstrate the effects of our new prompts in three different ways, incorporating both automated and human evaluations.


title: Compressing Context to Enhance Inference Efficiency of Large Language Models

abstract: Large language models (LLMs) achieved remarkable performance across various tasks. However, they face challenges in managing long documents and extended conversations, due to significantly increased computational requirements, both in memory and inference time, and potential context truncation when the input exceeds the LLM's fixed context length. This paper proposes a method called Selective Context that enhances the inference efficiency of LLMs by identifying and pruning redundancy in the input context to make the input more compact. We test our approach using common data sources requiring long context processing: arXiv papers, news articles, and long conversations, on tasks of summarisation, question answering, and response generation. Experimental results show that Selective Context significantly reduces memory cost and decreases generation latency while maintaining comparable performance compared to that achieved when full context is used. Specifically, we achieve a 50\% reduction in context cost, resulting in a 36\% reduction in inference memory usage and a 32\% reduction in inference time, while observing only a minor drop of .023 in BERTscore and .038 in faithfulness on four downstream applications, indicating that our method strikes a good balance between efficiency and performance.


title: GPT-who: An Information Density-based Machine-Generated Text Detector

abstract: The Uniform Information Density (UID) principle posits that humans prefer to spread information evenly during language production. We examine if this UID principle can help capture differences between Large Language Models (LLMs)-generated and human-generated texts. We propose GPT-who, the first psycholinguistically-inspired domain-agnostic statistical detector. This detector employs UID-based features to model the unique statistical signature of each LLM and human author for accurate detection. We evaluate our method using 4 large-scale benchmark datasets and find that GPT-who outperforms state-of-the-art detectors (both statistical- & non-statistical) such as GLTR, GPTZero, DetectGPT, OpenAI detector, and ZeroGPT by over $20$% across domains. In addition to better performance, it is computationally inexpensive and utilizes an interpretable representation of text articles. We find that GPT-who can distinguish texts generated by very sophisticated LLMs, even when the overlying text is indiscernible. UID-based measures for all datasets and code are available at https://github.com/saranya-venkatraman/gpt-who.


title: Graphs with three and four distinct eigenvalues based on circulants

abstract: In this paper, we aim to address the open questions raised in various recent papers regarding characterization of circulant graphs with three or four distinct eigenvalues in their spectra. Our focus is on providing characterizations and constructing classes of graphs falling under this specific category. We present a characterization of circulant graphs with prime number order and unitary Cayley graphs with arbitrary order, both of which possess spectra displaying three or four distinct eigenvalues. Various constructions of circulant graphs with composite orders are provided whose spectra consist of four distinct eigenvalues. These constructions primarily utilize specific subgraphs of circulant graphs that already possess two or three eigenvalues in their spectra, employing graph operations like the tensor product, the union, and the complement. Finally, we characterize the iterated line graphs of unitary Cayley graphs whose spectra contain three or four distinct eigenvalues, and we show their non-circulant nature.


title: Estimating Numbers without Regression

abstract: Despite recent successes in language models, their ability to represent numbers is insufficient. Humans conceptualize numbers based on their magnitudes, effectively projecting them on a number line; whereas subword tokenization fails to explicitly capture magnitude by splitting numbers into arbitrary chunks. To alleviate this shortcoming, alternative approaches have been proposed that modify numbers at various stages of the language modeling pipeline. These methods change either the (1) notation in which numbers are written (\eg scientific vs decimal), the (2) vocabulary used to represent numbers or the entire (3) architecture of the underlying language model, to directly regress to a desired number. Previous work suggests that architectural change helps achieve state-of-the-art on number estimation but we find an insightful ablation: changing the model's vocabulary instead (\eg introduce a new token for numbers in range 10-100) is a far better trade-off. In the context of masked number prediction, a carefully designed tokenization scheme is both the simplest to implement and sufficient, \ie with similar performance to the state-of-the-art approach that requires making significant architectural changes. Finally, we report similar trends on the downstream task of numerical fact estimation (for Fermi Problems) and discuss reasons behind our findings.


title: Fair Classifiers that Abstain without Harm

abstract: In critical applications, it is vital for classifiers to defer decision-making to humans. We propose a post-hoc method that makes existing classifiers selectively abstain from predicting certain samples. Our abstaining classifier is incentivized to maintain the original accuracy for each sub-population (i.e. no harm) while achieving a set of group fairness definitions to a user specified degree. To this end, we design an Integer Programming (IP) procedure that assigns abstention decisions for each training sample to satisfy a set of constraints. To generalize the abstaining decisions to test samples, we then train a surrogate model to learn the abstaining decisions based on the IP solutions in an end-to-end manner. We analyze the feasibility of the IP procedure to determine the possible abstention rate for different levels of unfairness tolerance and accuracy constraint for achieving no harm. To the best of our knowledge, this work is the first to identify the theoretical relationships between the constraint parameters and the required abstention rate. Our theoretical results are important since a high abstention rate is often infeasible in practice due to a lack of human resources. Our framework outperforms existing methods in terms of fairness disparity without sacrificing accuracy at similar abstention rates.


title: Complex homothetic sections and projections through a Helly type Theorem for cosets of $\S^1$

abstract: We prove that two closed subsets of complex space $\C^n$ with corresponding complex homothetic sections (projections) are complex homothetic. The proof uses a new Helly-type theorem for cosets of closed subgroups of $\S ^1$.


title: Experimental neutrino physics in a nuclear landscape

abstract: There are profound connections between neutrino physics and nuclear experiments. Exceptionally precise measurements of single and double beta-decay spectra illuminate the scale and nature of neutrino mass and may finally answer the question of whether neutrinos are their own antimatter counterparts. Neutrino-nucleus scattering underpins oscillation experiments and probes nuclear structure, neutrinos offer a rare vantage point into collapsing stars and nuclear fission reactors, and techniques pioneered in neutrino nuclear-physics experiments are advancing quantum-sensing technologies. In this article, we review current and planned efforts at the intersection of neutrino and nuclear experiments.


title: Human-Robot Gym: Benchmarking Reinforcement Learning in Human-Robot Collaboration

abstract: Deep reinforcement learning (RL) has shown promising results in robot motion planning with first attempts in human-robot collaboration (HRC). However, a fair comparison of RL approaches in HRC under the constraint of guaranteed safety is yet to be made. We, therefore, present human-robot gym, a benchmark suite for safe RL in HRC. Our benchmark suite provides eight challenging, realistic HRC tasks in a modular simulation framework. Most importantly, human-robot gym includes a safety shield that provably guarantees human safety. We are, thereby, the first to provide a benchmark suite to train RL agents that adhere to the safety specifications of real-world HRC. This bridges a critical gap between theoretic RL research and its real-world deployment. Our evaluation of six tasks led to three key results: (a) the diverse nature of the tasks offered by human-robot gym creates a challenging benchmark for state-of-the-art RL methods, (b) incorporating expert knowledge in RL training in the form of an action-based reward can outperform the expert, and (c) our agents negligibly overfit to training data.


title: EUSO-SPB2 Fluorescence Telescope Calibration and Field Tests

abstract: The Extreme Universe Space Observatory on a Super Pressure Balloon 2 (EUSO-SPB2), successfully launched from Wanaka, New Zealand on May 13, 2022, is a precursor for a space-based astroparticle observatory such as the Probe Of Extreme Multi-Messenger Astrophysics (POEMMA). EUSO-SPB2 flew two custom telescopes. Both have UV/UV-visible sensitivity and feature Schmidt optics. The Fluorescence Telescope (FT) measures ultra-high energy cosmic rays by looking down. The \v{C}erenkov Telescope (CT) searches for neutrino signatures by looking toward Earth's limb. The two telescopes each have a 1 m diameter entrance pupil and segmented glass mirrors that collect light from extensive air showers at the PeV and EeV-scale. Here we describe the FT telescope optics together with the results of the FT field tests at the Utah Telescope Array (TA) site from August/September 2022. The FT recorded the night sky background, lasers, and artificial point sources. The field tests included an absolute photometric calibration of the FT telescope that is compared to a piece-wise laboratory calibration.


title: CAT-RRT: Motion Planning that Admits Contact One Link at a Time

abstract: Current motion planning approaches rely on binary collision checking to evaluate the validity of a state and thereby dictate where the robot is allowed to move. This approach leaves little room for robots to engage in contact with an object, as is often necessary when operating in densely cluttered spaces. In this work, we propose an alternative method that considers contact states as high-cost states that the robot should avoid but can traverse if necessary to complete a task. More specifically, we introduce Contact Admissible Transition-based Rapidly exploring Random Trees (CAT-RRT), a planner that uses a novel per-link cost heuristic to find a path by traversing high-cost obstacle regions. Through extensive testing, we find that state-of-the-art optimization planners tend to over-explore low-cost states, which leads to slow and inefficient convergence to contact regions. Conversely, CAT-RRT searches both low and high-cost regions simultaneously with an adaptive thresholding mechanism carried out at each robot link. This leads to paths with a balance between efficiency, path length, and contact cost.


title: On convergence rates of proximal alternating direction method of multipliers

abstract: In this paper we consider from two different aspects the proximal alternating direction method of multipliers (ADMM) in Hilbert spaces. We first consider the application of the proximal ADMM to solve well-posed linearly constrained two-block separable convex minimization problems in Hilbert spaces and obtain new and improved non-ergodic convergence rate results, including linear and sublinear rates under certain regularity conditions. We next consider proximal ADMM as a regularization method for solving linear ill-posed inverse problems in Hilbert spaces. When the data is corrupted by additive noise, we establish, under a benchmark source condition, a convergence rate result in terms of the noise level when the number of iteration is properly chosen.


title: Comparison of deep-learning data fusion strategies in mandibular osteoradionecrosis prediction modelling using clinical variables and radiation dose distribution volumes

abstract: Purpose. NTCP modelling is rapidly embracing DL methods as the need to include spatial dose information is acknowledged. Finding the most appropriate way of combining radiation dose distribution images and clinical data involves technical challenges and requires domain knowledge. We propose different data fusion strategies that we hope will serve as a starting point for future DL NTCP studies. Methods. Early, joint and late DL multi-modality fusion strategies were compared using clinical variables and mandibular radiation dose distribution volumes. The discriminative performance of the multi-modality models was compared to that of single-modality models. All the experiments were conducted on a control-case matched cohort of 92 ORN cases and 92 controls from a single institution. Results. The highest ROC AUC score was obtained with the late fusion model (0.70), but no statistically significant differences in discrimination performance were observed between strategies. While late fusion was the least technically complex strategy, its design did not model the inter-modality interactions that are required for NTCP modelling. Joint fusion involved the most complex design but resulted in a single network training process which included intra- and inter-modality interactions in its model parameter optimisation. Conclusions. This is the first study that compares different strategies for including image data into DL NTCP models in combination with lower dimensional data such as clinical variables. The discrimination performance of such multi-modality NTCP models and the choice of fusion strategy will depend on the distribution and quality of both types of data. We encourage future DL NTCP studies to report on different fusion strategies to better justify their choice of DL pipeline.


title: GeoLLM: Extracting Geospatial Knowledge from Large Language Models

abstract: The application of machine learning (ML) in a range of geospatial tasks is increasingly common but often relies on globally available covariates such as satellite imagery that can either be expensive or lack predictive power. Here we explore the question of whether the vast amounts of knowledge found in Internet language corpora, now compressed within large language models (LLMs), can be leveraged for geospatial prediction tasks. We first demonstrate that LLMs embed remarkable spatial information about locations, but naively querying LLMs using geographic coordinates alone is ineffective in predicting key indicators like population density. We then present GeoLLM, a novel method that can effectively extract geospatial knowledge from LLMs with auxiliary map data from OpenStreetMap. We demonstrate the utility of our approach across multiple tasks of central interest to the international community, including the measurement of population density and economic livelihoods. Across these tasks, our method demonstrates a 70% improvement in performance (measured using Pearson's $r^2$) relative to baselines that use nearest neighbors or use information directly from the prompt, and performance equal to or exceeding satellite-based benchmarks in the literature. With GeoLLM, we observe that GPT-3.5 outperforms Llama 2 and RoBERTa by 19% and 51% respectively, suggesting that the performance of our method scales well with the size of the model and its pretraining dataset. Our experiments reveal that LLMs are remarkably sample-efficient, rich in geospatial information, and robust across the globe. Crucially, GeoLLM shows promise in mitigating the limitations of existing geospatial covariates and complementing them well. Code is available on the project website: https://rohinmanvi.github.io/GeoLLM


title: CoT3DRef: Chain-of-Thoughts Data-Efficient 3D Visual Grounding

abstract: 3D visual grounding is the ability to localize objects in 3D scenes conditioned by utterances. Most existing methods devote the referring head to localize the referred object directly, causing failure in complex scenarios. In addition, it does not illustrate how and why the network reaches the final decision. In this paper, we address this question Can we design an interpretable 3D visual grounding framework that has the potential to mimic the human perception system?. To this end, we formulate the 3D visual grounding problem as a sequence-to-sequence Seq2Seq task by first predicting a chain of anchors and then the final target. Interpretability not only improves the overall performance but also helps us identify failure cases. Following the chain of thoughts approach enables us to decompose the referring task into interpretable intermediate steps, boosting the performance and making our framework extremely data-efficient. Moreover, our proposed framework can be easily integrated into any existing architecture. We validate our approach through comprehensive experiments on the Nr3D, Sr3D, and Scanrefer benchmarks and show consistent performance gains compared to existing methods without requiring manually annotated data. Furthermore, our proposed framework, dubbed CoT3DRef, is significantly data-efficient, whereas on the Sr3D dataset, when trained only on 10% of the data, we match the SOTA performance that trained on the entire data. The code is available at https:eslambakr.github.io/cot3dref.github.io/.


title: Wakefield Generation in Hydrogen and Lithium Plasmas at FACET-II: Diagnostics and First Beam-Plasma Interaction Results

abstract: Plasma Wakefield Acceleration (PWFA) provides ultrahigh acceleration gradients of 10s of GeV/m, providing a novel path towards efficient, compact, TeV-scale linear colliders and high brightness free electron lasers. Critical to the success of these applications is demonstrating simultaneously high gradient acceleration, high energy transfer efficiency, and preservation of emittance, charge, and energy spread. Experiments at the FACET-II National User Facility at SLAC National Accelerator Laboratory aim to achieve all of these milestones in a single stage plasma wakefield accelerator, providing a 10 GeV energy gain in a <1 m plasma with high energy transfer efficiency. Such a demonstration depends critically on diagnostics able to measure emittance with mm-mrad accuracy, energy spectra to determine both %-level energy spread and broadband energy gain and loss, incoming longitudinal phase space, and matching dynamics. This paper discusses the experimental setup at FACET-II, including the incoming beam parameters from the FACET-II linac, plasma sources, and diagnostics developed to meet this challenge. Initial progress on the generation of beam ionized wakes in meter-scale hydrogen gas is discussed, as well as commissioning of the plasma sources and diagnostics.


title: Extreme FeLoBAL Outflow in the VLT/UVES Spectrum of Quasar SDSS J1321-0041

abstract: Context. Quasar outflows are often analyzed to determine their ability to contribute to active galactic nucleus (AGN) feedback. We identified a broad absorption line (BAL) outflow in the VLT/UVES spectrum of the quasar SDSS J1321-0041. The outflow shows troughs from Fe II, and is thus categorized as an FeLoBAL. This outflow is unusual among the population of FeLoBAL outflows, as it displays C II and Si II BALs. Aims. Outflow systems require a kinetic luminosity above $\sim0.5\%$ of the quasar's luminosity to contribute to AGN feedback. For this reason, we analyzed the spectrum of J1321-0041 to determine the outflow's kinetic luminosity, as well as the quasar's bolometric luminosity. Methods. We measured the ionic column densities from the absorption troughs in the spectrum and determined the Hydrogen column density and ionization parameter using those column densities as our constraints. We also determined the electron number density, $n_e$, based on the ratios between the excited-state and resonance-state column densities of Fe II and Si II. This allowed us to find the distance of the outflow from its central source, as well as its kinetic luminosity. Results. We determined the kinetic luminosity of the outflow to be $8.4^{+13.7}_{-5.4}\times 10^{45}\text{ erg s}^{-1}$, and the quasar's bolometric luminosity to be $1.72\pm0.13\times10^{47}\text{ erg s}^{-1}$, resulting in a ratio of $\dot{E}_k/L_{Bol}=4.8^{+8.0}_{-3.1}\%$. We conclude that this outflow has a sufficiently high kinetic luminosity to contribute to AGN feedback.


title: Federated Multi-Level Optimization over Decentralized Networks

abstract: Multi-level optimization has gained increasing attention in recent years, as it provides a powerful framework for solving complex optimization problems that arise in many fields, such as meta-learning, multi-player games, reinforcement learning, and nested composition optimization. In this paper, we study the problem of distributed multi-level optimization over a network, where agents can only communicate with their immediate neighbors. This setting is motivated by the need for distributed optimization in large-scale systems, where centralized optimization may not be practical or feasible. To address this problem, we propose a novel gossip-based distributed multi-level optimization algorithm that enables networked agents to solve optimization problems at different levels in a single timescale and share information through network propagation. Our algorithm achieves optimal sample complexity, scaling linearly with the network size, and demonstrates state-of-the-art performance on various applications, including hyper-parameter tuning, decentralized reinforcement learning, and risk-averse optimization.


title: SUBP: Soft Uniform Block Pruning for 1xN Sparse CNNs Multithreading Acceleration

abstract: The study of sparsity in Convolutional Neural Networks (CNNs) has become widespread to compress and accelerate models in environments with limited resources. By constraining N consecutive weights along the output channel to be group-wise non-zero, the recent network with 1$\times$N sparsity has received tremendous popularity for its three outstanding advantages: 1) A large amount of storage space saving by a \emph{Block Sparse Row} matrix. 2) Excellent performance at a high sparsity. 3) Significant speedups on CPUs with Advanced Vector Extensions. Recent work requires selecting and fine-tuning 1$\times$N sparse weights based on dense pre-trained weights, leading to the problems such as expensive training cost and memory access, sub-optimal model quality, as well as unbalanced workload across threads (different sparsity across output channels). To overcome them, this paper proposes a novel \emph{\textbf{S}oft \textbf{U}niform \textbf{B}lock \textbf{P}runing} (SUBP) approach to train a uniform 1$\times$N sparse structured network from scratch. Specifically, our approach tends to repeatedly allow pruned blocks to regrow to the network based on block angular redundancy and importance sampling in a uniform manner throughout the training process. It not only makes the model less dependent on pre-training, reduces the model redundancy and the risk of pruning the important blocks permanently but also achieves balanced workload. Empirically, on ImageNet, comprehensive experiments across various CNN architectures show that our SUBP consistently outperforms existing 1$\times$N and structured sparsity methods based on pre-trained models or training from scratch. Source codes and models are available at \url{https://github.com/JingyangXiang/SUBP}.


title: Runtime Monitoring of Human-centric Requirements in Machine Learning Components: A Model-driven Engineering Approach

abstract: As machine learning (ML) components become increasingly integrated into software systems, the emphasis on the ethical or responsible aspects of their use has grown significantly. This includes building ML-based systems that adhere to human-centric requirements, such as fairness, privacy, explainability, well-being, transparency and human values. Meeting these human-centric requirements is not only essential for maintaining public trust but also a key factor determining the success of ML-based systems. However, as these requirements are dynamic in nature and continually evolve, pre-deployment monitoring of these models often proves insufficient to establish and sustain trust in ML components. Runtime monitoring approaches for ML are potentially valuable solutions to this problem. Existing state-of-the-art techniques often fall short as they seldom consider more than one human-centric requirement, typically focusing on fairness, safety, and trust. The technical expertise and effort required to set up a monitoring system are also challenging. In my PhD research, I propose a novel approach for the runtime monitoring of multiple human-centric requirements. This approach leverages model-driven engineering to more comprehensively monitor ML components. This doctoral symposium paper outlines the motivation for my PhD work, a potential solution, progress so far and future plans.


title: Slope of $H_{c2}$ close to $T_c$ versus the size of the Cooper pairs: The role of disorder in Dynes superconductors

abstract: The size of the Cooper pair $\xi_{\rm pair}$ is one of the basic characteristics of a superconductor, but it is not possible to measure it directly. It might be argued that $\xi_{\rm pair}$ can be determined from the value $\xi_{\rm slope}$ extracted from the measurement of the slope of $H_{c2}$ close to $T_c$. Taking into account both pair-conserving and pair-breaking scattering on impurities within the recently developed theory of Dynes superconductors, we perform an explicit calculation of $\xi_{\rm pair}$ and $\xi_{\rm slope}$. We show that the two quantities agree only in clean superconductors. In particular, when the pair-breaking disorder approaches the quantum critical point, $\xi_{\rm pair}$ stays finite, whereas $\xi_{\rm slope}$ diverges.


title: Detecting and Learning Out-of-Distribution Data in the Open world: Algorithm and Theory

abstract: This thesis makes considerable contributions to the realm of machine learning, specifically in the context of open-world scenarios where systems face previously unseen data and contexts. Traditional machine learning models are usually trained and tested within a fixed and known set of classes, a condition known as the closed-world setting. While this assumption works in controlled environments, it falls short in real-world applications where new classes or categories of data can emerge dynamically and unexpectedly. To address this, our research investigates two intertwined steps essential for open-world machine learning: Out-of-distribution (OOD) Detection and Open-world Representation Learning (ORL). OOD detection focuses on identifying instances from unknown classes that fall outside the model's training distribution. This process reduces the risk of making overly confident, erroneous predictions about unfamiliar inputs. Moving beyond OOD detection, ORL extends the capabilities of the model to not only detect unknown instances but also learn from and incorporate knowledge about these new classes. By delving into these research problems of open-world learning, this thesis contributes both algorithmic solutions and theoretical foundations, which pave the way for building machine learning models that are not only performant but also reliable in the face of the evolving complexities of the real world.


title: Evolved galaxies in high-density environments across $2.0\leq z<4.2$ using the ZFOURGE survey

abstract: To explore the role environment plays in influencing galaxy evolution at high redshifts, we study $2.0\leq z<4.2$ environments using the FourStar Galaxy Evolution (ZFOURGE) survey. Using galaxies from the COSMOS legacy field with ${\rm log(M_{*}/M_{\odot})}\geq9.5$, we use a seventh nearest neighbour density estimator to quantify galaxy environment, dividing this into bins of low, intermediate and high density. We discover new high density environment candidates across $2.0\leq z<2.4$ and $3.1\leq z<4.2$. We analyse the quiescent fraction, stellar mass and specific star formation rate (sSFR) of our galaxies to understand how these vary with redshift and environment. Our results reveal that, across $2.0\leq z<2.4$, the high density environments are the most significant regions, which consist of elevated quiescent fractions, ${\rm log(M_{*}/M_{\odot})}\geq10.2$ massive galaxies and suppressed star formation activity. At $3.1\leq z<4.2$, we find that high density regions consist of elevated stellar masses but require more complete samples of quiescent and sSFR data to study the effects of environment in more detail at these higher redshifts. Overall, our results suggest that well-evolved, passive galaxies are already in place in high density environments at $z\sim2.4$, and that the Butcher-Oemler effect and SFR-density relation may not reverse towards higher redshifts as previously thought.


title: Projected Push-Pull For Distributed Constrained Optimization Over Time-Varying Directed Graphs (extended version)

abstract: We introduce the Projected Push-Pull algorithm that enables multiple agents to solve a distributed constrained optimization problem with private cost functions and global constraints, in a collaborative manner. Our algorithm employs projected gradient descent to deal with constraints and a lazy update rule to control the trade-off between the consensus and optimization steps in the protocol. We prove that our algorithm achieves geometric convergence over time-varying directed graphs while ensuring that the decision variable always stays within the constraint set. We derive explicit bounds for step sizes that guarantee geometric convergence based on the strong-convexity and smoothness of cost functions, and graph properties. Moreover, we provide additional theoretical results on the usefulness of lazy updates, revealing the challenges in the analysis of any gradient tracking method that uses projection operators in a distributed constrained optimization setting. We validate our theoretical results with numerical studies over different graph types, showing that our algorithm achieves geometric convergence empirically.


title: Context-aware Status Updating: Wireless Scheduling for Maximizing Situational Awareness in Safety-critical Systems

abstract: In this study, we investigate a context-aware status updating system consisting of multiple sensor-estimator pairs. A centralized monitor pulls status updates from multiple sensors that are monitoring several safety-critical situations (e.g., carbon monoxide density in forest fire detection, machine safety in industrial automation, and road safety). Based on the received sensor updates, multiple estimators determine the current safety-critical situations. Due to transmission errors and limited communication resources, the sensor updates may not be timely, resulting in the possibility of misunderstanding the current situation. In particular, if a dangerous situation is misinterpreted as safe, the safety risk is high. In this paper, we introduce a novel framework that quantifies the penalty due to the unawareness of a potentially dangerous situation. This situation-unaware penalty function depends on two key factors: the Age of Information (AoI) and the observed signal value. For optimal estimators, we provide an information-theoretic bound of the penalty function that evaluates the fundamental performance limit of the system. To minimize the penalty, we study a pull-based multi-sensor, multi-channel transmission scheduling problem. Our analysis reveals that for optimal estimators, it is always beneficial to keep the channels busy. Due to communication resource constraints, the scheduling problem can be modelled as a Restless Multi-armed Bandit (RMAB) problem. By utilizing relaxation and Lagrangian decomposition of the RMAB, we provide a low-complexity scheduling algorithm which is asymptotically optimal. Our results hold for both reliable and unreliable channels. Numerical evidence shows that our scheduling policy can achieve up to 100 times performance gain over periodic updating and up to 10 times over randomized policy.


title: GPT-4 as an Agronomist Assistant? Answering Agriculture Exams Using Large Language Models

abstract: Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding across various domains, including healthcare and finance. For some tasks, LLMs achieve similar or better performance than trained human beings, therefore it is reasonable to employ human exams (e.g., certification tests) to assess the performance of LLMs. We present a comprehensive evaluation of popular LLMs, such as Llama 2 and GPT, on their ability to answer agriculture-related questions. In our evaluation, we also employ RAG (Retrieval-Augmented Generation) and ER (Ensemble Refinement) techniques, which combine information retrieval, generation capabilities, and prompting strategies to improve the LLMs' performance. To demonstrate the capabilities of LLMs, we selected agriculture exams and benchmark datasets from three of the largest agriculture producer countries: Brazil, India, and the USA. Our analysis highlights GPT-4's ability to achieve a passing score on exams to earn credits for renewing agronomist certifications, answering 93% of the questions correctly and outperforming earlier general-purpose models, which achieved 88% accuracy. On one of our experiments, GPT-4 obtained the highest performance when compared to human subjects. This performance suggests that GPT-4 could potentially pass on major graduate education admission tests or even earn credits for renewing agronomy certificates. We also explore the models' capacity to address general agriculture-related questions and generate crop management guidelines for Brazilian and Indian farmers, utilizing robust datasets from the Brazilian Agency of Agriculture (Embrapa) and graduate program exams from India. The results suggest that GPT-4, ER, and RAG can contribute meaningfully to agricultural education, assessment, and crop management practice, offering valuable insights to farmers and agricultural professionals.


title: Words into Action: Learning Diverse Humanoid Robot Behaviors using Language Guided Iterative Motion Refinement

abstract: Humanoid robots are well suited for human habitats due to their morphological similarity, but developing controllers for them is a challenging task that involves multiple sub-problems, such as control, planning and perception. In this paper, we introduce a method to simplify controller design by enabling users to train and fine-tune robot control policies using natural language commands. We first learn a neural network policy that generates behaviors given a natural language command, such as "walk forward", by combining Large Language Models (LLMs), motion retargeting, and motion imitation. Based on the synthesized motion, we iteratively fine-tune by updating the text prompt and querying LLMs to find the best checkpoint associated with the closest motion in history. We validate our approach using a simulated Digit humanoid robot and demonstrate learning of diverse motions, such as walking, hopping, and kicking, without the burden of complex reward engineering. In addition, we show that our iterative refinement enables us to learn 3x times faster than a naive formulation that learns from scratch.


title: Exploring adversarial attacks in federated learning for medical imaging

abstract: Federated learning offers a privacy-preserving framework for medical image analysis but exposes the system to adversarial attacks. This paper aims to evaluate the vulnerabilities of federated learning networks in medical image analysis against such attacks. Employing domain-specific MRI tumor and pathology imaging datasets, we assess the effectiveness of known threat scenarios in a federated learning environment. Our tests reveal that domain-specific configurations can increase the attacker's success rate significantly. The findings emphasize the urgent need for effective defense mechanisms and suggest a critical re-evaluation of current security protocols in federated medical image analysis systems.


title: Evolution of Natural Language Processing Technology: Not Just Language Processing Towards General Purpose AI

abstract: Since the invention of computers, communication through natural language (actual human language) has been a dream technology. However, natural language is extremely difficult to mathematically formulate, making it difficult to realize as an algorithm without considering programming. While there have been numerous technological developments, one cannot say that any results allowing free utilization have been achieved thus far. In the case of language learning in humans, for instance when learning one's mother tongue or foreign language, one must admit that this process is similar to the adage "practice makes perfect" in principle, even though the learning method is significant up to a point. Deep learning has played a central role in contemporary AI technology in recent years. When applied to natural language processing (NLP), this produced unprecedented results. Achievements exceeding the initial predictions have been reported from the results of learning vast amounts of textual data using deep learning. For instance, four arithmetic operations could be performed without explicit learning, thereby enabling the explanation of complex images and the generation of images from corresponding explanatory texts. It is an accurate example of the learner embodying the concept of "practice makes perfect" by using vast amounts of textual data. This report provides a technological explanation of how cutting-edge NLP has made it possible to realize the "practice makes perfect" principle. Additionally, examples of how this can be applied to business are provided. We reported in June 2022 in Japanese on the NLP movement from late 2021 to early 2022. We would like to summarize this as a memorandum since this is just the initial movement leading to the current large language models (LLMs).


title: Energy Stable and Structure-Preserving Schemes for the Stochastic Galerkin Shallow Water Equations

abstract: The shallow water flow model is widely used to describe water flows in rivers, lakes, and coastal areas. Accounting for uncertainty in the corresponding transport-dominated nonlinear PDE models presents theoretical and numerical challenges that motivate the central advances of this paper. Starting with a spatially one-dimensional hyperbolicity-preserving, positivity-preserving stochastic Galerkin formulation of the parametric/uncertain shallow water equations, we derive an entropy-entropy flux pair for the system. We exploit this entropy-entropy flux pair to construct structure-preserving second-order energy conservative, and first- and second-order energy stable finite volume schemes for the stochastic Galerkin shallow water system. The performance of the methods is illustrated on several numerical experiments.


title: Defining Millisecond Pulsars

abstract: Millisecond pulsars (MSP) are an important subclass of rotation powered pulsars (RPP), traditionally defined as those with $P_s < 20-30$~ms and $B_s \lesssim 10^{10}$~G. We re-examine this definition by applying Gaussian mixture model (GMM) analysis to identify distinct clusters within the RPP population and find that the MSPs appear to be better demarcated by the condition $\mathbf{P_s \lesssim 16}$~ms.


title: Transmission Investment Coordination using MILP Lagrange Dual Decomposition and Auxiliary Problem Principle

abstract: This paper considers the investment coordination problem for the long term transmission capacity expansion in a situation where there are multiple regional Transmission Planners (TPs), each acting in order to maximize the utility in only its own region. In such a setting, any particular TP does not normally have any incentive to cooperate with the neighboring TP(s), although the optimal investment decision of each TP is contingent upon those of the neighboring TPs. A game-theoretic interaction among the TPs does not necessarily lead to this overall social optimum. We, therefore, introduce a social planner and call it the Transmission Planning Coordinator (TPC) whose goal is to attain the optimal possible social welfare for the bigger geographical region. In order to achieve this goal, this paper introduces a new incentive mechanism, based on distributed optimization theory. This incentive mechanism can be viewed as a set of rules of the transmission expansion investment coordination game, set by the social planner TPC, such that, even if the individual TPs act selfishly, it will still lead to the TPC's goal of attaining overall social optimum. Finally, the effectiveness of our approach is demonstrated through several simulation studies.


title: Spiking PointNet: Spiking Neural Networks for Point Clouds

abstract: Recently, Spiking Neural Networks (SNNs), enjoying extreme energy efficiency, have drawn much research attention on 2D visual recognition and shown gradually increasing application potential. However, it still remains underexplored whether SNNs can be generalized to 3D recognition. To this end, we present Spiking PointNet in the paper, the first spiking neural model for efficient deep learning on point clouds. We discover that the two huge obstacles limiting the application of SNNs in point clouds are: the intrinsic optimization obstacle of SNNs that impedes the training of a big spiking model with large time steps, and the expensive memory and computation cost of PointNet that makes training a big spiking point model unrealistic. To solve the problems simultaneously, we present a trained-less but learning-more paradigm for Spiking PointNet with theoretical justifications and in-depth experimental analysis. In specific, our Spiking PointNet is trained with only a single time step but can obtain better performance with multiple time steps inference, compared to the one trained directly with multiple time steps. We conduct various experiments on ModelNet10, ModelNet40 to demonstrate the effectiveness of Spiking PointNet. Notably, our Spiking PointNet even can outperform its ANN counterpart, which is rare in the SNN field thus providing a potential research direction for the following work. Moreover, Spiking PointNet shows impressive speedup and storage saving in the training phase.


title: Low-Rank Tensor Completion via Novel Sparsity-Inducing Regularizers

abstract: To alleviate the bias generated by the l1-norm in the low-rank tensor completion problem, nonconvex surrogates/regularizers have been suggested to replace the tensor nuclear norm, although both can achieve sparsity. However, the thresholding functions of these nonconvex regularizers may not have closed-form expressions and thus iterations are needed, which increases the computational loads. To solve this issue, we devise a framework to generate sparsity-inducing regularizers with closed-form thresholding functions. These regularizers are applied to low-tubal-rank tensor completion, and efficient algorithms based on the alternating direction method of multipliers are developed. Furthermore, convergence of our methods is analyzed and it is proved that the generated sequences are bounded and any limit point is a stationary point. Experimental results using synthetic and real-world datasets show that the proposed algorithms outperform the state-of-the-art methods in terms of restoration performance.


title: Efficient Adaptation of Large Vision Transformer via Adapter Re-Composing

abstract: The advent of high-capacity pre-trained models has revolutionized problem-solving in computer vision, shifting the focus from training task-specific models to adapting pre-trained models. Consequently, effectively adapting large pre-trained models to downstream tasks in an efficient manner has become a prominent research area. Existing solutions primarily concentrate on designing lightweight adapters and their interaction with pre-trained models, with the goal of minimizing the number of parameters requiring updates. In this study, we propose a novel Adapter Re-Composing (ARC) strategy that addresses efficient pre-trained model adaptation from a fresh perspective. Our approach considers the reusability of adaptation parameters and introduces a parameter-sharing scheme. Specifically, we leverage symmetric down-/up-projections to construct bottleneck operations, which are shared across layers. By learning low-dimensional re-scaling coefficients, we can effectively re-compose layer-adaptive adapters. This parameter-sharing strategy in adapter design allows us to significantly reduce the number of new parameters while maintaining satisfactory performance, thereby offering a promising approach to compress the adaptation cost. We conduct experiments on 24 downstream image classification tasks using various Vision Transformer variants to evaluate our method. The results demonstrate that our approach achieves compelling transfer learning performance with a reduced parameter count. Our code is available at \href{https://github.com/DavidYanAnDe/ARC}{https://github.com/DavidYanAnDe/ARC}.


title: Domain Expansion via Network Adaptation for Solving Inverse Problems

abstract: Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal estimate, which is known to be fragile; (2) learn a prior for the signal to use in an optimization-based recovery. Despite the impressive results from the latter approach, many of these methods also lack robustness to shifts in data distribution, measurements, and noise levels. Such domain shifts result in a performance gap and in some cases introduce undesired artifacts in the estimated signal. In this paper, we explore the qualitative and quantitative effects of various domain shifts and propose a flexible and parameter efficient framework that adapt pretrained networks to such shifts. We demonstrate the effectiveness of our method for a number of natural image, MRI, and CT reconstructions tasks under domain, measurement model, and noise-level shifts. Our experiments demonstrate that our method provides significantly better performance and parameter efficiency compared to existing domain adaptation techniques.


title: Engineering Phonon-Qubit Interactions using Phononic Crystals

abstract: The ability to control phonons in solids is key for diverse quantum applications, ranging from quantum information processing to sensing. Often, phonons are sources of noise and decoherence, since they can interact with a variety of solid-state quantum systems. To mitigate this, quantum systems typically operate at milli-Kelvin temperatures to reduce the number of thermal phonons. Here we demonstrate an alternative approach that relies on engineering phononic density of states, drawing inspiration from photonic bandgap structures that have been used to control the spontaneous emission of quantum emitters. We design and fabricate diamond phononic crystals with a complete phononic bandgap spanning 50 - 70 gigahertz, tailored to suppress interactions of a single silicon-vacancy color center with resonant phonons of the thermal bath. At 4 Kelvin, we demonstrate a reduction of the phonon-induced orbital relaxation rate of the color center by a factor of 18 compared to bulk. Furthermore, we show that the phononic bandgap can efficiently suppress phonon-color center interactions up to 20 Kelvin. In addition to enabling operation of quantum memories at higher temperatures, the ability to engineer qubit-phonon interactions may enable new functionalities for quantum science and technology, where phonons are used as carriers of quantum information.


title: Differentially Private Multi-Site Treatment Effect Estimation

abstract: Patient privacy is a major barrier to healthcare AI. For confidentiality reasons, most patient data remains in silo in separate hospitals, preventing the design of data-driven healthcare AI systems that need large volumes of patient data to make effective decisions. A solution to this is collective learning across multiple sites through federated learning with differential privacy. However, literature in this space typically focuses on differentially private statistical estimation and machine learning, which is different from the causal inference-related problems that arise in healthcare. In this work, we take a fresh look at federated learning with a focus on causal inference; specifically, we look at estimating the average treatment effect (ATE), an important task in causal inference for healthcare applications, and provide a federated analytics approach to enable ATE estimation across multiple sites along with differential privacy (DP) guarantees at each site. The main challenge comes from site heterogeneity -- different sites have different sample sizes and privacy budgets. We address this through a class of per-site estimation algorithms that reports the ATE estimate and its variance as a quality measure, and an aggregation algorithm on the server side that minimizes the overall variance of the final ATE estimate. Our experiments on real and synthetic data show that our method reliably aggregates private statistics across sites and provides better privacy-utility tradeoff under site heterogeneity than baselines.


title: Tackling Data Bias in MUSIC-AVQA: Crafting a Balanced Dataset for Unbiased Question-Answering

abstract: In recent years, there has been a growing emphasis on the intersection of audio, vision, and text modalities, driving forward the advancements in multimodal research. However, strong bias that exists in any modality can lead to the model neglecting the others. Consequently, the model's ability to effectively reason across these diverse modalities is compromised, impeding further advancement. In this paper, we meticulously review each question type from the original dataset, selecting those with pronounced answer biases. To counter these biases, we gather complementary videos and questions, ensuring that no answers have outstanding skewed distribution. In particular, for binary questions, we strive to ensure that both answers are almost uniformly spread within each question category. As a result, we construct a new dataset, named MUSIC-AVQA v2.0, which is more challenging and we believe could better foster the progress of AVQA task. Furthermore, we present a novel baseline model that delves deeper into the audio-visual-text interrelation. On MUSIC-AVQA v2.0, this model surpasses all the existing benchmarks, improving accuracy by 2% on MUSIC-AVQA v2.0, setting a new state-of-the-art performance.

categories: cs.CV cs.AI cs.CL cs.LG cs.MM cs.SD eess.AS