title: Bridging the Gap Between Variational Inference and Wasserstein Gradient Flows

abstract: Variational inference is a technique that approximates a target distribution by optimizing within the parameter space of variational families. On the other hand, Wasserstein gradient flows describe optimization within the space of probability measures where they do not necessarily admit a parametric density function. In this paper, we bridge the gap between these two methods. We demonstrate that, under certain conditions, the Bures-Wasserstein gradient flow can be recast as the Euclidean gradient flow where its forward Euler scheme is the standard black-box variational inference algorithm. Specifically, the vector field of the gradient flow is generated via the path-derivative gradient estimator. We also offer an alternative perspective on the path-derivative gradient, framing it as a distillation procedure to the Wasserstein gradient flow. Distillations can be extended to encompass $f$-divergences and non-Gaussian variational families. This extension yields a new gradient estimator for $f$-divergences, readily implementable using contemporary machine learning libraries like PyTorch or TensorFlow.


title: Density-based User Representation using Gaussian Process Regression for Multi-interest Personalized Retrieval

abstract: Accurate modeling of the diverse and dynamic interests of users remains a significant challenge in the design of personalized recommender systems. Existing user modeling methods, like single-point and multi-point representations, have limitations w.r.t.\ accuracy, diversity, and adaptability. To overcome these deficiencies, we introduce density-based user representations (DURs), a novel method that leverages Gaussian process regression (GPR) for effective multi-interest recommendation and retrieval. Our approach, GPR4DUR, exploits DURs to capture user interest variability without manual tuning, incorporates uncertainty-awareness, and scales well to large numbers of users. Experiments using real-world offline datasets confirm the adaptability and efficiency of GPR4DUR, while online experiments with simulated users demonstrate its ability to address the exploration-exploitation trade-off by effectively utilizing model uncertainty.


title: The Missing U for Efficient Diffusion Models

abstract: Diffusion Probabilistic Models stand as a critical tool in generative modelling, enabling the generation of complex data distributions. This family of generative models yields record-breaking performance in tasks such as image synthesis, video generation, and molecule design. Despite their capabilities, their efficiency, especially in the reverse process, remains a challenge due to slow convergence rates and high computational costs. In this paper, we introduce an approach that leverages continuous dynamical systems to design a novel denoising network for diffusion models that is more parameter-efficient, exhibits faster convergence, and demonstrates increased noise robustness. Experimenting with Denoising Diffusion Probabilistic Models (DDPMs), our framework operates with approximately a quarter of the parameters, and $\sim$ 30\% of the Floating Point Operations (FLOPs) compared to standard U-Nets in DDPMs. Furthermore, our model is notably faster in inference than the baseline when measured in fair and equal conditions. We also provide a mathematical intuition as to why our proposed reverse process is faster as well as a mathematical discussion of the empirical tradeoffs in the denoising downstream task. Finally, we argue that our method is compatible with existing performance enhancement techniques, enabling further improvements in efficiency, quality, and speed.


title: Evaluating Neural Language Models as Cognitive Models of Language Acquisition

abstract: The success of neural language models (LMs) on many technological tasks has brought about their potential relevance as scientific theories of language despite some clear differences between LM training and child language acquisition. In this paper we argue that some of the most prominent benchmarks for evaluating the syntactic capacities of LMs may not be sufficiently rigorous. In particular, we show that the template-based benchmarks lack the structural diversity commonly found in the theoretical and psychological studies of language. When trained on small-scale data modeling child language acquisition, the LMs can be readily matched by simple baseline models. We advocate for the use of the readily available, carefully curated datasets that have been evaluated for gradient acceptability by large pools of native speakers and are designed to probe the structural basis of grammar specifically. On one such dataset, the LI-Adger dataset, LMs evaluate sentences in a way inconsistent with human language users. We conclude with suggestions for better connecting LMs with the empirical study of child language acquisition.


title: My model, it has three layers: a reduced model of the smectic transition in two dimensions

abstract: My model, it has three layers, Three layers is nematic. And had it just two layers, it would be a smectic. We study a reduced model of the smectic transition in two dimensions where the particles occupy three equally spaced layers. The role of particle geometry comes in through the interactions between particles on the central layer and those above and below. The system is understood to be smectic when the central layer is empty, and nematic when all three are equally occupied. It is possible to compute the free energies of these states exactly. We find that the free energy of the nematic can only exceed that of the smectic if the particle tips are sufficiently wide, mirroring the fact that ellipsoids do not make a smectic but sphero-cylinders do.


title: $p$-Poisson surface reconstruction in curl-free flow from point clouds

abstract: The aim of this paper is the reconstruction of a smooth surface from an unorganized point cloud sampled by a closed surface, with the preservation of geometric shapes, without any further information other than the point cloud. Implicit neural representations (INRs) have recently emerged as a promising approach to surface reconstruction. However, the reconstruction quality of existing methods relies on ground truth implicit function values or surface normal vectors. In this paper, we show that proper supervision of partial differential equations and fundamental properties of differential vector fields are sufficient to robustly reconstruct high-quality surfaces. We cast the $p$-Poisson equation to learn a signed distance function (SDF) and the reconstructed surface is implicitly represented by the zero-level set of the SDF. For efficient training, we develop a variable splitting structure by introducing a gradient of the SDF as an auxiliary variable and impose the $p$-Poisson equation directly on the auxiliary variable as a hard constraint. Based on the curl-free property of the gradient field, we impose a curl-free constraint on the auxiliary variable, which leads to a more faithful reconstruction. Experiments on standard benchmark datasets show that the proposed INR provides a superior and robust reconstruction. The code is available at \url{https://github.com/Yebbi/PINC}.


title: Data Market Design through Deep Learning

abstract: The $\textit{data market design}$ problem is a problem in economic theory to find a set of signaling schemes (statistical experiments) to maximize expected revenue to the information seller, where each experiment reveals some of the information known to a seller and has a corresponding price [Bergemann et al., 2018]. Each buyer has their own decision to make in a world environment, and their subjective expected value for the information associated with a particular experiment comes from the improvement in this decision and depends on their prior and value for different outcomes. In a setting with multiple buyers, a buyer's expected value for an experiment may also depend on the information sold to others [Bonatti et al., 2022]. We introduce the application of deep learning for the design of revenue-optimal data markets, looking to expand the frontiers of what can be understood and achieved. Relative to earlier work on deep learning for auction design [D\"utting et al., 2023], we must learn signaling schemes rather than allocation rules and handle $\textit{obedience constraints}$ $-$ these arising from modeling the downstream actions of buyers $-$ in addition to incentive constraints on bids. Our experiments demonstrate that this new deep learning framework can almost precisely replicate all known solutions from theory, expand to more complex settings, and be used to establish the optimality of new designs for data markets and make conjectures in regard to the structure of optimal designs.


title: A note on the indivisibility of the Henson graphs

abstract: We show that in contrast to the Rado graph, the Henson graphs are not computably indivisible.


title: Robust Learning for Smoothed Online Convex Optimization with Feedback Delay

abstract: We study a challenging form of Smoothed Online Convex Optimization, a.k.a. SOCO, including multi-step nonlinear switching costs and feedback delay. We propose a novel machine learning (ML) augmented online algorithm, Robustness-Constrained Learning (RCL), which combines untrusted ML predictions with a trusted expert online algorithm via constrained projection to robustify the ML prediction. Specifically,we prove that RCL is able to guarantee$(1+\lambda)$-competitiveness against any given expert for any$\lambda>0$, while also explicitly training the ML model in a robustification-aware manner to improve the average-case performance. Importantly,RCL is the first ML-augmented algorithm with a provable robustness guarantee in the case of multi-step switching cost and feedback delay.We demonstrate the improvement of RCL in both robustness and average performance using battery management for electrifying transportationas a case study.


title: BP3M: Bayesian Positions, Parallaxes, and Proper Motions derived from the Hubble Space Telescope and Gaia data

abstract: We present a hierarchical Bayesian pipeline, BP3M, that measures positions, parallaxes, and proper motions (PMs) for cross-matched sources between Hubble~Space~Telescope (HST) images and Gaia -- even for sparse fields ($N_*<10$ per image) -- expanding from the recent GaiaHub tool. This technique uses Gaia-measured astrometry as priors to predict the locations of sources in HST images, and is therefore able to put the HST images onto a global reference frame without the use of background galaxies/QSOs. Testing our publicly-available code in the Fornax and Draco dSphs, we measure accurate PMs that are a median of 8-13 times more precise than Gaia DR3 alone for $20.5<G<21~\mathrm{mag}$. We are able to explore the effect of observation strategies on BP3M astrometry using synthetic data, finding an optimal strategy to improve parallax and position precision at no cost to the PM uncertainty. Using 1619 HST images in the sparse COSMOS field (median 9 Gaia sources per HST image), we measure BP3M PMs for 2640 unique sources in the $16<G<21.5~\mathrm{mag}$ range, 25% of which have no Gaia PMs; the median BP3M PM uncertainty for $20.25<G<20.75~\mathrm{mag}$ sources is $0.44~$mas/yr compared to $1.03~$mas/yr from Gaia, while the median BP3M PM uncertainty for sources without Gaia-measured PMs ($20.75<G<21.5~\mathrm{mag}$) is $1.16~$mas/yr. The statistics that underpin the BP3M pipeline are a generalized way of combining position measurements from different images, epochs, and telescopes, which allows information to be shared between surveys and archives to achieve higher astrometric precision than that from each catalog alone.


title: Varieties of mathematical understanding

abstract: This essay considers ways that recent uses of computers in mathematics challenge contemporary views on the nature of mathematical understanding. It also puts these challenges in a historical perspective and offers speculation as to a possible resolution.


title: Medical Image Denosing via Explainable AI Feature Preserving Loss

abstract: Denoising algorithms play a crucial role in medical image processing and analysis. However, classical denoising algorithms often ignore explanatory and critical medical features preservation, which may lead to misdiagnosis and legal liabilities. In this work, we propose a new denoising method for medical images that not only efficiently removes various types of noise, but also preserves key medical features throughout the process. To achieve this goal, we utilize a gradient-based eXplainable Artificial Intelligence (XAI) approach to design a feature preserving loss function. Our feature preserving loss function is motivated by the characteristic that gradient-based XAI is sensitive to noise. Through backpropagation, medical image features before and after denoising can be kept consistent. We conducted extensive experiments on three available medical image datasets, including synthesized 13 different types of noise and artifacts. The experimental results demonstrate the superiority of our method in terms of denoising performance, model explainability, and generalization.


title: Sample-Conditioned Hypothesis Stability Sharpens Information-Theoretic Generalization Bounds

abstract: We present new information-theoretic generalization guarantees through the a novel construction of the "neighboring-hypothesis" matrix and a new family of stability notions termed sample-conditioned hypothesis (SCH) stability. Our approach yields sharper bounds that improve upon previous information-theoretic bounds in various learning scenarios. Notably, these bounds address the limitations of existing information-theoretic bounds in the context of stochastic convex optimization (SCO) problems, as explored in the recent work by Haghifam et al. (2023).


title: Efficient Full-frequency GW Calculations using a Lanczos Method

abstract: The GW approximation is widely used for reliable and accurate modeling of single-particle excitations. It also serves as a starting point for many theoretical methods, such as its use in the Bethe-Salpeter equation (BSE) and dynamical mean-field theory. However, full-frequency GW calculations for large systems with hundreds of atoms remain computationally challenging, even after years of efforts to reduce the prefactor and improve scaling. We propose a method that reformulates the correlation part of the GW self-energy as a resolvent of a Hermitian matrix, which can be efficiently and accurately computed using the standard Lanczos method. This method enables full-frequency GW calculations of material systems with a few hundred atoms on a single computing workstation. We further demonstrate the efficiency of the method by calculating the defect-state energies of silicon quantum dots with diameters up to 4 nm and nearly 2,000 silicon atoms using only 20 computational nodes.


title: Plagiarism and AI Assistance Misuse in Web Programming: Unfair Benefits and Characteristics

abstract: In programming education, plagiarism and misuse of artificial intelligence (AI) assistance are emerging issues. However, not many relevant studies are focused on web programming. We plan to develop automated tools to help instructors identify both misconducts. To fully understand the issues, we conducted a controlled experiment to observe the unfair benefits and the characteristics. We compared student performance in completing web programming tasks independently, with a submission to plagiarize, and with the help of AI assistance (ChatGPT). Our study shows that students who are involved in such misconducts get comparable test marks with less completion time. Plagiarized submissions are similar to the independent ones except in trivial aspects such as color and identifier names. AI-assisted submissions are more complex, making them less readable. Students believe AI assistance could be useful given proper acknowledgment of the use, although they are not convinced with readability and correctness of the solutions.


title: Efficient Classification of Student Help Requests in Programming Courses Using Large Language Models

abstract: The accurate classification of student help requests with respect to the type of help being sought can enable the tailoring of effective responses. Automatically classifying such requests is non-trivial, but large language models (LLMs) appear to offer an accessible, cost-effective solution. This study evaluates the performance of the GPT-3.5 and GPT-4 models for classifying help requests from students in an introductory programming class. In zero-shot trials, GPT-3.5 and GPT-4 exhibited comparable performance on most categories, while GPT-4 outperformed GPT-3.5 in classifying sub-categories for requests related to debugging. Fine-tuning the GPT-3.5 model improved its performance to such an extent that it approximated the accuracy and consistency across categories observed between two human raters. Overall, this study demonstrates the feasibility of using LLMs to enhance educational systems through the automated classification of student needs.


title: Progress and outlook on advanced fly scans based on Mamba

abstract: Development related to PandABox-based fly scans is an important part of the active work on Mamba, the software framework for beamline experiments at the High Energy Photon Source (HEPS); presented in this paper is the progress of our development, and some outlook for advanced fly scans based on knowledge learned during the process. By treating fly scans as a collaboration between a few loosely coupled subsystems - motors / mechanics, detectors / data processing, sequencer devices like PandABox - systematic analyses of issues in fly scans are conducted. Interesting products of these analyses include a general-purpose software-based fly-scan mechanism, a general way to design undulator-monochromator fly scans, a sketch of how to practically implement online tuning of fly-scan behaviours based on processing of the data acquired, and many more. Based on the results above, an architectural discussion on >=10kHz fly scans is given.


title: Preparing a commercial quantum key distribution system for certification against implementation loopholes

abstract: A commercial quantum key distribution (QKD) system needs to be formally certified to enable its wide deployment. The certification should include the system's robustness against known implementation loopholes and attacks that exploit them. Here we ready a fiber-optic QKD system for this procedure. The system has a prepare-and-measure scheme with decoy-state BB84 protocol, polarisation encoding, qubit source rate of 312.5 MHz, and is manufactured by QRate in Russia. We detail its hardware and post-processing. We analyse the hardware for any possible implementation loopholes and discuss countermeasures. We then amend the system design to address the highest-risk loopholes identified. We also work out technical requirements on the certification lab and outline its possible structure.


title: Fast elementary gates for universal quantum computation with Kerr parametric oscillator qubits

abstract: Kerr parametric oscillators (KPOs) can stabilize the superpositions of coherent states, which can be utilized as qubits, and are promising candidates for realizing hardware-efficient quantum computers. Although elementary gates for universal quantum computation with KPO qubits have been proposed, these gates are usually based on adiabatic operations and thus need long gate times, which result in errors caused by photon loss in KPOs realized by, e.g., superconducting circuits. In this work, we accelerate the elementary gates by experimentally feasible control methods, which are based on numerical optimization of pulse shapes for shortcuts to adiabaticity. By numerical simulations, we show that the proposed methods can achieve speedups compared to adiabatic ones by up to six times with high gate fidelities of 99.9%. These methods are thus expected to be useful for quantum computers with KPOs.


title: Multi-Objective Intrinsic Reward Learning for Conversational Recommender Systems

abstract: Conversational Recommender Systems (CRS) actively elicit user preferences to generate adaptive recommendations. Mainstream reinforcement learning-based CRS solutions heavily rely on handcrafted reward functions, which may not be aligned with user intent in CRS tasks. Therefore, the design of task-specific rewards is critical to facilitate CRS policy learning, which remains largely under-explored in the literature. In this work, we propose a novel approach to address this challenge by learning intrinsic rewards from interactions with users. Specifically, we formulate intrinsic reward learning as a multi-objective bi-level optimization problem. The inner level optimizes the CRS policy augmented by the learned intrinsic rewards, while the outer level drives the intrinsic rewards to optimize two CRS-specific objectives: maximizing the success rate and minimizing the number of turns to reach a successful recommendation in conversations. To evaluate the effectiveness of our approach, we conduct extensive experiments on three public CRS benchmarks. The results show that our algorithm significantly improves CRS performance by exploiting informative learned intrinsic rewards.


title: On definable $f$-generic groups and minimal flows in $p$-adically closed fields

abstract: Let $X$ be a definable group definable over a small model $M_0$. Recall that a global type $p$ on $X$ is definable $f$-generic over $M_0$ if every left translate of $p$ is definable over $M_0$. We call $p$ strongly $f$-generic over $M_0$ if every left translate of $p$ does not fork over $M_0$. Let $H$ be a group definable over the field ${\mathbb Q}_p$ of $p$-adic numbers admitting global definable $f$-generic types over ${\mathbb Q}_p$. We show that $H$ has unboundedly many global weakly generic types iff there is a global type $r$ on $H$ which is strongly $f$-generic over ${\mathbb Q}_p$ and a ${\mathbb Q}_p$-definable function $\theta$ such that $\theta(r)$ is finitely satisfiable in ${\mathbb Q}_p$. Recall that the $\mu$-type $\mu(x)$ on $H$ is the partial type consisting of the formulas over ${\mathbb Q}_p$ which define open neighborhoods of the identity of $H$. We show that every global weakly generic type $r$ on $H$ is $\mu$-invariant: For any $\epsilon\models \mu$ and $a\models r$, we have $\epsilon\cdot a\models r$. Let $G$ be groups definable over ${\mathbb Q}_p$ such that $H$ is a normal subgroup of $G$ and $G/H$ is a definably compact group. Then we show that the weakly generic types on $G$ coincide with almost periodic types $G$ iff $G$ has boundedly many global weakly generic types.


title: Making Large Language Models Better Data Creators

abstract: Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As such, trainable models are still the preferred option in some cases. However, these models still require human-labeled data for optimal performance, which is expensive and time-consuming to obtain. In order to address this issue, several techniques to reduce human effort involve labeling or generating data using LLMs. Although these methods are effective for certain applications, in practice they encounter difficulties in real-world scenarios. Labeling data requires careful data selection, while generating data necessitates task-specific prompt engineering. In this paper, we propose a unified data creation pipeline that requires only a single formatting example, and which is applicable to a broad range of tasks, including traditionally problematic ones with semantically devoid label spaces. In our experiments we demonstrate that instruction-following LLMs are highly cost-effective data creators, and that models trained with these data exhibit performance better than those trained with human-labeled data (by up to 17.5%) on out-of-distribution evaluation, while maintaining comparable performance on in-distribution tasks. These results have important implications for the robustness of NLP systems deployed in the real-world.


title: Well-Posedness of the Bochner Integral Form of Operator-Valued Riccati Equations

abstract: In this short paper, we prove that the Bochner integral form of the operator-valued Riccati equation has a unique solution if and only if its mild form has a unique solution. This implies that the mild and Bochner integral forms of this equation are equivalent. The result is obtained through an operator representation argument.


title: Planets Across Space and Time (PAST) IV: The Occurrence and Architecture of Kepler Planetary Systems as a Function of Kinematic Age Revealed by the LAMOST-Gaia-Kepler Sample

abstract: One of the fundamental questions in astronomy is how planetary systems form and evolve. Measuring the planetary occurrence and architecture as a function of time directly addresses this question. In the fourth paper of the Planets Across Space and Time (PAST) series, we investigate the occurrence and architecture of Kepler planetary systems as a function of kinematic age by using the LAMOST-Gaia-Kepler sample. To isolate the age effect, other stellar properties (e.g., metallicity) have been controlled. We find the following results. (1) The fraction of stars with Kepler-like planets ($F_{\text{Kep}}$) is about 50% for all stars; no significant trend is found between $F_{\text{Kep}}$ and age. (2) The average planet multiplicity ($\bar{N}_p$) exhibits a decreasing trend (~2$\sigma$ significance) with age. It decreases from $\bar{N}_p$~3 for stars younger than 1 Gyr to $\bar{N}_p$~1.8 for stars about 8 Gyr. (3) The number of planets per star ($\eta=F_{\text{Kep}}\times\bar{N}_p$) also shows a decreasing trend (~2-3$\sigma$ significance). It decreases from $\eta$~1.6-1.7 for young stars to $\eta$~1.0 for old stars. (4) The mutual orbital inclination of the planets ($\sigma_{i,k}$) increases from $1.2^{+1.4}_{-0.5}$ to $3.5^{+8.1}_{-2.3}$ as stars aging from 0.5 to 8 Gyr with a best fit of $\log{\sigma_{i,k}}=0.2+0.4\times\log{\frac{\text{Age}}{\text{1Gyr}}}$. Interestingly, the Solar System also fits such a trend. The nearly independence of $F_{\text{Kep}}$~50% on age implies that planet formation is robust and stable across the Galaxy history. The age dependence of $\bar{N}_p$ and $\sigma_{i,k}$ demonstrates planetary architecture is evolving, and planetary systems generally become dynamically hotter with fewer planets as they age.


title: On the entropy of a stealth vector-tensor black hole

abstract: We apply Wald's formalism to a Lagrangian within generalised Proca gravity that admits a Schwarzschild black hole with a non-trivial vector field. The resulting entropy differs from that of the same black hole in General Relativity by a logarithmic correction modulated by the only independent charge of the vector field. We find conditions on this charge to guarantee that the entropy is a non-decreasing function of the black hole area, as is the case in GR. If this requirement is extended to black hole mergers, we find that for Planck scale black holes, a non-decreasing entropy is possible only if the area of the final black hole is several times larger than the initial total area of the merger. Finally, we discuss some implications of the vector Galileon entropy from the point of view of entropic gravity.


title: Rectification of Random Walkers Induced by Energy Flow at Boundaries

abstract: We explore rectification phenomena in a system where two-dimensional random walkers interact with a funnel-shaped ratchet under two distinct classes of reflection rules. The two classes include the angle of reflection exceeding the angle of incidence ($\theta_{reflect} > \theta_{incident}$), or vice versa ($\theta_{reflect} < \theta_{incident}$). These generalized boundary reflection rules are indicative of non-equilibrium conditions due to the introduction of energy flows at the boundary. Our findings reveal that the nature of such particle-wall interactions dictates the system's behavior: the funnel either acts as a pump, directing flow, or as a collector, demonstrating a ratchet reversal. Importantly, we provide a geometric proof elucidating the underlying mechanism of rectification, thereby offering insights into why certain interactions lead to directed motion, while others do not.


title: Search for the Sagittarius tidal stream of axion dark matter around 4.55 $\mu$eV

abstract: We report the first search for the Sagittarius tidal stream of axion dark matter around 4.55 $\mu$eV using CAPP-12TB haloscope data acquired in March of 2022. Our result excluded the Sagittarius tidal stream of Dine-Fischler-Srednicki-Zhitnitskii and Kim-Shifman-Vainshtein-Zakharov axion dark matter densities of $\rho_a\gtrsim0.184$ and $\gtrsim0.025$ GeV/cm$^3$, respectively, over a mass range from 4.51 to 4.59 $\mu$eV at a 90\% confidence level.


title: Refined Equivalent Pinhole Model for Large-scale 3D Reconstruction from Spaceborne CCD Imagery

abstract: In this study, we present a large-scale earth surface reconstruction pipeline for linear-array charge-coupled device (CCD) satellite imagery. While mainstream satellite image-based reconstruction approaches perform exceptionally well, the rational functional model (RFM) is subject to several limitations. For example, the RFM has no rigorous physical interpretation and differs significantly from the pinhole imaging model; hence, it cannot be directly applied to learning-based 3D reconstruction networks and to more novel reconstruction pipelines in computer vision. Hence, in this study, we introduce a method in which the RFM is equivalent to the pinhole camera model (PCM), meaning that the internal and external parameters of the pinhole camera are used instead of the rational polynomial coefficient parameters. We then derive an error formula for this equivalent pinhole model for the first time, demonstrating the influence of the image size on the accuracy of the reconstruction. In addition, we propose a polynomial image refinement model that minimizes equivalent errors via the least squares method. The experiments were conducted using four image datasets: WHU-TLC, DFC2019, ISPRS-ZY3, and GF7. The results demonstrated that the reconstruction accuracy was proportional to the image size. Our polynomial image refinement model significantly enhanced the accuracy and completeness of the reconstruction, and achieved more significant improvements for larger-scale images.


title: Compactification of Superstring Theory

abstract: We give a mathematical perspective on string compactifications. Submitted as a chapter in the Encyclopedia of Mathematical Physics.


title: Patching for \'etale algebras and the period-index problem for higher degree Galois cohomology groups over Hensel semi-global fields

abstract: In this manuscript, we present a partial generalization of the field patching technique initially proposed by Harbater-Hartmann to Hensel semi-global fields, i.e., function fields of curves over excellent henselian discretely valued fields. More specifically, we show that patching holds for \'etale algebras over such fields and a suitable set of overfields. Within this new framework, we further establish a local-global principle for higher degree Galois cohomology groups over Hensel semi-global fields. As an application, we extend a recent result regarding a uniform period-index bound for higher degree Galois cohomology classes by Harbater-Hartmann-Krashen to Hensel semi-global fields. Additionally, we provide a proof of such a bound for coefficient groups of non-prime orders.


title: Team I2R-VI-FF Technical Report on EPIC-KITCHENS VISOR Hand Object Segmentation Challenge 2023

abstract: In this report, we present our approach to the EPIC-KITCHENS VISOR Hand Object Segmentation Challenge, which focuses on the estimation of the relation between the hands and the objects given a single frame as input. The EPIC-KITCHENS VISOR dataset provides pixel-wise annotations and serves as a benchmark for hand and active object segmentation in egocentric video. Our approach combines the baseline method, i.e., Point-based Rendering (PointRend) and the Segment Anything Model (SAM), aiming to enhance the accuracy of hand and object segmentation outcomes, while also minimizing instances of missed detection. We leverage accurate hand segmentation maps obtained from the baseline method to extract more precise hand and in-contact object segments. We utilize the class-agnostic segmentation provided by SAM and apply specific hand-crafted constraints to enhance the results. In cases where the baseline model misses the detection of hands or objects, we re-train an object detector on the training set to enhance the detection accuracy. The detected hand and in-contact object bounding boxes are then used as prompts to extract their respective segments from the output of SAM. By effectively combining the strengths of existing methods and applying our refinements, our submission achieved the 1st place in terms of evaluation criteria in the VISOR HOS Challenge.


title: Ling-CL: Understanding NLP Models through Linguistic Curricula

abstract: We employ a characterization of linguistic complexity from psycholinguistic and language acquisition research to develop data-driven curricula to understand the underlying linguistic knowledge that models learn to address NLP tasks. The novelty of our approach is in the development of linguistic curricula derived from data, existing knowledge about linguistic complexity, and model behavior during training. By analyzing several benchmark NLP datasets, our curriculum learning approaches identify sets of linguistic metrics (indices) that inform the challenges and reasoning required to address each task. Our work will inform future research in all NLP areas, allowing linguistic complexity to be considered early in the research and development process. In addition, our work prompts an examination of gold standards and fair evaluation in NLP.


title: Oscillatory integral operators on manifolds and related Kakeya and Nikodym problems

abstract: We consider Carleson-Sj\"{o}lin operators on Riemannian manifolds that arise naturally from the study of Bochner-Riesz problems on manifolds. They are special cases of H\"{o}rmander-type oscillatory integral operators. We obtain improved $L^p$ bounds of Carleson-Sj\"{o}lin operators in two cases: The case where the underlying manifold has constant sectional curvature and the case where the manifold satisfies Sogge's chaotic curvature condition. The two results rely on very different methods: To prove the former result, we show that on a Riemannian manifold, the distance function satisfies Bourgain's condition if and only if the manifold has constant sectional curvature. To obtain the second result, we introduce the notion of "contact orders" to H\"{o}rmander-type oscillatory integral operators, prove that if a H\"{o}rmander-type oscillatory integral operator is of a finite contact order, then it always has better $L^p$ bounds than "worst cases" (in spirit of Bourgain and Guth, and Guth, Hickman and Iliopoulou), and eventually verify that for Riemannian manifolds that satisfy Sogge's chaotic curvature condition, their distance functions alway have finite contact orders. As byproducts, we obtain new bounds for Nikodym maximal functions on manifolds of constant sectional curvatures.


title: Conformal perturbations of dirac operators and general Kastler-Kalau-Walze type theorems for even dimensional manifolds with boundary

abstract: In this paper, we establish the proof of general Kastler-Kalau-Walze type theorems for conformal perturbations of dirac Operators on even dimensional compact manifolds with (respectively without) boundary.


title: Cubic threefolds moduli and the Monster group

abstract: Allcock constructed a 13-dimensional complex ball quotient of which he conjectured that it admits a natural covering with covering group isomorphic to the Bimonster. This ball quotient contains the moduli space of cubic threefolds as an open dense subset of a 10-dimensional complex subball quotient. We prove that this subball quotient has a neighborhood in the Allcock ball quotient over which the conjectured cover exists.


title: Zephyr : Stitching Heterogeneous Training Data with Normalizing Flows for Photometric Redshift Inference

abstract: We present zephyr, a novel method that integrates cutting-edge normalizing flow techniques into a mixture density estimation framework, enabling the effective use of heterogeneous training data for photometric redshift inference. Compared to previous methods, zephyr demonstrates enhanced robustness for both point estimation and distribution reconstruction by leveraging normalizing flows for density estimation and incorporating careful uncertainty quantification. Moreover, zephyr offers unique interpretability by explicitly disentangling contributions from multi-source training data, which can facilitate future weak lensing analysis by providing an additional quality assessment. As probabilistic generative deep learning techniques gain increasing prominence in astronomy, zephyr should become an inspiration for handling heterogeneous training data while remaining interpretable and robustly accounting for observational uncertainties.


title: The optically thick rotating magnetic wind from a massive white dwarf merger product -- II. axisymmetric magnetohydrodynamic simulations

abstract: We numerically construct a series of axisymmetric rotating magnetic wind solutions, aiming at exploring the observation properties of massive white dwarf (WD) merger remnants with a strong magnetic field, a fast spin, and an intense mass loss, as inferred for WD J005311. We investigate the magnetospheric structure and the resultant spin-down torque exerted to the merger remnant with respect to the surface magnetic flux $\Phi_*$, spin angular frequency $\Omega_*$ and the mass loss rate $\dot M$. We confirm that the wind properties for $\sigma \equiv \Phi^2_* \Omega_*^2/\dot M v_\mathrm{esc}^3 \gtrsim 1$ significantly deviate from those of the spherical Parker wind, where $v_\mathrm{esc}$ is the escape velocity at stellar surface. For such a rotating magnetic wind sequence, we find: (i) quasi-periodic mass eruption triggered by magnetic reconnection along with the equatorial plane (ii) a scaling relation for the spin-down torque $T \approx (1/2) \times \dot{M} \Omega_* R^2_* \sigma^{1/4}$. We apply our results to discuss the spin-down evolution and wind anisotropy of massive WD merger remnants, the latter of which could be probed by a successive observation of WD J005311 using Chandra.


title: Improving Prompt Tuning with Learned Prompting Layers

abstract: Prompt tuning prepends a soft prompt to the input embeddings or hidden states and only optimizes the prompt to adapt pretrained models (PTMs) to downstream tasks. The previous work manually selects prompt layers which are far from optimal and failed to exploit the potential of prompt tuning. In this work, we propose a novel framework, \underline{S}elective \underline{P}rompt \underline{T}uning (SPT), that learns to select the proper prompt layers by inserting a prompt controlled by a learnable probabilistic gate at each intermediate layer. We further propose a novel bi-level optimization framework, SPT-DARTS, that can better optimize the learnable gates and improve the final prompt tuning performances of the learned prompt layer settings. We conduct extensive experiments with ten benchmark datasets under the full-data and few-shot scenarios. The results demonstrate that our SPT framework can perform better than the previous state-of-the-art PETuning baselines with comparable or fewer tunable parameters.


title: Deconfined quantum critical point lost in pressurized SrCu2(BO3)2

abstract: In the field of correlated electron materials, the relation between the resonating spin singlet and antiferromagnetic states has long been an attractive topic for understanding of the interesting macroscopic quantum phenomena, such as the ones emerging from magnetic frustrated materials, antiferromagnets and high-temperature superconductors. SrCu2(BO3)2 is a well-known quantum magnet, and it is theoretically expected to be the candidate of correlated electron material for clarifying the existence of a pressure-induced deconfined quantum critical point (DQCP), featured by a continuous quantum phase transition, between the plaquette-singlet (PS) valence bond solid phase and the antiferromagnetic (AF) phase. However, the real nature of the transition is yet to be identified experimentally due to the technical challenge. Here we show the experimental results for the first time, through the state-of-the-art high-pressure heat capacity measurement, that the PS-AF phase transition of the pressurized SrCu2(BO3)2 at zero field is clearly a first-order one. Our result clarifies the more than two-decade long debates about this key issue, and resonates nicely with the recent quantum entanglement understanding that the theoretically predicted DQCPs in representative lattice models are actually a first-order transition. Intriguingly, we also find that the transition temperatures of the PS and AF phase meet at the same pressure-temperature point, which signifies a bi-critical point as those observed in Fe-based superconductor and heavy-fermion compound, and constitutes the first experimental discovery of the pressure-induced bi-critical point in frustrated magnets. Our results provide fresh information for understanding the evolution among different spin states of correlated electron materials under pressure.


title: Gibbs state sampling via cluster expansions

abstract: Gibbs states (i.e., thermal states) can be used for several applications such as quantum simulation, quantum machine learning, quantum optimization, and the study of open quantum systems. Moreover, semi-definite programming, combinatorial optimization problems, and training quantum Boltzmann machines can all be addressed by sampling from well-prepared Gibbs states. With that, however, comes the fact that preparing and sampling from Gibbs states on a quantum computer are notoriously difficult tasks. Such tasks can require large overhead in resources and/or calibration even in the simplest of cases, as well as the fact that the implementation might be limited to only a specific set of systems. We propose a method based on sampling from a quasi-distribution consisting of tensor products of mixed states on local clusters, i.e., expanding the full Gibbs state into a sum of products of local "Gibbs-cumulant" type states easier to implement and sample from on quantum hardware. We begin with presenting results for 4-spin linear chains with XY spin interactions, for which we obtain the $ZZ$ dynamical spin-spin correlation functions. We also present the results of measuring the specific heat of the 8-spin chain Gibbs state $\rho_8$.


title: Charging Autonomous Electric Vehicle Fleet for Mobility-on-Demand Services: Plug in or Swap out?

abstract: This paper compares two prevalent charging strategies for electric vehicles, plug-in charging and battery swapping, to investigate which charging strategy is superior for electric autonomous mobility-on-demand (AMoD) systems. To this end, we use a queueing-theoretic model to characterize the vehicle waiting time at charging stations and battery swapping stations, respectively. The model is integrated into an economic analysis of the electric AMoD system operated by a transportation network company (TNC), where the incentives of passengers, the charging/operating shift of TNC vehicles, the operational decisions of the platform, and the planning decisions of the government are captured. Overall, a bi-level optimization framework is proposed for charging infrastructure planning of the electric AMoD system. Based on the proposed framework, we compare the socio-economic performance of plug-in charging and battery swapping, and investigate how this comparison depends on the evolving charging technologies (such as charging speed, battery capacity, and infrastructure cost). At the planning level, we find that when choosing plug-in charging, increased charging speed leads to a transformation of infrastructure from sparsely distributed large stations to densely distributed small stations, while enlarged battery capacity transforms the infrastructure from densely distributed small stations to sparsely distributed large stations. On the other hand, when choosing battery swapping, both increased charging speed and enlarged battery capacity will lead to a smaller number of battery swapping stations. At the operational level, we find that improved charging speed leads to increased TNC profit when choosing plug-in charging, whereas improved charging speed may lead to smaller TNC profit under battery swapping. The above insights are validated through realistic numerical studies.


title: Metasurface-based Mueller Matrix Microscope

abstract: In conventional optical microscopes, image contrast of objects mainly results from the differences in light intensity and/or color. Muller matrix optical microscopes (MMMs), on the other hand, can provide significantly enhanced image contrast and rich information about objects by analyzing their interactions with polarized light. However, state-of-art MMMs are fundamentally limited by bulky and slow polarization state generators and analyzers. Here, we demonstrated the feasibility of applying metasurfaces to enable a fast and compact MMM, i.e., Meta-MMM. We developed a dual-color MMM, in both reflection and transmission modes, based on a chip-integrated high-speed (>20fps) metasurface polarization state analyzer (Meta-PSA) and realized high measurement accuracy for Muller matrix (MM) imaging. We then applied our Meta-MMM to nanostructure characterization, surface morphology analysis and discovered birefringent structures in honeybee wings. Our meta-MMMs hold the promise to revolutionize various applications from biological imaging, medical diagnosis, material characterization to industry inspection and space exploration.


title: Linear codes with few weights from non-weakly regular plateaued functions

abstract: Linear codes with few weights have significant applications in secret sharing schemes, authentication codes, association schemes, and strongly regular graphs. There are a number of methods to construct linear codes, one of which is based on functions. Furthermore, two generic constructions of linear codes from functions called the first and the second generic constructions, have aroused the research interest of scholars. Recently, in \cite{Nian}, Li and Mesnager proposed two open problems: Based on the first and the second generic constructions, respectively, construct linear codes from non-weakly regular plateaued functions and determine their weight distributions. Motivated by these two open problems, in this paper, firstly, based on the first generic construction, we construct some three-weight and at most five-weight linear codes from non-weakly regular plateaued functions and determine the weight distributions of the constructed codes. Next, based on the second generic construction, we construct some three-weight and at most five-weight linear codes from non-weakly regular plateaued functions belonging to $\mathcal{NWRF}$ (defined in this paper) and determine the weight distributions of the constructed codes. We also give the punctured codes of these codes obtained based on the second generic construction and determine their weight distributions. Meanwhile, we obtain some optimal and almost optimal linear codes. Besides, by the Ashikhmin-Barg condition, we have that the constructed codes are minimal for almost all cases and obtain some secret sharing schemes with nice access structures based on their dual codes.


title: Cohomological properties of multinorm-one tori

abstract: In this paper we investigate the Tate--Shafarevich group Sha^1(k, T) of a multinorm-one torus $T$ over a global field $k$. We establish a few functorial maps among cohomology groups and explore their relations. Using these properties and relations we obtain a few basic structural results for Sha^1(k, T) and extend a few results of Bayer-Fluckiger--Lee--Parimala [Adv. in Math., 2019] to some more general multinorm-one tori. We also give a uniform proof of a result of Demarche--Wei for a criterion of the vanishing of Sha^1(k, T), and of the main result of Pollio [Pure App. Math. Q., 2014] for the case where the \'etale $k$-algebra in question is a product of two abelian extensions. Moreover, we improve the explicit description of Sha^1(k, T) in Lee [J. Pure Appl. Alg., 2022] by removing an intersection condition.


title: Single-shot, full characterization of the spatial wavefunction of light fields via Stokes tomography

abstract: Since the diffraction behavior of a light field is fully determined by its spatial wavefunction, i.e., its spatial complex amplitude (SCA), full characterization of spatial wavefunction, plays a vital role in modern optics from both the fundamental and applied aspects. In this work, we present a novel complex-amplitude profiler based on spatial Stokes tomography with the capability to fully determine the SCA of a light field in a single shot with high precision and resolution. The SCA slice observed at any propagation plane provides complete information about the light field, thus allowing us to further retrieve the complete beam structure in 3 dimensions space, as well as the exact modal constitution in terms of spatial degrees of freedom. The principle demonstrated here provides an important advancement for the full characterization of light beams with a broad spectrum of potential applications in various areas of optics, especially for the growing field of structured light.


title: The Connection between the Intracluster Light and its Host Halo: Formation Time and Contribution from Different Channels

abstract: We extend the analysis presented in \cite{contini2023a} to higher redshifts, up to $z=2$, by focusing on the relation between the intracluster light (ICL) fraction and the halo mass, its dependence with redshift, role played by the halo concentration and formation time, in a large sample of simulated galaxy groups/clusters with $13\lesssim \log M_{halo} \lesssim 15$. Moreover, a key focus is to isolate the relative contributions provided by the main channels for the ICL formation to the total amount. The ICL fraction at higher redshift is weakly dependent on halo mass, and comparable with that at the present time, in agreement with recent observations. Stellar stripping, mergers and pre-processing are the major responsible channels of the ICL formation, with stellar stripping that accounts for $\sim 90\%$ of the total ICL, regardless of halo mass and redshift. Pre-processing is an important process for clusters to accrete already formed ICL. The diffuse component forms very early, $z\sim 0.6$, and its formation depends on both concentration and formation time of the halo, with more concentrated and earlier formed haloes that assemble their ICL earlier than later formed ones. The efficiency of this process is independent of halo mass, but increases with decreasing redshift, which implies that stellar stripping becomes more important with time as the concentration increases. This highlights the link between the ICL and the dynamical state of a halo: groups/clusters that have a higher fraction of diffuse light are more concentrated, relaxed and in an advanced stage of growth.


title: Rashba spin splitting based on trilayer graphene systems

abstract: We establish a general Rashba Hamiltonian for trilayer graphene (TLG) by introducing an extrinsic layer-dependent Rashba spin-orbit coupling (SOC) arising from the off-plane inversion symmetry breaking. Our results indicate that the band spin splitting depends strongly on the layer-distribution and sign of Rashba SOC as well as the ABA or ABC stacking order of TLG. We find that spin splitting is significantly enhanced as the number of layers of the Rashba SOC with the same sign and magnitude increases. For the spatially-separated two Rashba SOCs of the same magnitude but the opposite sign, no spin splitting arises in ABC-TLG due to the preservation of inversion symmetry that ensures the complete cancellation of contributions from the opposite layers, whereas nonzero spin splitting is observed for ABA-TLG due to its own lack of inversion symmetry. We further illustrate that gate voltage is effective to modulate the spin-polarized states near the band edges. Moreover, we use density functional theory calculations to verify the Rashba splitting effect in the example of TLG interfaced by Au layer(s), which induce simultaneously the effective terms of Rashba SOC and gate voltage. Our results demonstrate the significance of layer and symmetry in manipulating spin and can be extended to multilayer graphene or other van der Waals interface systems.


title: Co-evolution and Nuclear Structure in the Dwarf Galaxy POX 52 Studied by Multi-wavelength Data From Radio to X-ray

abstract: The nearby dwarf galaxy POX 52 at $z = 0.021$ hosts an active galactic nucleus (AGN) with a black-hole (BH) mass of $M_{\rm BH} \sim 10^{5-6} M_\odot$ and an Eddington ratio of $\sim$ 0.1-1. This object provides the rare opportunity to study both AGN and host-galaxy properties in a low-mass highly accreting system. To do so, we collected its multi-wavelength data from X-ray to radio. First, we construct a spectral energy distribution, and by fitting it with AGN and host-galaxy components, we constrain AGN-disk and dust-torus components. Then, while considering the AGN-disk emission, we decompose optical HST images. As a result, it is found that a classical bulge component is probably present, and its mass ($M_{\rm bulge}$) is consistent with an expected value from a local relation. Lastly, we analyze new quasi-simultaneous X-ray (0.2-30 keV) data obtained by NuSTAR and XMM-Newton. The X-ray spectrum can be reproduced by multi-color blackbody, warm and hot coronae, and disk and torus reflection components. Based on this, the spin is estimated to be $a_{\rm spin} = 0.998_{-0.814}$, which could suggest that most of the current BH mass was achieved by prolonged mass accretion. Given the presence of the bulge, POX 52 would have undergone a galaxy merger, while the $M_{\rm BH}$-$M_{\rm bulge}$ relation and the inferred prolonged accretion could suggest that AGN feedback occurred. Regarding the AGN structure, the spectral slope of the hot corona, its relative strength to the bolometric emission, and the torus structure are found to be consistent with Eddington-ratio dependencies found for nearby AGNs.


title: DEPN: Detecting and Editing Privacy Neurons in Pretrained Language Models

abstract: Large language models pretrained on a huge amount of data capture rich knowledge and information in the training data. The ability of data memorization and regurgitation in pretrained language models, revealed in previous studies, brings the risk of data leakage. In order to effectively reduce these risks, we propose a framework DEPN to Detect and Edit Privacy Neurons in pretrained language models, partially inspired by knowledge neurons and model editing. In DEPN, we introduce a novel method, termed as privacy neuron detector, to locate neurons associated with private information, and then edit these detected privacy neurons by setting their activations to zero. Furthermore, we propose a privacy neuron aggregator dememorize private information in a batch processing manner. Experimental results show that our method can significantly and efficiently reduce the exposure of private data leakage without deteriorating the performance of the model. Additionally, we empirically demonstrate the relationship between model memorization and privacy neurons, from multiple perspectives, including model size, training time, prompts, privacy neuron distribution, illustrating the robustness of our approach.


title: Tunnel Valley Current Filter in the Partially Overlapped Graphene under the Vertical Electric Field

abstract: The tunnel current (TC) and valley current (VC) are crucial in realizing high-speed and energy-saving in next-generation devices. This paper presents the TC and VC link in the partially overlapped graphene. Under the vertical electric field, the two graphene layers have the opposite AB sublattice symmetry, followed by a block on the intravalley transmission. In the allowed intervalley transmission, the difference in the phase of the decay factor prefers only one of the valleys in the output according to the overlapped length. These results suggest that the band gap with no edge state is a new platform of valleytronics.


title: Synthesizing Diabetic Foot Ulcer Images with Diffusion Model

abstract: Diabetic Foot Ulcer (DFU) is a serious skin wound requiring specialized care. However, real DFU datasets are limited, hindering clinical training and research activities. In recent years, generative adversarial networks and diffusion models have emerged as powerful tools for generating synthetic images with remarkable realism and diversity in many applications. This paper explores the potential of diffusion models for synthesizing DFU images and evaluates their authenticity through expert clinician assessments. Additionally, evaluation metrics such as Frechet Inception Distance (FID) and Kernel Inception Distance (KID) are examined to assess the quality of the synthetic DFU images. A dataset of 2,000 DFU images is used for training the diffusion model, and the synthetic images are generated by applying diffusion processes. The results indicate that the diffusion model successfully synthesizes visually indistinguishable DFU images. 70% of the time, clinicians marked synthetic DFU images as real DFUs. However, clinicians demonstrate higher unanimous confidence in rating real images than synthetic ones. The study also reveals that FID and KID metrics do not significantly align with clinicians' assessments, suggesting alternative evaluation approaches are needed. The findings highlight the potential of diffusion models for generating synthetic DFU images and their impact on medical training programs and research in wound detection and classification.


title: Contrastive Difference Predictive Coding

abstract: Predicting and reasoning about the future lie at the heart of many time-series questions. For example, goal-conditioned reinforcement learning can be viewed as learning representations to predict which states are likely to be visited in the future. While prior methods have used contrastive predictive coding to model time series data, learning representations that encode long-term dependencies usually requires large amounts of data. In this paper, we introduce a temporal difference version of contrastive predictive coding that stitches together pieces of different time series data to decrease the amount of data required to learn predictions of future events. We apply this representation learning method to derive an off-policy algorithm for goal-conditioned RL. Experiments demonstrate that, compared with prior RL methods, ours achieves $2 \times$ median improvement in success rates and can better cope with stochastic environments. In tabular settings, we show that our method is about $20 \times$ more sample efficient than the successor representation and $1500 \times$ more sample efficient than the standard (Monte Carlo) version of contrastive predictive coding.


title: Alternating Proximal Point Algorithm with Gradient Descent and Ascent Steps for Convex-Concave Saddle-Point Problems

abstract: Inspired by the Optimistic Gradient Ascent-Proximal Point Algorithm (OGAProx) proposed by Bo{\c{t}}, Csetnek, and Sedlmayer for solving a saddle-point problem associated with a convex-concave function with a nonsmooth coupling function and one regularizing function, we introduce the Alternating Proximal Point Algorithm with Gradient Descent and Ascent Steps for solving a saddle-point problem associated with a convex-concave function constructed by a smooth coupling function and two regularizing functions. In this work, we not only provide weak and linearly convergence of the sequence of iterations and of the minimax gap function evaluated at the ergodic sequences, similarly to what Bo{\c{t}} et al.\,did, but also demonstrate the convergence and linearly convergence of function values evaluated at convex combinations of iterations under convex and strongly convex assumptions, respectively.


title: Low regularity solutions for the surface quasi-geostrophic front equation

abstract: In this article we consider the low regularity well-posedness of the surface quasi-geostrophic (SQG) front equation. Recent work on other quasilinear models, including the gravity water waves system and nonlinear waves, have demonstrated that in presence of a null structure, a normal form analysis can substantially improve the low regularity theory. In the current article, we observe a null structure in the context of SQG fronts, and establish improved local and global well-posedness results.


title: EELBERT: Tiny Models through Dynamic Embeddings

abstract: We introduce EELBERT, an approach for compression of transformer-based models (e.g., BERT), with minimal impact on the accuracy of downstream tasks. This is achieved by replacing the input embedding layer of the model with dynamic, i.e. on-the-fly, embedding computations. Since the input embedding layer accounts for a significant fraction of the model size, especially for the smaller BERT variants, replacing this layer with an embedding computation function helps us reduce the model size significantly. Empirical evaluation on the GLUE benchmark shows that our BERT variants (EELBERT) suffer minimal regression compared to the traditional BERT models. Through this approach, we are able to develop our smallest model UNO-EELBERT, which achieves a GLUE score within 4% of fully trained BERT-tiny, while being 15x smaller (1.2 MB) in size.


title: Efficient Robust Bayesian Optimization for Arbitrary Uncertain Inputs

abstract: Bayesian Optimization (BO) is a sample-efficient optimization algorithm widely employed across various applications. In some challenging BO tasks, input uncertainty arises due to the inevitable randomness in the optimization process, such as machining errors, execution noise, or contextual variability. This uncertainty deviates the input from the intended value before evaluation, resulting in significant performance fluctuations in the final result. In this paper, we introduce a novel robust Bayesian Optimization algorithm, AIRBO, which can effectively identify a robust optimum that performs consistently well under arbitrary input uncertainty. Our method directly models the uncertain inputs of arbitrary distributions by empowering the Gaussian Process with the Maximum Mean Discrepancy (MMD) and further accelerates the posterior inference via Nystrom approximation. Rigorous theoretical regret bound is established under MMD estimation error and extensive experiments on synthetic functions and real problems demonstrate that our approach can handle various input uncertainties and achieve state-of-the-art performance.


title: A Note on the Convergence of the OGAProx

abstract: In this note, we consider the Optimistic Gradient Ascent-Proximal Point Algorithm (OGAProx) proposed by Bo{\c{t}}, Csetnek, and Sedlmayer for solving a saddle-point problem associated with a convex-concave function constructed by a nonsmooth coupling function and one regularizing function. We first provide a counterexample to show that the convergence of the minimax gap function, evaluated at the ergodic sequences, is insufficient to demonstrate the convergence of the function values evaluated at the ergodic sequences. Then under the same assumptions used by Bo{\c{t}} et al.\,for proving the convergence of the minimax gap function, we present convergence results for the function values evaluated at the ergodic sequences generated by the OGAProx with convergence rates of order $\mathcal{O}\left(\frac{1}{k}\right)$, $\mathcal{O}\left(\frac{1}{k^{2}}\right)$, and $\mathcal{O}\left(\theta^{k}\right)$ with $\theta \in (0,1)$ for the associated convex-concave coupling function being convex-concave, convex-strongly concave, and strongly convex-strongly concave, respectively.


title: Spinfoams: Foundations

abstract: Spinfoams provide a framework for the dynamics of loop quantum gravity that is manifestly covariant under the full four-dimensional diffeomorphism symmetry group of general relativity. In this way they complete the ideal of three-dimensional diffeomorphism covariance that consistently motivates loop quantum gravity at every step. Specifically, spinfoam models aim to provide a projector onto, and a physical inner product on, the simultaneous kernel of all of the constraints of loop quantum gravity by means of a discretization of the gravitational path integral. In the limit of small Planck constant, they are closely related to the path integral for Regge calculus, while at the same time retaining all of the tools of a canonical quantum theory of gravity. They may also be understood as generalizations of well-understood state sum models for topological quantum field theories. In this chapter, we review all of these aspects of spinfoams, as well as review in detail the derivation of the currently most used spinfoam model, the EPRL model, calculational tools for it, and the various extensions of it in the literature. We additionally summarize some of the successes and open problems in the field.


title: Decision-Making for Autonomous Vehicles with Interaction-Aware Behavioral Prediction and Social-Attention Neural Network

abstract: Autonomous vehicles need to accomplish their tasks while interacting with human drivers in traffic. It is thus crucial to equip autonomous vehicles with artificial reasoning to better comprehend the intentions of the surrounding traffic, thereby facilitating the accomplishments of the tasks. In this work, we propose a behavioral model that encodes drivers' interacting intentions into latent social-psychological parameters. Leveraging a Bayesian filter, we develop a receding-horizon optimization-based controller for autonomous vehicle decision-making which accounts for the uncertainties in the interacting drivers' intentions. For online deployment, we design a neural network architecture based on the attention mechanism which imitates the behavioral model with online estimated parameter priors. We also propose a decision tree search algorithm to solve the decision-making problem online. The proposed behavioral model is then evaluated in terms of its capabilities for real-world trajectory prediction. We further conduct extensive evaluations of the proposed decision-making module, in forced highway merging scenarios, using both simulated environments and real-world traffic datasets. The results demonstrate that our algorithms can complete the forced merging tasks in various traffic conditions while ensuring driving safety.


title: The NEO Surveyor Near Earth Asteroid Known Object Model

abstract: The known near-Earth object (NEO) population consists of over 32,000 objects, with a yearly discovery rate of over 3000 NEOs per year. An essential component of the next generation of NEO surveys is an understanding of the population of known objects, including an accounting of the discovery rate per year as a function of size. Using a near-Earth asteroid (NEA) reference model developed for NASA's NEO Surveyor (NEOS) mission and a model of the major current and historical ground-based surveys, an estimate of the current NEA survey completeness as a function of size and absolute magnitude has been determined (termed the Known Object Model; KOM). This allows for understanding of the intersection of the known catalog of NEAs and the objects expected to be observed by NEOS. The current NEA population is found to be $\sim38\%$ complete for objects larger than 140m, consistent with estimates by Harris & Chodas (2021). NEOS is expected to catalog more than two thirds of the NEAs larger than 140m, resulting in $\sim76\%$ of NEAs cataloged at the end of its 5 year nominal survey (Mainzer et al, 2023}, making significant progress towards the US Congressional mandate. The KOM estimates that $\sim77\%$ of the currently cataloged objects will be detected by NEOS, with those not detected contributing $\sim9\%$ to the final completeness at the end its 5 year mission. This model allows for placing the NEO Surveyor mission in the context of current surveys to more completely assess the progress toward the goal of cataloging the population of hazardous asteroids.


title: Unlearn What You Want to Forget: Efficient Unlearning for LLMs

abstract: Large language models (LLMs) have achieved significant progress from pre-training on and memorizing a wide range of textual data, however, this process might suffer from privacy issues and violations of data protection regulations. As a result, the ability to easily remove data related to individual users from such models while not deteriorating their predictive quality after the removal becomes increasingly important. To address these issues, in this work, we propose an efficient unlearning framework that could efficiently update LLMs without having to retrain the whole model after data removals, by introducing lightweight unlearning layers learned with a selective teacher-student objective into the transformers. In addition, we introduce a fusion mechanism to effectively combine different unlearning layers that learns to forget different sets of data to handle a sequence of forgetting operations. Experiments on classification and generation tasks demonstrate the effectiveness of our proposed methods compared to the state-of-the-art baselines.


title: Multi-Agent Consensus Seeking via Large Language Models

abstract: Multi-agent systems driven by large language models (LLMs) have shown promising abilities for solving complex tasks in a collaborative manner. This work considers a fundamental problem in multi-agent collaboration: consensus seeking. When multiple agents work together, we are interested in how they can reach a consensus through inter-agent negotiation. To that end, this work studies a consensus-seeking task where the state of each agent is a numerical value and they negotiate with each other to reach a consensus value. It is revealed that when not explicitly directed on which strategy should be adopted, the LLM-driven agents primarily use the average strategy for consensus seeking although they may occasionally use some other strategies. Moreover, this work analyzes the impact of the agent number, agent personality, and network topology on the negotiation process. The findings reported in this work can potentially lay the foundations for understanding the behaviors of LLM-driven multi-agent systems for solving more complex tasks. Furthermore, LLM-driven consensus seeking is applied to a multi-robot aggregation task. This application demonstrates the potential of LLM-driven agents to achieve zero-shot autonomous planning for multi-robot collaboration tasks. Project website: westlakeintelligentrobotics.github.io/ConsensusLLM/.


title: The Field Theory of Collective Cherenkov Radiation Associated with Electron Beams

abstract: Classical Cherenkov radiation is a celebrated physics phenomenon of electromagnetic (EM) radiation stimulated by an electric charge moving with constant velocity in a three dimensional dielectric medium. Cherenkov radiation has a wide spectrum and a particular distribution in space similar to the Mach cone created by a supersonic source. It is also characterized by the energy transfer from the charge's kinetic energy to the EM radiation. In the case of an electron beam passing through the middle of a an EM waveguide, the radiation is manifested as collective Cherenkov radiation. In this case the electron beam can be viewed as a one-dimensional non-neutral plasma whereas the waveguide can be viewed as a slow wave structure (SWS). This collective radiation occurs in particular in traveling wave tubes (TWTs), and it features the energy transfer from the electron beam to the EM radiation in the waveguide. Based on a Lagrangian field theory, we develop a convincing argument that the collective Cherenkov effect in TWTs is, in fact, a convective instability, that is, amplification. We also derive, for the first time, expressions identifying low- and high-frequency cutoffs for amplification in TWTs


title: Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision

abstract: Large language models (LLMs) have demonstrated remarkable capabilities in various tasks. However, their suitability for domain-specific tasks, is limited due to their immense scale at deployment, susceptibility to misinformation, and more importantly, high data annotation costs. We propose a novel Interactive Multi-Fidelity Learning (IMFL) framework for the cost-effective development of small domain-specific LMs under limited annotation budgets. Our approach formulates the domain-specific fine-tuning process as a multi-fidelity learning problem, focusing on identifying the optimal acquisition strategy that balances between low-fidelity automatic LLM annotations and high-fidelity human annotations to maximize model performance. We further propose an exploration-exploitation query strategy that enhances annotation diversity and informativeness, incorporating two innovative designs: 1) prompt retrieval that selects in-context examples from human-annotated samples to improve LLM annotation, and 2) variable batch size that controls the order for choosing each fidelity to facilitate knowledge distillation, ultimately enhancing annotation quality. Extensive experiments on financial and medical tasks demonstrate that IMFL achieves superior performance compared with single fidelity annotations. Given a limited budget of human annotation, IMFL significantly outperforms the human annotation baselines in all four tasks and achieves very close performance as human annotations on two of the tasks. These promising results suggest that the high human annotation costs in domain-specific tasks can be significantly reduced by employing IMFL, which utilizes fewer human annotations, supplemented with cheaper and faster LLM (e.g., GPT-3.5) annotations to achieve comparable performance.


title: A Quantum Optimization Method for Geometric Constrained Image Segmentation

abstract: Quantum image processing is a growing field attracting attention from both the quantum computing and image processing communities. We propose a novel method in combining a graph-theoretic approach for optimal surface segmentation and hybrid quantum-classical optimization of the problem-directed graph. The surface segmentation is modeled classically as a graph partitioning problem in which a smoothness constraint is imposed to control surface variation for realistic segmentation. Specifically, segmentation refers to a source set identified by a minimum s-t cut that divides graph nodes into the source (s) and sink (t) sets. The resulting surface consists of graph nodes located on the boundary between the source and the sink. Characteristics of the problem-specific graph, including its directed edges, connectivity, and edge capacities, are embedded in a quadratic objective function whose minimum value corresponds to the ground state energy of an equivalent Ising Hamiltonian. This work explores the use of quantum processors in image segmentation problems, which has important applications in medical image analysis. Here, we present a theoretical basis for the quantum implementation of LOGISMOS and the results of a simulation study on simple images. Quantum Approximate Optimization Algorithm (QAOA) approach was utilized to conduct two simulation studies whose objective was to determine the ground state energies and identify bitstring solutions that encode the optimal segmentation of objective functions. The objective function encodes tasks associated with surface segmentation in 2-D and 3-D images while incorporating a smoothness constraint. In this work, we demonstrate that the proposed approach can solve the geometric-constrained surface segmentation problem optimally with the capability of locating multiple minimum points corresponding to the globally minimal solution.


title: MLatom 3: Platform for machine learning-enhanced computational chemistry simulations and workflows

abstract: Machine learning (ML) is increasingly becoming a common tool in computational chemistry. At the same time, the rapid development of ML methods requires a flexible software framework for designing custom workflows. MLatom 3 is a program package designed to leverage the power of ML to enhance typical computational chemistry simulations and to create complex workflows. This open-source package provides plenty of choice to the users who can run simulations with the command line options, input files, or with scripts using MLatom as a Python package, both on their computers and on the online XACS cloud computing at XACScloud.com. Computational chemists can calculate energies and thermochemical properties, optimize geometries, run molecular and quantum dynamics, and simulate (ro)vibrational, one-photon UV/vis absorption, and two-photon absorption spectra with ML, quantum mechanical, and combined models. The users can choose from an extensive library of methods containing pre-trained ML models and quantum mechanical approximations such as AIQM1 approaching coupled-cluster accuracy. The developers can build their own models using various ML algorithms. The great flexibility of MLatom is largely due to the extensive use of the interfaces to many state-of-the-art software packages and libraries.


title: Alternating Proximity Mapping Method for Strongly Convex-Strongly Concave Saddle-Point Problems

abstract: This is a continuation of our previous work entitled \enquote{Alternating Proximity Mapping Method for Convex-Concave Saddle-Point Problems}, in which we proposed the alternating proximal mapping method and showed convergence results on the sequence of our iterates, the sequence of averages of our iterates, and the sequence of function values evaluated at the averages of the iterates for solving convex-concave saddle-point problems. In this work, we extend the application of the alternating proximal mapping method to solve strongly convex-strongly concave saddle-point problems. We demonstrate two sets of sufficient conditions and also their simplified versions, which guarantee the linear convergence of the sequence of iterates towards a desired saddle-point. Additionally, we provide two sets of sufficient conditions, along with their simplified versions, that ensure the linear convergence of the sequence of function values evaluated at the convex combinations of iteration points to the desired function value of a saddle-point.


title: Electrically empowered microcomb laser

abstract: Optical frequency comb underpins a wide range of applications from communication, metrology, to sensing. Its development on a chip-scale platform -- so called soliton microcomb -- provides a promising path towards system miniaturization and functionality integration via photonic integrated circuit (PIC) technology. Although extensively explored in recent years, challenges remain in key aspects of microcomb such as complex soliton initialization, high threshold, low power efficiency, and limited comb reconfigurability. Here we present an on-chip laser that directly outputs microcomb and resolves all these challenges, with a distinctive mechanism created from synergetic interaction among resonant electro-optic effect, optical Kerr effect, and optical gain inside the laser cavity. Realized with integration between a III-V gain chip and a thin-film lithium niobate (TFLN) PIC, the laser is able to directly emit mode-locked microcomb on demand with robust turnkey operation inherently built in, with individual comb linewidth down to 600 Hz, whole-comb frequency tuning rate exceeding $\rm 2.4\times10^{17}$ Hz/s, and 100% utilization of optical power fully contributing to comb generation. The demonstrated approach unifies architecture and operation simplicity, high-speed reconfigurability, and multifunctional capability enabled by TFLN PIC, opening up a great avenue towards on-demand generation of mode-locked microcomb that is expected to have profound impact on broad applications.


title: GAR-meets-RAG Paradigm for Zero-Shot Information Retrieval

abstract: Given a query and a document corpus, the information retrieval (IR) task is to output a ranked list of relevant documents. Combining large language models (LLMs) with embedding-based retrieval models, recent work shows promising results on the zero-shot retrieval problem, i.e., no access to labeled data from the target domain. Two such popular paradigms are generation-augmented retrieval or GAR (generate additional context for the query and then retrieve), and retrieval-augmented generation or RAG (retrieve relevant documents as context and then generate answers). The success of these paradigms hinges on (i) high-recall retrieval models, which are difficult to obtain in the zero-shot setting, and (ii) high-precision (re-)ranking models which typically need a good initialization. In this work, we propose a novel GAR-meets-RAG recurrence formulation that overcomes the challenges of existing paradigms. Our method iteratively improves retrieval (via GAR) and rewrite (via RAG) stages in the zero-shot setting. A key design principle is that the rewrite-retrieval stages improve the recall of the system and a final re-ranking stage improves the precision. We conduct extensive experiments on zero-shot passage retrieval benchmarks, BEIR and TREC-DL. Our method establishes a new state-of-the-art in the BEIR benchmark, outperforming previous best results in Recall@100 and nDCG@10 metrics on 6 out of 8 datasets, with up to 17% relative gains over the previous best.


title: Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts

abstract: Visual question answering (VQA) is the task of answering questions about an image. The task assumes an understanding of both the image and the question to provide a natural language answer. VQA has gained popularity in recent years due to its potential applications in a wide range of fields, including robotics, education, and healthcare. In this paper, we focus on knowledge-augmented VQA, where answering the question requires commonsense knowledge, world knowledge, and reasoning about ideas and concepts not present in the image. We propose a multimodal framework that uses language guidance (LG) in the form of rationales, image captions, scene graphs, etc to answer questions more accurately. We benchmark our method on the multi-choice question-answering task of the A-OKVQA, Science-QA, VSR, and IconQA datasets using CLIP and BLIP models. We show that the use of language guidance is a simple but powerful and effective strategy for visual question answering. Our language guidance improves the performance of CLIP by 7.6% and BLIP-2 by 4.8% in the challenging A-OKVQA dataset. We also observe consistent improvement in performance on the Science-QA, VSR, and IconQA datasets when using the proposed language guidances. The implementation of LG-VQA is publicly available at https:// github.com/declare-lab/LG-VQA.


title: On the Relationship between Code Verifiability and Understandability

abstract: Proponents of software verification have argued that simpler code is easier to verify: that is, that verification tools issue fewer false positives and require less human intervention when analyzing simpler code. We empirically validate this assumption by comparing the number of warnings produced by four state-of-the-art verification tools on 211 snippets of Java code with 20 metrics of code comprehensibility from human subjects in six prior studies. Our experiments, based on a statistical (meta-)analysis, show that, in aggregate, there is a small correlation (r = 0.23) between understandability and verifiability. The results support the claim that easy-to-verify code is often easier to understand than code that requires more effort to verify. Our work has implications for the users and designers of verification tools and for future attempts to automatically measure code comprehensibility: verification tools may have ancillary benefits to understandability, and measuring understandability may require reasoning about semantic, not just syntactic, code properties.


title: Sulphur isotopes toward Sagittarius B2 extended envelope in the Galactic Center

abstract: The isotopic ratios are good tools for probing the stellar nucleosynthesis and chemical evolution. We performed high-sensitivity mapping observations of the J=7-6 rotational transitions of OCS, OC34S, O13CS, and OC33S toward the Galactic Center giant molecular cloud, Sagittarius B2 (Sgr B2) with IRAM 30m telescope. Positions with optically thin and uncontaminated lines are chosen to determine the sulfur isotope ratios. A 32S/34S ratio of 17.1\pm0.9 was derived with OCS and OC34S lines, while 34S/33S ratio of 6.8\pm1.9 was derived directly from integrated intensity ratio of OC34S and OC33S. With independent and accurate measurements of 32S/34S ratio, our results confirm the termination of the decreasing trend of 32S/34S ratios toward the Galactic Center, suggesting a drop in the production of massive stars at the Galactic centre.


title: Is Robustness Transferable across Languages in Multilingual Neural Machine Translation?

abstract: Robustness, the ability of models to maintain performance in the face of perturbations, is critical for developing reliable NLP systems. Recent studies have shown promising results in improving the robustness of models through adversarial training and data augmentation. However, in machine translation, most of these studies have focused on bilingual machine translation with a single translation direction. In this paper, we investigate the transferability of robustness across different languages in multilingual neural machine translation. We propose a robustness transfer analysis protocol and conduct a series of experiments. In particular, we use character-, word-, and multi-level noises to attack the specific translation direction of the multilingual neural machine translation model and evaluate the robustness of other translation directions. Our findings demonstrate that the robustness gained in one translation direction can indeed transfer to other translation directions. Additionally, we empirically find scenarios where robustness to character-level noise and word-level noise is more likely to transfer.


title: A Perturbative Solution to the Linear Influence/Network Autocorrelation Model Under Network Dynamics

abstract: Known by many names and arising in many settings, the forced linear diffusion model is central to the modeling of power and influence within social networks (while also serving as the mechanistic justification for the widely used spatial/network autocorrelation models). The standard equilibrium solution to the diffusion model depends on strict timescale separation between network dynamics and attribute dynamics, such that the diffusion network can be considered fixed with respect to the diffusion process. Here, we consider a relaxation of this assumption, in which the network changes only slowly relative to the diffusion dynamics. In this case, we show that one can obtain a perturbative solution to the diffusion model, which depends on knowledge of past states in only a minimal way.


title: Highly Anisotropic Elastic Properties of Suspended Black Arsenic Nanoribbons

abstract: Anisotropy, as an exotic degree of freedom, enables us to discover the emergent two-dimensional (2D) layered nanomaterials with low in-plane symmetry and to explore their outstanding properties and promising applications. 2D black arsenic (b-As) with puckered structure has garnered increasing attention these years owing to its extreme anisotropy with respect to the electrical, thermal, and optical properties. However, the investigation on mechanical properties of 2D b-As is still lacking, despite much effort on theoretical simulations. Herein, we report the highly anisotropic elastic properties of suspended b-As nanoribbons via atomic force microscope-based nanoindentation. It was found that the extracted Young's modulus of b-As nanoribbons exhibits remarkable anisotropy, which approximates to 72.2 +- 5.4 and 44.3 +- 1.4 GPa along zigzag and armchair directions, respectively. The anisotropic ratio reaches up to ~ 1.6. We expect that these results could lay a solid foundation for the potential applications of 2D anisotropic nanomaterials in the next-generation nanomechanics and optoelectronics.


title: Extended Asymptotic Identifiability of Nonparametric Item Response Models

abstract: Nonparametric item response models provide a flexible framework in psychological and educational measurements. Douglas (2001) established asymptotic identifiability for a class of models with nonparametric response functions for long assessments. Nevertheless, the model class examined in Douglas (2001) excludes several popular parametric item response models. This limitation can hinder the applications in which nonparametric and parametric models are compared, such as evaluating model goodness-of-fit. To address this issue, We consider an extended nonparametric model class that encompasses most parametric models and establish asymptotic identifiability. The results bridge the parametric and nonparametric item response models and provide a solid theoretical foundation for the applications of nonparametric item response models for assessments with many items.


title: Low-dimensional polaritonics: Emergent non-trivial topology on exciton-polariton simulators

abstract: Polaritonic lattice configurations in dimensions $D=2$ are used as simulators of topological phases, based on symmetry class A Hamiltonians. Numerical and topological studies are performed in order to characterise the bulk topology of insulating phases, which is predicted to be connected to non-trivial edge mode states on the boundary. By using spectral flattened Hamiltonians on specific lattice geometries with time reversal symmetry breaking, e.g. Kagome lattice, we obtain maps from the Brillouin zone into Grassmannian spaces, which are further investigated by the topological method of space fibrations. Numerical evidence reveals a connection between the sum of valence band Chern numbers and the index of the projection operator onto the valence band states. Along these lines, we discover an index formula which resembles other index theorems and the classical result of Atiyah-Singer, but without any Dirac operator and from a different perspective. Through a combination of different tools, in particular homotopy and homology-cohomology duality, we provide a comprehensive mathematical framework, which fully addresses the source and structure of topological phases in coupled polaritonic array systems. Based on these results, it becomes possible to infer further designs and models of two-dimensional single sheet Chern insulators, implemented as polariton simulators.


title: Phase-Modulated Elastic Properties of Two-Dimensional Magnetic FeTe: Hexagonal and Tetragonal Polymorphs

abstract: Two-dimensional (2D) layered magnets, such as iron chalcogenides, have emerged these years as a new family of unconventional superconductor and provided the key insights to understand the phonon-electron interaction and pairing mechanism. Their mechanical properties are of strategic importance for the potential applications in spintronics and optoelectronics. However, there is still lack of efficient approach to tune the elastic modulus despite the extensive studies. Herein, we report the modulated elastic modulus of 2D magnetic FeTe and its thickness-dependence via phase engineering. The grown 2D FeTe by chemical vapor deposition can present various polymorphs, i.e. tetragonal FeTe (t-FeTe, antiferromagnetic) and hexagonal FeTe (h-FeTe, ferromagnetic). The measured Young's modulus of t-FeTe by nanoindentation method showed an obvious thickness-dependence, from 290.9+-9.2 to 113.0+-8.7 GPa when the thicknesses increased from 13.2 to 42.5 nm, respectively. In comparison, the elastic modulus of h-FeTe remains unchanged. Our results could shed light on the efficient modulation of mechanical properties of 2D magnetic materials and pave the avenues for their practical applications in nanodevices.


title: Understanding and Visualizing Droplet Distributions in Simulations of Shallow Clouds

abstract: Thorough analysis of local droplet-level interactions is crucial to better understand the microphysical processes in clouds and their effect on the global climate. High-accuracy simulations of relevant droplet size distributions from Large Eddy Simulations (LES) of bin microphysics challenge current analysis techniques due to their high dimensionality involving three spatial dimensions, time, and a continuous range of droplet sizes. Utilizing the compact latent representations from Variational Autoencoders (VAEs), we produce novel and intuitive visualizations for the organization of droplet sizes and their evolution over time beyond what is possible with clustering techniques. This greatly improves interpretation and allows us to examine aerosol-cloud interactions by contrasting simulations with different aerosol concentrations. We find that the evolution of the droplet spectrum is similar across aerosol levels but occurs at different paces. This similarity suggests that precipitation initiation processes are alike despite variations in onset times.


title: Plateau borders in soap films and Gauss' capillarity theory

abstract: We provide, in the setting of Gauss' capillarity theory, a rigorous derivation of the equilibrium law for the three dimensional structures known as Plateau borders which arise in "wet" soap films and foams. A key step in our analysis is a complete measure-theoretic overhaul of the homotopic spanning condition introduced by Harrison and Pugh in the study of Plateau's laws for two-dimensional area minimizing surfaces ("dry" soap films). This new point of view allows us to obtain effective compactness theorems and energy representation formulae for the homotopic spanning relaxation of Gauss' capillarity theory which, in turn, lead to prove sharp regularity properties of energy minimizers. The equilibrium law for Plateau borders in wet foams is also addressed as a (simpler) variant of the theory for wet soap films.


title: DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text

abstract: Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known information. Retrieval-augmented LLMs have emerged as a potential solution to ground LLMs in external knowledge. Nonetheless, recent approaches have primarily emphasized retrieval from unstructured text corpora, owing to its seamless integration into prompts. When using structured data such as knowledge graphs, most methods simplify it into natural text, neglecting the underlying structures. Moreover, a significant gap in the current landscape is the absence of a realistic benchmark for evaluating the effectiveness of grounding LLMs on heterogeneous knowledge sources (e.g., knowledge base and text). To fill this gap, we have curated a comprehensive dataset that poses two unique challenges: (1) Two-hop multi-source questions that require retrieving information from both open-domain structured and unstructured knowledge sources; retrieving information from structured knowledge sources is a critical component in correctly answering the questions. (2) The generation of symbolic queries (e.g., SPARQL for Wikidata) is a key requirement, which adds another layer of challenge. Our dataset is created using a combination of automatic generation through predefined reasoning chains and human annotation. We also introduce a novel approach that leverages multiple retrieval tools, including text passage retrieval and symbolic language-assisted retrieval. Our model outperforms previous approaches by a significant margin, demonstrating its effectiveness in addressing the above-mentioned reasoning challenges.


title: The Dependence of Joy's Law as a Function of Flux Emergence Phase

abstract: Data from the Michelson Doppler Imager (MDI) and Helioseismic and Magnetic Imager (HMI) are analyzed from 1996 to 2023 to investigate tilt angles ($\gamma$) of bipolar magnetic regions and Joy's Law for Cycles 23, 24, and a portion of 25. The HMI radial magnetic field ($B_{r}$) and MDI magnetogram ($B_{los}$) data are used to calculate ($\gamma$) using the flux-weighted centroids of the positive and negative polarities. Each AR is only sampled once. The analysis includes only Beta ($\beta$)-class active regions since computing $\gamma$ of complex active regions is less meaningful. During the emergence of the ARs, we find that the average tilt angle ($\bar{\gamma}$) increases from 3.30$^{\circ}\pm$0.75 when 20\% of the flux has emerged to 6.79$^{\circ}\pm$0.66 when the ARs are at their maximum flux. Cycle 24 had a larger average tilt $\bar{\gamma}_{24}$=6.67$\pm$0.66 than Cycle 23, $\bar{\gamma}_{23}$=5.11$\pm$0.61. There are persistent differences in $\bar{\gamma}$ in the hemispheres with the southern hemisphere having higher ${\bar{\gamma}}$ in Cycles 23 and 24 but the errors are such that these differences are not statistically significant.