title: Locally Phase-Engineered MoTe$_2$ for Near-Infrared Photodetectors

abstract: Transition metal dichalcogenides (TMDs) are ideal systems for two-dimensional (2D) optoelectronic applications, owing to their strong light-matter interaction and various band gap energies. New techniques to modify the crystallographic phase of TMDs have recently been discovered, allowing the creation of lateral heterostructures and the design of all-2D circuitry. Thus far, the potential benefits of phase-engineered TMD devices for optoelectronic applications are still largely unexplored. The dominant mechanisms involved in the photocurrent generation in these systems remain unclear, hindering further development of new all-2D optoelectronic devices. Here, we fabricate locally phase-engineered MoTe$_{2}$ optoelectronic devices, creating a metal (1T') semiconductor (2H) lateral junction and unveil the main mechanisms at play for photocurrent generation. We find that the photocurrent originates from the 1T'-2H junction, with a maximum at the 2H MoTe$_{2}$ side of the junction. This observation, together with the non-linear IV-curve, indicates that the photovoltaic effect plays a major role on the photon-to-charge current conversion in these systems. Additionally, the 1T'-2H MoTe$_{2}$ heterojunction device exhibits a fast optoelectronic response over a wavelength range of 700 nm to 1100 nm, with a rise and fall times of 113 $\mu$s and 110 $\mu$s, two orders of magnitude faster when compared to a directly contacted 2H MoTe$_{2}$ device. These results show the potential of local phase-engineering for all-2D optoelectronic circuitry.


title: Multi-Agent Transfer Learning via Temporal Contrastive Learning

abstract: This paper introduces a novel transfer learning framework for deep multi-agent reinforcement learning. The approach automatically combines goal-conditioned policies with temporal contrastive learning to discover meaningful sub-goals. The approach involves pre-training a goal-conditioned agent, finetuning it on the target domain, and using contrastive learning to construct a planning graph that guides the agent via sub-goals. Experiments on multi-agent coordination Overcooked tasks demonstrate improved sample efficiency, the ability to solve sparse-reward and long-horizon problems, and enhanced interpretability compared to baselines. The results highlight the effectiveness of integrating goal-conditioned policies with unsupervised temporal abstraction learning for complex multi-agent transfer learning. Compared to state-of-the-art baselines, our method achieves the same or better performances while requiring only 21.7% of the training samples.


title: A Theory of Learnability for Offline Decision Making

abstract: We study the problem of offline decision making, which focuses on learning decisions from datasets only partially correlated with the learning objective. While previous research has extensively studied specific offline decision making problems like offline reinforcement learning (RL) and off-policy evaluation (OPE), a unified framework and theory remain absent. To address this gap, we introduce a unified framework termed Decision Making with Offline Feedback (DMOF), which captures a wide range of offline decision making problems including offline RL, OPE, and offline partially observable Markov decision processes (POMDPs). For the DMOF framework, we introduce a hardness measure called the Offline Estimation Coefficient (OEC), which measures the learnability of offline decision making problems and is also reflected in the derived minimax lower bounds. Additionally, we introduce an algorithm called Empirical Decision with Divergence (EDD), for which we establish both an instance-dependent upper bound and a minimax upper bound. The minimax upper bound almost matches the lower bound determined by the OEC. Finally, we show that EDD achieves a fast convergence rate (i.e., a rate scaling as $1/N$, where $N$ is the sample size) for specific settings such as supervised learning and Markovian sequential problems~(e.g., MDPs) with partial coverage.


title: Hypertoric Fukaya categories and categories O

abstract: To a conical symplectic resolution with Hamiltonian torus action, Braden--Proudfoot--Licata--Webster associate a category O, defined using deformation quantization (DQ) modules. It has long been expected, though not stated precisely in the literature, that category O also admits a "Betti-type" realization as the Fukaya--Seidel category of a Lefschetz fibration. In this paper, we confirm that the category O associated to a toric hyperk\"ahler manifold is equivalent to the partially wrapped Fukaya category of a Liouville manifold stopped by the fiber of a J-holomorphic moment map. The proof involves relating earlier DQ-module computations to a new computation of microlocal perverse sheaves. Leveraging known results on (de Rham) hypertoric category O, we deduce several Floer-theoretic consequences, including formality of simple objects and Koszul duality for the (fully) wrapped Fukaya category; conversely, by applying results about microlocal sheaves, we produce a relative Calabi-Yau structure on category O.


title: Convolutional Unscented Kalman Filter for Multi-Object Tracking with Outliers

abstract: Multi-object tracking (MOT) is an essential technique for navigation in autonomous driving. In tracking-by-detection systems, biases, false positives, and misses, which are referred to as outliers, are inevitable due to complex traffic scenarios. Recent tracking methods are based on filtering algorithms that overlook these outliers, leading to reduced tracking accuracy or even loss of the objects trajectory. To handle this challenge, we adopt a probabilistic perspective, regarding the generation of outliers as misspecification between the actual distribution of measurement data and the nominal measurement model used for filtering. We further demonstrate that, by designing a convolutional operation, we can mitigate this misspecification. Incorporating this operation into the widely used unscented Kalman filter (UKF) in commonly adopted tracking algorithms, we derive a variant of the UKF that is robust to outliers, called the convolutional UKF (ConvUKF). We show that ConvUKF maintains the Gaussian conjugate property, thus allowing for real-time tracking. We also prove that ConvUKF has a bounded tracking error in the presence of outliers, which implies robust stability. The experimental results on the KITTI and nuScenes datasets show improved accuracy compared to representative baseline algorithms for MOT tasks.


title: Distillation and Stripping purification plants for JUNO liquid scintillator

abstract: The optical and radiochemical purification of the scintillating liquid, which will fill the central detector of the JUNO experiment, plays a crucial role in achieving its scientific goals. Given its gigantic mass and dimensions and an unprecedented target value of about 3% @ 1 MeV in energy resolution, JUNO has set severe requirements on the parameters of its scintillator, such as attenuation length (Lat>20 m at 430 nm), transparency, light yield, and content of radioactive contaminants (238U,232Th<10-15 g/g). To accomplish these needs, the scintillator will be processed using several purification methods, including distillation in partial vacuum and gas stripping, which are performed in two large scale plants installed at the JUNO site. In this paper, layout, operating principles, and technical aspects which have driven the design and construction of the distil- lation and gas stripping plants are reviewed. The distillation is effective in enhancing the optical properties and removing heavy radio-impurities (238U,232Th, 40K), while the stripping process exploits pure water steam and high-purity nitrogen to extract gaseous contaminants (222Rn, 39Ar, 85Kr, O2) from the scintillator. The plant operating parameters have been tuned during the recent com- missioning phase at the JUNO site and several QA/QC measurements and tests have been performed to evaluate the performances of the plants. Some preliminary results on the efficiency of these purification processes will be shown.


title: Do Large Language Models Perform the Way People Expect? Measuring the Human Generalization Function

abstract: What makes large language models (LLMs) impressive is also what makes them hard to evaluate: their diversity of uses. To evaluate these models, we must understand the purposes they will be used for. We consider a setting where these deployment decisions are made by people, and in particular, people's beliefs about where an LLM will perform well. We model such beliefs as the consequence of a human generalization function: having seen what an LLM gets right or wrong, people generalize to where else it might succeed. We collect a dataset of 19K examples of how humans make generalizations across 79 tasks from the MMLU and BIG-Bench benchmarks. We show that the human generalization function can be predicted using NLP methods: people have consistent structured ways to generalize. We then evaluate LLM alignment with the human generalization function. Our results show that -- especially for cases where the cost of mistakes is high -- more capable models (e.g. GPT-4) can do worse on the instances people choose to use them for, exactly because they are not aligned with the human generalization function.


title: Decoherence in electron transport: back-scattering, effect on interference and rectification

abstract: Decoherence is an undesirable, but ubiquitous phenomenon in quantum systems. Here, we study the effect of partial decoherence, induced via a B\"uttiker probe, on two-terminal electronic transport across one-dimensional quantum wires and rings, in both the linear and non-linear regimes. We find that dephasing causes backscattering when introduced locally in a ballistic channel. Further, we find that decoherence results in rectification when inversion is broken in the two-terminal transport set-up by a combination of a local dephasing centre and a static impurity. Interestingly, the rectification strength and even its direction varies strongly with the relative distance between the probe and the scatterer. We further analyze how decoherence affects characteristic quantum effects in electronic transport, such as, Fabry-P\'erot oscillations in double-barrier setups, and Aharonov-Bohm interference in one-dimensional rings, and find that the amplitude of oscillations in conductance is reduced by decoherence.


title: Extending Structural Causal Models for Use in Autonomous Embodied Systems

abstract: Much work has been done to develop causal reasoning techniques across a number of domains, however the utilisation of causality within autonomous systems is still in its infancy. Autonomous systems would greatly benefit from the integration of causality through the use of representations such as structural causal models (SCMs). The system would be afforded a higher level of transparency, it would enable post-hoc explanations of outcomes, and assist in the online inference of exogenous variables. These qualities are either directly beneficial to the autonomous system or a valuable step in building public trust and informing regulation. To such an end we present a case study in which we describe a module-based autonomous driving system comprised of SCMs. Approaching this task requires considerations of a number of challenges when dealing with a system of great complexity and size, that must operate for extended periods of time by itself. Here we describe these challenges, and present solutions. The first of these is SCM contexts, with the remainder being three new variable categories -- two of which are based upon functional programming monads. Finally, we conclude by presenting an example application of the causal capabilities of the autonomous driving system. In this example, we aim to attribute culpability between vehicular agents in a hypothetical road collision incident.


title: Mn$_2$C MXene Functionalized by Oxygen is a Semiconducting Antiferromagnet and Efficient Visible Light Absorber

abstract: Manganese-based MXenes are promising two-dimensional materials due to the broad palette of their magnetic phases and the possibility of experimental preparation because the corresponding MAX phase was already prepared. Here, we systematically investigated geometrical conformers and spin solutions of oxygen-terminated Mn$_2$C MXene and performed subsequent many-body calculations to obtain reliable electronic and optical properties. Allowing energy-lowering using the correct spin ordering via supercell magnetic motifs is essential for the Mn$_2$CO$_2$ system. The stable ground-state Mn$_2$CO$_2$ conformation is antiferromagnetic (AFM) one with zigzag lines of up and down spins on Mn atoms. The AFM nature is consistent with the parent MAX phase and even the clean depleted Mn$_2$C sheet. Other magnetic states and geometrical conformations are energetically very close, providing state-switching possibilities in the material. Subsequent many-body GW and Bethe-Salpeter equation (BSE) calculations provide indirect semiconductor characteristics of AFM Mn$_2$CO$_2$ with a fundamental gap of 2.1 eV (and a direct gap of 2.4 eV), the first bright optical transition at 1.3 eV and extremely strongly bounded (1.1 eV) first bright exciton. Mn$_2$CO$_2$ absorbs efficiently the whole visible light range and near ultraviolet range (between 10 - 20%).


title: Combinatorial Multivariant Multi-Armed Bandits with Applications to Episodic Reinforcement Learning and Beyond

abstract: We introduce a novel framework of combinatorial multi-armed bandits (CMAB) with multivariant and probabilistically triggering arms (CMAB-MT), where the outcome of each arm is a $d$-dimensional multivariant random variable and the feedback follows a general arm triggering process. Compared with existing CMAB works, CMAB-MT not only enhances the modeling power but also allows improved results by leveraging distinct statistical properties for multivariant random variables. For CMAB-MT, we propose a general 1-norm multivariant and triggering probability-modulated smoothness condition, and an optimistic CUCB-MT algorithm built upon this condition. Our framework can include many important problems as applications, such as episodic reinforcement learning (RL) and probabilistic maximum coverage for goods distribution, all of which meet the above smoothness condition and achieve matching or improved regret bounds compared to existing works. Through our new framework, we build the first connection between the episodic RL and CMAB literature, by offering a new angle to solve the episodic RL through the lens of CMAB, which may encourage more interactions between these two important directions.


title: Partial data inverse problems for reaction-diffusion and heat equations

abstract: We study partial data inverse problems for linear and nonlinear parabolic equations with unknown time-dependent coefficients. In particular, we prove uniqueness results for partial data inverse problems for semilinear reaction-diffusion equations where Dirichlet boundary data and Neumann measurements of solutions are restricted to any open subset of the boundary. We also prove injectivity of the Fr\'{e}chet derivative of the partial Dirichlet-to-Neumann map associated to heat equations. Our proof consists of two crucial ingredients; (i) we introduce an asymptotic family of spherical quasimodes that approximately solve heat equations modulo an exponentially decaying remainder term and (ii) the asymptotic study of a weighted Laplace transform of the unknown coefficient along a straight line segment in the domain where the weight may be viewed as a semiclassical symbol that itself depends on the complex-valued frequency. The latter analysis will rely on Phragm\'{e}n-Lindel\"{o}f principle and Gr\"{o}nwall inequality.


title: AutoStudio: Crafting Consistent Subjects in Multi-turn Interactive Image Generation

abstract: As cutting-edge Text-to-Image (T2I) generation models already excel at producing remarkable single images, an even more challenging task, i.e., multi-turn interactive image generation begins to attract the attention of related research communities. This task requires models to interact with users over multiple turns to generate a coherent sequence of images. However, since users may switch subjects frequently, current efforts struggle to maintain subject consistency while generating diverse images. To address this issue, we introduce a training-free multi-agent framework called AutoStudio. AutoStudio employs three agents based on large language models (LLMs) to handle interactions, along with a stable diffusion (SD) based agent for generating high-quality images. Specifically, AutoStudio consists of (i) a subject manager to interpret interaction dialogues and manage the context of each subject, (ii) a layout generator to generate fine-grained bounding boxes to control subject locations, (iii) a supervisor to provide suggestions for layout refinements, and (iv) a drawer to complete image generation. Furthermore, we introduce a Parallel-UNet to replace the original UNet in the drawer, which employs two parallel cross-attention modules for exploiting subject-aware features. We also introduce a subject-initialized generation method to better preserve small subjects. Our AutoStudio hereby can generate a sequence of multi-subject images interactively and consistently. Extensive experiments on the public CMIGBench benchmark and human evaluations show that AutoStudio maintains multi-subject consistency across multiple turns well, and it also raises the state-of-the-art performance by 13.65% in average Frechet Inception Distance and 2.83% in average character-character similarity.


title: RL in Latent MDPs is Tractable: Online Guarantees via Off-Policy Evaluation

abstract: In many real-world decision problems there is partially observed, hidden or latent information that remains fixed throughout an interaction. Such decision problems can be modeled as Latent Markov Decision Processes (LMDPs), where a latent variable is selected at the beginning of an interaction and is not disclosed to the agent. In the last decade, there has been significant progress in solving LMDPs under different structural assumptions. However, for general LMDPs, there is no known learning algorithm that provably matches the existing lower bound (Kwon et al., 2021). We introduce the first sample-efficient algorithm for LMDPs without any additional structural assumptions. Our result builds off a new perspective on the role of off-policy evaluation guarantees and coverage coefficients in LMDPs, a perspective, that has been overlooked in the context of exploration in partially observed environments. Specifically, we establish a novel off-policy evaluation lemma and introduce a new coverage coefficient for LMDPs. Then, we show how these can be used to derive near-optimal guarantees of an optimistic exploration algorithm. These results, we believe, can be valuable for a wide range of interactive learning problems beyond LMDPs, and especially, for partially observed environments.


title: How to design research-aligned DEI interventions in physics

abstract: This article provides resources to design effective diversity, equity and inclusion (DEI) interventions in physics settings. It summarizes critiques of DEI interventions and reviews research findings suggesting that DEI interventions show modest but positive benefits. It covers physics-specific concerns around DEI (resistance from skeptical participants, unintended negative consequences for members of minoritized groups). The article then explores six design questions: 1) What are the intended outcomes of the intervention? (with a list of possible outcomes) 2) How will the intervention be justified to participants? 3) Will the intervention be voluntary or required? 4) Who will the participants be? 5) What activities will the intervention consist of? (with suggested activities paired to outcomes) 6) How will you know whether the intervention worked? (with tools used by other researchers to measure particular outcomes, and bonus suggestions for how to carry out publication-worthy evaluations). Each question is explored using research results and recommendations, and illustrated using examples from physics and other STEM settings.


title: Knowledge Graph in Astronomical Research with Large Language Models: Quantifying Driving Forces in Interdisciplinary Scientific Discovery

abstract: Identifying and predicting the factors that contribute to the success of interdisciplinary research is crucial for advancing scientific discovery. However, there is a lack of methods to quantify the integration of new ideas and technological advancements in astronomical research and how these new technologies drive further scientific breakthroughs. Large language models, with their ability to extract key concepts from vast literature beyond keyword searches, provide a new tool to quantify such processes. In this study, we extracted concepts in astronomical research from 297,807 publications between 1993 and 2024 using large language models, resulting in a set of 24,939 concepts. These concepts were then used to form a knowledge graph, where the link strength between any two concepts was determined by their relevance through the citation-reference relationships. By calculating this relevance across different time periods, we quantified the impact of numerical simulations and machine learning on astronomical research. The knowledge graph demonstrates two phases of development: a phase where the technology was integrated and another where the technology was explored in scientific discovery. The knowledge graph reveals that despite machine learning has made much inroad in astronomy, there is currently a lack of new concept development at the intersection of AI and Astronomy, which may be the current bottleneck preventing machine learning from further transforming the field of astronomy.


title: Sparsity-Accelerated Training for Large Language Models

abstract: Large language models (LLMs) have demonstrated proficiency across various natural language processing (NLP) tasks but often require additional training, such as continual pre-training and supervised fine-tuning. However, the costs associated with this, primarily due to their large parameter count, remain high. This paper proposes leveraging \emph{sparsity} in pre-trained LLMs to expedite this training process. By observing sparsity in activated neurons during forward iterations, we identify the potential for computational speed-ups by excluding inactive neurons. We address associated challenges by extending existing neuron importance evaluation metrics and introducing a ladder omission rate scheduler. Our experiments on Llama-2 demonstrate that Sparsity-Accelerated Training (SAT) achieves comparable or superior performance to standard training while significantly accelerating the process. Specifically, SAT achieves a $45\%$ throughput improvement in continual pre-training and saves $38\%$ training time in supervised fine-tuning in practice. It offers a simple, hardware-agnostic, and easily deployable framework for additional LLM training. Our code is available at https://github.com/OpenDFM/SAT.


title: Introductive exercises to Quantum Field Theory

abstract: We present a collection of 12 exercises picked from the exam tests of the course "Elements of Quantum Field Theory", teached by professor Mauro Moretti in the academic year 2021-22 for the Master's Degree in Physics at the University of Ferrara. The goal of this review is to provide a general method to approach the main types of calculations in Quantum Field Theory, involving applications of Noether's theorem, checking of Ward identities, computations of cross sections and decay rates.


title: PrivacyRestore: Privacy-Preserving Inference in Large Language Models via Privacy Removal and Restoration

abstract: The widespread usage of online Large Language Models (LLMs) inference services has raised significant privacy concerns about the potential exposure of private information in user inputs to eavesdroppers or untrustworthy service providers. Existing privacy protection methods for LLMs suffer from insufficient privacy protection, performance degradation, or severe inference time overhead. In this paper, we propose PrivacyRestore to protect the privacy of user inputs during LLM inference. PrivacyRestore directly removes privacy spans in user inputs and restores privacy information via activation steering during inference. The privacy spans are encoded as restoration vectors. We propose Attention-aware Weighted Aggregation (AWA) which aggregates restoration vectors of all privacy spans in the input into a meta restoration vector. AWA not only ensures proper representation of all privacy spans but also prevents attackers from inferring the privacy spans from the meta restoration vector alone. This meta restoration vector, along with the query with privacy spans removed, is then sent to the server. The experimental results show that PrivacyRestore can protect private information while maintaining acceptable levels of performance and inference efficiency.


title: TE-NeXt: A LiDAR-Based 3D Sparse Convolutional Network for Traversability Estimation

abstract: This paper presents TE-NeXt, a novel and efficient architecture for Traversability Estimation (TE) from sparse LiDAR point clouds based on a residual convolution block. TE-NeXt block fuses notions of current trends such as attention mechanisms and 3D sparse convolutions. TE-NeXt aims to demonstrate high capacity for generalisation in a variety of urban and natural environments, using well-known and accessible datasets such as SemanticKITTI, Rellis-3D and SemanticUSL. Thus, the designed architecture ouperforms state-of-the-art methods in the problem of semantic segmentation, demonstrating better results in unstructured environments and maintaining high reliability and robustness in urbans environments, which leads to better abstraction. Implementation is available in a open repository to the scientific community with the aim of ensuring the reproducibility of results.


title: Slowing Down a Coherent Superposition of Circular Rydberg States of Strontium

abstract: Rydberg alkaline earth atoms are promising tools for quantum simulation and metrology. When one of the two valence electrons is promoted to long-lived circular states, the second valence electron can be optically manipulated without significant autoionization. We harness this feature to demonstrate laser slowing of a thermal atomic beam of circular strontium atoms. By driving the main ion core 422 nm wavelength resonance, we observe a velocity reduction of 50 m/s without significant autoionization. We also show that a superposition of circular states undergoes very weak decoherence during the cooling process, up to the scattering of more than thousand photons. This robustness opens new perspectives for quantum simulations over long timescales with circular atoms, while simultaneously cooling their motional state. It makes it possible to mitigate the harmful effects of unavoidable heating due to spin-motion coupling during a quantum simulation.


title: Emergent Cosmological Expansion in Scalar-Tensor Theories of Gravity

abstract: We consider the emergence of large-scale cosmological expansion in scalar-tensor theories of gravity. This is achieved by modelling sub-horizon regions of space-time as weak-field expansions around Minkowski space, and then subsequently joining many such regions together to create a statistically homogeneous and isotropic cosmology. We find that when the scalar field can be treated perturbatively, the cosmological behaviour that emerges is well modelled by the Friedmann solutions of the theory. When non-perturbative screening mechanisms occur this result no longer holds, and in the case of scalar fields subject to the chameleon mechanism we find significant deviations from the expected Friedmann behaviour. In particular, the screened mass no longer contributes to the Klein-Gordon equation, suppressing deviations from general relativistic behaviour.


title: Local non-bossiness and preferences over colleagues

abstract: The student-optimal stable mechanism (DA), the most popular mechanism in school choice, is the only one that is both stable and strategy-proof. However, when DA is implemented, a student can change the schools of others without changing her own. We show that this drawback is limited: a student cannot change her classmates without modifying her school. We refer to this new property as local non-bossiness. Along with strategy-proofness, it ensures a local notion of group strategy-proofness in which manipulating coalitions are restricted to students in the same school. Furthermore, local non-bossiness plays a crucial role in incentives when students have preferences over their colleagues. As long as students first consider the school to which they are assigned and then their classmates, DA induces the only stable and strategy-proof mechanism in this preference domain. To some extent, this is the maximal domain in which a stable and strategy-proof mechanism exists for any school choice context.


title: Null Compliance: NYC Local Law 144 and the Challenges of Algorithm Accountability

abstract: In July 2023, New York City became the first jurisdiction globally to mandate bias audits for commercial algorithmic systems, specifically for automated employment decisions systems (AEDTs) used in hiring and promotion. Local Law 144 (LL 144) requires AEDTs to be independently audited annually for race and gender bias, and the audit report must be publicly posted. Additionally, employers are obligated to post a transparency notice with the job listing. In this study, 155 student investigators recorded 391 employers' compliance with LL 144 and the user experience for prospective job applicants. Among these employers, 18 posted audit reports and 13 posted transparency notices. These rates could potentially be explained by a significant limitation in the accountability mechanisms enacted by LL 144. Since the law grants employers substantial discretion over whether their system is in scope of the law, a null result cannot be said to indicate non-compliance, a condition we call ``null compliance." Employer discretion may also explain our finding that nearly all audits reported an impact factor over 0.8, a rule of thumb often used in employment discrimination cases. We also find that the benefit of LL 144 to ordinary job seekers is limited due to shortcomings in accessibility and usability. Our findings offer important lessons for policy-makers as they consider regulating algorithmic systems, particularly the degree of discretion to grant to regulated parties and the limitations of relying on transparency and end-user accountability.


title: Efficient Computation Using Spatial-Photonic Ising Machines: Utilizing Low-Rank and Circulant Matrix Constraints

abstract: We explore the potential of spatial-photonic Ising machines (SPIMs) to address computationally intensive Ising problems that employ low-rank and circulant coupling matrices. Our results indicate that the performance of SPIMs is critically affected by the rank and precision of the coupling matrices. By developing and assessing advanced decomposition techniques, we expand the range of problems SPIMs can solve, overcoming the limitations of traditional Mattis-type matrices. Our approach accommodates a diverse array of coupling matrices, including those with inherently low ranks, applicable to complex NP-complete problems. We explore the practical benefits of low-rank approximation in optimization tasks, particularly in financial optimization, to demonstrate the real-world applications of SPIMs. Finally, we evaluate the computational limitations imposed by SPIM hardware precision and suggest strategies to optimize the performance of these systems within these constraints.

categories: physics.comp-ph cond-mat.dis-nn cs.ET cs.LG physics.optics


title: Size Matters: Lorentz Boosted Casimir Effect

abstract: Many evidences appear in the past decades and show that the negativity of Casimir energy is responsible for exotic mechanical and gravitational effects. We study in this work the Lorentz boost of a Casimir cavity, on which little attention is paid to its momentum in historical works. We find that the vacuum energy and momentum carried by the cavity transform differently from those of point particles due to the cavity's extension feature. However, the mass-shell condition of the two are identical as long as the cavity is finite along the moving direction only.


title: Mixture of Rationale: Multi-Modal Reasoning Mixture for Visual Question Answering

abstract: Zero-shot visual question answering (VQA) is a challenging task that requires reasoning across modalities. While some existing methods rely on a single rationale within the Chain of Thoughts (CoT) framework, they may fall short of capturing the complexity of the VQA problem. On the other hand, some other methods that use multiple rationales may still suffer from low diversity, poor modality alignment, and inefficient retrieval and fusion. In response to these challenges, we propose \emph{Mixture of Rationales (MoR)}, a novel multi-modal reasoning method that mixes multiple rationales for VQA. MoR uses a single frozen Vision-and-Language Pre-trained Models (VLPM) model to {dynamically generate, retrieve and fuse multi-modal thoughts}. We evaluate MoR on two challenging VQA datasets, i.e. NLVR2 and OKVQA, with two representative backbones OFA and VL-T5. MoR achieves a 12.43\% accuracy improvement on NLVR2, and a 2.45\% accuracy improvement on OKVQA-S( the science and technology category of OKVQA).


title: An expert-driven data generation pipeline for histological images

abstract: Deep Learning (DL) models have been successfully applied to many applications including biomedical cell segmentation and classification in histological images. These models require large amounts of annotated data which might not always be available, especially in the medical field where annotations are scarce and expensive. To overcome this limitation, we propose a novel pipeline for generating synthetic datasets for cell segmentation. Given only a handful of annotated images, our method generates a large dataset of images which can be used to effectively train DL instance segmentation models. Our solution is designed to generate cells of realistic shapes and placement by allowing experts to incorporate domain knowledge during the generation of the dataset.


title: Non-existence of a holomorphic imbedding of the Sobolev loop space into the Hilbert projective space

abstract: The goal of this paper is to understand the properties of meromorphic mappings with values in two model complex Hibert manifolds: Hilbert projective space $\pp(l^2)$ and Sobolev loop space of the Riemann sphere $L\pp^1$. It occurs that these properties are quite different. Based on our study we obtain as a corollary that $L\pp^1$ does not admit a closed holomorphic imbedding to $\pp(l^2)$. In other words $L\pp^1$ is {\slsf not} a Hilbert projective variety despite of the fact that it is K\"ahler and meromorphic functions separate points on it.


title: Review of the measurements of the strong coupling constant in CMS at 13 TeV. Contribution to the 2024 QCD session of the 58th Rencontres de Moriond

abstract: The strong coupling constant is the least known of the coupling constants in the standard model. Nevertheless it appears in the calculations of cross sections of all the processes at the LHC. We present a review of the strong coupling constant measurements conducted at the CMS experiment, focusing on those performed at a center-of-mass of 13 TeV.


title: On the role of $J/{\psi}$ production in electron-ion collisions

abstract: Within the framework of non-relativistic QCD (NRQCD) effective field theory, we study the leptoproduction of $J/{\psi}$ at next-to-leading order in perturbative QCD for both unpolarized and polarized electron-ion collisions. We demonstrate that the $J/{\psi}$-tagged deep inelastic scattering in the future Electron-Ion Collider can be served as a golden channel for the reasons including constraining NRQCD long distance matrix elements, probing the nuclear gluon distribution functions, as well as investigating the gluon helicity distribution inside a longitudinal polarized proton.


title: Utilizing Large Language Models for Automating Technical Customer Support

abstract: The use of large language models (LLMs) such as OpenAI's GPT-4 in technical customer support (TCS) has the potential to revolutionize this area. This study examines automated text correction, summarization of customer inquiries and question answering using LLMs. Through prototypes and data analyses, the potential and challenges of integrating LLMs into the TCS will be demonstrated. Our results show promising approaches for improving the efficiency and quality of customer service through LLMs, but also emphasize the need for quality-assured implementation and organizational adjustments in the data ecosystem.


title: Enhanced quantum metric due to vacancies in graphene

abstract: Random vacancies in a graphene monolayer induce defect states that are known to form a narrow impurity band centered around zero energy at half-filling. We use a space-resolved formulation of the quantum metric and establish a strong enhancement of the electronic correlations in this impurity band. The enhancement is primarily due to strong correlations between pairs of vacancies situated on different sublattices at anomalously large spatial distances. We trace the strong enhancement to both the multifractal vacancy wave functions, which ties the system exactly at the Anderson insulator transition for all defect concentrations, and preserving the chiral symmetry.


title: Performance comparison of Dask and Apache Spark on HPC systems for Neuroimaging

abstract: The general increase in data size and data sharing motivates the adoption of Big Data strategies in several scientific disciplines. However, while several options are available, no particular guidelines exist for selecting a Big Data engine. In this paper, we compare the runtime performance of two popular Big Data engines with Python APIs, Apache Spark, and Dask, in processing neuroimaging pipelines. Our experiments use three synthetic \HL{neuroimaging} applications to process the \SI{606}{\gibi\byte} BigBrain image and an actual pipeline to process data from thousands of anatomical images. We benchmark these applications on a dedicated HPC cluster running the Lustre file system while using varying combinations of the number of nodes, file size, and task duration. Our results show that although there are slight differences between Dask and Spark, the performance of the engines is comparable for data-intensive applications. However, Spark requires more memory than Dask, which can lead to slower runtime depending on configuration and infrastructure. In general, the limiting factor was the data transfer time. While both engines are suitable for neuroimaging, more efforts need to be put to reduce the data transfer time and the memory footprint of applications.


title: Remote-Controlled Activation of the Release through Drug-Loaded Magnetic Electrospun Fibers

abstract: The integration of magnetic nanoparticles within fibrillar structures represents an interesting avenue for the remotely controlled release of therapeutic agents. This work presents a novel drug release platform based on electrospun magnetic fibers (EMFs) combining drugs, magnetic nanoparticles (MNPs) and mesoporous silica nanoparticles (MSNs) for controlled drug delivery via alternating magnetic fields (AMF). The platform was demonstrated to be versatile and effective for hydrophilic ketorolac (KET) and hydrophobic curcumin (CUR) encapsulation and the major response observed for AMF-triggered release was reached using drug-loaded MSNs within the fibers, providing fine control over drug release patterns. The EMFs exhibited excellent inductive heating capabilities, showing a temperature increase up to 8 {\deg}C within a 5 min AMF pulse. The system is shown to be promising for applications like transdermal pain management, oncological drug delivery, tissue engineering, and wound healing, enabling precise control over drug release in both spatial and temporal dimensions. The findings of this study offer valuable insights into the development of the next generation of smart drug delivery systems, based in multifunctional materials that can be remotely regulated and potentially revolutionize the field of nanomedicine.


title: Using Constraints to Discover Sparse and Alternative Subgroup Descriptions

abstract: Subgroup-discovery methods allow users to obtain simple descriptions of interesting regions in a dataset. Using constraints in subgroup discovery can enhance interpretability even further. In this article, we focus on two types of constraints: First, we limit the number of features used in subgroup descriptions, making the latter sparse. Second, we propose the novel optimization problem of finding alternative subgroup descriptions, which cover a similar set of data objects as a given subgroup but use different features. We describe how to integrate both constraint types into heuristic subgroup-discovery methods. Further, we propose a novel Satisfiability Modulo Theories (SMT) formulation of subgroup discovery as a white-box optimization problem, which allows solver-based search for subgroups and is open to a variety of constraint types. Additionally, we prove that both constraint types lead to an NP-hard optimization problem. Finally, we employ 27 binary-classification datasets to compare heuristic and solver-based search for unconstrained and constrained subgroup discovery. We observe that heuristic search methods often yield high-quality subgroups within a short runtime, also in scenarios with constraints.


title: Relativistic interacting fluids in cosmology

abstract: Motivated by cosmological applications for interacting matters, an extension of the action functional for relativistic fluids is proposed to incorporate the physics of non-adiabatic processes and chemical reactions. The former are characterised by entropy growth, while the latter violate particle number conservation. The relevance of these physics is demonstrated in the contexts of self-interacting fluids, fluids interacting with scalar fields, and hyperhydrodynamical interactions with geometry. The possible cosmological applications range from early-universe phase transitions to astrophysical phenomena, and from matter creation inflationary alternatives to interacting dark sector alternatives to the $\Lambda$CDM model that aim to address its tensions. As an example of the latter, a single fluid model of a unified dark sector is presented. The simple action of the model features one field and one parameter, yet it can both reproduce the $\Lambda$CDM cosmology and predict new phenomenology.


title: KerrGeoPy: A Python Package for Computing Timelike Geodesics in Kerr Spacetime

abstract: KerrGeoPy is a Python package which computes both stable and plunging timelike geodesics in Kerr spacetime using analytic solutions to the geodesic equation that are written in terms of Legendre elliptic integrals. It mirrors and builds upon much of the functionality of the KerrGeodesics Mathematica library. Users can construct a geodesic by providing the initial position and four-velocity, or by providing either the constants of motion or a generalized version of the parameters defining a Keplerian orbit. The package provides methods for computing the four-velocity, fundamental frequencies, and constants of motion associated with a given geodesic along with the location of the separatrix. It also includes several methods for visualizing and animating geodesics.


title: CE-NAS: An End-to-End Carbon-Efficient Neural Architecture Search Framework

abstract: This work presents a novel approach to neural architecture search (NAS) that aims to increase carbon efficiency for the model design process. The proposed framework CE-NAS addresses the key challenge of high carbon cost associated with NAS by exploring the carbon emission variations of energy and energy differences of different NAS algorithms. At the high level, CE-NAS leverages a reinforcement-learning agent to dynamically adjust GPU resources based on carbon intensity, predicted by a time-series transformer, to balance energy-efficient sampling and energy-intensive evaluation tasks. Furthermore, CE-NAS leverages a recently proposed multi-objective optimizer to effectively reduce the NAS search space. We demonstrate the efficacy of CE-NAS in lowering carbon emissions while achieving SOTA results for both NAS datasets and open-domain NAS tasks. For example, on the HW-NasBench dataset, CE-NAS reduces carbon emissions by up to 7.22X while maintaining a search efficiency comparable to vanilla NAS. For open-domain NAS tasks, CE-NAS achieves SOTA results with 97.35% top-1 accuracy on CIFAR-10 with only 1.68M parameters and a carbon consumption of 38.53 lbs of CO2. On ImageNet, our searched model achieves 80.6% top-1 accuracy with a 0.78 ms TensorRT latency using FP16 on NVIDIA V100, consuming only 909.86 lbs of CO2, making it comparable to other one-shot-based NAS baselines.


title: Relic neutrino decay: a solution to the excess radio background

abstract: The detection of excess radio background detected by ARCADE 2 suggests the presence of new physics as there exists no clear astrophysical solution. We find that the radiative decay of a relic neutrino into a sterile neutrino, assumed to be quasi-degenerate, provides a very good fit to ARCADE 2 data. The solution also predicts a stronger 21 cm absorption global signal than the predicted one from the $\Lambda$CDM model, with a contrast brightness temperature. The solution obtained is in mild tension with a much stronger signal claimed by the EDGES collaboration.


title: Adapting Conformal Prediction to Distribution Shifts Without Labels

abstract: Conformal prediction (CP) enables machine learning models to output prediction sets with guaranteed coverage rate, assuming exchangeable data. Unfortunately, the exchangeability assumption is frequently violated due to distribution shifts in practice, and the challenge is often compounded by the lack of ground truth labels at test time. Focusing on classification in this paper, our goal is to improve the quality of CP-generated prediction sets using only unlabeled data from the test domain. This is achieved by two new methods called ECP and EACP, that adjust the score function in CP according to the base model's uncertainty on the unlabeled test data. Through extensive experiments on a number of large-scale datasets and neural network architectures, we show that our methods provide consistent improvement over existing baselines and nearly match the performance of supervised algorithms.


title: Mixup Augmentation with Multiple Interpolations

abstract: Mixup and its variants form a popular class of data augmentation techniques.Using a random sample pair, it generates a new sample by linear interpolation of the inputs and labels. However, generating only one single interpolation may limit its augmentation ability. In this paper, we propose a simple yet effective extension called multi-mix, which generates multiple interpolations from a sample pair. With an ordered sequence of generated samples, multi-mix can better guide the training process than standard mixup. Moreover, theoretically, this can also reduce the stochastic gradient variance. Extensive experiments on a number of synthetic and large-scale data sets demonstrate that multi-mix outperforms various mixup variants and non-mixup-based baselines in terms of generalization, robustness, and calibration.


title: Chromatic symmetric functions of conjoined graphs

abstract: We introduce path-conjoined graphs defined for two rooted graphs by joining their roots with a path, and investigate the chromatic symmetric functions of its two generalizations: spider-conjoined graphs and chain-conjoined graphs. By using the composition method developed by Zhou and the third author, we obtain neat positive $e_I$-expansions for the chromatic symmetric functions of clique-path-cycle graphs, path-clique-path graphs, and path-clique-clique graphs.


title: High-performance magnetostatic wave resonators through deep anisotropic etching of GGG substrates

abstract: Microscale resonators are fundamental and necessary building blocks for modern radio communication filters for mobile devices. The resonator's Q factor ($Q$) determines the insertion loss while coupling ($K_t^2$) governs the fractional bandwidth. The product $k_t^2 \times Q$ is widely recognized as the definitive figure of merit for microresonators. Magnetostatic wave resonators based on Yttrium Iron Garnet (YIG) are a promising technology platform for future communication filters. They have shown considerably better performance in terms of $Q$ when compared to the commercially successful acoustic resonators in the $>$7 GHz range. However, the coupling coefficients of these resonators have been limited to $<$3 %, primarily due to the restricted design space imposed by microfabrication challenges related to the patterning of gadolinium gallium garnet (GGG), the substrate material used for growing single crystal YIG. This paper reports novel resonator designs enabled by breakthrough bulk micromachining technology for anisotropic etching of GGG, leading to coupling >8 % in the 6-20 GHz frequency range. We use the same technology platform to show resonant enhancement of effective coupling, reaching up to 23 \% at 10.5 GHz. The frequency of resonant coupling can be tuned by design during the fabrication process. The resonant coupling results in an unprecedented $k_t^2 \times Q$ figure of merit of 191 at 10.5 GHz and 222 at 14.7 GHz. The technology platform presented in this paper supports both tunable filter architecture and switched filter banks that are currently being used in consumer mobile devices.


title: An absence of binary companions to Wolf-Rayet stars in the Small Magellanic Cloud: implications for mass loss and black hole masses at low metallicity

abstract: In order to predict the black hole mass distributions at high redshift, we need to understand whether very massive single stars ($M>40$ M$_\odot$) at low metallicity $Z$ lose their hydrogen-rich envelopes, like their metal-rich counterparts, or whether a binary companion is required to achieve this. To test this, we undertake a deep spectroscopic search for binary companions of the seven apparently single Wolf-Rayet (WR) stars in the Small Magellanic Cloud (SMC; $Z \simeq 1/5 Z_\odot$). For each of them, we acquired six high-quality VLT-UVES spectra spread over 1.5 years. By using the narrow N V lines in these spectra, we monitor radial velocity (RV) variations to search for binary motion. We find low RV variations between 6 and 23 km/s for the seven WR stars, with a median standard deviation of $5$ km/s. Our Monte Carlo simulations imply probabilities below ~5% for any of our target WR stars to have a binary companion more massive than ~5 M$_\odot$ at orbital periods of less than a year. We estimate that the probability that all our target WR stars have companions with orbital periods shorter than 10 yr is below ~10$^{-5}$, and argue that the observed modest RV variations may originate from intrinsic atmosphere or wind variability. Our findings imply that metal-poor massive stars born with $M \gtrsim 40$ M$_\odot$ can lose most of their hydrogen-rich envelopes via stellar winds or eruptive mass loss, which strongly constrains their initial mass - black hole mass relation. We also identify two of our seven target stars (SMC AB1 and SMC AB11) as runaway stars with a peculiar radial velocity of ~80 km/s. Moreover, with all five previously detected WR binaries in the SMC exhibiting orbital periods of below 20 d, a puzzling absence of intermediate-to-long-period WR binaries has emerged, with strong implications for the outcome of massive binary interaction at low metallicity.


title: Problematizing AI Omnipresence in Landscape Architecture

abstract: This position paper argues for, and offers, a critical lens through which to examine the current AI frenzy in the landscape architecture profession. In it, the authors propose five archetypes or mental modes that landscape architects might inhabit when thinking about AI. Rather than limiting judgments of AI use to a single axis of acceleration, these archetypes and corresponding narratives exist along a relational spectrum and are permeable, allowing LAs to take on and switch between them according to context. We model these relationships between the archetypes and their contributions to AI advancement using a causal loop diagram (CLD), and with those interactions argue that more nuanced ways of approaching AI might also open new modes of practice in the new digital economy.


title: How to Understand Whole Software Repository?

abstract: Recently, Large Language Model (LLM) based agents have advanced the significant development of Automatic Software Engineering (ASE). Although verified effectiveness, the designs of the existing methods mainly focus on the local information of codes, e.g., issues, classes, and functions, leading to limitations in capturing the global context and interdependencies within the software system. From the practical experiences of the human SE developers, we argue that an excellent understanding of the whole repository will be the critical path to ASE. However, understanding the whole repository raises various challenges, e.g., the extremely long code input, the noisy code information, the complex dependency relationships, etc. To this end, we develop a novel ASE method named RepoUnderstander by guiding agents to comprehensively understand the whole repositories. Specifically, we first condense the critical information of the whole repository into the repository knowledge graph in a top-to-down mode to decrease the complexity of repository. Subsequently, we empower the agents the ability of understanding whole repository by proposing a Monte Carlo tree search based repository exploration strategy. In addition, to better utilize the repository-level knowledge, we guide the agents to summarize, analyze, and plan. Then, they can manipulate the tools to dynamically acquire information and generate the patches to solve the real-world GitHub issues. Extensive experiments demonstrate the superiority and effectiveness of the proposed RepoUnderstander. It achieved 18.5\% relative improvement on the SWE-bench Lite benchmark compared to SWE-agent.


title: Value Improved Actor Critic Algorithms

abstract: Many modern reinforcement learning algorithms build on the actor-critic (AC) framework: iterative improvement of a policy (the actor) using policy improvement operators and iterative approximation of the policy's value (the critic). In contrast, the popular value-based algorithm family employs improvement operators in the value update, to iteratively improve the value function directly. In this work, we propose a general extension to the AC framework that employs two separate improvement operators: one applied to the policy in the spirit of policy-based algorithms and one applied to the value in the spirit of value-based algorithms, which we dub Value-Improved AC (VI-AC). We design two practical VI-AC algorithms based in the popular online off-policy AC algorithms TD3 and DDPG. We evaluate VI-TD3 and VI-DDPG in the Mujoco benchmark and find that both improve upon or match the performance of their respective baselines in all environments tested.


title: Universal In-Context Approximation By Prompting Fully Recurrent Models

abstract: Zero-shot and in-context learning enable solving tasks without model fine-tuning, making them essential for developing generative model solutions. Therefore, it is crucial to understand whether a pretrained model can be prompted to approximate any function, i.e., whether it is a universal in-context approximator. While it was recently shown that transformer models do possess this property, these results rely on their attention mechanism. Hence, these findings do not apply to fully recurrent architectures like RNNs, LSTMs, and the increasingly popular SSMs. We demonstrate that RNNs, LSTMs, GRUs, Linear RNNs, and linear gated architectures such as Mamba and Hawk/Griffin can also serve as universal in-context approximators. To streamline our argument, we introduce a programming language called LSRL that compiles to these fully recurrent architectures. LSRL may be of independent interest for further studies of fully recurrent models, such as constructing interpretability benchmarks. We also study the role of multiplicative gating and observe that architectures incorporating such gating (e.g., LSTMs, GRUs, Hawk/Griffin) can implement certain operations more stably, making them more viable candidates for practical in-context universal approximation.


title: Sensitivity-Informed Augmentation for Robust Segmentation

abstract: Segmentation is an integral module in many visual computing applications such as virtual try-on, medical imaging, autonomous driving, and agricultural automation. These applications often involve either widespread consumer use or highly variable environments, both of which can degrade the quality of visual sensor data, whether from a common mobile phone or an expensive satellite imaging camera. In addition to external noises like user difference or weather conditions, internal noises such as variations in camera quality or lens distortion can affect the performance of segmentation models during both development and deployment. In this work, we present an efficient, adaptable, and gradient-free method to enhance the robustness of learning-based segmentation models across training. First, we introduce a novel adaptive sensitivity analysis (ASA) using Kernel Inception Distance (KID) on basis perturbations to benchmark perturbation sensitivity of pre-trained segmentation models. Then, we model the sensitivity curve using the adaptive SA and sample perturbation hyperparameter values accordingly. Finally, we conduct adversarial training with the selected perturbation values and dynamically re-evaluate robustness during online training. Our method, implemented end-to-end with minimal fine-tuning required, consistently outperforms state-of-the-art data augmentation techniques for segmentation. It shows significant improvement in both clean data evaluation and real-world adverse scenario evaluation across various segmentation datasets used in visual computing and computer graphics applications.


title: High Throughput Polar Code Decoders with Information Bottleneck Quantization

abstract: In digital baseband processing, the forward error correction (FEC) unit belongs to the most demanding components in terms of computational complexity and power consumption. Hence, efficient implementation of FEC decoders is crucial for next generation mobile broadband standards and an ongoing research topic. Quantization has a significant impact on the decoder area, power consumption and throughput. Thus, lower bit-widths are preferred for efficient implementations but degrade the error-correction capability. To address this issue, a non-uniform quantization based on the Information Bottleneck (IB) method was proposed that enables a low bit width while maintaining the essential information. Many investigations on the use of IB method for Low-density parity-check code (LDPC) decoders exist and have shown its advantages from an implementation perspective. However, for polar code decoder implementations, there exists only one publication that is not based on the state-of-the-art Fast-SSC decoding algorithm, and only synthesis implementation results without energy estimation are shown. In contrast, our paper presents several optimized Fast Simplified Successive-Cancellation (Fast-SSC) polar code decoder implementations using IB-based quantization with placement&routing results in an advanced 12 nm FinFET technology. Gains of up to 16% in area and 13% in energy efficiency are achieved with IB-based quantization at a Frame Error Rate (FER) of 10-7 and a Polar Code of N = 1024, R = 0.5 compared to state-of-the-art decoders.


title: Holographic approach to anomalous transport in a massive $U(1)$ gauge theory

abstract: In this study, we explore a massive (U(1)) gauge holographic model with pure gauge and mixed gauge-gravitational Chern-Simons terms. By considering the full backreaction of the gauge field on the metric tensor, we explore the vortical and energy transport sectors. Our findings for the chiral vortical conductivity, $\sigma_V$, and the chiral magnetic/vortical conductivity of energy current show that $\sigma^\varepsilon_B = \sigma^\varepsilon_V$. Notably, we highlight a contribution to (\sigma_V) induced by the mixed term in the massive theory, which is absent in the massless case.


title: Superhuman performance in urology board questions by an explainable large language model enabled for context integration of the European Association of Urology guidelines: the UroBot study

abstract: Large Language Models (LLMs) are revolutionizing medical Question-Answering (medQA) through extensive use of medical literature. However, their performance is often hampered by outdated training data and a lack of explainability, which limits clinical applicability. This study aimed to create and assess UroBot, a urology-specialized chatbot, by comparing it with state-of-the-art models and the performance of urologists on urological board questions, ensuring full clinician-verifiability. UroBot was developed using OpenAI's GPT-3.5, GPT-4, and GPT-4o models, employing retrieval-augmented generation (RAG) and the latest 2023 guidelines from the European Association of Urology (EAU). The evaluation included ten runs of 200 European Board of Urology (EBU) In-Service Assessment (ISA) questions, with performance assessed by the mean Rate of Correct Answers (RoCA). UroBot-4o achieved an average RoCA of 88.4%, surpassing GPT-4o by 10.8%, with a score of 77.6%. It was also clinician-verifiable and exhibited the highest run agreement as indicated by Fleiss' Kappa (k = 0.979). By comparison, the average performance of urologists on board questions, as reported in the literature, is 68.7%. UroBot's clinician-verifiable nature and superior accuracy compared to both existing models and urologists on board questions highlight its potential for clinical integration. The study also provides the necessary code and instructions for further development of UroBot.


title: EAGLE: Efficient Adaptive Geometry-based Learning in Cross-view Understanding

abstract: Unsupervised Domain Adaptation has been an efficient approach to transferring the semantic segmentation model across data distributions. Meanwhile, the recent Open-vocabulary Semantic Scene understanding based on large-scale vision language models is effective in open-set settings because it can learn diverse concepts and categories. However, these prior methods fail to generalize across different camera views due to the lack of cross-view geometric modeling. At present, there are limited studies analyzing cross-view learning. To address this problem, we introduce a novel Unsupervised Cross-view Adaptation Learning approach to modeling the geometric structural change across views in Semantic Scene Understanding. First, we introduce a novel Cross-view Geometric Constraint on Unpaired Data to model structural changes in images and segmentation masks across cameras. Second, we present a new Geodesic Flow-based Correlation Metric to efficiently measure the geometric structural changes across camera views. Third, we introduce a novel view-condition prompting mechanism to enhance the view-information modeling of the open-vocabulary segmentation network in cross-view adaptation learning. The experiments on different cross-view adaptation benchmarks have shown the effectiveness of our approach in cross-view modeling, demonstrating that we achieve State-of-the-Art (SOTA) performance compared to prior unsupervised domain adaptation and open-vocabulary semantic segmentation methods.


title: The azimuthal correlation between the leading jet and the scattered lepton in deep inelastic scattering at HERA

abstract: The azimuthal correlation angle, $\Delta\phi$, between the scattered lepton and the leading jet in deep inelastic $e^{\pm}p$ scattering at HERA has been studied using data collected with the ZEUS detector at a centre-of-mass energy of $\sqrt{s} = 318 \;\mathrm{GeV}$, corresponding to an integrated luminosity of $326 \;\mathrm{pb}^{-1}$. A measurement of jet cross sections in the laboratory frame was made in a fiducial region corresponding to photon virtuality $10 \;\mathrm{GeV}^2 < Q^2 < 350 \;\mathrm{GeV}^2$, inelasticity $0.04 < y < 0.7$, outgoing lepton energy $E_e > 10 \;\mathrm{GeV}$, lepton polar angle $140^\circ < \theta_e < 180^\circ$, jet transverse momentum $2.5 \;\mathrm{GeV} < p_\mathrm{T,jet} < 30 \;\mathrm{GeV}$, and jet pseudorapidity $-1.5 < \eta_\mathrm{jet} < 1.8$. Jets were reconstructed using the $k_\mathrm{T}$ algorithm with the radius parameter $R = 1$. The leading jet in an event is defined as the jet that carries the highest $p_\mathrm{T,jet}$. Differential cross sections, $d\sigma/d\Delta\phi$, were measured as a function of the azimuthal correlation angle in various ranges of leading-jet transverse momentum, photon virtuality and jet multiplicity. Perturbative calculations at $\mathcal{O}(\alpha_{s}^2)$ accuracy successfully describe the data within the fiducial region, although a lower level of agreement is observed near $\Delta\phi \rightarrow \pi$ for events with high jet multiplicity, due to limitations of the perturbative approach in describing soft phenomena in QCD. The data are equally well described by Monte Carlo predictions that supplement leading-order matrix elements with parton showering.


title: Deep Stochastic Kinematic Models for Probabilistic Motion Forecasting in Traffic

abstract: Kinematic priors have shown to be helpful in boosting generalization and performance in prior work on trajectory forecasting. Specifically, kinematic priors have been applied such that models predict a set of actions instead of future output trajectories. By unrolling predicted trajectories via time integration and models of kinematic dynamics, predicted trajectories are not only kinematically feasible on average but also relate uncertainty from one timestep to the next. With benchmarks supporting prediction of multiple trajectory predictions, deterministic kinematic priors are less and less applicable to current models. We propose a method for integrating probabilistic kinematic priors into modern probabilistic trajectory forecasting architectures. The primary difference between our work and previous techniques is the analytical quantification of variance, or uncertainty, in predicted trajectories. With negligible additional computational overhead, our method can be generalized and easily implemented with any modern probabilistic method that models candidate trajectories as Gaussian distributions. In particular, our method works especially well in unoptimal settings, such as with small datasets or in the presence of noise. Our method achieves up to a 50% performance boost in small dataset settings and up to an 8% performance boost in large-scale learning compared to previous kinematic prediction methods on SOTA trajectory forecasting architectures out-of-the-box, with minimal fine-tuning. In this paper, we show four analytical formulations of probabilistic kinematic priors which can be used for any Gaussian Mixture Model (GMM)-based deep learning models, quantify the error bound on linear approximations applied during trajectory unrolling, and show results to evaluate each formulation in trajectory forecasting.


title: ED-SAM: An Efficient Diffusion Sampling Approach to Domain Generalization in Vision-Language Foundation Models

abstract: The Vision-Language Foundation Model has recently shown outstanding performance in various perception learning tasks. The outstanding performance of the vision-language model mainly relies on large-scale pre-training datasets and different data augmentation techniques. However, the domain generalization problem of the vision-language foundation model needs to be addressed. This problem has limited the generalizability of the vision-language foundation model to unknown data distributions. In this paper, we introduce a new simple but efficient Diffusion Sampling approach to Domain Generalization (ED-SAM) to improve the generalizability of the vision-language foundation model. Our theoretical analysis in this work reveals the critical role and relation of the diffusion model to domain generalization in the vision-language foundation model. Then, based on the insightful analysis, we introduce a new simple yet effective Transport Transformation to diffusion sampling method. It can effectively generate adversarial samples to improve the generalizability of the foundation model against unknown data distributions. The experimental results on different scales of vision-language pre-training datasets, including CC3M, CC12M, and LAION400M, have consistently shown State-of-the-Art performance and scalability of the proposed ED-SAM approach compared to the other recent methods.


title: Travelling waves for Maxwell's equations in nonlinear and symmetric media

abstract: We look for travelling wave fields $$ E(x,y,z,t)= U(x,y) \cos(kz+\omega t)+ \widetilde U(x,y)\sin(kz+\omega t),\quad (x,y,z)\in\mathbb{R}^3,\, t\in\mathbb{R}, $$ satisfying Maxwell's equations in a nonlinear and cylindrically symmetric medium. We obtain a sequence of solutions with diverging energy that is different from that obtained by McLeod, Stuart, and Troy. In addition, we consider a more general nonlinearity, controlled by an \textit{N}-function.


title: ZTF SN~Ia DR2: Cosmology-independent constraints on Type Ia supernova standardisation from supernova siblings

abstract: Understanding Type Ia supernovae (SNe~Ia) and the empirical standardisation relations that make them excellent distance indicators is vital to improving cosmological constraints. SN~Ia ``siblings", i.e. two or more SNe~Ia in the same host or parent galaxy offer a unique way to infer the standardisation relations and their diversity across the population. We analyse a sample of 25 SN~Ia pairs, observed homogeneously by the Zwicky Transient Factory (ZTF) to infer the SNe~Ia light curve width-luminosity and colour-luminosity parameters $\alpha$ and $\beta$. Using the pairwise constraints from siblings, allowing for a diversity in the standardisation relations, we find $\alpha = 0.218 \pm 0.055 $ and $\beta = 3.084 \pm 0.312$, respectively, with a dispersion in $\alpha$ and $\beta$ of $\leq 0.195$ and $\leq 0.923$, respectively, at 95$\%$ C.L. While the median dispersion is large, the values within $\sim 1 \sigma$ are consistent with no dispersion. Hence, fitting for a single global standardisation relation, we find $\alpha = 0.228 \pm 0.029 $ and $\beta = 3.160 \pm 0.191$. We find a very small intrinsic scatter of the siblings sample $\sigma_{\rm int} \leq 0.10$ at 95\% C.L. compared to $\sigma_{\rm int} = 0.22 \pm 0.04$ when computing the scatter using the Hubble residuals without comparing them as siblings. Splitting the sample based on host galaxy stellar mass, we find that SNe~Ia in both subsamples have consistent $\alpha$ and $\beta$. The $\beta$ value is consistent with the value for the cosmological sample. However, we find a higher $\alpha$ by $\sim 2.5 - 3.5 \sigma$. The high $\alpha$ is driven by low $x_1$ pairs, potentially suggesting that the slow and fast declining SN~Ia have different slopes of the width-luminosity relation. We can confirm or refute this with increased statistics from near future time-domain surveys. (abridged)


title: Learning Analysis of Kernel Ridgeless Regression with Asymmetric Kernel Learning

abstract: Ridgeless regression has garnered attention among researchers, particularly in light of the ``Benign Overfitting'' phenomenon, where models interpolating noisy samples demonstrate robust generalization. However, kernel ridgeless regression does not always perform well due to the lack of flexibility. This paper enhances kernel ridgeless regression with Locally-Adaptive-Bandwidths (LAB) RBF kernels, incorporating kernel learning techniques to improve performance in both experiments and theory. For the first time, we demonstrate that functions learned from LAB RBF kernels belong to an integral space of Reproducible Kernel Hilbert Spaces (RKHSs). Despite the absence of explicit regularization in the proposed model, its optimization is equivalent to solving an $\ell_0$-regularized problem in the integral space of RKHSs, elucidating the origin of its generalization ability. Taking an approximation analysis viewpoint, we introduce an $l_q$-norm analysis technique (with $0<q<1$) to derive the learning rate for the proposed model under mild conditions. This result deepens our theoretical understanding, explaining that our algorithm's robust approximation ability arises from the large capacity of the integral space of RKHSs, while its generalization ability is ensured by sparsity, controlled by the number of support vectors. Experimental results on both synthetic and real datasets validate our theoretical conclusions.


title: Editing the Mind of Giants: An In-Depth Exploration of Pitfalls of Knowledge Editing in Large Language Models

abstract: Knowledge editing is a rising technique for efficiently updating factual knowledge in Large Language Models (LLMs) with minimal alteration of parameters. However, recent studies have identified concerning side effects, such as knowledge distortion and the deterioration of general abilities, that have emerged after editing. This survey presents a comprehensive study of these side effects, providing a unified view of the challenges associated with knowledge editing in LLMs. We discuss related works and summarize potential research directions to overcome these limitations. Our work highlights the limitations of current knowledge editing methods, emphasizing the need for deeper understanding of inner knowledge structures of LLMs and improved knowledge editing methods. To foster future research, we have released the complementary materials such as paper collection publicly at https://github.com/MiuLab/EditLLM-Survey


title: Computing the Action of the Generating Function of Bernoulli Polynomials on a Matrix with An Application to Non-local Boundary Value Problems

abstract: This paper deals with efficient numerical methods for computing the action of the generating function of Bernoulli polynomials, say $q(\tau,w)$, on a typically large sparse matrix. This problem occurs when solving some non-local boundary value problems. Methods based on the Fourier expansion of $q(\tau,w)$ have already been addressed in the scientific literature. The contribution of this paper is twofold. First, we place these methods in the classical framework of Krylov-Lanczos (polynomial-rational) techniques for accelerating Fourier series. This allows us to apply the convergence results developed in this context to our function. Second, we design a new acceleration scheme. Some numerical results are presented to show the effectiveness of the proposed algorithms.


title: Asynchronous Byzantine Federated Learning

abstract: Federated learning (FL) enables a set of geographically distributed clients to collectively train a model through a server. Classically, the training process is synchronous, but can be made asynchronous to maintain its speed in presence of slow clients and in heterogeneous networks. The vast majority of Byzantine fault-tolerant FL systems however rely on a synchronous training process. Our solution is one of the first Byzantine-resilient and asynchronous FL algorithms that does not require an auxiliary server dataset and is not delayed by stragglers, which are shortcomings of previous works. Intuitively, the server in our solution waits to receive a minimum number of updates from clients on its latest model to safely update it, and is later able to safely leverage the updates that late clients might send. We compare the performance of our solution with state-of-the-art algorithms on both image and text datasets under gradient inversion, perturbation, and backdoor attacks. Our results indicate that our solution trains a model faster than previous synchronous FL solution, and maintains a higher accuracy, up to 1.54x and up to 1.75x for perturbation and gradient inversion attacks respectively, in the presence of Byzantine clients than previous asynchronous FL solutions.


title: Asynchronous Multi-Server Federated Learning for Geo-Distributed Clients

abstract: Federated learning (FL) systems enable multiple clients to train a machine learning model iteratively through synchronously exchanging the intermediate model weights with a single server. The scalability of such FL systems can be limited by two factors: server idle time due to synchronous communication and the risk of a single server becoming the bottleneck. In this paper, we propose a new FL architecture, to our knowledge, the first multi-server FL system that is entirely asynchronous, and therefore addresses these two limitations simultaneously. Our solution keeps both servers and clients continuously active. As in previous multi-server methods, clients interact solely with their nearest server, ensuring efficient update integration into the model. Differently, however, servers also periodically update each other asynchronously, and never postpone interactions with clients. We compare our solution to three representative baselines - FedAvg, FedAsync and HierFAVG - on the MNIST and CIFAR-10 image classification datasets and on the WikiText-2 language modeling dataset. Our solution converges to similar or higher accuracy levels than previous baselines and requires 61% less time to do so in geo-distributed settings.


title: Prethermalization in the PXP Model under Continuous Quasiperiodic Driving

abstract: Motivated by recent experiments realizing long-lived non-equilibrium states in aperiodically driven quantum many-body systems, we investigate the dynamics of a quasiperiodically driven Rydberg atom chain in the strong Rydberg blockage regime. In this regime, the system is kinetically constrained and the `PXP' model describes its dynamics. Even without driving, the PXP model exhibits many-body scarring and resultant persistent oscillations for dynamics originating from the N\'{e}el-ordered initial state. We demonstrate that a rich array of dynamical behaviors emerge when the system is subjected to a continuous drive. In the high-frequency regime, the system exhibits revivals and oscillations for the N\'{e}el ordered initial state both for periodic and quasi-periodic drives. We trace the origin of this non-ergodicity to an effective PXP Hamiltonian for both of these driving protocols in this regime. Furthermore, we demonstrate that the behavior of the fidelity and the entanglement entropy is non-monotonic at low frequencies in the high-amplitude regime. This leads to several re-entrant scarring transitions both for both the N\'{e}el-ordered and the fully polarized initial state. Our results demonstrate that continuous quasi-periodic drive protocols can provide a promising route to realize prethermal phases of matter in kinetically constrained systems.

categories: cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el quant-ph


title: LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation

abstract: The fine-tuning of open-source large language models (LLMs) for machine translation has recently received considerable attention, marking a shift towards data-centric research from traditional neural machine translation. However, the area of data collection for instruction fine-tuning in machine translation remains relatively underexplored. In this paper, we present LexMatcher, a simple yet effective method for data collection that leverages bilingual dictionaries to generate a dataset, the design of which is driven by the coverage of senses found in these dictionaries. The dataset comprises a subset retrieved from an existing corpus and a smaller synthesized subset which supplements the infrequent senses of polysemous words. Utilizing LLaMA2 as our base model, our approach outperforms the established baselines on the WMT2022 test sets and also exhibits significant performance improvements in tasks related to word sense disambiguation and specialized terminology translation. These results underscore the effectiveness of LexMatcher in enhancing LLM-based machine translation.


title: Rotational and Near-IR Spectra of PbF: Characterization of the Coupled $X_1\,^2\Pi_{1/2}$ and $X_2\,^2\Pi_{3/2}$ States

abstract: Observations of the rotational spectrum of lead monofluoride, PbF, have been extended up to transitions in the \textit{v} = 7 level for $^{208}$PbF in the lowest $X_1\,^2\Pi_{1/2}$ state of the radical and \textit{v} = 5 for the $^{207}$Pb and $^{206}$Pb isotopologues. The data also include a few measurements for $^{204}$PbF in \textit{v} = 0. These new measurements have been combined with existing near-IR measurements of the $X_2 - X_1$ fine-structure transition and a simultaneous multi-isotope fit of the data to an effective isotope-independent ro-vibronic Hamiltonian has been carried out. The resulting parameters fully characterize the vibrational, rotational and hyperfine structure of the combined $X_1 \, / \, X_2$ state of the radical. A pair of opposite parity levels with total angular momentum quantum number, $F=1/2$, in the lowest rotational level, $J=1/2$ of \PbF \,are close in energy and their spacing decreases with vibrational excitation. The experimental results show the spacing decreases to less than 20 MHz at $v=7$ and 8. The experimental work is complemented by new \textit{ab initio} calculations which support the results and allow predictions outside the experimental data range. The calculated radiative lifetimes of the relevant vibrationally excited states are of the order of 50 ms. This work was motivated by interest in using \PbF\, as a vehicle for future probes of the standard model of physics such as placing limits on the electron's electric dipole moment (\eEDM), molecular charge-parity non-conservation and Born-Oppenheimer breakdown effects for example.


title: Hilbert's tenth problem for families of $ \mathbb{Z}_p $-extensions of imaginary quadratic fields

abstract: Via a novel application of Iwasawa theory, we study Hilbert's tenth problem for number fields occurring in $\mathbb{Z}_p$-towers of imaginary quadratic fields $K$. For a odd prime $p$, the lines $(a,b) \in \mathbb{P}^1(\mathbb{Z}_p)$ are identified with $\mathbb{Z}_p$-extensions $ K_{a,b}/K $. Under certain conditions on $ K $ that involve explicit elliptic curves, we identify a line $(a_0,b_0) \in \mathbb{P}^1(\mathbb{Z}/p\mathbb{Z})$ such that for all $(a,b) \in \mathbb{P}^1(\mathbb{Z}_p)$ with $(a, b)\not\equiv (a_0, b_0)\pmod{p}$, Hilbert's tenth problem has a negative answer in all finite layers of $ K_{a,b} $. Using results of Kriz--Li and Bhargava et al., we demonstrate that for primes $ p = 3, 11, 13, 31, 37 $, a positive proportion of imaginary quadratic fields meet our criteria.


title: Development of large-volume $^{130}$TeO$_2$ bolometers for the CROSS $2\beta$ decay search experiment

abstract: We report on the development of thermal detectors based on large-size tellurium dioxide crystals (45x45x45 mm), containing tellurium enriched in $^{130}$Te to ~91%, for the CROSS double-beta decay experiment. A powder used for the crystals growth was additionally purified by the directional solidification method, resulting in the reduction of the concentration of impurities by a factor 10, to a few ppm of the total concentration of residual elements (the main impurity is Fe). The purest part of the ingot (the first ~200 mm, ~80% of the total length of the cylindrical part of the ingot) was determined by scanning segregation profiles of impurities (both on the surface and in center of the ingot) and used for the $^{130}$TeO$_2$ powder production with no evidence of re-contamination. The crystal growth was verified with precursors produced from powder with natural Te isotopic composition, and two small-size (20x20x10 mm) samples were tested at a sea-level laboratory showing high bolometric and spectrometric performance together with acceptable $^{210}$Po content (below 10 mBq/kg). This growth method was then applied for the production of six large cubic $^{130}$TeO$_2$ crystals for the CROSS experiment and 4 of them were taken randomly to be characterized at the Canfranc underground laboratory, in the CROSS-dedicated low-background cryogenic facility. Two $^{130}$TeO$_2$ samples were coated with a thin metal film in form of Al layer (on 4 sides) or AlPd grid (on a single side) to investigate the possibility to tag surface events by pulse-shape discrimination. Similarly to the small natural precursors, large-volume $^{130}$TeO$_2$ bolometers show high performance and even better internal purity ($^{210}$Po activity ~ 1 mBq/kg, while activities of $^{228}$Th and $^{226}$Ra are below 0.01 mBq/kg), satisfying requirements for the CROSS and, potentially, next-generation experiments.


title: Tessellated phase diagram and extended criticality in driven quasicrystals and quantum Hall matter

abstract: The well-known mapping between 1D quasiperiodic systems and 2D integer quantum Hall matter can also be applied in the presence of driving. Here we explore the effect of time-varying electric fields on the transport properties and phase diagram of Harper-Hofstadter materials. We consider light of arbitrary polarization illuminating a 2D electron gas at high magnetic field; this system maps to a 1D quasicrystal subjected to simultaneous phasonic and dipolar driving. We show that this generalized driving generates a tessellated phase diagram featuring a nested duality-protected pattern of metal-insulator transitions. Circularly or elliptically polarized light can create an extended critical phase, opening up a new route to achieving wavefunction multifractality without fine-tuning to a critical point, as well as induce Floquet topological insulators. We describe in detail a path to experimental realization of these phenomena using lattice-trapped ultracold atoms.


title: Enabling ASR for Low-Resource Languages: A Comprehensive Dataset Creation Approach

abstract: In recent years, automatic speech recognition (ASR) systems have significantly improved, especially in languages with a vast amount of transcribed speech data. However, ASR systems tend to perform poorly for low-resource languages with fewer resources, such as minority and regional languages. This study introduces a novel pipeline designed to generate ASR training datasets from audiobooks, which typically feature a single transcript associated with hours-long audios. The common structure of these audiobooks poses a unique challenge due to the extensive length of audio segments, whereas optimal ASR training requires segments ranging from 4 to 15 seconds. To address this, we propose a method for effectively aligning audio with its corresponding text and segmenting it into lengths suitable for ASR training. Our approach simplifies data preparation for ASR systems in low-resource languages and demonstrates its application through a case study involving the Armenian language. Our method, which is "portable" to many low-resource languages, not only mitigates the issue of data scarcity but also enhances the performance of ASR models for underrepresented languages.


title: Linear and nonlinear propagation of cylindrical vector beam through a non-degenerate four level atomic system

abstract: We investigate the phase-induced susceptibilities for both components of the probe vector beam (PVB) within an atomic system. The atoms are prepared in a non-degenerate four-level configuration. The transitions are coupled by a $\pi$ polarized control field and two orthogonally polarized components of a PVB. We show that the linear susceptibility of the medium depends on the phase shift between the control field and PVB, characterizing loss or gain in the system. Additionally, the phase shift causes polarization rotation in the vector beams (VBs) as they propagate. We further study the effect of nonlinearity on the VB propagation through the medium for a couple of Rayleigh lengths. The self-focusing and defocusing phenomena are observed for radial, azimuthal, and spiral VBs. The special chain-like self-focusing and defocusing leads to the formation of consecutive smaller spot sizes with moderate gain. Therefore, the mechanism of control of susceptibility and self-focusing may hold promise for applications such as transitioning from an absorber to an amplifier, high-resolution microscopy, and optical trap systems.


title: Theory of Eigenstate Thermalisation

abstract: If we prepare an isolated, interacting quantum system in an eigenstate and perturb a local observable at an initial time, its expectation value will relax towards a thermal expectation value, even though the time evolution of the system is deterministic. The eigenstate thermalization hypothesis (ETH) of Deutsch and Srednicki suggests that this is possible because each eigenstate of the full quantum system acts as a thermal bath to its subsystems, such that the reduced density matrices of the subsystems resemble thermal density matrices. Here, we use the observation that the eigenvalue distribution of interacting quantum systems is a Gaussian under very general circumstances, and Dyson Brownian motion random matrix theory, to derive the ETH and thereby elevate it from hypothesis to theory. Our analysis provides a derivation of statistical mechanics which neither requires the concepts of ergodicity or typicality, nor that of entropy. Thermodynamic equilibrium follows solely from the applicability of quantum mechanics to large systems and the absence of integrability.


title: SLANT: Spurious Logo ANalysis Toolkit

abstract: Online content is filled with logos, from ads and social media posts to website branding and product placements. Consequently, these logos are prevalent in the extensive web-scraped datasets used to pretrain Vision-Language Models, which are used for a wide array of tasks (content moderation, object classification). While these models have been shown to learn harmful correlations in various tasks, whether these correlations include logos remains understudied. Understanding this is especially important due to logos often being used by public-facing entities like brands and government agencies. To that end, we develop SLANT: A Spurious Logo ANalysis Toolkit. Our key finding is that some logos indeed lead to spurious incorrect predictions, for example, adding the Adidas logo to a photo of a person causes a model classify the person as greedy. SLANT contains a semi-automatic mechanism for mining such "spurious" logos. The mechanism consists of a comprehensive logo bank, CC12M-LogoBank, and an algorithm that searches the bank for logos that VLMs spuriously correlate with a user-provided downstream recognition target. We uncover various seemingly harmless logos that VL models correlate 1) with negative human adjectives 2) with the concept of `harmlessness'; causing models to misclassify harmful online content as harmless, and 3) with user-provided object concepts; causing lower recognition accuracy on ImageNet zero-shot classification. Furthermore, SLANT's logos can be seen as effective attacks against foundational models; an attacker could place a spurious logo on harmful content, causing the model to misclassify it as harmless. This threat is alarming considering the simplicity of logo attacks, increasing the attack surface of VL models. As a defense, we include in our Toolkit two effective mitigation strategies that seamlessly integrate with zero-shot inference of foundation models.


title: Cones of monotone functions generated by a generalized fractional maximal function

abstract: In this paper, we consider the generalized fractional maximal function and use it to introduce the space of generalized fractional maximal functions and the various cones of monotone functions generated by generalized fractional maximal functions $M_\Phi f$. We introduced three function classes. We give equivalent descriptions of such cones when the function $\Phi$ belongs to some function classes. The conditions for their mutual covering are given. Then, these cones are used to construct a criterion for embedding the space of generalized fractional maximal functions into the rearrangement invariant spaces (RIS). The optimal RIS for such embedding is also described.


title: SAM as the Guide: Mastering Pseudo-Label Refinement in Semi-Supervised Referring Expression Segmentation

abstract: In this paper, we introduce SemiRES, a semi-supervised framework that effectively leverages a combination of labeled and unlabeled data to perform RES. A significant hurdle in applying semi-supervised techniques to RES is the prevalence of noisy pseudo-labels, particularly at the boundaries of objects. SemiRES incorporates the Segment Anything Model (SAM), renowned for its precise boundary demarcation, to improve the accuracy of these pseudo-labels. Within SemiRES, we offer two alternative matching strategies: IoU-based Optimal Matching (IOM) and Composite Parts Integration (CPI). These strategies are designed to extract the most accurate masks from SAM's output, thus guiding the training of the student model with enhanced precision. In instances where a precise mask cannot be matched from the available candidates, we develop the Pixel-Wise Adjustment (PWA) strategy, guiding the student model's training directly by the pseudo-labels. Extensive experiments on three RES benchmarks--RefCOCO, RefCOCO+, and G-Ref reveal its superior performance compared to fully supervised methods. Remarkably, with only 1% labeled data, our SemiRES outperforms the supervised baseline by a large margin, e.g. +18.64% gains on RefCOCO val set. The project code is available at \url{https://github.com/nini0919/SemiRES}.


title: From high-dimensional committors to reactive insights

abstract: Transition path theory (TPT) offers a powerful formalism for extracting the rate and mechanism of rare dynamical transitions between metastable states. Most applications of TPT either focus on systems with modestly sized state spaces or use collective variables to try to tame the curse of dimensionality. Increasingly, expressive function approximators like neural networks and tensor networks have shown promise in computing the central object of TPT, the committor function, even in very high dimensional systems. That progress prompts our consideration of how one could use such a high dimensional function to extract mechanistic insight. Here, we present and illustrate a straightforward but powerful way to track how individual dynamical coordinates evolve during a reactive event. The strategy, which involves marginalizing the reactive ensemble, naturally captures the evolution of the dynamical coordinate's distribution, not just its mean reactive behavior.


title: Flag-like singular integrals and associated Hardy spaces on a kind of nilpotent Lie groups of step two

abstract: The Cauchy-Szeg\"o singular integral is a fundamental tool in the study of holomorphic $H^p$ Hardy space. But for a kind of Siegel domains, the Cauchy-Szeg\"o kernels are neither product ones nor flag ones on the Shilov boundaries, which have the structure of nilpotent Lie groups $\mathscr N $ of step two. We use the lifting method to investigate flag-like singular integrals on $\mathscr N $, which includes these Cauchy-Szeg\"o ones as a special case. The lifting group is the product $\tilde {\mathscr N }$ of three Heisenberg groups, and naturally geometric or analytical objects on $\mathscr N $ are the projection of those on $\tilde {\mathscr N } $. As in the flag case, we introduce various notions on $\mathscr N $ adapted to geometric feature of these kernels, such as tubes, nontangential regions, tube maximal functions, Littlewood-Paley functions, tents, shards and atoms etc. They have the feature of tri-parameters, although the second step of the group $\mathscr N$ is only $2$-dimensional, i.e. there exists a hidden parameter as in the flag case. We also establish the corresponding Calder\'on reproducing formula, characterization of $ L ^p (\mathscr N)$ by Littlewood-Paley functions, $ L ^p $-boundedness of tube maximal functions and flag-like singular integrals and atomic decomposition of $H^1$ Hardy space on $ {\mathscr N } $.


title: Two types of series expansions valid at strong coupling

abstract: It is known that perturbative expansions in powers of the coupling in quantum mechanics (QM) and quantum field theory (QFT) are asymptotic series. This can be useful at weak coupling but fails at strong coupling. In this work, we present two types of series expansions valid at strong coupling. We apply the series to a basic integral as well as a QM path integral containing a quadratic and quartic term with coupling constant $\lambda$. The first series is the usual asymptotic one, where the quartic interaction is expanded in powers of $\lambda$. The second series is an expansion of the quadratic part where the interaction is left alone. This yields an absolutely convergent series in inverse powers of $\lambda$ valid at strong coupling. For the basic integral, we revisit the first series and identify what makes it diverge even though the original integral is finite. We fix the problem and obtain, remarkably, a series in powers of the coupling which is absolutely convergent and valid at strong coupling. We explain how this series avoids Dyson's argument on convergence. We then consider the QM path integral (discretized with time interval divided into $N$ equal segments). As before, the second series is absolutely convergent and we obtain analytical expressions in inverse powers of $\lambda$ for the $n$th order terms by taking functional derivatives of generalized hypergeometric functions. The expressions are functions of $N$ and we work them out explicitly up to third order. The general procedure has been implemented in a Mathematica program that generates the expressions at any order $n$. We present numerical results at strong coupling for different values of $N$ starting at $N=2$. The series matches the exact numerical value for a given $N$ (up to a certain accuracy). The continuum is formally reached when $N\to \infty$ but in practice this can be reached at small $N$.