title: Identifying sparse treatment effects

abstract: Based on technological advances in sensing modalities, randomized trials with primary outcomes represented as high-dimensional vectors have become increasingly prevalent. For example, these outcomes could be week-long time-series data from wearable devices or high-dimensional neuroimaging data, such as from functional magnetic resonance imaging. This paper focuses on randomized treatment studies with such high-dimensional outcomes characterized by sparse treatment effects, where interventions may influence a small number of dimensions, e.g., small temporal windows or specific brain regions. Conventional practices, such as using fixed, low-dimensional summaries of the outcomes, result in significantly reduced power for detecting treatment effects. To address this limitation, we propose a procedure that involves subset selection followed by inference. Specifically, given a potentially large set of outcome summaries, we identify the subset that captures treatment effects, which requires only one call to the Lasso, and subsequently conduct inference on the selected subset. Via theoretical analysis as well as simulations, we demonstrate that our method asymptotically selects the correct subset and increases statistical power.


title: Creation and Manipulation of Higher-Order Topological States by Altermagnets

abstract: We propose to implement tunable higher-order topological states in a heterojunction consisting of a two-dimensional (2D) topological insulator and the recently discovered altermagnets, whose unique spin-polarization in both real and reciprocal space and null magnetization are in contrast to conventional ferromagnets and antiferromagnets. Based on symmetry analysis and effective edge theory, we show that the special spin splitting in altermagnets with different symmetries, such as $d$-wave, can introduce Dirac mass terms with opposite signs on the adjacent boundaries of the topological insulator, resulting in the higher-order topological state with mass-domain bound corner states. Moreover, by adjusting the direction of the N\'{e}el vector, we can manipulate such topological corner states by moving their positions. By first-principles calculations, taking a 2D topological insulator bismuthene with a square lattice on an altermagnet MnF$_2$ as an example, we demonstrate the feasibility of creating and manipulating the higher-order topological states through altermagnets. Finally, we discuss the experimental implementation and detection of the tunable topological corner states, as well as the potential non-Abelian braiding of the Dirac corner fermions.


title: Exploring and Unleashing the Power of Large Language Models in Automated Code Translation

abstract: Code translation tools (transpilers) are developed for automatic source-to-source translation. Although learning-based transpilers have shown impressive enhancement against rule-based counterparts, owing to their task-specific pre-training on extensive monolingual corpora. Their current performance still remains unsatisfactory for practical deployment, and the associated training resources are also prohibitively expensive. LLMs pre-trained on huge amounts of human-written code/text have shown remarkable performance in many code intelligence tasks due to their powerful generality, even without task-specific training. Thus, LLMs can potentially circumvent the above limitations, but they have not been exhaustively explored yet. This paper investigates diverse LLMs and learning-based transpilers for automated code translation tasks, finding that: although certain LLMs have outperformed current transpilers, they still have some accuracy issues, where most of the failures are induced by a lack of comprehension of source programs, missing clear instructions on I/O types in translation, and ignoring discrepancies between source and target programs. Enlightened by the above findings, we further propose UniTrans, a Unified code Translation framework, applicable to various LLMs, for unleashing their power in this field. Specifically, UniTrans first crafts a series of test cases for target programs with the assistance of source programs. Next, it harnesses the above auto-generated test cases to augment the code translation and then evaluate their correctness via execution. Afterward, UniTrans further (iteratively) repairs incorrectly translated programs prompted by test case execution results. Extensive experiments are conducted on six settings of translation datasets between Python, Java, and C++. Three recent LLMs of diverse sizes are tested with UniTrans, and all achieve substantial improvements.


title: Human Behavior Modeling via Identification of Task Objective and Variability

abstract: Human behavior modeling is important for the design and implementation of human-automation interactive control systems. In this context, human behavior refers to a human's control input to systems. We propose a novel method for human behavior modeling that uses human demonstrations for a given task to infer the unknown task objective and the variability. The task objective represents the human's intent or desire. It can be inferred by the inverse optimal control and improve the understanding of human behavior by providing an explainable objective function behind the given human behavior. Meanwhile, the variability denotes the intrinsic uncertainty in human behavior. It can be described by a Gaussian mixture model and capture the uncertainty in human behavior which cannot be encoded by the task objective. The proposed method can improve the prediction accuracy of human behavior by leveraging both task objective and variability. The proposed method is demonstrated through human-subject experiments using an illustrative quadrotor remote control example.


title: Pseudorandom Permutations from Random Reversible Circuits

abstract: We study pseudorandomness properties of permutations on $\{0,1\}^n$ computed by random circuits made from reversible $3$-bit gates (permutations on $\{0,1\}^3$). Our main result is that a random circuit of depth $n \cdot \tilde{O}(k^2)$, with each layer consisting of $\approx n/3$ random gates in a fixed nearest-neighbor architecture, yields almost $k$-wise independent permutations. The main technical component is showing that the Markov chain on $k$-tuples of $n$-bit strings induced by a single random $3$-bit nearest-neighbor gate has spectral gap at least $1/n \cdot \tilde{O}(k)$. This improves on the original work of Gowers [Gowers96], who showed a gap of $1/\mathrm{poly}(n,k)$ for one random gate (with non-neighboring inputs); and, on subsequent work [HMMR05,BH08] improving the gap to $\Omega(1/n^2k)$ in the same setting. From the perspective of cryptography, our result can be seen as a particularly simple/practical block cipher construction that gives provable statistical security against attackers with access to $k$~input-output pairs within few rounds. We also show that the Luby--Rackoff construction of pseudorandom permutations from pseudorandom functions can be implemented with reversible circuits. From this, we make progress on the complexity of the Minimum Reversible Circuit Size Problem (MRCSP), showing that block ciphers of fixed polynomial size are computationally secure against arbitrary polynomial-time adversaries, assuming the existence of one-way functions (OWFs).


title: Bi-CL: A Reinforcement Learning Framework for Robots Coordination Through Bi-level Optimization

abstract: In multi-robot systems, achieving coordinated missions remains a significant challenge due to the coupled nature of coordination behaviors and the lack of global information for individual robots. To mitigate these challenges, this paper introduces a novel approach, Bi-level Coordination Learning (Bi-CL), that leverages a bi-level optimization structure within a centralized training and decentralized execution paradigm. Our bi-level reformulation decomposes the original problem into a reinforcement learning level with reduced action space, and an imitation learning level that gains demonstrations from a global optimizer. Both levels contribute to improved learning efficiency and scalability. We note that robots' incomplete information leads to mismatches between the two levels of learning models. To address this, Bi-CL further integrates an alignment penalty mechanism, aiming to minimize the discrepancy between the two levels without degrading their training efficiency. We introduce a running example to conceptualize the problem formulation and apply Bi-CL to two variations of this example: route-based and graph-based scenarios. Simulation results demonstrate that Bi-CL can learn more efficiently and achieve comparable performance with traditional multi-agent reinforcement learning baselines for multi-robot coordination.


title: On the homology of partial group actions

abstract: We study the partial group (co)homology of partial group actions using simplicial methods. We introduce the concept of universal globalization of a partial group action on a $K$-module and prove that, given a partial representation of $G$ on $M$, the partial group homology $H^{par}_{\bullet}(G, M)$ is naturally isomorphic to the usual group homology $H_{\bullet}(G, KG \otimes_{G_{par}} M)$, where $KG \otimes_{G_{par}} M$ is the universal globalization of the partial group action associated to $M$. We dualize this result into a cohomological spectral sequence converging to $H^{\bullet}_{par}(G,M)$.


title: Forecasting the Forced Van der Pol Equation with Frequent Phase Shifts Using a Reservoir Computer

abstract: A reservoir computer (RC) is a recurrent neural network (RNN) framework that achieves computational efficiency where only readout layer training is required. Additionally, it effectively predicts nonlinear dynamical system tasks and has various applications. RC is effective for forecasting nonautonomous dynamical systems with gradual changes to the external drive amplitude. This study investigates the predictability of nonautonomous dynamical systems with rapid changes to the phase of the external drive. The forced Van der Pol equation was employed for the base model, implementing forecasting tasks with the RC. The study findings suggest that, despite hidden variables, a nonautonomous dynamical system with rapid changes to the phase of the external drive is predictable. Therefore, RC can offer better schedules for individual shift workers.


title: Transonic shocks for steady Euler flows with an external force in an axisymmetric perturbed cylinder

abstract: We concern the structural stability of transonic shocks for the steady Euler system with an external force in an axisymmetric perturbed cylinder. For a class of external forces, we first prove the existence and uniqueness of the transonic shock solution to the one-dimensional steady Euler system with an external force, which shows that the external force has a stabilization effect on the transonic shock in the flat cylinder and the shock position is uniquely determined. We then establish the existence and stability of the transonic shock solution under axisymmetric perturbations of the incoming supersonic flow, the nozzle boundary, the exit pressure and the external force. Different from the transonic shock problem in two-dimensional nozzles, there exists a singularity along the symmetric axis for axisymmetric flows. We introduce an invertible modified Lagrangian transformation to overcome this difficulty and straighten the streamline. One of the key elements in the analysis is to utilize the deformation-curl decomposition to effectively decouple the hyperbolic and elliptic modes in the steady axisymmetric Euler system with an external force. Another one is an equivalent reformulation of the Rankine-Hugoniot conditions so that the shock front is uniquely determined by an algebraic equation.


title: Machine Vision Based Assessment of Fall Color Changes in Apple Trees: Exploring Relationship with Leaf Nitrogen Concentration

abstract: Apple trees being deciduous trees, shed leaves each year which is preceded by the change in color of leaves from green to yellow (also known as senescence) during the fall season. The rate and timing of color change are affected by the number of factors including nitrogen (N) deficiencies. The green color of leaves is highly dependent on the chlorophyll content, which in turn depends on the nitrogen concentration in the leaves. The assessment of the leaf color can give vital information on the nutrient status of the tree. The use of a machine vision based system to capture and quantify these timings and changes in leaf color can be a great tool for that purpose. \par This study is based on data collected during the fall of 2021 and 2023 at a commercial orchard using a ground-based stereo-vision sensor for five weeks. The point cloud obtained from the sensor was segmented to get just the tree in the foreground. The study involved the segmentation of the trees in a natural background using point cloud data and quantification of the color using a custom-defined metric, \textit{yellowness index}, varying from $-1$ to $+1$ ($-1$ being completely green and $+1$ being completely yellow), which gives the proportion of yellow leaves on a tree. The performance of K-means based algorithm and gradient boosting algorithm were compared for \textit{yellowness index} calculation. The segmentation method proposed in the study was able to estimate the \textit{yellowness index} on the trees with $R^2 = 0.72$. The results showed that the metric was able to capture the gradual color transition from green to yellow over the study duration. It was also observed that the trees with lower nitrogen showed the color transition to yellow earlier than the trees with higher nitrogen. The onset of color transition during both years aligned with the $29^{th}$ week post-full bloom.


title: Inverse limit method for generalized Bratteli diagrams and invariant measures

abstract: Generalized Bratteli diagrams with a countable set of vertices in every level are models for aperiodic Borel automorphisms. This paper is devoted to the description of all ergodic probability tail invariant measures on the path spaces of generalized Bratteli diagrams. Such measures can be identified with inverse limits of infinite-dimensional simplices associated with levels in generalized Bratteli diagrams. Though this method is general, we apply it to several classes of reducible generalized Bratteli diagrams. In particular, we explicitly describe all ergodic tail invariant probability measures for (i) the infinite Pascal graph and give the formulas for the values of such measures on cylinder sets, (ii) generalized Bratteli diagrams formed by a countable set of odometers, (iii) reducible generalized Bratteli diagrams with uncountable set of ergodic tail invariant probability measures. We also consider the method of measure extension by tail invariance from subdiagrams. We discuss the properties of the Vershik map defined on reducible generalized Bratteli diagrams.


title: Geometric Optimization of Restricted-Open and Complete Active Space Self-Consistent Field Wavefunctions

abstract: We explore Riemannian optimization methods for Restricted-Open-shell Hartree-Fock (ROHF) and Complete Active Space Self-Consistent Field (CASSCF) methods. After showing that ROHF and CASSCF can be reformulated as optimization problems on so-called flag manifolds, we review Riemannian optimization basics and their application to these specific problems. We compare these methods to traditional ones and find robust convergence properties without fine-tuning of numerical parameters. Our study suggests Riemannian optimization as a valuable addition to orbital optimization for ROHF and CASSCF, warranting further investigation.


title: A Non-staggered Projection Algorithm for Two-Phase Fluid-Structure Interaction Simulation Using the Phase-Field/Immersed-Boundary Method

abstract: We present a Pressure-Oscillation-Free projection algorithm for large-density-ratio multiphase fluid-structure interaction simulations, implemented on a non-staggered Cartesian grid. The incompressible Navier-Stokes is decoupled with an improved five-step incremental pressure correction algorithm. Fluid-fluid interface is captured using the Cahn-Hilliard equation, and the surface tension model is coupled with a momentum-weighted interpolation scheme to suppress unphysical pressure oscillations, ensuring accurate evolution of multiphase interfaces. Interaction at the fluid-structure interface is obtained by implicitly solving for the feedback acceleration in the Eulerian-Lagrangian system. For validation of the present method, the comparison studies for Pressure-Oscillation-Free effect are systematically conducted using lid driving cavity and droplet deformation cases. Moreover, several challenging multiphase simulations are implemented and discussed. As a demonstrating example of fluid-structure interaction, a rising bubble bypassing an obstacle is tested.


title: Progressive Token Length Scaling in Transformer Encoders for Efficient Universal Segmentation

abstract: A powerful architecture for universal segmentation relies on transformers that encode multi-scale image features and decode object queries into mask predictions. With efficiency being a high priority for scaling such models, we observed that the state-of-the-art method Mask2Former uses ~50% of its compute only on the transformer encoder. This is due to the retention of a full-length token-level representation of all backbone feature scales at each encoder layer. With this observation, we propose a strategy termed PROgressive Token Length SCALing for Efficient transformer encoders (PRO-SCALE) that can be plugged-in to the Mask2Former-style segmentation architectures to significantly reduce the computational cost. The underlying principle of PRO-SCALE is: progressively scale the length of the tokens with the layers of the encoder. This allows PRO-SCALE to reduce computations by a large margin with minimal sacrifice in performance (~52% GFLOPs reduction with no drop in performance on COCO dataset). We validate our framework on multiple public benchmarks.


title: Anti-pig Antibodies in Swine Veterinarian Serum: Implications for Clinical Xenotransplantation

abstract: Recent clinical xenotransplantation and human decedent studies demonstrate that clinical hyperacute rejection of genetically engineered porcine organs can be reliably avoided but that antibody mediated rejection continues to limit graft survival. We previously identified porcine glycans and proteins which are immunogenic after cardiac xenotransplantation in nonhuman primates, but the clinical immune response to antigens present in glycan depleted triple knockout (TKO) donor pigs is poorly understood. In this study we use fluorescence barcoded HEK cells and HEK cell lines expressing porcine glycans (Gal and SDa) or proteins (CD9, CD46, CD59, PROCR and ANXA2) to screen antibody reactivity in human serum from 160 swine veterinarians, a serum source with potential occupational immune challenge from porcine tissues and pathogens. High levels of anti-Gal IgM were present in all samples and lower levels of anti-SDa IgM were present in 41% of samples. IgM binding to porcine proteins, primarily CD9 and CD46, previously identified as immunogenic in pig to non-human primate cardiac xenograft recipients, was detected in 28 of the 160 swine veterinarian samples. These results suggest that barcoded HEK cell lines expressing porcine protein antigens can be useful for screening human patient serum. A comprehensive analysis of sera from clinical xenotransplant recipients to define a panel of commonly immunogenic porcine antigens will likely be necessary to establish an array of porcine non-Gal antigens for effective monitoring of patient immune responses and allow earlier therapies to reverse antibody mediated rejection.


title: Droplet impact behavior on a hydrophobic plate with a wettability-patterned orifice

abstract: Droplet impact behavior has attracted much attention recently due to its academic significance and diverse industrial applications. This study employs the lattice Boltzmann method to simulate the impact of a droplet on a hydrophobic plate featuring a square orifice. Unlike previous studies, the chemical property of the orifice considered in this work is not homogeneous but heterogeneous, and its cross-sectional wettability changes from hydrophobicity to hydrophilicity. The study first validates the numerical method against experimental data, and then investigates in detail the influences of the Weber number, wettability difference, and pore size. According to the numerical results, we observed that the evolutionary stages of the impinging droplet always include the spreading phase and the rebounding phase, while whether there exists the splitting phase, it depends on the combined effect of the wettability difference and the Weber number. The impact behavior of droplets is analyzed by evaluating the underlying mechanisms such as kinetic energy, surface energy, viscous dissipation energy, and pressure. It is interesting to note that the existence of wettability-patterned pore tends to promote adhesion of droplets on the plate, resulting in the droplet impact behaviors are largely different from that for the case of homogeneous pore. Additionally, a phase diagram is constructed for various Weber numbers and pore sizes, revealing that the dynamic behavior of droplets is determined by the competition among dynamic pressure, capillary pressure, and viscous pressure losses. These insights from numerical studies guide the development of innovative solid substrates capable of manipulating droplet motion.


title: AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance

abstract: Public sector use of AI has been quietly on the rise for the past decade, but only recently have efforts to regulate it entered the cultural zeitgeist. While simple to articulate, promoting ethical and effective roll outs of AI systems in government is a notoriously elusive task. On the one hand there are hard-to-address pitfalls associated with AI-based tools, including concerns about bias towards marginalized communities, safety, and gameability. On the other, there is pressure not to make it too difficult to adopt AI, especially in the public sector which typically has fewer resources than the private sector$\unicode{x2014}$conserving scarce government resources is often the draw of using AI-based tools in the first place. These tensions create a real risk that procedures built to ensure marginalized groups are not hurt by government use of AI will, in practice, be performative and ineffective. To inform the latest wave of regulatory efforts in the United States, we look to jurisdictions with mature regulations around government AI use. We report on lessons learned by officials in Brazil, Singapore and Canada, who have collectively implemented risk categories, disclosure requirements and assessments into the way they procure AI tools. In particular, we investigate two implemented checklists: the Canadian Directive on Automated Decision-Making (CDADM) and the World Economic Forum's AI Procurement in a Box (WEF). We detail three key pitfalls around expertise, risk frameworks and transparency, that can decrease the efficacy of regulations aimed at government AI use and suggest avenues for improvement.


title: First Mapping the Canopy Height of Primeval Forests in the Tallest Tree Area of Asia

abstract: We have developed the world's first canopy height map of the distribution area of world-level giant trees. This mapping is crucial for discovering more individual and community world-level giant trees, and for analyzing and quantifying the effectiveness of biodiversity conservation measures in the Yarlung Tsangpo Grand Canyon (YTGC) National Nature Reserve. We proposed a method to map the canopy height of the primeval forest within the world-level giant tree distribution area by using a spaceborne LiDAR fusion satellite imagery (Global Ecosystem Dynamics Investigation (GEDI), ICESat-2, and Sentinel-2) driven deep learning modeling. And we customized a pyramid receptive fields depth separable CNN (PRFXception). PRFXception, a CNN architecture specifically customized for mapping primeval forest canopy height to infer the canopy height at the footprint level of GEDI and ICESat-2 from Sentinel-2 optical imagery with a 10-meter spatial resolution. We conducted a field survey of 227 permanent plots using a stratified sampling method and measured several giant trees using UAV-LS. The predicted canopy height was compared with ICESat-2 and GEDI validation data (RMSE =7.56 m, MAE=6.07 m, ME=-0.98 m, R^2=0.58 m), UAV-LS point clouds (RMSE =5.75 m, MAE =3.72 m, ME = 0.82 m, R^2= 0.65 m), and ground survey data (RMSE = 6.75 m, MAE = 5.56 m, ME= 2.14 m, R^2=0.60 m). We mapped the potential distribution map of world-level giant trees and discovered two previously undetected giant tree communities with an 89% probability of having trees 80-100 m tall, potentially taller than Asia's tallest tree. This paper provides scientific evidence confirming southeastern Tibet--northwestern Yunnan as the fourth global distribution center of world-level giant trees initiatives and promoting the inclusion of the YTGC giant tree distribution area within the scope of China's national park conservation.


title: NExT: Teaching Large Language Models to Reason about Code Execution

abstract: A fundamental skill among human developers is the ability to understand and reason about program execution. As an example, a programmer can mentally simulate code execution in natural language to debug and repair code (aka. rubber duck debugging). However, large language models (LLMs) of code are typically trained on the surface textual form of programs, thus may lack a semantic understanding of how programs execute at run-time. To address this issue, we propose NExT, a method to teach LLMs to inspect the execution traces of programs (variable states of executed lines) and reason about their run-time behavior through chain-of-thought (CoT) rationales. Specifically, NExT uses self-training to bootstrap a synthetic training set of execution-aware rationales that lead to correct task solutions (e.g., fixed programs) without laborious manual annotation. Experiments on program repair tasks based on MBPP and HumanEval demonstrate that NExT improves the fix rate of a PaLM 2 model, by 26.1% and 14.3% absolute, respectively, with significantly improved rationale quality as verified by automated metrics and human raters. Our model can also generalize to scenarios where program traces are absent at test-time.


title: VLBI with SKA: Possible Arrays and Astrometric Science

abstract: The next generation of very long baseline interferometry (VLBI) is stepping into the era of microarcsecond ($\mu$as) astronomy, and pushing astronomy, especially astrometry, to new heights. VLBI with the Square Kilometre Array (SKA), SKA-VLBI, will increase current sensitivity by an order of magnitude, and reach astrometric precision routinely below 10 $\mu$as, even challenging 1 $\mu$as. This advancement allows precise parallax and proper motion measurements of various celestial objects. Such improvements can be used to study objects (including isolated objects, and binary or multiple systems) in different stellar stages (such as star formation, main-sequence stars, asymptotic giant branch stars, pulsars, black holes, white dwarfs, etc.), unveil the structure and evolution of complex systems (such as the Milky Way), benchmark the international celestial reference frame, and reveal cosmic expansion. Furthermore, the theory of general relativity can also be tested with SKA-VLBI using precise measurements of light deflection under the gravitational fields of different solar system objects and the perihelion precession of solar system objects.

categories: astro-ph.GA astro-ph.CO astro-ph.IM astro-ph.SR gr-qc


title: Employing Layerwised Unsupervised Learning to Lessen Data and Loss Requirements in Forward-Forward Algorithms

abstract: Recent deep learning models such as ChatGPT utilizing the back-propagation algorithm have exhibited remarkable performance. However, the disparity between the biological brain processes and the back-propagation algorithm has been noted. The Forward-Forward algorithm, which trains deep learning models solely through the forward pass, has emerged to address this. Although the Forward-Forward algorithm cannot replace back-propagation due to limitations such as having to use special input and loss functions, it has the potential to be useful in special situations where back-propagation is difficult to use. To work around this limitation and verify usability, we propose an Unsupervised Forward-Forward algorithm. Using an unsupervised learning model enables training with usual loss functions and inputs without restriction. Through this approach, we lead to stable learning and enable versatile utilization across various datasets and tasks. From a usability perspective, given the characteristics of the Forward-Forward algorithm and the advantages of the proposed method, we anticipate its practical application even in scenarios such as federated learning, where deep learning layers need to be trained separately in physically distributed environments.


title: Illuminating the Unseen: Investigating the Context-induced Harms in Behavioral Sensing

abstract: Behavioral sensing technologies are rapidly evolving across a range of well-being applications. Despite its potential, concerns about the responsible use of such technology are escalating. In response, recent research within the sensing technology has started to address these issues. While promising, they primarily focus on broad demographic categories and overlook more nuanced, context-specific identities. These approaches lack grounding within domain-specific harms that arise from deploying sensing technology in diverse social, environmental, and technological settings. Additionally, existing frameworks for evaluating harms are designed for a generic ML life cycle, and fail to adapt to the dynamic and longitudinal considerations for behavioral sensing technology. To address these gaps, we introduce a framework specifically designed for evaluating behavioral sensing technologies. This framework emphasizes a comprehensive understanding of context, particularly the situated identities of users and the deployment settings of the sensing technology. It also highlights the necessity for iterative harm mitigation and continuous maintenance to adapt to the evolving nature of technology and its use. We demonstrate the feasibility and generalizability of our framework through post-hoc evaluations on two real-world behavioral sensing studies conducted in different international contexts, involving varied population demographics and machine learning tasks. Our evaluations provide empirical evidence of both situated identity-based harm and more domain-specific harms, and discuss the trade-offs introduced by implementing bias mitigation techniques.


title: Reversal in Thermally Driven Rotation of Chiral Liquid Crystal Droplets

abstract: For chiral liquid crystals that express topologically protected defects and thermally driven mechanical rotation, the size- and temperature-driven reversal of the rotational direction of their droplets was demonstrated even under a fixed temperature gradient. This unconventional reversal indicates the dependence of thermomechanical coupling on the molecular orientational order, this dependence is justified through an examination of the size, temperature, and molecular structure as well as by phenomenological arguments on the order parameter.


title: 3DFlowRenderer: One-shot Face Re-enactment via Dense 3D Facial Flow Estimation

abstract: Performing facial expression transfer under one-shot setting has been increasing in popularity among research community with a focus on precise control of expressions. Existing techniques showcase compelling results in perceiving expressions, but they lack robustness with extreme head poses. They also struggle to accurately reconstruct background details, thus hindering the realism. In this paper, we propose a novel warping technology which integrates the advantages of both 2D and 3D methods to achieve robust face re-enactment. We generate dense 3D facial flow fields in feature space to warp an input image based on target expressions without depth information. This enables explicit 3D geometric control for re-enacting misaligned source and target faces. We regularize the motion estimation capability of the 3D flow prediction network through proposed "Cyclic warp loss" by converting warped 3D features back into 2D RGB space. To ensure the generation of finer facial region with natural-background, our framework only renders the facial foreground region first and learns to inpaint the blank area which needs to be filled due to source face translation, thus reconstructing the detailed background without any unwanted pixel motion. Extensive evaluation reveals that our method outperforms state-of-the-art techniques in rendering artifact-free facial images.


title: Source Localization for Cross Network Information Diffusion

abstract: Source localization aims to locate information diffusion sources only given the diffusion observation, which has attracted extensive attention in the past few years. Existing methods are mostly tailored for single networks and may not be generalized to handle more complex networks like cross-networks. Cross-network is defined as two interconnected networks, where one network's functionality depends on the other. Source localization on cross-networks entails locating diffusion sources on the source network by only giving the diffused observation in the target network. The task is challenging due to challenges including: 1) diffusion sources distribution modeling; 2) jointly considering both static and dynamic node features; and 3) heterogeneous diffusion patterns learning. In this work, we propose a novel method, namely CNSL, to handle the three primary challenges. Specifically, we propose to learn the distribution of diffusion sources through Bayesian inference and leverage disentangled encoders to separately learn static and dynamic node features. The learning objective is coupled with the cross-network information propagation estimation model to make the inference of diffusion sources considering the overall diffusion process. Additionally, we also provide two novel cross-network datasets collected by ourselves. Extensive experiments are conducted on both datasets to demonstrate the effectiveness of \textit{CNSL} in handling the source localization on cross-networks.


title: Who told you magnetization is a vector in $4-\epsilon$ dimensions?

abstract: But if you treat it as a two-form, you get three nontrivial renormalization group fixed points! Which becomes the Heisenberg fixed point in three dimensions? Motivated by this question, we study the conformal bootstrap constraint in the $O(d)$ anti-symmetric matrix model in $d$ dimensions, varying $d$ as a continuous parameter. Besides the one that is naturally connected to the Heisenberg fixed point in three dimensions, we find "evanescent" kinks whose origin is yet to be identified. We also bootstrap $O(4), O(5), O(6)$ anti-symmetric matrix model in $d=3$, aiming at physical applications.


title: On the sizes of BDDs and ZDDs representing matroids

abstract: Matroids are often represented as oracles since there are no unified and compact representations for general matroids. This paper initiates the study of binary decision diagrams (BDDs) and zero-suppressed binary decision diagrams (ZDDs) as relatively compact data structures for representing matroids in a computer. This study particularly focuses on the sizes of BDDs and ZDDs representing matroids. First, we compare the sizes of different variations of BDDs and ZDDs for a matroid. These comparisons involve concise transformations between specific decision diagrams. Second, we provide upper bounds on the size of BDDs and ZDDs for several classes of matroids. These bounds are closely related to the number of minors of the matroid and depend only on the connectivity function or pathwidth of the matroid, which deeply relates to the classes of matroids called strongly pigeonhole classes. In essence, these results indicate upper bounds on the number of minors for specific classes of matroids and new strongly pigeonhole classes.


title: LaneCorrect: Self-supervised Lane Detection

abstract: Lane detection has evolved highly functional autonomous driving system to understand driving scenes even under complex environments. In this paper, we work towards developing a generalized computer vision system able to detect lanes without using any annotation. We make the following contributions: (i) We illustrate how to perform unsupervised 3D lane segmentation by leveraging the distinctive intensity of lanes on the LiDAR point cloud frames, and then obtain the noisy lane labels in the 2D plane by projecting the 3D points; (ii) We propose a novel self-supervised training scheme, dubbed LaneCorrect, that automatically corrects the lane label by learning geometric consistency and instance awareness from the adversarial augmentations; (iii) With the self-supervised pre-trained model, we distill to train a student network for arbitrary target lane (e.g., TuSimple) detection without any human labels; (iv) We thoroughly evaluate our self-supervised method on four major lane detection benchmarks (including TuSimple, CULane, CurveLanes and LLAMAS) and demonstrate excellent performance compared with existing supervised counterpart, whilst showing more effective results on alleviating the domain gap, i.e., training on CULane and test on TuSimple.


title: Locally dualisable modular representations and local regularity

abstract: This work concerns the stable module category of a finite group over a field of characteristic dividing the group order. The minimal localising tensor ideals correspond to the non-maximal homogeneous prime ideals in the cohomology ring of the group. Given such a prime ideal, a number of characterisations of the dualisable objects in the corresponding tensor ideal are given. One characterisation of interest is that they are exactly the modules whose restriction along a corresponding $\pi$-point are finite dimensional plus projective. A key insight is the identification of a special property of the stable module category that controls the cohomological behaviour of local dualisable objects. This property, introduced in this work for general triangulated categories and called local regularity, is related to strong generation. A major part of the paper is devoted to developing this notion and investigating its ramifications for various special classes of objects in tensor triangulated categories.


title: High-Dimensional Two-Photon Quantum Controlled Phase-Flip Gate

abstract: High-dimensional quantum systems have been used to reveal interesting fundamental physics and to improve information capacity and noise resilience in quantum information processing. However, it remains a significant challenge to realize universal two-photon quantum gates in high dimensions with high success probability. Here, by considering an ion-cavity QED system, we theoretically propose, to the best of our knowledge, the first high-dimensional, deterministic and universal two-photon quantum gate. By using an optical cavity embedded with a single trapped 40Ca+ ion, we achieve a high average fidelity larger than 98% for a quantum controlled phase-flip gate in four-dimensional space, spanned by photonic spin angular momenta and orbital angular momenta. Our proposed system can be an essential building block for high-dimensional quantum information processing, and also provides a platform for studying high-dimensional cavity QED.


title: HOIN: High-Order Implicit Neural Representations

abstract: Implicit neural representations (INR) suffer from worsening spectral bias, which results in overly smooth solutions to the inverse problem. To deal with this problem, we propose a universal framework for processing inverse problems called \textbf{High-Order Implicit Neural Representations (HOIN)}. By refining the traditional cascade structure to foster high-order interactions among features, HOIN enhances the model's expressive power and mitigates spectral bias through its neural tangent kernel's (NTK) strong diagonal properties, accelerating and optimizing inverse problem resolution. By analyzing the model's expression space, high-order derivatives, and the NTK matrix, we theoretically validate the feasibility of HOIN. HOIN realizes 1 to 3 dB improvements in most inverse problems, establishing a new state-of-the-art recovery quality and training efficiency, thus providing a new general paradigm for INR and paving the way for it to solve the inverse problem.


title: Rational Exceptional Belyi Coverings

abstract: Exceptional Belyi covering is a connected Belyi covering uniquely determined by its ramification scheme or the respective dessin d'enfant. We focus on rational exceptional Belyi coverings of compact Riemann surfaces of genus 0. Well known examples are cyclic, dihedral, and Chebyshev coverings. Using Maple, we identified all rational exceptional Belyi coverings up to degree 15. Their Belyi functions were calculated for degrees up to 6 along with some for degree 7. We also found new infinite series.


title: DreamPBR: Text-driven Generation of High-resolution SVBRDF with Multi-modal Guidance

abstract: Prior material creation methods had limitations in producing diverse results mainly because reconstruction-based methods relied on real-world measurements and generation-based methods were trained on relatively small material datasets. To address these challenges, we propose DreamPBR, a novel diffusion-based generative framework designed to create spatially-varying appearance properties guided by text and multi-modal controls, providing high controllability and diversity in material generation. Key to achieving diverse and high-quality PBR material generation lies in integrating the capabilities of recent large-scale vision-language models trained on billions of text-image pairs, along with material priors derived from hundreds of PBR material samples. We utilize a novel material Latent Diffusion Model (LDM) to establish the mapping between albedo maps and the corresponding latent space. The latent representation is then decoded into full SVBRDF parameter maps using a rendering-aware PBR decoder. Our method supports tileable generation through convolution with circular padding. Furthermore, we introduce a multi-modal guidance module, which includes pixel-aligned guidance, style image guidance, and 3D shape guidance, to enhance the control capabilities of the material LDM. We demonstrate the effectiveness of DreamPBR in material creation, showcasing its versatility and user-friendliness on a wide range of controllable generation and editing applications.


title: Streamlined jet tagging network assisted by jet prong structure

abstract: Attention-based transformer models have become increasingly prevalent in collider analysis, offering enhanced performance for tasks such as jet tagging. However, they are computationally intensive and require substantial data for training. In this paper, we introduce a new jet classification network using an MLP mixer, where two subsequent MLP operations serve to transform particle and feature tokens over the jet constituents. The transformed particles are combined with subjet information using multi-head cross-attention so that the network is invariant under the permutation of the jet constituents. We utilize two clustering algorithms to identify subjets: the standard sequential recombination algorithms with fixed radius parameters and a new IRC-safe, density-based algorithm of dynamic radii based on HDBSCAN. The proposed network demonstrates comparable classification performance to state-of-the-art models while boosting computational efficiency drastically. Finally, we evaluate the network performance using various interpretable methods, including centred kernel alignment and attention maps, to highlight network efficacy in collider analysis tasks.


title: 3DBench: A Scalable 3D Benchmark and Instruction-Tuning Dataset

abstract: Evaluating the performance of Multi-modal Large Language Models (MLLMs), integrating both point cloud and language, presents significant challenges. The lack of a comprehensive assessment hampers determining whether these models truly represent advancements, thereby impeding further progress in the field. Current evaluations heavily rely on classification and caption tasks, falling short in providing a thorough assessment of MLLMs. A pressing need exists for a more sophisticated evaluation method capable of thoroughly analyzing the spatial understanding and expressive capabilities of these models. To address these issues, we introduce a scalable 3D benchmark, accompanied by a large-scale instruction-tuning dataset known as 3DBench, providing an extensible platform for a comprehensive evaluation of MLLMs. Specifically, we establish the benchmark that spans a wide range of spatial and semantic scales, from object-level to scene-level, addressing both perception and planning tasks. Furthermore, we present a rigorous pipeline for automatically constructing scalable 3D instruction-tuning datasets, covering 10 diverse multi-modal tasks with more than 0.23 million QA pairs generated in total. Thorough experiments evaluating trending MLLMs, comparisons against existing datasets, and variations of training protocols demonstrate the superiority of 3DBench, offering valuable insights into current limitations and potential research directions.


title: A Multi-Dimensional Online Contention Resolution Scheme for Revenue Maximization

abstract: We study multi-buyer multi-item sequential item pricing mechanisms for revenue maximization with the goal of approximating a natural fractional relaxation -- the ex ante optimal revenue. We assume that buyers' values are subadditive but make no assumptions on the value distributions. While the optimal revenue, and therefore also the ex ante benchmark, is inapproximable by any simple mechanism in this context, previous work has shown that a weaker benchmark that optimizes over so-called ``buy-many" mechanisms can be approximable. Approximations are known, in particular, for settings with either a single buyer or many unit-demand buyers. We extend these results to the much broader setting of many subadditive buyers. We show that the ex ante buy-many revenue can be approximated via sequential item pricings to within an $O(\log^2 m)$ factor, where $m$ is the number of items. We also show that a logarithmic dependence on $m$ is necessary. Our approximation is achieved through the construction of a new multi-dimensional Online Contention Resolution Scheme (OCRS), that provides an online rounding of the optimal ex ante solution. Chawla et al. arXiv:2204.01962 previously constructed an OCRS for revenue for unit-demand buyers, but their construction relied heavily on the ``almost single dimensional" nature of unit-demand values. Prior to that work, OCRSes have only been studied in the context of social welfare maximization for single-parameter buyers. For the welfare objective, constant-factor approximations have been demonstrated for a wide range of combinatorial constraints on item allocations and classes of buyer valuation functions. Our work opens up the possibility of a similar success story for revenue maximization.


title: Automated Multi-Language to English Machine Translation Using Generative Pre-Trained Transformers

abstract: The task of accurate and efficient language translation is an extremely important information processing task. Machine learning enabled and automated translation that is accurate and fast is often a large topic of interest in the machine learning and data science communities. In this study, we examine using local Generative Pretrained Transformer (GPT) models to perform automated zero shot black-box, sentence wise, multi-natural-language translation into English text. We benchmark 16 different open-source GPT models, with no custom fine-tuning, from the Huggingface LLM repository for translating 50 different non-English languages into English using translated TED Talk transcripts as the reference dataset. These GPT model inference calls are performed strictly locally, on single A100 Nvidia GPUs. Benchmark metrics that are reported are language translation accuracy, using BLEU, GLEU, METEOR, and chrF text overlap measures, and wall-clock time for each sentence translation. The best overall performing GPT model for translating into English text for the BLEU metric is ReMM-v2-L2-13B with a mean score across all tested languages of $0.152$, for the GLEU metric is ReMM-v2-L2-13B with a mean score across all tested languages of $0.256$, for the chrF metric is Llama2-chat-AYT-13B with a mean score across all tested languages of $0.448$, and for the METEOR metric is ReMM-v2-L2-13B with a mean score across all tested languages of $0.438$.


title: Physical Vapor Deposition of High Mobility P-type Tellurium and its Applications for Gate-tunable van der Waals PN Photodiodes

abstract: Recently tellurium (Te) has attracted resurgent interests due to its p-type characteristics and outstanding ambient environmental stability. Here we present a substrate engineering based physical vapor deposition method to synthesize high-quality Te nanoflakes and achieved a field-effect hole mobility of 1500 cm2/Vs, which is, to the best of our knowledge, the highest among the existing synthesized van der Waals p-type semiconductors. The high mobility Te enables the fabrication of Te/MoS2 pn diodes with highly gate-tunable electronic and optoelectronic characteristics. The Te/MoS2 heterostructure can be used as a visible range photodetector with a current responsivity up to 630 A/W, which is about one order of magnitude higher than the one achieved using p-type Si-MoS2 PN photodiodes. The photo response of the Te/MoS2 heterojunction also exhibits strong gate tunability due to their ultrathin thickness and unique band structures. The successful synthesis of high mobility Te and the enabled Te/MoS2 photodiodes show promise for the development of highly tunable and ultrathin photodetectors.


title: Uncovering Name-Based Biases in Large Language Models Through Simulated Trust Game

abstract: Gender and race inferred from an individual's name are a notable source of stereotypes and biases that subtly influence social interactions. Abundant evidence from human experiments has revealed the preferential treatment that one receives when one's name suggests a predominant gender or race. As large language models acquire more capabilities and begin to support everyday applications, it becomes crucial to examine whether they manifest similar biases when encountering names in a complex social interaction. In contrast to previous work that studies name-based biases in language models at a more fundamental level, such as word representations, we challenge three prominent models to predict the outcome of a modified Trust Game, a well-publicized paradigm for studying trust and reciprocity. To ensure the internal validity of our experiments, we have carefully curated a list of racially representative surnames to identify players in a Trust Game and rigorously verified the construct validity of our prompts. The results of our experiments show that our approach can detect name-based biases in both base and instruction-tuned models.


title: Some Remarks on Controllability of the Liouville Equation

abstract: We revisit the work of Roger Brockett on controllability of the Liouville equation, with a particular focus on the following problem: Given a smooth controlled dynamical system of the form $\dot{x} = f(x,u)$ and a state-space diffeomorphism $\psi$, design a feedback control $u(t,x)$ to steer an arbitrary initial state $x_0$ to $\psi(x_0)$ in finite time. This formulation of the problem makes contact with the theory of optimal transportation and with nonlinear controllability. For controllable linear systems, Brockett showed that this is possible under a fairly restrictive condition on $\psi$. We prove that controllability suffices for a much larger class of diffeomorphisms. For nonlinear systems defined on smooth manifolds, we review a recent result of Agrachev and Caponigro regarding controllability on the group of diffeomorphisms. A corollary of this result states that, for control-affine systems satisfying a bracket generating condition, any $\psi$ in a neighborhood of the identity can be implemented using a time-varying feedback control law that switches between finitely many time-invariant flows. We prove a quantitative version which allows us to describe the implementation complexity of the Agrachev-Caponigro construction in terms of a lower bound on the number of switchings.


title: Tests of gravitational wave propagation with LIGO-Virgo catalog

abstract: In the framework of general relativity (GR), gravitational waves (GWs) are theorized to travel at the speed of light across all frequencies. However, Lorentz invariance (LI) violation and weak equivalence principle (WEP) violation may lead to frequency-dependent variations in the propagation speed of GWs, which can be examined by comparing the theoretical and observed discrepancies in the arrival times of GW signals at various frequencies. This provides us with an opportunity to test these theories. In theories involving LI violations, we focus on the massive gravity with the graviton mass $m_g$. In the case of WEP violation, different massless particles exposed to the same gravitational source should exhibit varying gravitational time delays. The gravitational time delay induced by massive gravitational sources is proportional to $\gamma+1$, where the parameter $\gamma=1$ in GR. Therefore, we can quantify these two violations using the graviton mass $m_g$ and $|\Delta \gamma|$, respectively. In this study, we use selected GW data from binary black hole coalescences in the LIGO-Virgo catalogs GWTC-2.1 and GWTC-3 to place constraints on the parameters $m_g$ and $|\Delta \gamma|$. Our most stringent constraints suggest that $m_g \lesssim 1.40\times10^{-26}eV/c^2$ at the upper limit of the 90% credible interval and $|\Delta \gamma| \lesssim 7.05 \times 10^{-16}$ at the 90% credible interval. We also compute Bayes factors for models that assume LI and WEP violations compared to the standard GW model, respectively. The absolute value of the natural logarithm of the Bayes factor is generally less than 2. Our analysis reveals no statistically significant preference for either model. Additionally, the Bayes factors between these two models do not provide obvious evidence in favor of either one.


title: Hilbert space valued Gaussian processes, their kernels, factorizations, and covariance structure

abstract: Motivated by applications, we introduce a general and new framework for operator valued positive definite kernels. We further give applications both to operator theory and to stochastic processes. The first one yields several dilation constructions in operator theory, and the second to general classes of stochastic processes. For the latter, we apply our operator valued kernel-results in order to build new Hilbert space-valued Gaussian processes, and to analyze their structures of covariance configurations.


title: Assessing Human Judgment Forecasts in the Rapid Spread of the Mpox Outbreak: Insights and Challenges for Pandemic Preparedness

abstract: In May 2022, mpox (formerly monkeypox) spread to non-endemic countries rapidly. Human judgment is a forecasting approach that has been sparsely evaluated during the beginning of an outbreak. We collected -- between May 19, 2022 and July 31, 2022 -- 1275 forecasts from 442 individuals of six questions about the mpox outbreak where ground truth data are now available. Individual human judgment forecasts and an equally weighted ensemble were evaluated, as well as compared to a random walk, autoregressive, and doubling time model. We found (1) individual human judgment forecasts underestimated outbreak size, (2) the ensemble forecast median moved closer to the ground truth over time but uncertainty around the median did not appreciably decrease, and (3) compared to computational models, for 2-8 week ahead forecasts, the human judgment ensemble outperformed all three models when using median absolute error and weighted interval score; for one week ahead forecasts a random walk outperformed human judgment. We propose two possible explanations: at the time a forecast was submitted, the mode was correlated with the most recent (and smaller) observation that would eventually determine ground truth. Several forecasts were solicited on a logarithmic scale which may have caused humans to generate forecasts with unintended, large uncertainty intervals. To aide in outbreak preparedness, platforms that solicit human judgment forecasts may wish to assess whether specifying a forecast on logarithmic scale matches an individual's intended forecast, support human judgment by finding cues that are typically used to build forecasts, and, to improve performance, tailor their platform to allow forecasters to assign zero probability to events.


title: Pegasus-v1 Technical Report

abstract: This technical report introduces Pegasus-1, a multimodal language model specialized in video content understanding and interaction through natural language. Pegasus-1 is designed to address the unique challenges posed by video data, such as interpreting spatiotemporal information, to offer nuanced video content comprehension across various lengths. This technical report overviews Pegasus-1's architecture, training strategies, and its performance in benchmarks on video conversation, zero-shot video question answering, and video summarization. We also explore qualitative characteristics of Pegasus-1 , demonstrating its capabilities as well as its limitations, in order to provide readers a balanced view of its current state and its future direction.


title: FMint: Bridging Human Designed and Data Pretrained Models for Differential Equation Foundation Model

abstract: In this paper, we propose a pre-trained foundation model \textbf{FMint} (\textbf{F}oundation \textbf{M}odel based on \textbf{In}i\textbf{t}ialization), designed to speed up large-scale simulations of various differential equations with high accuracy via error correction. Human-designed simulation algorithms excel at capturing the fundamental physics of engineering problems, but often need to balance the trade-off between accuracy and efficiency. While deep learning methods offer innovative solutions across numerous scientific fields, they frequently fall short in domain-specific knowledge. FMint bridges these gaps through conditioning on the initial coarse solutions obtained from conventional human-designed algorithms, and trained to obtain refined solutions for various differential equations. Based on the backbone of large language models, we adapt the in-context learning scheme to learn a universal error correction method for dynamical systems from given prompted sequences of coarse solutions. The model is pre-trained on a corpus of 600K ordinary differential equations (ODEs), and we conduct extensive experiments on both in-distribution and out-of-distribution tasks. FMint outperforms various baselines on large-scale simulation, and demonstrates its capability in generalization to unseen ODEs. Our approach achieves an accuracy improvement of 1 to 2 orders of magnitude over state-of-the-art dynamical system simulators, and delivers a 5X speedup compared to traditional numerical algorithms.


title: Interpretable Prediction and Feature Selection for Survival Analysis

abstract: Survival analysis is widely used as a technique to model time-to-event data when some data is censored, particularly in healthcare for predicting future patient risk. In such settings, survival models must be both accurate and interpretable so that users (such as doctors) can trust the model and understand model predictions. While most literature focuses on discrimination, interpretability is equally as important. A successful interpretable model should be able to describe how changing each feature impacts the outcome, and should only use a small number of features. In this paper, we present DyS (pronounced ``dice''), a new survival analysis model that achieves both strong discrimination and interpretability. DyS is a feature-sparse Generalized Additive Model, combining feature selection and interpretable prediction into one model. While DyS works well for all survival analysis problems, it is particularly useful for large (in $n$ and $p$) survival datasets such as those commonly found in observational healthcare studies. Empirical studies show that DyS competes with other state-of-the-art machine learning models for survival analysis, while being highly interpretable.


title: Scalable cyclic transformation of orbital angular momentum modes based on a nonreciprocal Mach-Zehnder interferometer

abstract: The orbital angular momentum (OAM) of photons provides a pivotal resource for carrying out high-dimensional classical and quantum information processing due to its unique discrete high-dimensional nature. The cyclic transformation of a set of orthogonal OAM modes is an essential building block for universal high-dimensional information processing. Its realization in the quantum domain is the universal quantum Pauli-X gate. In this work, we experimentally demonstrate a cyclic transformation of six OAM modes with an averaged efficiency higher than 96% by exploiting a nonreciprocal Mach-Zehnder interferometer. Our system is simple and can, in principle, be scaled to more modes. By improving phase stabilization and inputting quantum photonic states, this method can perform universal single-photon quantum Pauli-X gate, thus paving the way for scalable high-dimensional quantum computation.


title: Towards Fast Setup and High Throughput of GPU Serverless Computing

abstract: Integrating GPUs into serverless computing platforms is crucial for improving efficiency. However, existing solutions for GPU-enabled serverless computing platforms face two significant problems due to coarse-grained GPU management: long setup time and low function throughput. To address these issues, we propose SAGE, a GPU serverless framework with fast setup and high throughput. First, based on the data knowability of GPU function ahead of actual execution, SAGE first devises the parallelized function setup mechanism, which parallelizes the data preparation and context creation. In this way, SAGE achieves fast setup of GPU function invocations.Second, SAGE further proposes the sharing-based memory management mechanism, which shares the read-only memory and context memory across multiple invocations of the same function. The memory sharing mechanism avoids repeated data preparation and then unnecessary data-loading contention. As a consequence, the function throughput could be improved. Our experimental results show that SAGE reduces function duration by 11.3X and improves function density by 1.22X compared to the state-of-the-art serverless platform.


title: Deep Overlapping Community Search via Subspace Embedding

abstract: Community search (CS) aims to identify a set of nodes based on a specified query, leveraging structural cohesiveness and attribute homogeneity. This task enjoys various applications, ranging from fraud detection to recommender systems. In contrast to algorithm-based approaches, graph neural network (GNN) based methods define communities using ground truth labels, leveraging prior knowledge to explore patterns from graph structures and node features. However, existing solutions face three major limitations: 1) GNN-based models primarily focus on the disjoint community structure, disregarding the nature of nodes belonging to multiple communities. 2) These model structures suffer from low-order awareness and severe efficiency issues. 3) The identified community is subject to the free-rider and boundary effects. In this paper, we propose Simplified Multi-hop Attention Networks (SMN), which consist of three designs. First, we introduce a subspace community embedding technique called Sparse Subspace Filter (SSF). SSF enables the projection of community embeddings into distinct vector subspaces, accommodating the nature of overlapping and nesting community structures. In addition, we propose a lightweight model structure and a hop-wise attention mechanism to capture high-order patterns while improving model efficiency. Furthermore, two search algorithms are developed to minimize the latent space's community radius, addressing the challenges of free-rider and boundary effects. To the best of our knowledge, this is the first learning-based study of overlapping community search. Extensive experiments validate the superior performance of SMN compared with the state-of-the-art approaches. SMN achieves 14.73% improvements in F1-Score and up to 3 orders of magnitude acceleration in model efficiency.


title: Double Privacy Guard: Robust Traceable Adversarial Watermarking against Face Recognition

abstract: The wide deployment of Face Recognition (FR) systems poses risks of privacy leakage. One countermeasure to address this issue is adversarial attacks, which deceive malicious FR searches but simultaneously interfere the normal identity verification of trusted authorizers. In this paper, we propose the first Double Privacy Guard (DPG) scheme based on traceable adversarial watermarking. DPG employs a one-time watermark embedding to deceive unauthorized FR models and allows authorizers to perform identity verification by extracting the watermark. Specifically, we propose an information-guided adversarial attack against FR models. The encoder embeds an identity-specific watermark into the deep feature space of the carrier, guiding recognizable features of the image to deviate from the source identity. We further adopt a collaborative meta-optimization strategy compatible with sub-tasks, which regularizes the joint optimization direction of the encoder and decoder. This strategy enhances the representation of universal carrier features, mitigating multi-objective optimization conflicts in watermarking. Experiments confirm that DPG achieves significant attack success rates and traceability accuracy on state-of-the-art FR models, exhibiting remarkable robustness that outperforms the existing privacy protection methods using adversarial attacks and deep watermarking, or simple combinations of the two. Our work potentially opens up new insights into proactive protection for FR privacy.


title: Transformation operators and the Kastler-Kalau-Walze type theorems on 4-dimensional manifolds

abstract: In this paper, we compute the lower-dimensional volume Vol(1,1) about transformation operators for 4- dimensional spin manifolds with boundary and we also get the Kastler-Kalau-Walze type theorem about transformation operators on 4-dimensional compact manifolds with boundary.


title: MisgenderMender: A Community-Informed Approach to Interventions for Misgendering

abstract: Content Warning: This paper contains examples of misgendering and erasure that could be offensive and potentially triggering. Misgendering, the act of incorrectly addressing someone's gender, inflicts serious harm and is pervasive in everyday technologies, yet there is a notable lack of research to combat it. We are the first to address this lack of research into interventions for misgendering by conducting a survey of gender-diverse individuals in the US to understand perspectives about automated interventions for text-based misgendering. Based on survey insights on the prevalence of misgendering, desired solutions, and associated concerns, we introduce a misgendering interventions task and evaluation dataset, MisgenderMender. We define the task with two sub-tasks: (i) detecting misgendering, followed by (ii) correcting misgendering where misgendering is present in domains where editing is appropriate. MisgenderMender comprises 3790 instances of social media content and LLM-generations about non-cisgender public figures, annotated for the presence of misgendering, with additional annotations for correcting misgendering in LLM-generated text. Using this dataset, we set initial benchmarks by evaluating existing NLP systems and highlighting challenges for future models to address. We release the full dataset, code, and demo at https://tamannahossainkay.github.io/misgendermender/.


title: Adaptive Prompt Learning with Negative Textual Semantics and Uncertainty Modeling for Universal Multi-Source Domain Adaptation

abstract: Universal Multi-source Domain Adaptation (UniMDA) transfers knowledge from multiple labeled source domains to an unlabeled target domain under domain shifts (different data distribution) and class shifts (unknown target classes). Existing solutions focus on excavating image features to detect unknown samples, ignoring abundant information contained in textual semantics. In this paper, we propose an Adaptive Prompt learning with Negative textual semantics and uncErtainty modeling method based on Contrastive Language-Image Pre-training (APNE-CLIP) for UniMDA classification tasks. Concretely, we utilize the CLIP with adaptive prompts to leverage textual information of class semantics and domain representations, helping the model identify unknown samples and address domain shifts. Additionally, we design a novel global instance-level alignment objective by utilizing negative textual semantics to achieve more precise image-text pair alignment. Furthermore, we propose an energy-based uncertainty modeling strategy to enlarge the margin distance between known and unknown samples. Extensive experiments demonstrate the superiority of our proposed method.


title: Competing anisotropies in the chiral cubic magnet Co$_8$Zn$_8$Mn$_4$ unveiled by resonant x-ray magnetic scattering

abstract: The cubic $\beta$-Mn-type alloy Co$_8$Zn$_8$Mn$_4$ is a chiral helimagnet that exhibits a peculiar temperature-dependent behavior in the spiral pitch, which decreases from 130 nm at room temperature to 70 nm below 20 K. Notably, this shortening is also accompanied by a structural transition of the metastable skyrmion texture, transforming from a hexagonal lattice to a square lattice of elongated skyrmions. The underlying mechanism of these transformations remain unknown, with interactions potentially involved including temperature-dependent Dzyaloshinskii-Moriya interaction, magnetocrystalline anisotropy, and exchange anisotropy. Here, x-ray resonant magnetic small-angle scattering in vectorial magnetic fields was employed to investigate the temperature dependence of the anisotropic properties of the helical phase in Co$_8$Zn$_8$Mn$_4$. Our results reveal quantitatively that the magnitude of the anisotropic exchange interaction increases by a factor of 4 on cooling from room temperature to 20 K, leading to a 5% variation in the helical pitch within the (001) plane at 20 K. While anisotropic exchange interaction contributes to the shortening of the spiral pitch, its magnitude is insufficient to explain the variation in the spiral periodicity from room to low temperatures. Finally, we demonstrate that magnetocrystalline and exchange anisotropies compete, favoring different orientations of the helical vector in the ground state.


title: Tight contact structures on hyperbolic homology 3-spheres

abstract: We produce a large class of hyperbolic homology 3-spheres admitting arbitrarily many distinct tight contact structures. We also produce a sub-class admitting arbitrarily many distinct tight contact structures within the same homotopy class of oriented plane distributions. As a corollary, we give a recipe to construct hyperbolic L-spaces admitting arbitrarily many distinct tight contact structures. We also introduce a notion of geometric limits of contact structures compatible with geometric limits of hyperbolic manifolds and study the behavior of the tight contact structures we construct under geometric limits.


title: Experimental measurement of mean transition path velocities of colloidal particles surmounting energy barriers

abstract: Transition paths are rare events occurring when a system, thanks to the effect of fluctuations, crosses successfully from one stable state to another by surmounting an energy barrier. Even though they are of great significance in many mesoscale processes, their direct determination is often challenging due to their short duration as compared to other relevant time-scales. Here, we measure the local average velocity along transition paths of a colloidal bead embedded in a glycerol/water mixture that hops over a barrier separating two optical potential wells. Owing to the slow dynamics of the bead in this viscous medium, we can spatially resolve the mean velocity profiles of the transition paths for distinct potentials, which agree with theoretical predictions of a model for the motion of a Brownian particle traversing a parabolic barrier. This allows us to experimentally verify various expressions linking the behavior of such mean velocities with equilibrium and transition path position distributions, mean transition-path times and mean escape times from the wells. We also show that artifacts in the mean velocity profiles arise when reducing the experimental time resolution, thus highlighting the importance of the sampling rate in the characterization of the transition path dynamics. Our results confirm that mean transition path velocity establishes a fundamental relationship between mean transition path times and equilibrium rates in thermally activated processes of small-scaled systems.


title: FlashSpeech: Efficient Zero-Shot Speech Synthesis

abstract: Recent progress in large-scale zero-shot speech synthesis has been significantly advanced by language models and diffusion models. However, the generation process of both methods is slow and computationally intensive. Efficient speech synthesis using a lower computing budget to achieve quality on par with previous work remains a significant challenge. In this paper, we present FlashSpeech, a large-scale zero-shot speech synthesis system with approximately 5\% of the inference time compared with previous work. FlashSpeech is built on the latent consistency model and applies a novel adversarial consistency training approach that can train from scratch without the need for a pre-trained diffusion model as the teacher. Furthermore, a new prosody generator module enhances the diversity of prosody, making the rhythm of the speech sound more natural. The generation processes of FlashSpeech can be achieved efficiently with one or two sampling steps while maintaining high audio quality and high similarity to the audio prompt for zero-shot speech generation. Our experimental results demonstrate the superior performance of FlashSpeech. Notably, FlashSpeech can be about 20 times faster than other zero-shot speech synthesis systems while maintaining comparable performance in terms of voice quality and similarity. Furthermore, FlashSpeech demonstrates its versatility by efficiently performing tasks like voice conversion, speech editing, and diverse speech sampling. Audio samples can be found in https://flashspeech.github.io/.


title: Deep neural networks for choice analysis: Enhancing behavioral regularity with gradient regularization

abstract: Deep neural networks (DNNs) frequently present behaviorally irregular patterns, significantly limiting their practical potentials and theoretical validity in travel behavior modeling. This study proposes strong and weak behavioral regularities as novel metrics to evaluate the monotonicity of individual demand functions (a.k.a. law of demand), and further designs a constrained optimization framework with six gradient regularizers to enhance DNNs' behavioral regularity. The proposed framework is applied to travel survey data from Chicago and London to examine the trade-off between predictive power and behavioral regularity for large vs. small sample scenarios and in-domain vs. out-of-domain generalizations. The results demonstrate that, unlike models with strong behavioral foundations such as the multinomial logit, the benchmark DNNs cannot guarantee behavioral regularity. However, gradient regularization (GR) increases DNNs' behavioral regularity by around 6 percentage points (pp) while retaining their relatively high predictive power. In the small sample scenario, GR is more effective than in the large sample scenario, simultaneously improving behavioral regularity by about 20 pp and log-likelihood by around 1.7%. Comparing with the in-domain generalization of DNNs, GR works more effectively in out-of-domain generalization: it drastically improves the behavioral regularity of poorly performing benchmark DNNs by around 65 pp, indicating the criticality of behavioral regularization for enhancing model transferability and application in forecasting. Moreover, the proposed framework is applicable to other NN-based choice models such as TasteNets. Future studies could use behavioral regularity as a metric along with log-likelihood in evaluating travel demand models, and investigate other methods to further enhance behavioral regularity when adopting complex machine learning models.


title: Singular algebraic curves and infinite symplectic staircases

abstract: We show that the infinite staircases which arise in the ellipsoid embedding functions of rigid del Pezzo surfaces can be entirely explained in terms of rational sesquicuspidal symplectic curves. Moreover, we show that these curves can all be realized algebraically, giving various new families of algebraic curves with one cusp singularity. Our main techniques are (i) a generalized Orevkov twist, and (ii) the interplay between algebraic $\Q$-Gorenstein smoothings and symplectic almost toric fibrations. Along the way we develop various methods for constructing singular algebraic (and hence symplectic) curves which may be of independent interest.


title: Thin-film limit of the Ginzburg-Landau heat flow in a curved thin domain

abstract: We consider the Ginzburg-Landau heat flow without magnetic effect in a curved thin domain under the Naumann boundary condition. When the curved thin domain shrinks to a given closed hypersurface as the thickness of the thin domain tends to zero, we show that the weighted average of a weak solution to the thin-domain problem converges weakly on the limit surface under the assumption that the initial data is of class $L^\infty$ and satisfies some conditions. Moreover, under the same assumption, we derive a limit equation by characterizing the limit function as a weak solution, and prove a difference estimate on the limit surface of an averaged weak solution to the thin-domain problem and a weak solution to the limit problem explicitly in terms of the thickness of the thin domain. We also derive a difference estimate in the curved thin domain of weak solutions to the thin-domain problem and to the limit problem, but without requiring that the initial data of the thin-domain problem is of class $L^\infty$.


title: Unsupervised Domain Adaptation Architecture Search with Self-Training for Land Cover Mapping

abstract: Unsupervised domain adaptation (UDA) is a challenging open problem in land cover mapping. Previous studies show encouraging progress in addressing cross-domain distribution shifts on remote sensing benchmarks for land cover mapping. The existing works are mainly built on large neural network architectures, which makes them resource-hungry systems, limiting their practical impact for many real-world applications in resource-constrained environments. Thus, we proposed a simple yet effective framework to search for lightweight neural networks automatically for land cover mapping tasks under domain shifts. This is achieved by integrating Markov random field neural architecture search (MRF-NAS) into a self-training UDA framework to search for efficient and effective networks under a limited computation budget. This is the first attempt to combine NAS with self-training UDA as a single framework for land cover mapping. We also investigate two different pseudo-labelling approaches (confidence-based and energy-based) in self-training scheme. Experimental results on two recent datasets (OpenEarthMap & FLAIR #1) for remote sensing UDA demonstrate a satisfactory performance. With only less than 2M parameters and 30.16 GFLOPs, the best-discovered lightweight network reaches state-of-the-art performance on the regional target domain of OpenEarthMap (59.38% mIoU) and the considered target domain of FLAIR #1 (51.19% mIoU). The code is at https://github.com/cliffbb/UDA-NAS}{https://github.com/cliffbb/UDA-NAS.


title: Think-Program-reCtify: 3D Situated Reasoning with Large Language Models

abstract: This work addresses the 3D situated reasoning task which aims to answer questions given egocentric observations in a 3D environment. The task remains challenging as it requires comprehensive 3D perception and complex reasoning skills. End-to-end models trained on supervised data for 3D situated reasoning suffer from data scarcity and generalization ability. Inspired by the recent success of leveraging large language models (LLMs) for visual reasoning, we propose LLM-TPC, a novel framework that leverages the planning, tool usage, and reflection capabilities of LLMs through a ThinkProgram-reCtify loop. The Think phase first decomposes the compositional question into a sequence of steps, and then the Program phase grounds each step to a piece of code and calls carefully designed 3D visual perception modules. Finally, the Rectify phase adjusts the plan and code if the program fails to execute. Experiments and analysis on the SQA3D benchmark demonstrate the effectiveness, interpretability and robustness of our method. Our code is publicly available at https://qingrongh.github.io/LLM-TPC/.


title: Channel Estimation for Optical IRS-Assisted VLC System via Spatial Coherence

abstract: Optical intelligent reflecting surface (OIRS) has been considered a promising technology for visible light communication (VLC) by constructing visual line-of-sight propagation paths to address the signal blockage issue. However, the existing works on OIRSs are mostly based on perfect channel state information (CSI), whose acquisition appears to be challenging due to the passive nature of the OIRS. To tackle this challenge, this paper proposes a customized channel estimation algorithm for OIRSs. Specifically, we first unveil the OIRS spatial coherence characteristics and derive the coherence distance in closed form. Based on this property, a spatial sampling-based algorithm is proposed to estimate the OIRS-reflected channel, by dividing the OIRS into multiple subarrays based on the coherence distance and sequentially estimating their associated CSI, followed by an interpolation to retrieve the full CSI. Simulation results validate the derived OIRS spatial coherence and demonstrate the efficacy of the proposed OIRS channel estimation algorithm.


title: A tree formula for the ellipsoidal superpotential of the complex projective plane

abstract: The ellipsoidal superpotential of the complex projective plane can be interpreted as a count of rigid rational plane curves of a given degree with one prescribed cusp singularity. In this note we present a closed formula for these counts as a sum over trees with certain explicit weights. This is a step towards understanding the combinatorial underpinnings of the ellipsoidal superpotential and its mysterious nonvanishing and nondecreasing properties.


title: An Exactly Solvable Dual Bus Route Model

abstract: In 1998, O'Loan et al. introduced a simplified bus route model to illustrate bus dynamics. However, due to fluctuations in passenger numbers, achieving an exact solution for the model's stationary state remains challenging, as these fluctuations can impact the buses' behavior. In this study, we present an exactly solvable model for the dual bus route model whose dynamics expand upon O'Loan et al.'s model. Using this dual model allows us to analyze bus route dynamics comprehensively. However, our model introduces additional parameters not previously considered by O'Loan et al. to account for neighboring effects, which have the potential to influence the average stationary current and velocity of buses. When the neighboring effect is weak, our model behaves similarly to O'Loan et al.'s bus route model. However, in the presence of a strong neighboring effect, our model exhibits intriguing characteristics.


title: SC-HVPPNet: Spatial and Channel Hybrid-Attention Video Post-Processing Network with CNN and Transformer

abstract: Convolutional Neural Network (CNN) and Transformer have attracted much attention recently for video post-processing (VPP). However, the interaction between CNN and Transformer in existing VPP methods is not fully explored, leading to inefficient communication between the local and global extracted features. In this paper, we explore the interaction between CNN and Transformer in the task of VPP, and propose a novel Spatial and Channel Hybrid-Attention Video Post-Processing Network (SC-HVPPNet), which can cooperatively exploit the image priors in both spatial and channel domains. Specifically, in the spatial domain, a novel spatial attention fusion module is designed, in which two attention weights are generated to fuse the local and global representations collaboratively. In the channel domain, a novel channel attention fusion module is developed, which can blend the deep representations at the channel dimension dynamically. Extensive experiments show that SC-HVPPNet notably boosts video restoration quality, with average bitrate savings of 5.29%, 12.42%, and 13.09% for Y, U, and V components in the VTM-11.0-NNVC RA configuration.


title: Challenges of Using Pre-trained Models: the Practitioners' Perspective

abstract: The challenges associated with using pre-trained models (PTMs) have not been specifically investigated, which hampers their effective utilization. To address this knowledge gap, we collected and analyzed a dataset of 5,896 PTM-related questions on Stack Overflow. We first analyze the popularity and difficulty trends of PTM-related questions. We find that PTM-related questions are becoming more and more popular over time. However, it is noteworthy that PTM-related questions not only have a lower response rate but also exhibit a longer response time compared to many well-researched topics in software engineering. This observation emphasizes the significant difficulty and complexity associated with the practical application of PTMs. To delve into the specific challenges, we manually annotate 430 PTM-related questions, categorizing them into a hierarchical taxonomy of 42 codes (i.e., leaf nodes) and three categories. This taxonomy encompasses many PTM prominent challenges such as fine-tuning, output understanding, and prompt customization, which reflects the gaps between current techniques and practical needs. We discuss the implications of our study for PTM practitioners, vendors, and educators, and suggest possible directions and solutions for future research.


title: Monte Carlo Studies on Geometrically Confined Skyrmions in Nanodots: Stability and Morphology under Radial Stresses

abstract: We numerically study the stability and morphology of geometrically confined skyrmions in nanodots using Finsler geometry (FG) modeling technique. The FG model dynamically implements anisotropies in ferromagnetic interaction, Dzyaloshinskii-Moriya interaction, and magneto-elastic coupling in response to mechanical stresses. Without the stresses, there exists a geometrically confined effect originating from the surface effect of small nanodots, in which skyrmions are stabilized under a low external magnetic field. This surface effect is enhanced by radial stresses, which significantly reduce the surface DMI compared to the bulk DMI. The radial stresses also alter the interactions to be anisotropic. Owing to these position- and direction-dependent interactions, incomplete skyrmions emerge at the center of the nanodots under the tensile stress. In addition to the incomplete skyrmions, target skyrmions are observed under the compressive stress. Our numerical results indicate that the strain-enhanced surface effect and the strain-induced interaction anisotropies suitably explain the skyrmion stability in nanodots with zero magnetic field.


title: ORBIT: Oak Ridge Base Foundation Model for Earth System Predictability

abstract: Earth system predictability is challenged by the complexity of environmental dynamics and the multitude of variables involved. Current AI foundation models, although advanced by leveraging large and heterogeneous data, are often constrained by their size and data integration, limiting their effectiveness in addressing the full range of Earth system prediction challenges. To overcome these limitations, we introduce the Oak Ridge Base Foundation Model for Earth System Predictability (ORBIT), an advanced vision-transformer model that scales up to 113 billion parameters using a novel hybrid tensor-data orthogonal parallelism technique. As the largest model of its kind, ORBIT surpasses the current climate AI foundation model size by a thousandfold. Performance scaling tests conducted on the Frontier supercomputer have demonstrated that ORBIT achieves 230 to 707 PFLOPS, with scaling efficiency maintained at 78% to 96% across 24,576 AMD GPUs. These breakthroughs establish new advances in AI-driven climate modeling and demonstrate promise to significantly improve the Earth system predictability.

categories: physics.ao-ph cs.AI cs.DC eess.IV physics.geo-ph


title: Enhancing High-Speed Cruising Performance of Autonomous Vehicles through Integrated Deep Reinforcement Learning Framework

abstract: High-speed cruising scenarios with mixed traffic greatly challenge the road safety of autonomous vehicles (AVs). Unlike existing works that only look at fundamental modules in isolation, this work enhances AV safety in mixed-traffic high-speed cruising scenarios by proposing an integrated framework that synthesizes three fundamental modules, i.e., behavioral decision-making, path-planning, and motion-control modules. Considering that the integrated framework would increase the system complexity, a bootstrapped deep Q-Network (DQN) is employed to enhance the deep exploration of the reinforcement learning method and achieve adaptive decision making of AVs. Moreover, to make AV behavior understandable by surrounding HDVs to prevent unexpected operations caused by misinterpretations, we derive an inverse reinforcement learning (IRL) approach to learn the reward function of skilled drivers for the path planning of lane-changing maneuvers. Such a design enables AVs to achieve a human-like tradeoff between multi-performance requirements. Simulations demonstrate that the proposed integrated framework can guide AVs to take safe actions while guaranteeing high-speed cruising performance.


title: Spectropolarimetric Radio Imaging of Faint Gyrosynchrotron Emission from a CME : A Possible Indication of the Insufficiency of Homogeneous Models

abstract: The geo-effectiveness of coronal mass ejections (CMEs) is determined primarily by their magnetic fields. Modeling of Gyrosynchrotron (GS) emission is a promising remote sensing technique to measure the CME magnetic field at coronal heights. However, faint GS emission from CME flux ropes is hard to detect in the presence of bright solar emission from the solar corona. With high dynamic-range spectropolarimetric meter wavelength solar images provided by the Murchison Widefield Array, we have detected faint GS emission from a CME out to $\sim 8.3\ R_\odot$, the largest heliocentric distance reported to date. High-fidelity polarimetric calibration also allowed us to robustly detect circularly polarized emission from GS emission. For the first time in literature, Stokes V detection has jointly been used with Stokes I spectra to constrain GS models. One expects that the inclusion of polarimetric measurement will provide tighter constraints on GS model parameters. Instead, we found that homogeneous GS models, which have been used in all prior works, are unable to model both the total intensity and circular polarized emission simultaneously. This strongly suggests the need for using inhomogeneous GS models to robustly estimate the CME magnetic field and plasma parameters.


title: FINEMATCH: Aspect-based Fine-grained Image and Text Mismatch Detection and Correction

abstract: Recent progress in large-scale pre-training has led to the development of advanced vision-language models (VLMs) with remarkable proficiency in comprehending and generating multimodal content. Despite the impressive ability to perform complex reasoning for VLMs, current models often struggle to effectively and precisely capture the compositional information on both the image and text sides. To address this, we propose FineMatch, a new aspect-based fine-grained text and image matching benchmark, focusing on text and image mismatch detection and correction. This benchmark introduces a novel task for boosting and evaluating the VLMs' compositionality for aspect-based fine-grained text and image matching. In this task, models are required to identify mismatched aspect phrases within a caption, determine the aspect's class, and propose corrections for an image-text pair that may contain between 0 and 3 mismatches. To evaluate the models' performance on this new task, we propose a new evaluation metric named ITM-IoU for which our experiments show a high correlation to human evaluation. In addition, we also provide a comprehensive experimental analysis of existing mainstream VLMs, including fully supervised learning and in-context learning settings. We have found that models trained on FineMatch demonstrate enhanced proficiency in detecting fine-grained text and image mismatches. Moreover, models (e.g., GPT-4V, Gemini Pro Vision) with strong abilities to perform multimodal in-context learning are not as skilled at fine-grained compositional image and text matching analysis. With FineMatch, we are able to build a system for text-to-image generation hallucination detection and correction.


title: Bayesian Example Selection Improves In-Context Learning for Speech, Text, and Visual Modalities

abstract: Large language models (LLMs) can adapt to new tasks through in-context learning (ICL) based on a few examples presented in dialogue history without any model parameter update. Despite such convenience, the performance of ICL heavily depends on the quality of the in-context examples presented, which makes the in-context example selection approach a critical choice. This paper proposes a novel Bayesian in-Context example Selection method (ByCS) for ICL. Extending the inference probability conditioned on in-context examples based on Bayes' theorem, ByCS focuses on the inverse inference conditioned on test input. Following the assumption that accurate inverse inference probability (likelihood) will result in accurate inference probability (posterior), in-context examples are selected based on their inverse inference results. Diverse and extensive cross-tasking and cross-modality experiments are performed with speech, text, and image examples. Experimental results show the efficacy and robustness of our ByCS method on various models, tasks and modalities.


title: Optimisation of electron irradiation for creating spin ensembles in hexagonal boron nitride

abstract: Boron vacancy centre ($V_{\rm B}^-$) ensembles in hexagonal boron nitride (hBN) have attracted recent interest for their potential as two-dimensional solid-state quantum sensors. Irradiation is necessary for $V_{\rm B}^-$ creation, however, to date only limited attention has been given to optimising the defect production process, especially in the case of bulk irradiation with high-energy particles, which offers scalability through the potential for creating ensembles in large volumes of material. Here we systematically investigate the effect of electron irradiation by varying the dose delivered to a range of hBN samples, which differ in their purity, and search for an optimum in measurement sensitivity. We find that moderate electron irradiation doses ($\approx 5\times 10^{18}$~cm$^{-2}$) appear to offer the best sensitivity, and also observe a dependence on the initial crystal purity. These results pave the way for the scalable and cost-effective production of hBN quantum sensors, and provide insight into the mechanisms limiting $V_{\rm B}^-$ spin properties.


title: Variation in Path Lengths of Turbulent Magnetic Field Lines and Solar Energetic Particles

abstract: Modeling of time profiles of solar energetic particle (SEP) observations often considers transport along a large-scale magnetic field with a fixed path length from the source to the observer. Here we point out that variability in the turbulent field line path length can affect the fits to SEP data and the inferred mean free path and injection profile. To explore such variability, we perform Monte Carlo simulations in representations of homogeneous 2D MHD + slab turbulence adapted to spherical geometry and trace trajectories of field lines and full particle orbits, considering proton injection from a narrow or wide angular region near the Sun, corresponding to an impulsive or gradual solar event, respectively. We analyze our simulation results in terms of field line and particle path length statistics for $1^\circ\times 1^\circ$ pixels in heliolatitude and heliolongitude at 0.35 and 1 AU from the Sun, for different values of the turbulence amplitude $b/B_0$ and turbulence geometry as expressed by the slab fraction $f_s$. Maps of the most probable path lengths of field lines and particles at each pixel exhibit systematic patterns that reflect the fluctuation amplitudes experienced by the field lines, which in turn relate to the local topology of 2D turbulence. We describe the effects of such path length variations on SEP time profiles, both in terms of path length variability at specific locations and motion of the observer with respect to turbulence topology during the course of the observations.